2026-02-13T02:12:01.158 INFO:root:teuthology version: 1.2.4.dev9+ga2c505dae 2026-02-13T02:12:01.178 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-13T02:12:01.262 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47968 branch: wip-pdonnell-testing-20260210.171210 description: fs/workload/{0-distro begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rpm_latest} ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/always} standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-namespace-isolated} 0-use-snaprealm/{global} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-quiesce/no 6-workunit/postgres}} email: pdonnell@redhat.com first_in_suite: false flavor: default job_id: '47968' kernel: client: sha1: distro sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: trial name: pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rocky os_version: '10.1' overrides: admin_socket: branch: wip-pdonnell-testing-20260210.171210 ceph: cephfs: ec_profile: - disabled max_mds: 5 session_timeout: 300 standby_replay: true cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon warn on pool no app: false mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: client: client_fscrypt_dummy_encryption: true global: ms die on skipped message: false mds: mds_bal_replicate_threshold: 1 mds_export_ephemeral_random_max: 0.2 mgr: cephsqlite lock renewal timeout: 900000 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - is offline because no MDS - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - BLUESTORE_SLOW_OP_ALERT - slow operation indications in BlueStore - experiencing slow operations in BlueStore - MGR_MODULE_ERROR - OSD_DOWN - osd.* is down - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - osds down - osd.* is down - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - pg .* is stuck inactive - pg .* is .*degraded - slow metadata IO - SLOW_OPS - slow request sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f subvols: create: 2 subvol_options: --namespace-isolated ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mntopts: - context=system_u:object_r:postgresql_db_t:s0 mount_subvol_num: 0 mountpoint: /tmp/cephfs check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt install: ceph: flavor: default sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f kclient: client.0: mntopts: - context=system_u:object_r:postgresql_db_t:s0 mount_subvol_num: 1 mountpoint: /tmp/cephfs mntopts: - ms_mode=legacy - wsync syntax: v2 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 - comm="systemd".*denied.*\{ prog_run \}.*tclass=bpf.*permissive=1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20260210.171210 sha1: cfcf307502511ba51c39a8b9085c2fcde505d421 owner: scheduled_pdonnell@soko04.front.sepia.ceph.com priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 7166 sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f sleep_before_teardown: 0 subset: 604/1024 suite: fs suite_branch: wip-pdonnell-testing-20260210.171210 suite_path: /home/teuthworker/src/github.com_batrick_ceph_cfcf307502511ba51c39a8b9085c2fcde505d421/qa suite_relpath: qa suite_repo: https://github.com/batrick/ceph suite_sha1: cfcf307502511ba51c39a8b9085c2fcde505d421 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: trial011.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM5MPQOnyTGpUQ+QhpfEcesLMOhs4Pr4l86h63Ky42UBawlgscmb8m+oJngK4B6AvJdLDTHjqKQ6MPy/JQZbrKg= trial060.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC0AUL4wJGr98bimSWLOZ8DTfEZnWj267DTM9v/frcPBL9OF5fLraJUiBGSIkf3FlvwdWAFyYzDoe5IXpYxhNj8= trial078.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGKLR5AyYCIXQvN6zcLzNtIdmZ8kNWMZM8AIUBQGoRCoAFF48LQMgHNvvwXqTwDWfvq8OOMXRlE8wudG4D+DTUA= tasks: - pexec: all: - sudo dnf remove nvme-cli -y - sudo dnf install nvmetcli nvme-cli -y - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: distro-suffix: rockylinux-10 roleless: false skip_dashboard: true - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - kclient: null - pexec: all: - sudo dnf remove nvme-cli -y - sudo dnf install nvmetcli nvme-cli -y - exec: mon.a: - ceph fs set cephfs balance_automate false - ceph fs subvolumegroup pin cephfs qa random 0.20 - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - exec: client.0: - sudo ls -l /tmp/cephfs/ && sudo df -h /tmp/cephfs/ - sudo mkdir -m 755 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres && sudo chown postgres:postgres /tmp/cephfs/postgres - sudo -u postgres -- mkdir -m 700 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres/data - sudo semanage fcontext -a -t postgresql_db_t "/tmp/cephfs/postgres(/.*)?" - sudo grep -i postgresql /etc/selinux/targeted/contexts/files/file_contexts.local - sudo restorecon -R -v /tmp/cephfs/postgres - sudo ls -lZaR /tmp/cephfs/postgres/ - sudo mkdir -p /etc/systemd/system/postgresql.service.d/ && printf '[Service]\nEnvironment=PGDATA=/tmp/cephfs/postgres/data\nEnvironment=PGLOG=/tmp/cephfs/postgres/pgstartup.log\n' | sudo tee /etc/systemd/system/postgresql.service.d/env.conf - sudo -u postgres -- postgresql-setup --initdb - sudo ls -lZaR /tmp/cephfs/postgres/ - sudo systemctl start postgresql - sudo -u postgres -- pgbench -s 32 -i - sudo -u postgres -- pgbench -c 100 -j 4 --progress=5 --time=900 - sudo systemctl stop postgresql - sudo ls -lZaR /tmp/cephfs/postgres/ teuthology: fragments_dropped: [] meta: {} postmerge: - "local kernel = py_attrgetter(yaml).get('kernel')\nif kernel ~= nil then\n local\ \ branch = py_attrgetter(kernel).get('branch')\n if branch and not kernel.branch:find\ \ \"-all$\" then\n log.debug(\"removing default kernel specification: %s\"\ , kernel)\n py_attrgetter(kernel).pop('branch', nil)\n py_attrgetter(kernel).pop('deb',\ \ nil)\n py_attrgetter(kernel).pop('flavor', nil)\n py_attrgetter(kernel).pop('kdb',\ \ nil)\n py_attrgetter(kernel).pop('koji', nil)\n py_attrgetter(kernel).pop('koji_task',\ \ nil)\n py_attrgetter(kernel).pop('rpm', nil)\n py_attrgetter(kernel).pop('sha1',\ \ nil)\n py_attrgetter(kernel).pop('tag', nil)\n end\nend\n" - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: kernel-fix-3 teuthology_sha1: a2c505dae37458c5537fa44f1320bd04eef25bb1 timestamp: 2026-02-13_01:53:26 tube: trial user: pdonnell verbose: false worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3932482 2026-02-13T02:12:01.262 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_batrick_ceph_cfcf307502511ba51c39a8b9085c2fcde505d421/qa; will attempt to use it 2026-02-13T02:12:01.262 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_batrick_ceph_cfcf307502511ba51c39a8b9085c2fcde505d421/qa/tasks 2026-02-13T02:12:01.262 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-13T02:12:01.264 INFO:teuthology.task.internal:Checking packages... 2026-02-13T02:12:01.264 INFO:teuthology.task.internal:Checking packages for os_type 'rocky', flavor 'default' and ceph hash '8f8d38294e4db8750b4b1649f62ce37caa63080f' 2026-02-13T02:12:01.264 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-13T02:12:01.264 INFO:teuthology.packaging:ref: None 2026-02-13T02:12:01.264 INFO:teuthology.packaging:tag: None 2026-02-13T02:12:01.264 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20260210.171210 2026-02-13T02:12:01.264 INFO:teuthology.packaging:sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-13T02:12:01.264 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=rocky%2F10%2Fx86_64&ref=wip-pdonnell-testing-20260210.171210 2026-02-13T02:12:01.378 INFO:teuthology.task.internal:Found packages for ceph version 20.3.0-5241.g8f8d3829 2026-02-13T02:12:01.379 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-13T02:12:01.391 INFO:teuthology.task.internal:no buildpackages task found 2026-02-13T02:12:01.391 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-13T02:12:01.405 INFO:teuthology.task.internal:Saving configuration 2026-02-13T02:12:01.426 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-13T02:12:01.439 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-13T02:12:01.509 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial011.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47968', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'rocky', 'os_version': '10.1', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-13 02:08:22.684697', 'locked_by': 'scheduled_pdonnell@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM5MPQOnyTGpUQ+QhpfEcesLMOhs4Pr4l86h63Ky42UBawlgscmb8m+oJngK4B6AvJdLDTHjqKQ6MPy/JQZbrKg='} 2026-02-13T02:12:01.566 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial060.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47968', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'rocky', 'os_version': '10.1', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-13 02:08:22.684044', 'locked_by': 'scheduled_pdonnell@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC0AUL4wJGr98bimSWLOZ8DTfEZnWj267DTM9v/frcPBL9OF5fLraJUiBGSIkf3FlvwdWAFyYzDoe5IXpYxhNj8='} 2026-02-13T02:12:01.620 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial078.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47968', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'rocky', 'os_version': '10.1', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-13 02:08:22.685077', 'locked_by': 'scheduled_pdonnell@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGKLR5AyYCIXQvN6zcLzNtIdmZ8kNWMZM8AIUBQGoRCoAFF48LQMgHNvvwXqTwDWfvq8OOMXRlE8wudG4D+DTUA='} 2026-02-13T02:12:01.621 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-13T02:12:01.632 INFO:teuthology.task.internal:roles: ubuntu@trial011.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2026-02-13T02:12:01.632 INFO:teuthology.task.internal:roles: ubuntu@trial060.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2026-02-13T02:12:01.632 INFO:teuthology.task.internal:roles: ubuntu@trial078.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2026-02-13T02:12:01.633 INFO:teuthology.run_tasks:Running task console_log... 2026-02-13T02:12:01.843 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x74d42b5ec040>, signals=[15]) 2026-02-13T02:12:01.843 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-13T02:12:01.853 INFO:teuthology.task.internal:Opening connections... 2026-02-13T02:12:01.853 DEBUG:teuthology.task.internal:connecting to ubuntu@trial011.front.sepia.ceph.com 2026-02-13T02:12:01.854 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial011.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T02:12:01.917 DEBUG:teuthology.task.internal:connecting to ubuntu@trial060.front.sepia.ceph.com 2026-02-13T02:12:01.918 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T02:12:01.977 DEBUG:teuthology.task.internal:connecting to ubuntu@trial078.front.sepia.ceph.com 2026-02-13T02:12:01.978 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T02:12:02.039 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-13T02:12:02.051 DEBUG:teuthology.orchestra.run.trial011:> uname -m 2026-02-13T02:12:02.068 INFO:teuthology.orchestra.run.trial011.stdout:x86_64 2026-02-13T02:12:02.069 DEBUG:teuthology.orchestra.run.trial011:> cat /etc/os-release 2026-02-13T02:12:02.126 INFO:teuthology.orchestra.run.trial011.stdout:NAME="Rocky Linux" 2026-02-13T02:12:02.126 INFO:teuthology.orchestra.run.trial011.stdout:VERSION="10.1 (Red Quartz)" 2026-02-13T02:12:02.126 INFO:teuthology.orchestra.run.trial011.stdout:ID="rocky" 2026-02-13T02:12:02.126 INFO:teuthology.orchestra.run.trial011.stdout:ID_LIKE="rhel centos fedora" 2026-02-13T02:12:02.126 INFO:teuthology.orchestra.run.trial011.stdout:VERSION_ID="10.1" 2026-02-13T02:12:02.126 INFO:teuthology.orchestra.run.trial011.stdout:PLATFORM_ID="platform:el10" 2026-02-13T02:12:02.126 INFO:teuthology.orchestra.run.trial011.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-13T02:12:02.127 INFO:teuthology.orchestra.run.trial011.stdout:ANSI_COLOR="0;32" 2026-02-13T02:12:02.127 INFO:teuthology.orchestra.run.trial011.stdout:LOGO="fedora-logo-icon" 2026-02-13T02:12:02.127 INFO:teuthology.orchestra.run.trial011.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-13T02:12:02.127 INFO:teuthology.orchestra.run.trial011.stdout:HOME_URL="https://rockylinux.org/" 2026-02-13T02:12:02.127 INFO:teuthology.orchestra.run.trial011.stdout:VENDOR_NAME="RESF" 2026-02-13T02:12:02.127 INFO:teuthology.orchestra.run.trial011.stdout:VENDOR_URL="https://resf.org/" 2026-02-13T02:12:02.127 INFO:teuthology.orchestra.run.trial011.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-13T02:12:02.127 INFO:teuthology.orchestra.run.trial011.stdout:SUPPORT_END="2035-05-31" 2026-02-13T02:12:02.127 INFO:teuthology.orchestra.run.trial011.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-13T02:12:02.127 INFO:teuthology.orchestra.run.trial011.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-13T02:12:02.127 INFO:teuthology.orchestra.run.trial011.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-13T02:12:02.127 INFO:teuthology.orchestra.run.trial011.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-13T02:12:02.128 INFO:teuthology.lock.ops:Updating trial011.front.sepia.ceph.com on lock server 2026-02-13T02:12:02.203 DEBUG:teuthology.orchestra.run.trial060:> uname -m 2026-02-13T02:12:02.219 INFO:teuthology.orchestra.run.trial060.stdout:x86_64 2026-02-13T02:12:02.220 DEBUG:teuthology.orchestra.run.trial060:> cat /etc/os-release 2026-02-13T02:12:02.277 INFO:teuthology.orchestra.run.trial060.stdout:NAME="Rocky Linux" 2026-02-13T02:12:02.277 INFO:teuthology.orchestra.run.trial060.stdout:VERSION="10.1 (Red Quartz)" 2026-02-13T02:12:02.277 INFO:teuthology.orchestra.run.trial060.stdout:ID="rocky" 2026-02-13T02:12:02.277 INFO:teuthology.orchestra.run.trial060.stdout:ID_LIKE="rhel centos fedora" 2026-02-13T02:12:02.277 INFO:teuthology.orchestra.run.trial060.stdout:VERSION_ID="10.1" 2026-02-13T02:12:02.277 INFO:teuthology.orchestra.run.trial060.stdout:PLATFORM_ID="platform:el10" 2026-02-13T02:12:02.277 INFO:teuthology.orchestra.run.trial060.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-13T02:12:02.277 INFO:teuthology.orchestra.run.trial060.stdout:ANSI_COLOR="0;32" 2026-02-13T02:12:02.277 INFO:teuthology.orchestra.run.trial060.stdout:LOGO="fedora-logo-icon" 2026-02-13T02:12:02.277 INFO:teuthology.orchestra.run.trial060.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-13T02:12:02.277 INFO:teuthology.orchestra.run.trial060.stdout:HOME_URL="https://rockylinux.org/" 2026-02-13T02:12:02.277 INFO:teuthology.orchestra.run.trial060.stdout:VENDOR_NAME="RESF" 2026-02-13T02:12:02.277 INFO:teuthology.orchestra.run.trial060.stdout:VENDOR_URL="https://resf.org/" 2026-02-13T02:12:02.278 INFO:teuthology.orchestra.run.trial060.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-13T02:12:02.278 INFO:teuthology.orchestra.run.trial060.stdout:SUPPORT_END="2035-05-31" 2026-02-13T02:12:02.278 INFO:teuthology.orchestra.run.trial060.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-13T02:12:02.278 INFO:teuthology.orchestra.run.trial060.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-13T02:12:02.278 INFO:teuthology.orchestra.run.trial060.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-13T02:12:02.278 INFO:teuthology.orchestra.run.trial060.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-13T02:12:02.278 INFO:teuthology.lock.ops:Updating trial060.front.sepia.ceph.com on lock server 2026-02-13T02:12:02.354 DEBUG:teuthology.orchestra.run.trial078:> uname -m 2026-02-13T02:12:02.371 INFO:teuthology.orchestra.run.trial078.stdout:x86_64 2026-02-13T02:12:02.371 DEBUG:teuthology.orchestra.run.trial078:> cat /etc/os-release 2026-02-13T02:12:02.428 INFO:teuthology.orchestra.run.trial078.stdout:NAME="Rocky Linux" 2026-02-13T02:12:02.428 INFO:teuthology.orchestra.run.trial078.stdout:VERSION="10.1 (Red Quartz)" 2026-02-13T02:12:02.428 INFO:teuthology.orchestra.run.trial078.stdout:ID="rocky" 2026-02-13T02:12:02.428 INFO:teuthology.orchestra.run.trial078.stdout:ID_LIKE="rhel centos fedora" 2026-02-13T02:12:02.428 INFO:teuthology.orchestra.run.trial078.stdout:VERSION_ID="10.1" 2026-02-13T02:12:02.428 INFO:teuthology.orchestra.run.trial078.stdout:PLATFORM_ID="platform:el10" 2026-02-13T02:12:02.429 INFO:teuthology.orchestra.run.trial078.stdout:PRETTY_NAME="Rocky Linux 10.1 (Red Quartz)" 2026-02-13T02:12:02.429 INFO:teuthology.orchestra.run.trial078.stdout:ANSI_COLOR="0;32" 2026-02-13T02:12:02.429 INFO:teuthology.orchestra.run.trial078.stdout:LOGO="fedora-logo-icon" 2026-02-13T02:12:02.429 INFO:teuthology.orchestra.run.trial078.stdout:CPE_NAME="cpe:/o:rocky:rocky:10::baseos" 2026-02-13T02:12:02.429 INFO:teuthology.orchestra.run.trial078.stdout:HOME_URL="https://rockylinux.org/" 2026-02-13T02:12:02.429 INFO:teuthology.orchestra.run.trial078.stdout:VENDOR_NAME="RESF" 2026-02-13T02:12:02.429 INFO:teuthology.orchestra.run.trial078.stdout:VENDOR_URL="https://resf.org/" 2026-02-13T02:12:02.429 INFO:teuthology.orchestra.run.trial078.stdout:BUG_REPORT_URL="https://bugs.rockylinux.org/" 2026-02-13T02:12:02.429 INFO:teuthology.orchestra.run.trial078.stdout:SUPPORT_END="2035-05-31" 2026-02-13T02:12:02.429 INFO:teuthology.orchestra.run.trial078.stdout:ROCKY_SUPPORT_PRODUCT="Rocky-Linux-10" 2026-02-13T02:12:02.429 INFO:teuthology.orchestra.run.trial078.stdout:ROCKY_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-13T02:12:02.429 INFO:teuthology.orchestra.run.trial078.stdout:REDHAT_SUPPORT_PRODUCT="Rocky Linux" 2026-02-13T02:12:02.429 INFO:teuthology.orchestra.run.trial078.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="10.1" 2026-02-13T02:12:02.429 INFO:teuthology.lock.ops:Updating trial078.front.sepia.ceph.com on lock server 2026-02-13T02:12:02.513 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-13T02:12:02.527 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-13T02:12:02.539 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-13T02:12:02.540 DEBUG:teuthology.orchestra.run.trial011:> test '!' -e /home/ubuntu/cephtest 2026-02-13T02:12:02.541 DEBUG:teuthology.orchestra.run.trial060:> test '!' -e /home/ubuntu/cephtest 2026-02-13T02:12:02.543 DEBUG:teuthology.orchestra.run.trial078:> test '!' -e /home/ubuntu/cephtest 2026-02-13T02:12:02.560 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-13T02:12:02.571 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-13T02:12:02.571 DEBUG:teuthology.orchestra.run.trial011:> test -z $(ls -A /var/lib/ceph) 2026-02-13T02:12:02.600 DEBUG:teuthology.orchestra.run.trial060:> test -z $(ls -A /var/lib/ceph) 2026-02-13T02:12:02.602 DEBUG:teuthology.orchestra.run.trial078:> test -z $(ls -A /var/lib/ceph) 2026-02-13T02:12:02.614 INFO:teuthology.orchestra.run.trial011.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2026-02-13T02:12:02.617 INFO:teuthology.orchestra.run.trial060.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2026-02-13T02:12:02.619 INFO:teuthology.orchestra.run.trial078.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2026-02-13T02:12:02.620 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-13T02:12:02.840 INFO:teuthology.run_tasks:Running task kernel... 2026-02-13T02:12:02.858 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'sha1': 'distro'} 2026-02-13T02:12:02.858 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2026-02-13T02:12:02.858 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2026-02-13T02:12:02.859 DEBUG:teuthology.orchestra.run.trial011:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-13T02:12:02.876 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T02:12:02.877 DEBUG:teuthology.orchestra.run.trial011:> uname -r 2026-02-13T02:12:02.933 INFO:teuthology.orchestra.run.trial011.stdout:6.12.0-124.27.1.el10_1.x86_64 2026-02-13T02:12:02.934 INFO:teuthology.task.kernel:Running kernel on trial011: 6.12.0-124.27.1.el10_1.x86_64 2026-02-13T02:12:02.934 DEBUG:teuthology.orchestra.run.trial011:> sudo yum install -y kernel 2026-02-13T02:12:03.440 INFO:teuthology.orchestra.run.trial011.stdout:Rocky Linux 10 - AppStream 22 MB/s | 2.2 MB 00:00 2026-02-13T02:12:03.758 INFO:teuthology.orchestra.run.trial011.stdout:Rocky Linux 10 - BaseOS 57 MB/s | 11 MB 00:00 2026-02-13T02:12:04.245 INFO:teuthology.orchestra.run.trial011.stdout:Rocky Linux 10 - CRB 6.6 MB/s | 507 kB 00:00 2026-02-13T02:12:05.552 INFO:teuthology.orchestra.run.trial011.stdout:Extra Packages for Enterprise Linux 4.9 MB/s | 6.2 MB 00:01 2026-02-13T02:12:06.223 INFO:teuthology.orchestra.run.trial011.stdout:lab-extras 163 kB/s | 3.7 kB 00:00 2026-02-13T02:12:06.636 INFO:teuthology.orchestra.run.trial011.stdout:Package kernel-6.12.0-124.27.1.el10_1.x86_64 is already installed. 2026-02-13T02:12:06.647 INFO:teuthology.orchestra.run.trial011.stdout:Dependencies resolved. 2026-02-13T02:12:06.649 INFO:teuthology.orchestra.run.trial011.stdout:================================================================================ 2026-02-13T02:12:06.649 INFO:teuthology.orchestra.run.trial011.stdout: Package Arch Version Repo Size 2026-02-13T02:12:06.649 INFO:teuthology.orchestra.run.trial011.stdout:================================================================================ 2026-02-13T02:12:06.649 INFO:teuthology.orchestra.run.trial011.stdout:Installing: 2026-02-13T02:12:06.649 INFO:teuthology.orchestra.run.trial011.stdout: kernel x86_64 6.12.0-124.31.1.el10_1 baseos 1.4 M 2026-02-13T02:12:06.649 INFO:teuthology.orchestra.run.trial011.stdout:Installing dependencies: 2026-02-13T02:12:06.649 INFO:teuthology.orchestra.run.trial011.stdout: kernel-core x86_64 6.12.0-124.31.1.el10_1 baseos 18 M 2026-02-13T02:12:06.649 INFO:teuthology.orchestra.run.trial011.stdout: kernel-modules x86_64 6.12.0-124.31.1.el10_1 baseos 41 M 2026-02-13T02:12:06.649 INFO:teuthology.orchestra.run.trial011.stdout: kernel-modules-core x86_64 6.12.0-124.31.1.el10_1 baseos 30 M 2026-02-13T02:12:06.649 INFO:teuthology.orchestra.run.trial011.stdout: kernel-modules-extra x86_64 6.12.0-124.31.1.el10_1 baseos 2.8 M 2026-02-13T02:12:06.650 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:12:06.650 INFO:teuthology.orchestra.run.trial011.stdout:Transaction Summary 2026-02-13T02:12:06.650 INFO:teuthology.orchestra.run.trial011.stdout:================================================================================ 2026-02-13T02:12:06.650 INFO:teuthology.orchestra.run.trial011.stdout:Install 5 Packages 2026-02-13T02:12:06.650 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:12:06.650 INFO:teuthology.orchestra.run.trial011.stdout:Total download size: 93 M 2026-02-13T02:12:06.650 INFO:teuthology.orchestra.run.trial011.stdout:Installed size: 135 M 2026-02-13T02:12:06.650 INFO:teuthology.orchestra.run.trial011.stdout:Downloading Packages: 2026-02-13T02:12:06.705 INFO:teuthology.orchestra.run.trial011.stdout:(1/5): kernel-6.12.0-124.31.1.el10_1.x86_64.rpm 25 MB/s | 1.4 MB 00:00 2026-02-13T02:12:06.893 INFO:teuthology.orchestra.run.trial011.stdout:(2/5): kernel-core-6.12.0-124.31.1.el10_1.x86_6 75 MB/s | 18 MB 00:00 2026-02-13T02:12:06.945 INFO:teuthology.orchestra.run.trial011.stdout:(3/5): kernel-modules-extra-6.12.0-124.31.1.el1 54 MB/s | 2.8 MB 00:00 2026-02-13T02:12:07.108 INFO:teuthology.orchestra.run.trial011.stdout:(4/5): kernel-modules-core-6.12.0-124.31.1.el10 73 MB/s | 30 MB 00:00 2026-02-13T02:12:07.325 INFO:teuthology.orchestra.run.trial011.stdout:(5/5): kernel-modules-6.12.0-124.31.1.el10_1.x8 60 MB/s | 41 MB 00:00 2026-02-13T02:12:07.326 INFO:teuthology.orchestra.run.trial011.stdout:-------------------------------------------------------------------------------- 2026-02-13T02:12:07.326 INFO:teuthology.orchestra.run.trial011.stdout:Total 137 MB/s | 93 MB 00:00 2026-02-13T02:12:07.326 INFO:teuthology.orchestra.run.trial011.stdout:Running transaction check 2026-02-13T02:12:07.472 INFO:teuthology.orchestra.run.trial011.stdout:Transaction check succeeded. 2026-02-13T02:12:07.473 INFO:teuthology.orchestra.run.trial011.stdout:Running transaction test 2026-02-13T02:12:07.875 INFO:teuthology.orchestra.run.trial011.stdout:Transaction test succeeded. 2026-02-13T02:12:07.876 INFO:teuthology.orchestra.run.trial011.stdout:Running transaction 2026-02-13T02:12:08.572 INFO:teuthology.orchestra.run.trial011.stdout: Preparing : 1/1 2026-02-13T02:12:08.774 INFO:teuthology.orchestra.run.trial011.stdout: Installing : kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 1/5 2026-02-13T02:12:08.795 INFO:teuthology.orchestra.run.trial011.stdout: Installing : kernel-core-6.12.0-124.31.1.el10_1.x86_64 2/5 2026-02-13T02:12:10.047 INFO:teuthology.orchestra.run.trial011.stdout: Running scriptlet: kernel-core-6.12.0-124.31.1.el10_1.x86_64 2/5 2026-02-13T02:12:10.075 INFO:teuthology.orchestra.run.trial011.stdout: Installing : kernel-modules-6.12.0-124.31.1.el10_1.x86_64 3/5 2026-02-13T02:12:11.921 INFO:teuthology.orchestra.run.trial011.stdout: Running scriptlet: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 3/5 2026-02-13T02:12:11.927 INFO:teuthology.orchestra.run.trial011.stdout: Installing : kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 4/5 2026-02-13T02:12:13.786 INFO:teuthology.orchestra.run.trial011.stdout: Running scriptlet: kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 4/5 2026-02-13T02:12:13.796 INFO:teuthology.orchestra.run.trial011.stdout: Installing : kernel-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-13T02:12:15.661 INFO:teuthology.orchestra.run.trial011.stdout: Running scriptlet: kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-13T02:12:49.350 INFO:teuthology.orchestra.run.trial011.stdout: Running scriptlet: kernel-core-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-13T02:12:49.373 INFO:teuthology.orchestra.run.trial011.stdout: Running scriptlet: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-13T02:12:49.605 INFO:teuthology.orchestra.run.trial011.stdout: Running scriptlet: kernel-6.12.0-124.31.1.el10_1.x86_64 5/5 2026-02-13T02:12:49.605 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:12:49.605 INFO:teuthology.orchestra.run.trial011.stdout:Installed: 2026-02-13T02:12:49.605 INFO:teuthology.orchestra.run.trial011.stdout: kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-13T02:12:49.605 INFO:teuthology.orchestra.run.trial011.stdout: kernel-core-6.12.0-124.31.1.el10_1.x86_64 2026-02-13T02:12:49.606 INFO:teuthology.orchestra.run.trial011.stdout: kernel-modules-6.12.0-124.31.1.el10_1.x86_64 2026-02-13T02:12:49.606 INFO:teuthology.orchestra.run.trial011.stdout: kernel-modules-core-6.12.0-124.31.1.el10_1.x86_64 2026-02-13T02:12:49.606 INFO:teuthology.orchestra.run.trial011.stdout: kernel-modules-extra-6.12.0-124.31.1.el10_1.x86_64 2026-02-13T02:12:49.606 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:12:49.606 INFO:teuthology.orchestra.run.trial011.stdout:Complete! 2026-02-13T02:12:49.672 DEBUG:teuthology.orchestra.run.trial011:> rpm -q kernel | sort -rV | head -n 1 2026-02-13T02:12:49.706 INFO:teuthology.orchestra.run.trial011.stdout:kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-13T02:12:49.708 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 6.12.0-124.31.1.el10_1.x86_64 2026-02-13T02:12:49.708 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 6.12.0-124.27.1.el10_1.x86_64 Expected: 6.12.0-124.31.1.el10_1.x86_64 2026-02-13T02:12:49.708 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-13T02:12:49.708 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-13T02:12:49.708 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2026-02-13T02:12:49.708 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial011.front.sepia.ceph.com, path=None, version=distro) 2026-02-13T02:12:49.709 DEBUG:teuthology.orchestra.run.trial011:> rpm -q kernel | sort -rV | head -n 1 2026-02-13T02:12:49.780 INFO:teuthology.orchestra.run.trial011.stdout:kernel-6.12.0-124.31.1.el10_1.x86_64 2026-02-13T02:12:49.780 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 6.12.0-124.31.1.el10_1.x86_64 2026-02-13T02:12:49.780 DEBUG:teuthology.orchestra.run.trial011:> sudo rpm -qi grub2-tools 2026-02-13T02:12:49.851 INFO:teuthology.orchestra.run.trial011.stdout:Name : grub2-tools 2026-02-13T02:12:49.852 INFO:teuthology.orchestra.run.trial011.stdout:Epoch : 1 2026-02-13T02:12:49.852 INFO:teuthology.orchestra.run.trial011.stdout:Version : 2.12 2026-02-13T02:12:49.852 INFO:teuthology.orchestra.run.trial011.stdout:Release : 29.el10_1 2026-02-13T02:12:49.852 INFO:teuthology.orchestra.run.trial011.stdout:Architecture: x86_64 2026-02-13T02:12:49.853 INFO:teuthology.orchestra.run.trial011.stdout:Install Date: Mon 19 Jan 2026 04:26:39 PM UTC 2026-02-13T02:12:49.853 INFO:teuthology.orchestra.run.trial011.stdout:Group : Unspecified 2026-02-13T02:12:49.853 INFO:teuthology.orchestra.run.trial011.stdout:Size : 7963769 2026-02-13T02:12:49.853 INFO:teuthology.orchestra.run.trial011.stdout:License : GPL-3.0-or-later 2026-02-13T02:12:49.853 INFO:teuthology.orchestra.run.trial011.stdout:Signature : 2026-02-13T02:12:49.854 INFO:teuthology.orchestra.run.trial011.stdout: RSA/SHA256, Wed 12 Nov 2025 09:58:06 PM UTC, Key ID 5b106c736fedfc85 2026-02-13T02:12:49.854 INFO:teuthology.orchestra.run.trial011.stdout:Source RPM : grub2-2.12-29.el10_1.src.rpm 2026-02-13T02:12:49.854 INFO:teuthology.orchestra.run.trial011.stdout:Build Date : Wed 12 Nov 2025 01:04:23 AM UTC 2026-02-13T02:12:49.854 INFO:teuthology.orchestra.run.trial011.stdout:Build Host : iad1-prod-build001.bld.equ.rockylinux.org 2026-02-13T02:12:49.854 INFO:teuthology.orchestra.run.trial011.stdout:Packager : Release Engineering 2026-02-13T02:12:49.854 INFO:teuthology.orchestra.run.trial011.stdout:Vendor : Rocky Enterprise Software Foundation 2026-02-13T02:12:49.855 INFO:teuthology.orchestra.run.trial011.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-13T02:12:49.855 INFO:teuthology.orchestra.run.trial011.stdout:Summary : Support tools for GRUB. 2026-02-13T02:12:49.855 INFO:teuthology.orchestra.run.trial011.stdout:Description : 2026-02-13T02:12:49.855 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:12:49.855 INFO:teuthology.orchestra.run.trial011.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-13T02:12:49.856 INFO:teuthology.orchestra.run.trial011.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-13T02:12:49.856 INFO:teuthology.orchestra.run.trial011.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-13T02:12:49.856 INFO:teuthology.orchestra.run.trial011.stdout:hardware devices. 2026-02-13T02:12:49.856 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:12:49.856 INFO:teuthology.orchestra.run.trial011.stdout:This subpackage provides tools for support of all platforms. 2026-02-13T02:12:49.857 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-13T02:12:49.857 INFO:teuthology.task.kernel:Updating grub on trial011 to boot 6.12.0-124.31.1.el10_1.x86_64 2026-02-13T02:12:49.858 DEBUG:teuthology.orchestra.run.trial011:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-13T02:12:49.924 INFO:teuthology.orchestra.run.trial011.stdout:/boot/loader/entries/867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64.conf 2026-02-13T02:12:49.925 DEBUG:teuthology.orchestra.run.trial011:> sudo command -v grubby && echo yes || echo no 2026-02-13T02:12:49.990 INFO:teuthology.orchestra.run.trial011.stdout:/sbin/grubby 2026-02-13T02:12:49.991 INFO:teuthology.orchestra.run.trial011.stdout:yes 2026-02-13T02:12:49.992 DEBUG:teuthology.orchestra.run.trial011:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "6.12.0-124.31.1.el10_1.x86_64" | head -n 1 2026-02-13T02:12:50.057 INFO:teuthology.orchestra.run.trial011.stdout:/boot/loader/entries/867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64.conf 2026-02-13T02:12:50.058 DEBUG:teuthology.orchestra.run.trial011:> sudo grub2-set-default 867f0e4f0ea54d5ab28df19610730767-6.12.0-124.31.1.el10_1.x86_64 2026-02-13T02:12:50.133 DEBUG:teuthology.orchestra.run.trial011:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-13T02:12:50.245 INFO:teuthology.orchestra.run.trial011.stderr:Generating grub configuration file ... 2026-02-13T02:12:50.422 INFO:teuthology.orchestra.run.trial011.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-13T02:12:50.431 INFO:teuthology.orchestra.run.trial011.stderr:done 2026-02-13T02:12:50.432 DEBUG:teuthology.orchestra.run.trial011:> test -d /sys/firmware/efi 2026-02-13T02:12:50.449 DEBUG:teuthology.orchestra.run.trial011:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-13T02:12:50.516 INFO:teuthology.orchestra.run.trial011.stdout:/boot/efi/EFI/BOOT 2026-02-13T02:12:50.516 INFO:teuthology.orchestra.run.trial011.stdout:/boot/efi/EFI/rocky 2026-02-13T02:12:50.518 DEBUG:teuthology.orchestra.run.trial011:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-13T02:12:50.585 INFO:teuthology.orchestra.run.trial011.stdout:no 2026-02-13T02:12:50.586 DEBUG:teuthology.orchestra.run.trial011:> sudo test -f /boot/efi/EFI/rocky/grub.cfg && echo yes || echo no 2026-02-13T02:12:50.653 INFO:teuthology.orchestra.run.trial011.stdout:yes 2026-02-13T02:12:50.653 DEBUG:teuthology.orchestra.run.trial011:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/rocky/grub.cfg 2026-02-13T02:12:50.721 INFO:teuthology.task.kernel:Triggering safe hard reboot via SysRq on trial011 2026-02-13T02:12:50.722 DEBUG:teuthology.orchestra.run.trial011:> sudo bash -c 'echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger' 2026-02-13T02:13:20.764 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-13T02:13:20.765 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial011.front.sepia.ceph.com' 2026-02-13T02:13:20.766 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial011.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T02:14:20.768 DEBUG:teuthology.orchestra.remote:timed out 2026-02-13T02:14:29.768 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial011.front.sepia.ceph.com' 2026-02-13T02:14:29.769 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial011.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T02:14:29.908 DEBUG:teuthology.orchestra.run.trial011:> true 2026-02-13T02:14:30.105 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial011.front.sepia.ceph.com' 2026-02-13T02:14:30.105 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.12.0-124.31.1.el10_1.x86_64"... 2026-02-13T02:14:30.105 DEBUG:teuthology.orchestra.run.trial011:> uname -r 2026-02-13T02:14:30.162 INFO:teuthology.orchestra.run.trial011.stdout:6.12.0-124.31.1.el10_1.x86_64 2026-02-13T02:14:30.162 DEBUG:teuthology.task.kernel:current kernel version is 6.12.0-124.31.1.el10_1.x86_64 vs 6.12.0-124.31.1.el10_1.x86_64 2026-02-13T02:14:30.163 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-13T02:14:30.163 DEBUG:teuthology.task.kernel:Distro of this test job: rocky 2026-02-13T02:14:31.164 DEBUG:teuthology.parallel:result is None 2026-02-13T02:14:31.164 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-13T02:14:31.177 INFO:teuthology.task.internal:Creating test directory... 2026-02-13T02:14:31.177 DEBUG:teuthology.orchestra.run.trial011:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-13T02:14:31.180 DEBUG:teuthology.orchestra.run.trial060:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-13T02:14:31.183 DEBUG:teuthology.orchestra.run.trial078:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-13T02:14:31.202 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-13T02:14:31.214 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-13T02:14:31.228 INFO:teuthology.task.internal:Creating archive directory... 2026-02-13T02:14:31.228 DEBUG:teuthology.orchestra.run.trial011:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-13T02:14:31.239 DEBUG:teuthology.orchestra.run.trial060:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-13T02:14:31.241 DEBUG:teuthology.orchestra.run.trial078:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-13T02:14:31.272 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-13T02:14:31.283 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-13T02:14:31.284 DEBUG:teuthology.orchestra.run.trial060:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-13T02:14:31.314 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T02:14:31.315 DEBUG:teuthology.orchestra.run.trial078:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-13T02:14:31.332 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T02:14:31.333 DEBUG:teuthology.orchestra.run.trial011:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-13T02:14:31.335 DEBUG:teuthology.orchestra.run.trial060:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-13T02:14:31.357 DEBUG:teuthology.orchestra.run.trial078:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-13T02:14:31.366 INFO:teuthology.orchestra.run.trial011.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T02:14:31.376 INFO:teuthology.orchestra.run.trial011.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T02:14:31.383 INFO:teuthology.orchestra.run.trial060.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T02:14:31.393 INFO:teuthology.orchestra.run.trial060.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T02:14:31.399 INFO:teuthology.orchestra.run.trial078.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T02:14:31.409 INFO:teuthology.orchestra.run.trial078.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T02:14:31.410 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-13T02:14:31.422 INFO:teuthology.task.internal:Configuring sudo... 2026-02-13T02:14:31.423 DEBUG:teuthology.orchestra.run.trial011:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-13T02:14:31.425 DEBUG:teuthology.orchestra.run.trial060:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-13T02:14:31.436 DEBUG:teuthology.orchestra.run.trial078:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-13T02:14:31.478 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-13T02:14:31.494 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-13T02:14:31.494 DEBUG:teuthology.orchestra.run.trial011:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-13T02:14:31.497 DEBUG:teuthology.orchestra.run.trial060:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-13T02:14:31.503 DEBUG:teuthology.orchestra.run.trial078:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-13T02:14:31.535 DEBUG:teuthology.orchestra.run.trial011:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T02:14:31.673 DEBUG:teuthology.orchestra.run.trial011:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T02:14:31.700 DEBUG:teuthology.orchestra.run.trial011:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T02:14:31.853 DEBUG:teuthology.orchestra.run.trial011:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T02:14:31.879 DEBUG:teuthology.orchestra.run.trial011:> set -ex 2026-02-13T02:14:31.879 DEBUG:teuthology.orchestra.run.trial011:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-13T02:14:31.947 DEBUG:teuthology.orchestra.run.trial060:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T02:14:32.024 DEBUG:teuthology.orchestra.run.trial060:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T02:14:32.050 DEBUG:teuthology.orchestra.run.trial060:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T02:14:32.187 DEBUG:teuthology.orchestra.run.trial060:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T02:14:32.213 DEBUG:teuthology.orchestra.run.trial060:> set -ex 2026-02-13T02:14:32.213 DEBUG:teuthology.orchestra.run.trial060:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-13T02:14:32.280 DEBUG:teuthology.orchestra.run.trial078:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T02:14:32.399 DEBUG:teuthology.orchestra.run.trial078:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T02:14:32.426 DEBUG:teuthology.orchestra.run.trial078:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T02:14:32.574 DEBUG:teuthology.orchestra.run.trial078:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T02:14:32.601 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-13T02:14:32.601 DEBUG:teuthology.orchestra.run.trial078:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-13T02:14:32.667 DEBUG:teuthology.orchestra.run.trial011:> sudo service rsyslog restart 2026-02-13T02:14:32.670 DEBUG:teuthology.orchestra.run.trial060:> sudo service rsyslog restart 2026-02-13T02:14:32.672 DEBUG:teuthology.orchestra.run.trial078:> sudo service rsyslog restart 2026-02-13T02:14:32.699 INFO:teuthology.orchestra.run.trial011.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-13T02:14:32.702 INFO:teuthology.orchestra.run.trial060.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-13T02:14:32.737 INFO:teuthology.orchestra.run.trial078.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-13T02:14:33.232 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-13T02:14:33.245 INFO:teuthology.task.internal:Starting timer... 2026-02-13T02:14:33.245 INFO:teuthology.run_tasks:Running task pcp... 2026-02-13T02:14:33.267 INFO:teuthology.run_tasks:Running task selinux... 2026-02-13T02:14:33.285 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0', 'comm="systemd".*denied.*\\{ prog_run \\}.*tclass=bpf.*permissive=1']} 2026-02-13T02:14:33.285 DEBUG:teuthology.orchestra.run.trial011:> sudo service auditd rotate 2026-02-13T02:14:33.316 INFO:teuthology.orchestra.run.trial011.stdout:Rotating logs: 2026-02-13T02:14:33.318 DEBUG:teuthology.orchestra.run.trial060:> sudo service auditd rotate 2026-02-13T02:14:33.350 INFO:teuthology.orchestra.run.trial060.stdout:Rotating logs: 2026-02-13T02:14:33.352 DEBUG:teuthology.orchestra.run.trial078:> sudo service auditd rotate 2026-02-13T02:14:33.384 INFO:teuthology.orchestra.run.trial078.stdout:Rotating logs: 2026-02-13T02:14:33.386 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-13T02:14:33.386 DEBUG:teuthology.orchestra.run.trial011:> /usr/sbin/getenforce 2026-02-13T02:14:33.404 INFO:teuthology.orchestra.run.trial011.stdout:Permissive 2026-02-13T02:14:33.404 DEBUG:teuthology.orchestra.run.trial060:> /usr/sbin/getenforce 2026-02-13T02:14:33.421 INFO:teuthology.orchestra.run.trial060.stdout:Permissive 2026-02-13T02:14:33.422 DEBUG:teuthology.orchestra.run.trial078:> /usr/sbin/getenforce 2026-02-13T02:14:33.443 INFO:teuthology.orchestra.run.trial078.stdout:Permissive 2026-02-13T02:14:33.444 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial011.front.sepia.ceph.com': 'permissive', 'ubuntu@trial060.front.sepia.ceph.com': 'permissive', 'ubuntu@trial078.front.sepia.ceph.com': 'permissive'} 2026-02-13T02:14:33.444 DEBUG:teuthology.orchestra.run.trial011:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e 'comm="systemd".*denied.*\{ prog_run \}.*tclass=bpf.*permissive=1' 2026-02-13T02:14:33.462 INFO:teuthology.orchestra.run.trial011.stderr:grep: Invalid content of \{\} 2026-02-13T02:14:33.471 DEBUG:teuthology.orchestra.run:got remote process result: 2 2026-02-13T02:14:33.471 DEBUG:teuthology.orchestra.run.trial060:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e 'comm="systemd".*denied.*\{ prog_run \}.*tclass=bpf.*permissive=1' 2026-02-13T02:14:33.489 INFO:teuthology.orchestra.run.trial060.stderr:grep: Invalid content of \{\} 2026-02-13T02:14:33.498 DEBUG:teuthology.orchestra.run:got remote process result: 2 2026-02-13T02:14:33.498 DEBUG:teuthology.orchestra.run.trial078:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e 'comm="systemd".*denied.*\{ prog_run \}.*tclass=bpf.*permissive=1' 2026-02-13T02:14:33.516 INFO:teuthology.orchestra.run.trial078.stderr:grep: Invalid content of \{\} 2026-02-13T02:14:33.525 DEBUG:teuthology.orchestra.run:got remote process result: 2 2026-02-13T02:14:33.526 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-13T02:14:33.526 DEBUG:teuthology.orchestra.run.trial011:> sudo /usr/sbin/setenforce permissive 2026-02-13T02:14:33.552 DEBUG:teuthology.orchestra.run.trial060:> sudo /usr/sbin/setenforce permissive 2026-02-13T02:14:33.578 DEBUG:teuthology.orchestra.run.trial078:> sudo /usr/sbin/setenforce permissive 2026-02-13T02:14:33.605 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-13T02:14:33.621 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-13T02:14:33.631 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-13T02:14:33.633 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial011.front.sepia.ceph.com,trial060.front.sepia.ceph.com,trial078.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-13T02:15:41.886 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial011.front.sepia.ceph.com'), Remote(name='ubuntu@trial060.front.sepia.ceph.com'), Remote(name='ubuntu@trial078.front.sepia.ceph.com')] 2026-02-13T02:15:41.888 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial011.front.sepia.ceph.com' 2026-02-13T02:15:41.889 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial011.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T02:15:42.044 DEBUG:teuthology.orchestra.run.trial011:> true 2026-02-13T02:15:42.123 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial011.front.sepia.ceph.com' 2026-02-13T02:15:42.123 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial060.front.sepia.ceph.com' 2026-02-13T02:15:42.123 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T02:15:42.210 DEBUG:teuthology.orchestra.run.trial060:> true 2026-02-13T02:15:42.289 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial060.front.sepia.ceph.com' 2026-02-13T02:15:42.290 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial078.front.sepia.ceph.com' 2026-02-13T02:15:42.290 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T02:15:42.382 DEBUG:teuthology.orchestra.run.trial078:> true 2026-02-13T02:15:42.464 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial078.front.sepia.ceph.com' 2026-02-13T02:15:42.464 INFO:teuthology.run_tasks:Running task clock... 2026-02-13T02:15:42.478 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-13T02:15:42.478 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-13T02:15:42.479 DEBUG:teuthology.orchestra.run.trial011:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-13T02:15:42.481 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-13T02:15:42.482 DEBUG:teuthology.orchestra.run.trial060:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-13T02:15:42.484 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-13T02:15:42.484 DEBUG:teuthology.orchestra.run.trial078:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-13T02:15:42.509 INFO:teuthology.orchestra.run.trial011.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-13T02:15:42.512 INFO:teuthology.orchestra.run.trial060.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-13T02:15:42.522 INFO:teuthology.orchestra.run.trial011.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-13T02:15:42.525 INFO:teuthology.orchestra.run.trial060.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-13T02:15:42.533 INFO:teuthology.orchestra.run.trial078.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-13T02:15:42.544 INFO:teuthology.orchestra.run.trial011.stderr:sudo: ntpd: command not found 2026-02-13T02:15:42.546 INFO:teuthology.orchestra.run.trial078.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-13T02:15:42.547 INFO:teuthology.orchestra.run.trial060.stderr:sudo: ntpd: command not found 2026-02-13T02:15:42.554 INFO:teuthology.orchestra.run.trial011.stdout:506 Cannot talk to daemon 2026-02-13T02:15:42.557 INFO:teuthology.orchestra.run.trial060.stdout:506 Cannot talk to daemon 2026-02-13T02:15:42.567 INFO:teuthology.orchestra.run.trial011.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-13T02:15:42.568 INFO:teuthology.orchestra.run.trial078.stderr:sudo: ntpd: command not found 2026-02-13T02:15:42.570 INFO:teuthology.orchestra.run.trial060.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-13T02:15:42.578 INFO:teuthology.orchestra.run.trial078.stdout:506 Cannot talk to daemon 2026-02-13T02:15:42.579 INFO:teuthology.orchestra.run.trial011.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-13T02:15:42.583 INFO:teuthology.orchestra.run.trial060.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-13T02:15:42.591 INFO:teuthology.orchestra.run.trial078.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-13T02:15:42.603 INFO:teuthology.orchestra.run.trial078.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-13T02:15:42.628 INFO:teuthology.orchestra.run.trial060.stderr:bash: line 1: ntpq: command not found 2026-02-13T02:15:42.631 INFO:teuthology.orchestra.run.trial011.stderr:bash: line 1: ntpq: command not found 2026-02-13T02:15:42.643 INFO:teuthology.orchestra.run.trial060.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-13T02:15:42.643 INFO:teuthology.orchestra.run.trial060.stdout:=============================================================================== 2026-02-13T02:15:42.643 INFO:teuthology.orchestra.run.trial060.stdout:^? ntp.maxhost.io 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T02:15:42.643 INFO:teuthology.orchestra.run.trial060.stdout:^? ntp.shastacoe.net 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T02:15:42.643 INFO:teuthology.orchestra.run.trial060.stdout:^? 99-28-14-242.lightspeed.> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T02:15:42.643 INFO:teuthology.orchestra.run.trial060.stdout:^? time2.trtnw.net 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T02:15:42.646 INFO:teuthology.orchestra.run.trial011.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-13T02:15:42.646 INFO:teuthology.orchestra.run.trial011.stdout:=============================================================================== 2026-02-13T02:15:42.646 INFO:teuthology.orchestra.run.trial011.stdout:^? nyc2.us.ntp.li 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T02:15:42.646 INFO:teuthology.orchestra.run.trial011.stdout:^? us-east-2.clearnet.pw 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T02:15:42.646 INFO:teuthology.orchestra.run.trial011.stdout:^? 44.190.5.123 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T02:15:42.646 INFO:teuthology.orchestra.run.trial011.stdout:^? ip216-250-115-174.pbiaas> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T02:15:42.658 INFO:teuthology.orchestra.run.trial078.stderr:bash: line 1: ntpq: command not found 2026-02-13T02:15:42.670 INFO:teuthology.orchestra.run.trial078.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-13T02:15:42.670 INFO:teuthology.orchestra.run.trial078.stdout:=============================================================================== 2026-02-13T02:15:42.671 INFO:teuthology.orchestra.run.trial078.stdout:^? time.nullroutenetworks.c> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T02:15:42.671 INFO:teuthology.orchestra.run.trial078.stdout:^? LAX.CALTICK.NET 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T02:15:42.671 INFO:teuthology.orchestra.run.trial078.stdout:^? s2-b.time.mci1.us.rozint> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T02:15:42.671 INFO:teuthology.orchestra.run.trial078.stdout:^? 44.190.5.123 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T02:15:42.672 INFO:teuthology.run_tasks:Running task pexec... 2026-02-13T02:15:42.690 INFO:teuthology.task.pexec:Executing custom commands... 2026-02-13T02:15:42.691 DEBUG:teuthology.orchestra.run.trial011:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-02-13T02:15:42.691 DEBUG:teuthology.orchestra.run.trial060:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-02-13T02:15:42.692 DEBUG:teuthology.orchestra.run.trial078:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-02-13T02:15:42.695 INFO:teuthology.task.pexec:Running commands on host ubuntu@trial060.front.sepia.ceph.com 2026-02-13T02:15:42.695 INFO:teuthology.task.pexec:sudo dnf remove nvme-cli -y 2026-02-13T02:15:42.695 INFO:teuthology.task.pexec:sudo dnf install nvmetcli nvme-cli -y 2026-02-13T02:15:42.696 INFO:teuthology.task.pexec:Running commands on host ubuntu@trial011.front.sepia.ceph.com 2026-02-13T02:15:42.696 INFO:teuthology.task.pexec:sudo dnf remove nvme-cli -y 2026-02-13T02:15:42.696 INFO:teuthology.task.pexec:sudo dnf install nvmetcli nvme-cli -y 2026-02-13T02:15:42.714 INFO:teuthology.task.pexec:Running commands on host ubuntu@trial078.front.sepia.ceph.com 2026-02-13T02:15:42.715 INFO:teuthology.task.pexec:sudo dnf remove nvme-cli -y 2026-02-13T02:15:42.715 INFO:teuthology.task.pexec:sudo dnf install nvmetcli nvme-cli -y 2026-02-13T02:15:42.865 INFO:teuthology.orchestra.run.trial060.stdout:No match for argument: nvme-cli 2026-02-13T02:15:42.866 INFO:teuthology.orchestra.run.trial060.stderr:No packages marked for removal. 2026-02-13T02:15:42.867 INFO:teuthology.orchestra.run.trial060.stdout:Dependencies resolved. 2026-02-13T02:15:42.868 INFO:teuthology.orchestra.run.trial060.stdout:Nothing to do. 2026-02-13T02:15:42.868 INFO:teuthology.orchestra.run.trial060.stdout:Complete! 2026-02-13T02:15:42.876 INFO:teuthology.orchestra.run.trial011.stdout:No match for argument: nvme-cli 2026-02-13T02:15:42.876 INFO:teuthology.orchestra.run.trial011.stderr:No packages marked for removal. 2026-02-13T02:15:42.878 INFO:teuthology.orchestra.run.trial011.stdout:Dependencies resolved. 2026-02-13T02:15:42.879 INFO:teuthology.orchestra.run.trial011.stdout:Nothing to do. 2026-02-13T02:15:42.879 INFO:teuthology.orchestra.run.trial011.stdout:Complete! 2026-02-13T02:15:42.887 INFO:teuthology.orchestra.run.trial078.stdout:No match for argument: nvme-cli 2026-02-13T02:15:42.887 INFO:teuthology.orchestra.run.trial078.stderr:No packages marked for removal. 2026-02-13T02:15:42.888 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-13T02:15:42.889 INFO:teuthology.orchestra.run.trial078.stdout:Nothing to do. 2026-02-13T02:15:42.889 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-13T02:15:43.145 INFO:teuthology.orchestra.run.trial060.stdout:Last metadata expiration check: 0:00:34 ago on Fri 13 Feb 2026 02:15:09 AM UTC. 2026-02-13T02:15:43.162 INFO:teuthology.orchestra.run.trial011.stdout:Last metadata expiration check: 0:00:36 ago on Fri 13 Feb 2026 02:15:07 AM UTC. 2026-02-13T02:15:43.172 INFO:teuthology.orchestra.run.trial078.stdout:Last metadata expiration check: 0:00:30 ago on Fri 13 Feb 2026 02:15:13 AM UTC. 2026-02-13T02:15:43.183 INFO:teuthology.orchestra.run.trial060.stdout:Dependencies resolved. 2026-02-13T02:15:43.184 INFO:teuthology.orchestra.run.trial060.stdout:================================================================================ 2026-02-13T02:15:43.184 INFO:teuthology.orchestra.run.trial060.stdout: Package Arch Version Repository Size 2026-02-13T02:15:43.184 INFO:teuthology.orchestra.run.trial060.stdout:================================================================================ 2026-02-13T02:15:43.184 INFO:teuthology.orchestra.run.trial060.stdout:Installing: 2026-02-13T02:15:43.184 INFO:teuthology.orchestra.run.trial060.stdout: nvme-cli x86_64 2.13-2.el10 baseos 1.1 M 2026-02-13T02:15:43.184 INFO:teuthology.orchestra.run.trial060.stdout: nvmetcli noarch 0.8-1.el10 baseos 54 k 2026-02-13T02:15:43.184 INFO:teuthology.orchestra.run.trial060.stdout:Installing dependencies: 2026-02-13T02:15:43.185 INFO:teuthology.orchestra.run.trial060.stdout: python3-configshell noarch 1:1.1.30-8.el10 baseos 90 k 2026-02-13T02:15:43.185 INFO:teuthology.orchestra.run.trial060.stdout: python3-kmod x86_64 0.9.2-6.el10 baseos 111 k 2026-02-13T02:15:43.185 INFO:teuthology.orchestra.run.trial060.stdout: python3-pyparsing noarch 3.1.1-7.el10 baseos 271 k 2026-02-13T02:15:43.185 INFO:teuthology.orchestra.run.trial060.stdout: python3-typing-extensions noarch 4.9.0-6.el10 baseos 77 k 2026-02-13T02:15:43.185 INFO:teuthology.orchestra.run.trial060.stdout: python3-urwid x86_64 2.5.3-4.el10 baseos 1.1 M 2026-02-13T02:15:43.185 INFO:teuthology.orchestra.run.trial060.stdout: python3-wcwidth noarch 0.2.6-6.el10 baseos 48 k 2026-02-13T02:15:43.185 INFO:teuthology.orchestra.run.trial060.stdout: 2026-02-13T02:15:43.185 INFO:teuthology.orchestra.run.trial060.stdout:Transaction Summary 2026-02-13T02:15:43.185 INFO:teuthology.orchestra.run.trial060.stdout:================================================================================ 2026-02-13T02:15:43.185 INFO:teuthology.orchestra.run.trial060.stdout:Install 8 Packages 2026-02-13T02:15:43.185 INFO:teuthology.orchestra.run.trial060.stdout: 2026-02-13T02:15:43.186 INFO:teuthology.orchestra.run.trial060.stdout:Total download size: 2.8 M 2026-02-13T02:15:43.186 INFO:teuthology.orchestra.run.trial060.stdout:Installed size: 13 M 2026-02-13T02:15:43.186 INFO:teuthology.orchestra.run.trial060.stdout:Downloading Packages: 2026-02-13T02:15:43.196 INFO:teuthology.orchestra.run.trial011.stdout:Dependencies resolved. 2026-02-13T02:15:43.197 INFO:teuthology.orchestra.run.trial011.stdout:================================================================================ 2026-02-13T02:15:43.197 INFO:teuthology.orchestra.run.trial011.stdout: Package Arch Version Repository Size 2026-02-13T02:15:43.197 INFO:teuthology.orchestra.run.trial011.stdout:================================================================================ 2026-02-13T02:15:43.197 INFO:teuthology.orchestra.run.trial011.stdout:Installing: 2026-02-13T02:15:43.197 INFO:teuthology.orchestra.run.trial011.stdout: nvme-cli x86_64 2.13-2.el10 baseos 1.1 M 2026-02-13T02:15:43.197 INFO:teuthology.orchestra.run.trial011.stdout: nvmetcli noarch 0.8-1.el10 baseos 54 k 2026-02-13T02:15:43.197 INFO:teuthology.orchestra.run.trial011.stdout:Installing dependencies: 2026-02-13T02:15:43.198 INFO:teuthology.orchestra.run.trial011.stdout: python3-configshell noarch 1:1.1.30-8.el10 baseos 90 k 2026-02-13T02:15:43.198 INFO:teuthology.orchestra.run.trial011.stdout: python3-kmod x86_64 0.9.2-6.el10 baseos 111 k 2026-02-13T02:15:43.198 INFO:teuthology.orchestra.run.trial011.stdout: python3-pyparsing noarch 3.1.1-7.el10 baseos 271 k 2026-02-13T02:15:43.198 INFO:teuthology.orchestra.run.trial011.stdout: python3-typing-extensions noarch 4.9.0-6.el10 baseos 77 k 2026-02-13T02:15:43.198 INFO:teuthology.orchestra.run.trial011.stdout: python3-urwid x86_64 2.5.3-4.el10 baseos 1.1 M 2026-02-13T02:15:43.198 INFO:teuthology.orchestra.run.trial011.stdout: python3-wcwidth noarch 0.2.6-6.el10 baseos 48 k 2026-02-13T02:15:43.198 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:15:43.198 INFO:teuthology.orchestra.run.trial011.stdout:Transaction Summary 2026-02-13T02:15:43.198 INFO:teuthology.orchestra.run.trial011.stdout:================================================================================ 2026-02-13T02:15:43.198 INFO:teuthology.orchestra.run.trial011.stdout:Install 8 Packages 2026-02-13T02:15:43.198 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:15:43.199 INFO:teuthology.orchestra.run.trial011.stdout:Total download size: 2.8 M 2026-02-13T02:15:43.199 INFO:teuthology.orchestra.run.trial011.stdout:Installed size: 13 M 2026-02-13T02:15:43.199 INFO:teuthology.orchestra.run.trial011.stdout:Downloading Packages: 2026-02-13T02:15:43.209 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-13T02:15:43.210 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-13T02:15:43.210 INFO:teuthology.orchestra.run.trial078.stdout: Package Arch Version Repository Size 2026-02-13T02:15:43.210 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-13T02:15:43.210 INFO:teuthology.orchestra.run.trial078.stdout:Installing: 2026-02-13T02:15:43.210 INFO:teuthology.orchestra.run.trial078.stdout: nvme-cli x86_64 2.13-2.el10 baseos 1.1 M 2026-02-13T02:15:43.211 INFO:teuthology.orchestra.run.trial078.stdout: nvmetcli noarch 0.8-1.el10 baseos 54 k 2026-02-13T02:15:43.211 INFO:teuthology.orchestra.run.trial078.stdout:Installing dependencies: 2026-02-13T02:15:43.211 INFO:teuthology.orchestra.run.trial078.stdout: python3-configshell noarch 1:1.1.30-8.el10 baseos 90 k 2026-02-13T02:15:43.211 INFO:teuthology.orchestra.run.trial078.stdout: python3-kmod x86_64 0.9.2-6.el10 baseos 111 k 2026-02-13T02:15:43.211 INFO:teuthology.orchestra.run.trial078.stdout: python3-pyparsing noarch 3.1.1-7.el10 baseos 271 k 2026-02-13T02:15:43.211 INFO:teuthology.orchestra.run.trial078.stdout: python3-typing-extensions noarch 4.9.0-6.el10 baseos 77 k 2026-02-13T02:15:43.211 INFO:teuthology.orchestra.run.trial078.stdout: python3-urwid x86_64 2.5.3-4.el10 baseos 1.1 M 2026-02-13T02:15:43.211 INFO:teuthology.orchestra.run.trial078.stdout: python3-wcwidth noarch 0.2.6-6.el10 baseos 48 k 2026-02-13T02:15:43.211 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:15:43.211 INFO:teuthology.orchestra.run.trial078.stdout:Transaction Summary 2026-02-13T02:15:43.211 INFO:teuthology.orchestra.run.trial078.stdout:================================================================================ 2026-02-13T02:15:43.211 INFO:teuthology.orchestra.run.trial078.stdout:Install 8 Packages 2026-02-13T02:15:43.211 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:15:43.212 INFO:teuthology.orchestra.run.trial078.stdout:Total download size: 2.8 M 2026-02-13T02:15:43.212 INFO:teuthology.orchestra.run.trial078.stdout:Installed size: 13 M 2026-02-13T02:15:43.212 INFO:teuthology.orchestra.run.trial078.stdout:Downloading Packages: 2026-02-13T02:15:43.224 INFO:teuthology.orchestra.run.trial060.stdout:(1/8): nvmetcli-0.8-1.el10.noarch.rpm 1.3 MB/s | 54 kB 00:00 2026-02-13T02:15:43.226 INFO:teuthology.orchestra.run.trial060.stdout:(2/8): python3-configshell-1.1.30-8.el10.noarch 2.2 MB/s | 90 kB 00:00 2026-02-13T02:15:43.235 INFO:teuthology.orchestra.run.trial011.stdout:(1/8): nvmetcli-0.8-1.el10.noarch.rpm 1.4 MB/s | 54 kB 00:00 2026-02-13T02:15:43.237 INFO:teuthology.orchestra.run.trial060.stdout:(3/8): nvme-cli-2.13-2.el10.x86_64.rpm 21 MB/s | 1.1 MB 00:00 2026-02-13T02:15:43.238 INFO:teuthology.orchestra.run.trial011.stdout:(2/8): python3-configshell-1.1.30-8.el10.noarch 2.2 MB/s | 90 kB 00:00 2026-02-13T02:15:43.243 INFO:teuthology.orchestra.run.trial060.stdout:(4/8): python3-kmod-0.9.2-6.el10.x86_64.rpm 5.7 MB/s | 111 kB 00:00 2026-02-13T02:15:43.248 INFO:teuthology.orchestra.run.trial060.stdout:(5/8): python3-pyparsing-3.1.1-7.el10.noarch.rp 12 MB/s | 271 kB 00:00 2026-02-13T02:15:43.250 INFO:teuthology.orchestra.run.trial078.stdout:(1/8): nvmetcli-0.8-1.el10.noarch.rpm 1.4 MB/s | 54 kB 00:00 2026-02-13T02:15:43.252 INFO:teuthology.orchestra.run.trial078.stdout:(2/8): python3-configshell-1.1.30-8.el10.noarch 2.2 MB/s | 90 kB 00:00 2026-02-13T02:15:43.253 INFO:teuthology.orchestra.run.trial060.stdout:(6/8): python3-typing-extensions-4.9.0-6.el10.n 4.8 MB/s | 77 kB 00:00 2026-02-13T02:15:43.257 INFO:teuthology.orchestra.run.trial011.stdout:(3/8): python3-kmod-0.9.2-6.el10.x86_64.rpm 5.1 MB/s | 111 kB 00:00 2026-02-13T02:15:43.258 INFO:teuthology.orchestra.run.trial078.stdout:(3/8): nvme-cli-2.13-2.el10.x86_64.rpm 23 MB/s | 1.1 MB 00:00 2026-02-13T02:15:43.259 INFO:teuthology.orchestra.run.trial011.stdout:(4/8): python3-pyparsing-3.1.1-7.el10.noarch.rp 13 MB/s | 271 kB 00:00 2026-02-13T02:15:43.261 INFO:teuthology.orchestra.run.trial011.stdout:(5/8): nvme-cli-2.13-2.el10.x86_64.rpm 18 MB/s | 1.1 MB 00:00 2026-02-13T02:15:43.264 INFO:teuthology.orchestra.run.trial060.stdout:(7/8): python3-wcwidth-0.2.6-6.el10.noarch.rpm 3.1 MB/s | 48 kB 00:00 2026-02-13T02:15:43.268 INFO:teuthology.orchestra.run.trial060.stdout:(8/8): python3-urwid-2.5.3-4.el10.x86_64.rpm 43 MB/s | 1.1 MB 00:00 2026-02-13T02:15:43.268 INFO:teuthology.orchestra.run.trial078.stdout:(4/8): python3-kmod-0.9.2-6.el10.x86_64.rpm 6.0 MB/s | 111 kB 00:00 2026-02-13T02:15:43.269 INFO:teuthology.orchestra.run.trial060.stdout:-------------------------------------------------------------------------------- 2026-02-13T02:15:43.269 INFO:teuthology.orchestra.run.trial060.stdout:Total 33 MB/s | 2.8 MB 00:00 2026-02-13T02:15:43.269 INFO:teuthology.orchestra.run.trial060.stdout:Running transaction check 2026-02-13T02:15:43.269 INFO:teuthology.orchestra.run.trial078.stdout:(5/8): python3-pyparsing-3.1.1-7.el10.noarch.rp 15 MB/s | 271 kB 00:00 2026-02-13T02:15:43.273 INFO:teuthology.orchestra.run.trial011.stdout:(6/8): python3-typing-extensions-4.9.0-6.el10.n 4.5 MB/s | 77 kB 00:00 2026-02-13T02:15:43.276 INFO:teuthology.orchestra.run.trial078.stdout:(6/8): python3-typing-extensions-4.9.0-6.el10.n 4.4 MB/s | 77 kB 00:00 2026-02-13T02:15:43.277 INFO:teuthology.orchestra.run.trial060.stdout:Transaction check succeeded. 2026-02-13T02:15:43.277 INFO:teuthology.orchestra.run.trial060.stdout:Running transaction test 2026-02-13T02:15:43.277 INFO:teuthology.orchestra.run.trial011.stdout:(7/8): python3-wcwidth-0.2.6-6.el10.noarch.rpm 3.0 MB/s | 48 kB 00:00 2026-02-13T02:15:43.287 INFO:teuthology.orchestra.run.trial011.stdout:(8/8): python3-urwid-2.5.3-4.el10.x86_64.rpm 37 MB/s | 1.1 MB 00:00 2026-02-13T02:15:43.288 INFO:teuthology.orchestra.run.trial011.stdout:-------------------------------------------------------------------------------- 2026-02-13T02:15:43.288 INFO:teuthology.orchestra.run.trial011.stdout:Total 31 MB/s | 2.8 MB 00:00 2026-02-13T02:15:43.288 INFO:teuthology.orchestra.run.trial011.stdout:Running transaction check 2026-02-13T02:15:43.291 INFO:teuthology.orchestra.run.trial078.stdout:(7/8): python3-wcwidth-0.2.6-6.el10.noarch.rpm 2.1 MB/s | 48 kB 00:00 2026-02-13T02:15:43.294 INFO:teuthology.orchestra.run.trial078.stdout:(8/8): python3-urwid-2.5.3-4.el10.x86_64.rpm 40 MB/s | 1.1 MB 00:00 2026-02-13T02:15:43.295 INFO:teuthology.orchestra.run.trial078.stdout:-------------------------------------------------------------------------------- 2026-02-13T02:15:43.295 INFO:teuthology.orchestra.run.trial078.stdout:Total 33 MB/s | 2.8 MB 00:00 2026-02-13T02:15:43.295 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction check 2026-02-13T02:15:43.296 INFO:teuthology.orchestra.run.trial011.stdout:Transaction check succeeded. 2026-02-13T02:15:43.296 INFO:teuthology.orchestra.run.trial011.stdout:Running transaction test 2026-02-13T02:15:43.303 INFO:teuthology.orchestra.run.trial078.stdout:Transaction check succeeded. 2026-02-13T02:15:43.304 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction test 2026-02-13T02:15:43.343 INFO:teuthology.orchestra.run.trial060.stdout:Transaction test succeeded. 2026-02-13T02:15:43.344 INFO:teuthology.orchestra.run.trial060.stdout:Running transaction 2026-02-13T02:15:43.363 INFO:teuthology.orchestra.run.trial011.stdout:Transaction test succeeded. 2026-02-13T02:15:43.364 INFO:teuthology.orchestra.run.trial011.stdout:Running transaction 2026-02-13T02:15:43.370 INFO:teuthology.orchestra.run.trial078.stdout:Transaction test succeeded. 2026-02-13T02:15:43.370 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction 2026-02-13T02:15:43.411 INFO:teuthology.orchestra.run.trial060.stdout: Preparing : 1/1 2026-02-13T02:15:43.415 INFO:teuthology.orchestra.run.trial060.stdout: Installing : python3-wcwidth-0.2.6-6.el10.noarch 1/8 2026-02-13T02:15:43.433 INFO:teuthology.orchestra.run.trial011.stdout: Preparing : 1/1 2026-02-13T02:15:43.436 INFO:teuthology.orchestra.run.trial011.stdout: Installing : python3-wcwidth-0.2.6-6.el10.noarch 1/8 2026-02-13T02:15:43.440 INFO:teuthology.orchestra.run.trial078.stdout: Preparing : 1/1 2026-02-13T02:15:43.441 INFO:teuthology.orchestra.run.trial060.stdout: Installing : python3-typing-extensions-4.9.0-6.el10.noarch 2/8 2026-02-13T02:15:43.443 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-wcwidth-0.2.6-6.el10.noarch 1/8 2026-02-13T02:15:43.448 INFO:teuthology.orchestra.run.trial060.stdout: Installing : python3-urwid-2.5.3-4.el10.x86_64 3/8 2026-02-13T02:15:43.452 INFO:teuthology.orchestra.run.trial060.stdout: Installing : python3-pyparsing-3.1.1-7.el10.noarch 4/8 2026-02-13T02:15:43.457 INFO:teuthology.orchestra.run.trial060.stdout: Installing : python3-configshell-1:1.1.30-8.el10.noarch 5/8 2026-02-13T02:15:43.461 INFO:teuthology.orchestra.run.trial011.stdout: Installing : python3-typing-extensions-4.9.0-6.el10.noarch 2/8 2026-02-13T02:15:43.462 INFO:teuthology.orchestra.run.trial060.stdout: Installing : python3-kmod-0.9.2-6.el10.x86_64 6/8 2026-02-13T02:15:43.463 INFO:teuthology.orchestra.run.trial060.stdout: Installing : nvmetcli-0.8-1.el10.noarch 7/8 2026-02-13T02:15:43.468 INFO:teuthology.orchestra.run.trial011.stdout: Installing : python3-urwid-2.5.3-4.el10.x86_64 3/8 2026-02-13T02:15:43.470 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-typing-extensions-4.9.0-6.el10.noarch 2/8 2026-02-13T02:15:43.472 INFO:teuthology.orchestra.run.trial011.stdout: Installing : python3-pyparsing-3.1.1-7.el10.noarch 4/8 2026-02-13T02:15:43.476 INFO:teuthology.orchestra.run.trial011.stdout: Installing : python3-configshell-1:1.1.30-8.el10.noarch 5/8 2026-02-13T02:15:43.477 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-urwid-2.5.3-4.el10.x86_64 3/8 2026-02-13T02:15:43.481 INFO:teuthology.orchestra.run.trial011.stdout: Installing : python3-kmod-0.9.2-6.el10.x86_64 6/8 2026-02-13T02:15:43.481 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-pyparsing-3.1.1-7.el10.noarch 4/8 2026-02-13T02:15:43.482 INFO:teuthology.orchestra.run.trial011.stdout: Installing : nvmetcli-0.8-1.el10.noarch 7/8 2026-02-13T02:15:43.485 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-configshell-1:1.1.30-8.el10.noarch 5/8 2026-02-13T02:15:43.490 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-kmod-0.9.2-6.el10.x86_64 6/8 2026-02-13T02:15:43.491 INFO:teuthology.orchestra.run.trial078.stdout: Installing : nvmetcli-0.8-1.el10.noarch 7/8 2026-02-13T02:15:43.518 INFO:teuthology.orchestra.run.trial060.stdout: Running scriptlet: nvmetcli-0.8-1.el10.noarch 7/8 2026-02-13T02:15:43.521 INFO:teuthology.orchestra.run.trial060.stdout: Installing : nvme-cli-2.13-2.el10.x86_64 8/8 2026-02-13T02:15:43.540 INFO:teuthology.orchestra.run.trial011.stdout: Running scriptlet: nvmetcli-0.8-1.el10.noarch 7/8 2026-02-13T02:15:43.543 INFO:teuthology.orchestra.run.trial011.stdout: Installing : nvme-cli-2.13-2.el10.x86_64 8/8 2026-02-13T02:15:43.544 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: nvmetcli-0.8-1.el10.noarch 7/8 2026-02-13T02:15:43.547 INFO:teuthology.orchestra.run.trial078.stdout: Installing : nvme-cli-2.13-2.el10.x86_64 8/8 2026-02-13T02:15:43.763 INFO:teuthology.orchestra.run.trial060.stdout: Running scriptlet: nvme-cli-2.13-2.el10.x86_64 8/8 2026-02-13T02:15:43.763 INFO:teuthology.orchestra.run.trial060.stdout:Created symlink '/etc/systemd/system/default.target.wants/nvmefc-boot-connections.service' → '/usr/lib/systemd/system/nvmefc-boot-connections.service'. 2026-02-13T02:15:43.763 INFO:teuthology.orchestra.run.trial060.stdout: 2026-02-13T02:15:43.787 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: nvme-cli-2.13-2.el10.x86_64 8/8 2026-02-13T02:15:43.787 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink '/etc/systemd/system/default.target.wants/nvmefc-boot-connections.service' → '/usr/lib/systemd/system/nvmefc-boot-connections.service'. 2026-02-13T02:15:43.787 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:15:43.799 INFO:teuthology.orchestra.run.trial011.stdout: Running scriptlet: nvme-cli-2.13-2.el10.x86_64 8/8 2026-02-13T02:15:43.799 INFO:teuthology.orchestra.run.trial011.stdout:Created symlink '/etc/systemd/system/default.target.wants/nvmefc-boot-connections.service' → '/usr/lib/systemd/system/nvmefc-boot-connections.service'. 2026-02-13T02:15:43.799 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:15:44.061 INFO:teuthology.orchestra.run.trial060.stdout: 2026-02-13T02:15:44.062 INFO:teuthology.orchestra.run.trial060.stdout:Installed: 2026-02-13T02:15:44.062 INFO:teuthology.orchestra.run.trial060.stdout: nvme-cli-2.13-2.el10.x86_64 2026-02-13T02:15:44.062 INFO:teuthology.orchestra.run.trial060.stdout: nvmetcli-0.8-1.el10.noarch 2026-02-13T02:15:44.062 INFO:teuthology.orchestra.run.trial060.stdout: python3-configshell-1:1.1.30-8.el10.noarch 2026-02-13T02:15:44.062 INFO:teuthology.orchestra.run.trial060.stdout: python3-kmod-0.9.2-6.el10.x86_64 2026-02-13T02:15:44.062 INFO:teuthology.orchestra.run.trial060.stdout: python3-pyparsing-3.1.1-7.el10.noarch 2026-02-13T02:15:44.062 INFO:teuthology.orchestra.run.trial060.stdout: python3-typing-extensions-4.9.0-6.el10.noarch 2026-02-13T02:15:44.062 INFO:teuthology.orchestra.run.trial060.stdout: python3-urwid-2.5.3-4.el10.x86_64 2026-02-13T02:15:44.062 INFO:teuthology.orchestra.run.trial060.stdout: python3-wcwidth-0.2.6-6.el10.noarch 2026-02-13T02:15:44.062 INFO:teuthology.orchestra.run.trial060.stdout: 2026-02-13T02:15:44.063 INFO:teuthology.orchestra.run.trial060.stdout:Complete! 2026-02-13T02:15:44.090 DEBUG:teuthology.parallel:result is None 2026-02-13T02:15:44.096 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:15:44.096 INFO:teuthology.orchestra.run.trial078.stdout:Installed: 2026-02-13T02:15:44.096 INFO:teuthology.orchestra.run.trial078.stdout: nvme-cli-2.13-2.el10.x86_64 2026-02-13T02:15:44.096 INFO:teuthology.orchestra.run.trial078.stdout: nvmetcli-0.8-1.el10.noarch 2026-02-13T02:15:44.096 INFO:teuthology.orchestra.run.trial078.stdout: python3-configshell-1:1.1.30-8.el10.noarch 2026-02-13T02:15:44.096 INFO:teuthology.orchestra.run.trial078.stdout: python3-kmod-0.9.2-6.el10.x86_64 2026-02-13T02:15:44.096 INFO:teuthology.orchestra.run.trial078.stdout: python3-pyparsing-3.1.1-7.el10.noarch 2026-02-13T02:15:44.096 INFO:teuthology.orchestra.run.trial078.stdout: python3-typing-extensions-4.9.0-6.el10.noarch 2026-02-13T02:15:44.096 INFO:teuthology.orchestra.run.trial078.stdout: python3-urwid-2.5.3-4.el10.x86_64 2026-02-13T02:15:44.097 INFO:teuthology.orchestra.run.trial078.stdout: python3-wcwidth-0.2.6-6.el10.noarch 2026-02-13T02:15:44.097 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:15:44.097 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-13T02:15:44.125 DEBUG:teuthology.parallel:result is None 2026-02-13T02:15:44.130 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:15:44.130 INFO:teuthology.orchestra.run.trial011.stdout:Installed: 2026-02-13T02:15:44.131 INFO:teuthology.orchestra.run.trial011.stdout: nvme-cli-2.13-2.el10.x86_64 2026-02-13T02:15:44.131 INFO:teuthology.orchestra.run.trial011.stdout: nvmetcli-0.8-1.el10.noarch 2026-02-13T02:15:44.131 INFO:teuthology.orchestra.run.trial011.stdout: python3-configshell-1:1.1.30-8.el10.noarch 2026-02-13T02:15:44.131 INFO:teuthology.orchestra.run.trial011.stdout: python3-kmod-0.9.2-6.el10.x86_64 2026-02-13T02:15:44.131 INFO:teuthology.orchestra.run.trial011.stdout: python3-pyparsing-3.1.1-7.el10.noarch 2026-02-13T02:15:44.131 INFO:teuthology.orchestra.run.trial011.stdout: python3-typing-extensions-4.9.0-6.el10.noarch 2026-02-13T02:15:44.131 INFO:teuthology.orchestra.run.trial011.stdout: python3-urwid-2.5.3-4.el10.x86_64 2026-02-13T02:15:44.131 INFO:teuthology.orchestra.run.trial011.stdout: python3-wcwidth-0.2.6-6.el10.noarch 2026-02-13T02:15:44.131 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:15:44.131 INFO:teuthology.orchestra.run.trial011.stdout:Complete! 2026-02-13T02:15:44.159 DEBUG:teuthology.parallel:result is None 2026-02-13T02:15:44.159 INFO:teuthology.run_tasks:Running task install... 2026-02-13T02:15:44.173 DEBUG:teuthology.task.install:project ceph 2026-02-13T02:15:44.173 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '8f8d38294e4db8750b4b1649f62ce37caa63080f'}} 2026-02-13T02:15:44.173 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '8f8d38294e4db8750b4b1649f62ce37caa63080f'} 2026-02-13T02:15:44.173 INFO:teuthology.task.install:Using flavor: default 2026-02-13T02:15:44.182 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-osd', 'ceph-osd-classic', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-osd', 'ceph-osd-classic', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-13T02:15:44.182 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2026-02-13T02:15:44.183 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8f8d38294e4db8750b4b1649f62ce37caa63080f', 'tag': None, 'wait_for_package': False} 2026-02-13T02:15:44.184 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=rocky%2F10%2Fx86_64&sha1=8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-13T02:15:44.187 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8f8d38294e4db8750b4b1649f62ce37caa63080f', 'tag': None, 'wait_for_package': False} 2026-02-13T02:15:44.187 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=rocky%2F10%2Fx86_64&sha1=8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-13T02:15:44.189 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8f8d38294e4db8750b4b1649f62ce37caa63080f', 'tag': None, 'wait_for_package': False} 2026-02-13T02:15:44.189 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=rocky%2F10%2Fx86_64&sha1=8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-13T02:15:44.420 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/rocky/10/flavors/default/ 2026-02-13T02:15:44.420 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5241.g8f8d3829 2026-02-13T02:15:44.447 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/rocky/10/flavors/default/ 2026-02-13T02:15:44.447 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5241.g8f8d3829 2026-02-13T02:15:44.448 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/rocky/10/flavors/default/ 2026-02-13T02:15:44.448 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5241.g8f8d3829 2026-02-13T02:15:44.638 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/rocky/10/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/rocky/10/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/rocky/10/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-13T02:15:44.638 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-13T02:15:44.638 DEBUG:teuthology.orchestra.run.trial078:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-13T02:15:44.641 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/rocky/10/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/rocky/10/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/rocky/10/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-13T02:15:44.641 DEBUG:teuthology.orchestra.run.trial011:> set -ex 2026-02-13T02:15:44.641 DEBUG:teuthology.orchestra.run.trial011:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-13T02:15:44.648 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/rocky/10/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/rocky/10/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/rocky/10/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-13T02:15:44.648 DEBUG:teuthology.orchestra.run.trial060:> set -ex 2026-02-13T02:15:44.648 DEBUG:teuthology.orchestra.run.trial060:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-13T02:15:44.668 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2026-02-13T02:15:44.668 DEBUG:teuthology.orchestra.run.trial078:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8f8d38294e4db8750b4b1649f62ce37caa63080f/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-13T02:15:44.670 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2026-02-13T02:15:44.670 DEBUG:teuthology.orchestra.run.trial011:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8f8d38294e4db8750b4b1649f62ce37caa63080f/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-13T02:15:44.676 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2026-02-13T02:15:44.677 DEBUG:teuthology.orchestra.run.trial060:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8f8d38294e4db8750b4b1649f62ce37caa63080f/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-13T02:15:44.735 DEBUG:teuthology.orchestra.run.trial078:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-13T02:15:44.739 DEBUG:teuthology.orchestra.run.trial011:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-13T02:15:44.745 DEBUG:teuthology.orchestra.run.trial060:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-13T02:15:44.812 DEBUG:teuthology.orchestra.run.trial078:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-13T02:15:44.818 DEBUG:teuthology.orchestra.run.trial011:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-13T02:15:44.825 DEBUG:teuthology.orchestra.run.trial060:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-13T02:15:44.877 INFO:teuthology.orchestra.run.trial078.stdout:check_obsoletes = 1 2026-02-13T02:15:44.879 DEBUG:teuthology.orchestra.run.trial078:> sudo yum clean all 2026-02-13T02:15:44.884 INFO:teuthology.orchestra.run.trial011.stdout:check_obsoletes = 1 2026-02-13T02:15:44.886 DEBUG:teuthology.orchestra.run.trial011:> sudo yum clean all 2026-02-13T02:15:44.891 INFO:teuthology.orchestra.run.trial060.stdout:check_obsoletes = 1 2026-02-13T02:15:44.893 DEBUG:teuthology.orchestra.run.trial060:> sudo yum clean all 2026-02-13T02:15:45.031 INFO:teuthology.orchestra.run.trial078.stdout:28 files removed 2026-02-13T02:15:45.037 INFO:teuthology.orchestra.run.trial011.stdout:28 files removed 2026-02-13T02:15:45.046 INFO:teuthology.orchestra.run.trial060.stdout:28 files removed 2026-02-13T02:15:45.047 DEBUG:teuthology.orchestra.run.trial078:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-osd ceph-osd-classic ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2026-02-13T02:15:45.053 DEBUG:teuthology.orchestra.run.trial011:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-osd ceph-osd-classic ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2026-02-13T02:15:45.061 DEBUG:teuthology.orchestra.run.trial060:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-osd ceph-osd-classic ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2026-02-13T02:15:45.312 INFO:teuthology.orchestra.run.trial011.stdout:ceph packages for x86_64 243 kB/s | 26 kB 00:00 2026-02-13T02:15:45.312 INFO:teuthology.orchestra.run.trial060.stdout:ceph packages for x86_64 236 kB/s | 26 kB 00:00 2026-02-13T02:15:45.313 INFO:teuthology.orchestra.run.trial078.stdout:ceph packages for x86_64 214 kB/s | 26 kB 00:00 2026-02-13T02:15:45.416 INFO:teuthology.orchestra.run.trial078.stdout:ceph noarch packages 41 kB/s | 3.9 kB 00:00 2026-02-13T02:15:45.417 INFO:teuthology.orchestra.run.trial011.stdout:ceph noarch packages 41 kB/s | 3.9 kB 00:00 2026-02-13T02:15:45.417 INFO:teuthology.orchestra.run.trial060.stdout:ceph noarch packages 41 kB/s | 3.9 kB 00:00 2026-02-13T02:15:45.518 INFO:teuthology.orchestra.run.trial078.stdout:ceph source packages 19 kB/s | 1.8 kB 00:00 2026-02-13T02:15:45.518 INFO:teuthology.orchestra.run.trial060.stdout:ceph source packages 18 kB/s | 1.8 kB 00:00 2026-02-13T02:15:45.519 INFO:teuthology.orchestra.run.trial011.stdout:ceph source packages 18 kB/s | 1.8 kB 00:00 2026-02-13T02:15:45.610 INFO:teuthology.orchestra.run.trial011.stdout:Rocky Linux 10 - AppStream 26 MB/s | 2.2 MB 00:00 2026-02-13T02:15:45.612 INFO:teuthology.orchestra.run.trial078.stdout:Rocky Linux 10 - AppStream 25 MB/s | 2.2 MB 00:00 2026-02-13T02:15:45.616 INFO:teuthology.orchestra.run.trial060.stdout:Rocky Linux 10 - AppStream 24 MB/s | 2.2 MB 00:00 2026-02-13T02:15:45.920 INFO:teuthology.orchestra.run.trial060.stdout:Rocky Linux 10 - BaseOS 62 MB/s | 11 MB 00:00 2026-02-13T02:15:45.933 INFO:teuthology.orchestra.run.trial078.stdout:Rocky Linux 10 - BaseOS 56 MB/s | 11 MB 00:00 2026-02-13T02:15:45.954 INFO:teuthology.orchestra.run.trial011.stdout:Rocky Linux 10 - BaseOS 50 MB/s | 11 MB 00:00 2026-02-13T02:15:46.412 INFO:teuthology.orchestra.run.trial060.stdout:Rocky Linux 10 - CRB 6.1 MB/s | 507 kB 00:00 2026-02-13T02:15:46.424 INFO:teuthology.orchestra.run.trial078.stdout:Rocky Linux 10 - CRB 6.1 MB/s | 507 kB 00:00 2026-02-13T02:15:46.442 INFO:teuthology.orchestra.run.trial011.stdout:Rocky Linux 10 - CRB 6.4 MB/s | 507 kB 00:00 2026-02-13T02:15:47.086 INFO:teuthology.orchestra.run.trial060.stdout:Extra Packages for Enterprise Linux 9.9 MB/s | 6.2 MB 00:00 2026-02-13T02:15:47.194 INFO:teuthology.orchestra.run.trial078.stdout:Extra Packages for Enterprise Linux 8.6 MB/s | 6.2 MB 00:00 2026-02-13T02:15:47.748 INFO:teuthology.orchestra.run.trial060.stdout:lab-extras 289 kB/s | 3.7 kB 00:00 2026-02-13T02:15:47.850 INFO:teuthology.orchestra.run.trial078.stdout:lab-extras 303 kB/s | 3.7 kB 00:00 2026-02-13T02:15:48.054 INFO:teuthology.orchestra.run.trial011.stdout:Extra Packages for Enterprise Linux 4.0 MB/s | 6.2 MB 00:01 2026-02-13T02:15:48.260 INFO:teuthology.orchestra.run.trial060.stdout:Package librados2-2:18.2.1-4.el10.x86_64 is already installed. 2026-02-13T02:15:48.261 INFO:teuthology.orchestra.run.trial060.stdout:Package librbd1-2:18.2.1-4.el10.x86_64 is already installed. 2026-02-13T02:15:48.264 INFO:teuthology.orchestra.run.trial060.stdout:Package NetworkManager-1:1.54.0-2.el10_1.x86_64 is already installed. 2026-02-13T02:15:48.265 INFO:teuthology.orchestra.run.trial060.stdout:Package iproute-6.14.0-2.el10.x86_64 is already installed. 2026-02-13T02:15:48.265 INFO:teuthology.orchestra.run.trial060.stdout:Package util-linux-2.40.2-13.el10.x86_64 is already installed. 2026-02-13T02:15:48.266 INFO:teuthology.orchestra.run.trial060.stdout:Package libacl-devel-2.3.2-4.el10.x86_64 is already installed. 2026-02-13T02:15:48.266 INFO:teuthology.orchestra.run.trial060.stdout:Package libattr-devel-2.5.2-5.el10.x86_64 is already installed. 2026-02-13T02:15:48.267 INFO:teuthology.orchestra.run.trial060.stdout:Package xfsdump-3.2.0-1.el10.x86_64 is already installed. 2026-02-13T02:15:48.267 INFO:teuthology.orchestra.run.trial060.stdout:Package xfsprogs-6.11.0-2.el10.x86_64 is already installed. 2026-02-13T02:15:48.283 INFO:teuthology.orchestra.run.trial060.stdout:Dependencies resolved. 2026-02-13T02:15:48.291 INFO:teuthology.orchestra.run.trial060.stdout:======================================================================================== 2026-02-13T02:15:48.291 INFO:teuthology.orchestra.run.trial060.stdout: Package Arch Version Repository Size 2026-02-13T02:15:48.291 INFO:teuthology.orchestra.run.trial060.stdout:======================================================================================== 2026-02-13T02:15:48.291 INFO:teuthology.orchestra.run.trial060.stdout:Installing: 2026-02-13T02:15:48.291 INFO:teuthology.orchestra.run.trial060.stdout: bison x86_64 3.8.2-9.el10 appstream 1.0 M 2026-02-13T02:15:48.291 INFO:teuthology.orchestra.run.trial060.stdout: ceph x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 6.6 k 2026-02-13T02:15:48.291 INFO:teuthology.orchestra.run.trial060.stdout: ceph-base x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 5.4 M 2026-02-13T02:15:48.292 INFO:teuthology.orchestra.run.trial060.stdout: ceph-fuse x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 1.1 M 2026-02-13T02:15:48.292 INFO:teuthology.orchestra.run.trial060.stdout: ceph-immutable-object-cache x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 151 k 2026-02-13T02:15:48.292 INFO:teuthology.orchestra.run.trial060.stdout: ceph-mgr x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 984 k 2026-02-13T02:15:48.292 INFO:teuthology.orchestra.run.trial060.stdout: ceph-mgr-cephadm noarch 2:20.3.0-5241.g8f8d3829.el10 ceph-noarch 183 k 2026-02-13T02:15:48.292 INFO:teuthology.orchestra.run.trial060.stdout: ceph-mgr-dashboard noarch 2:20.3.0-5241.g8f8d3829.el10 ceph-noarch 15 M 2026-02-13T02:15:48.292 INFO:teuthology.orchestra.run.trial060.stdout: ceph-mgr-diskprediction-local noarch 2:20.3.0-5241.g8f8d3829.el10 ceph-noarch 7.4 M 2026-02-13T02:15:48.292 INFO:teuthology.orchestra.run.trial060.stdout: ceph-mgr-rook noarch 2:20.3.0-5241.g8f8d3829.el10 ceph-noarch 50 k 2026-02-13T02:15:48.292 INFO:teuthology.orchestra.run.trial060.stdout: ceph-osd x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 176 k 2026-02-13T02:15:48.292 INFO:teuthology.orchestra.run.trial060.stdout: ceph-osd-classic x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 17 M 2026-02-13T02:15:48.292 INFO:teuthology.orchestra.run.trial060.stdout: ceph-radosgw x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 14 M 2026-02-13T02:15:48.292 INFO:teuthology.orchestra.run.trial060.stdout: ceph-test x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 81 M 2026-02-13T02:15:48.293 INFO:teuthology.orchestra.run.trial060.stdout: ceph-volume noarch 2:20.3.0-5241.g8f8d3829.el10 ceph-noarch 374 k 2026-02-13T02:15:48.293 INFO:teuthology.orchestra.run.trial060.stdout: cephadm noarch 2:20.3.0-5241.g8f8d3829.el10 ceph-noarch 1.3 M 2026-02-13T02:15:48.293 INFO:teuthology.orchestra.run.trial060.stdout: cephfs-mirror x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 252 k 2026-02-13T02:15:48.293 INFO:teuthology.orchestra.run.trial060.stdout: cephfs-shell x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 27 k 2026-02-13T02:15:48.293 INFO:teuthology.orchestra.run.trial060.stdout: cephfs-top noarch 2:20.3.0-5241.g8f8d3829.el10 ceph-noarch 18 k 2026-02-13T02:15:48.293 INFO:teuthology.orchestra.run.trial060.stdout: elfutils-libelf-devel x86_64 0.193-1.el10.rocky.0.1 appstream 48 k 2026-02-13T02:15:48.293 INFO:teuthology.orchestra.run.trial060.stdout: flex x86_64 2.6.4-19.el10 appstream 300 k 2026-02-13T02:15:48.293 INFO:teuthology.orchestra.run.trial060.stdout: libaio-devel x86_64 0.3.111-22.el10 appstream 10 k 2026-02-13T02:15:48.293 INFO:teuthology.orchestra.run.trial060.stdout: libcephfs-devel x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 37 k 2026-02-13T02:15:48.293 INFO:teuthology.orchestra.run.trial060.stdout: libcephfs2 x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 937 k 2026-02-13T02:15:48.293 INFO:teuthology.orchestra.run.trial060.stdout: librados-devel x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 128 k 2026-02-13T02:15:48.293 INFO:teuthology.orchestra.run.trial060.stdout: libtool x86_64 2.4.7-13.el10 appstream 601 k 2026-02-13T02:15:48.293 INFO:teuthology.orchestra.run.trial060.stdout: libuuid-devel x86_64 2.40.2-15.el10_1 appstream 37 k 2026-02-13T02:15:48.294 INFO:teuthology.orchestra.run.trial060.stdout: openssl-devel x86_64 1:3.5.1-7.el10_1 appstream 3.0 M 2026-02-13T02:15:48.294 INFO:teuthology.orchestra.run.trial060.stdout: postgresql x86_64 16.11-1.el10_1 appstream 2.0 M 2026-02-13T02:15:48.294 INFO:teuthology.orchestra.run.trial060.stdout: postgresql-contrib x86_64 16.11-1.el10_1 appstream 1.0 M 2026-02-13T02:15:48.294 INFO:teuthology.orchestra.run.trial060.stdout: postgresql-server x86_64 16.11-1.el10_1 appstream 7.0 M 2026-02-13T02:15:48.294 INFO:teuthology.orchestra.run.trial060.stdout: python3-cephfs x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 253 k 2026-02-13T02:15:48.294 INFO:teuthology.orchestra.run.trial060.stdout: python3-rados x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 352 k 2026-02-13T02:15:48.294 INFO:teuthology.orchestra.run.trial060.stdout: python3-rbd x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 372 k 2026-02-13T02:15:48.294 INFO:teuthology.orchestra.run.trial060.stdout: python3-rgw x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 130 k 2026-02-13T02:15:48.294 INFO:teuthology.orchestra.run.trial060.stdout: rbd-fuse x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 87 k 2026-02-13T02:15:48.294 INFO:teuthology.orchestra.run.trial060.stdout: rbd-mirror x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 2.9 M 2026-02-13T02:15:48.294 INFO:teuthology.orchestra.run.trial060.stdout: rbd-nbd x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 180 k 2026-02-13T02:15:48.294 INFO:teuthology.orchestra.run.trial060.stdout: xfsprogs-devel x86_64 6.11.0-2.el10 appstream 105 k 2026-02-13T02:15:48.294 INFO:teuthology.orchestra.run.trial060.stdout:Upgrading: 2026-02-13T02:15:48.295 INFO:teuthology.orchestra.run.trial060.stdout: libblkid x86_64 2.40.2-15.el10_1 baseos 124 k 2026-02-13T02:15:48.295 INFO:teuthology.orchestra.run.trial060.stdout: libfdisk x86_64 2.40.2-15.el10_1 baseos 159 k 2026-02-13T02:15:48.295 INFO:teuthology.orchestra.run.trial060.stdout: libmount x86_64 2.40.2-15.el10_1 baseos 154 k 2026-02-13T02:15:48.295 INFO:teuthology.orchestra.run.trial060.stdout: librados2 x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 3.6 M 2026-02-13T02:15:48.295 INFO:teuthology.orchestra.run.trial060.stdout: librbd1 x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 2.8 M 2026-02-13T02:15:48.295 INFO:teuthology.orchestra.run.trial060.stdout: libsmartcols x86_64 2.40.2-15.el10_1 baseos 83 k 2026-02-13T02:15:48.295 INFO:teuthology.orchestra.run.trial060.stdout: libuuid x86_64 2.40.2-15.el10_1 baseos 28 k 2026-02-13T02:15:48.295 INFO:teuthology.orchestra.run.trial060.stdout: openssl x86_64 1:3.5.1-7.el10_1 baseos 1.2 M 2026-02-13T02:15:48.295 INFO:teuthology.orchestra.run.trial060.stdout: openssl-fips-provider x86_64 1:3.5.1-7.el10_1 baseos 812 k 2026-02-13T02:15:48.295 INFO:teuthology.orchestra.run.trial060.stdout: openssl-libs x86_64 1:3.5.1-7.el10_1 baseos 2.2 M 2026-02-13T02:15:48.295 INFO:teuthology.orchestra.run.trial060.stdout: util-linux x86_64 2.40.2-15.el10_1 baseos 1.2 M 2026-02-13T02:15:48.295 INFO:teuthology.orchestra.run.trial060.stdout: util-linux-core x86_64 2.40.2-15.el10_1 baseos 542 k 2026-02-13T02:15:48.295 INFO:teuthology.orchestra.run.trial060.stdout:Installing dependencies: 2026-02-13T02:15:48.296 INFO:teuthology.orchestra.run.trial060.stdout: abseil-cpp x86_64 20240722.1-1.el10_0 epel 590 k 2026-02-13T02:15:48.296 INFO:teuthology.orchestra.run.trial060.stdout: automake noarch 1.16.5-20.el10 appstream 704 k 2026-02-13T02:15:48.296 INFO:teuthology.orchestra.run.trial060.stdout: boost-program-options x86_64 1.83.0-5.el10 appstream 109 k 2026-02-13T02:15:48.296 INFO:teuthology.orchestra.run.trial060.stdout: ceph-common x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 25 M 2026-02-13T02:15:48.296 INFO:teuthology.orchestra.run.trial060.stdout: ceph-grafana-dashboards noarch 2:20.3.0-5241.g8f8d3829.el10 ceph-noarch 57 k 2026-02-13T02:15:48.296 INFO:teuthology.orchestra.run.trial060.stdout: ceph-mds x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 2.4 M 2026-02-13T02:15:48.296 INFO:teuthology.orchestra.run.trial060.stdout: ceph-mgr-modules-core noarch 2:20.3.0-5241.g8f8d3829.el10 ceph-noarch 297 k 2026-02-13T02:15:48.296 INFO:teuthology.orchestra.run.trial060.stdout: ceph-mon x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 6.0 M 2026-02-13T02:15:48.296 INFO:teuthology.orchestra.run.trial060.stdout: ceph-osd-crimson x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 20 M 2026-02-13T02:15:48.296 INFO:teuthology.orchestra.run.trial060.stdout: ceph-prometheus-alerts noarch 2:20.3.0-5241.g8f8d3829.el10 ceph-noarch 17 k 2026-02-13T02:15:48.296 INFO:teuthology.orchestra.run.trial060.stdout: ceph-selinux x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 25 k 2026-02-13T02:15:48.296 INFO:teuthology.orchestra.run.trial060.stdout: cmake-filesystem x86_64 3.30.5-3.el10_0 appstream 15 k 2026-02-13T02:15:48.296 INFO:teuthology.orchestra.run.trial060.stdout: cryptsetup x86_64 2.7.5-2.el10 baseos 335 k 2026-02-13T02:15:48.297 INFO:teuthology.orchestra.run.trial060.stdout: daxctl-libs x86_64 80-4.el10 baseos 42 k 2026-02-13T02:15:48.297 INFO:teuthology.orchestra.run.trial060.stdout: flexiblas x86_64 3.4.2-3.el10 appstream 25 k 2026-02-13T02:15:48.297 INFO:teuthology.orchestra.run.trial060.stdout: flexiblas-netlib x86_64 3.4.2-3.el10 appstream 3.2 M 2026-02-13T02:15:48.297 INFO:teuthology.orchestra.run.trial060.stdout: flexiblas-openblas-openmp x86_64 3.4.2-3.el10 appstream 17 k 2026-02-13T02:15:48.297 INFO:teuthology.orchestra.run.trial060.stdout: fuse3 x86_64 3.16.2-5.el10 baseos 58 k 2026-02-13T02:15:48.297 INFO:teuthology.orchestra.run.trial060.stdout: gperftools-libs x86_64 2.15-4.el10_0 epel 303 k 2026-02-13T02:15:48.297 INFO:teuthology.orchestra.run.trial060.stdout: grpc-data noarch 1.48.4-44.el10_0 epel 21 k 2026-02-13T02:15:48.297 INFO:teuthology.orchestra.run.trial060.stdout: hwloc-libs x86_64 2.11.1-3.el10 baseos 2.1 M 2026-02-13T02:15:48.297 INFO:teuthology.orchestra.run.trial060.stdout: ledmon-libs x86_64 1.1.0-2.el10 appstream 42 k 2026-02-13T02:15:48.297 INFO:teuthology.orchestra.run.trial060.stdout: libarrow x86_64 17.0.0-9.el10_2 epel 5.7 M 2026-02-13T02:15:48.297 INFO:teuthology.orchestra.run.trial060.stdout: libarrow-doc noarch 17.0.0-9.el10_2 epel 27 k 2026-02-13T02:15:48.297 INFO:teuthology.orchestra.run.trial060.stdout: libcephfs-proxy2 x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 25 k 2026-02-13T02:15:48.297 INFO:teuthology.orchestra.run.trial060.stdout: libcephsqlite x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 168 k 2026-02-13T02:15:48.298 INFO:teuthology.orchestra.run.trial060.stdout: libconfig x86_64 1.7.3-10.el10 baseos 72 k 2026-02-13T02:15:48.298 INFO:teuthology.orchestra.run.trial060.stdout: libgfortran x86_64 14.3.1-2.1.el10 baseos 827 k 2026-02-13T02:15:48.298 INFO:teuthology.orchestra.run.trial060.stdout: libnbd x86_64 1.22.2-3.el10_1 appstream 175 k 2026-02-13T02:15:48.298 INFO:teuthology.orchestra.run.trial060.stdout: liboath x86_64 2.6.12-1.el10_0 epel 48 k 2026-02-13T02:15:48.298 INFO:teuthology.orchestra.run.trial060.stdout: liborc2 x86_64 2.0.7-1.el10_2 epel 515 k 2026-02-13T02:15:48.298 INFO:teuthology.orchestra.run.trial060.stdout: libpciaccess x86_64 0.16-16.el10 baseos 27 k 2026-02-13T02:15:48.298 INFO:teuthology.orchestra.run.trial060.stdout: libpmem x86_64 2.1.0-2.el10_0 epel 112 k 2026-02-13T02:15:48.298 INFO:teuthology.orchestra.run.trial060.stdout: libpmemobj x86_64 2.1.0-2.el10_0 epel 161 k 2026-02-13T02:15:48.298 INFO:teuthology.orchestra.run.trial060.stdout: libquadmath x86_64 14.3.1-2.1.el10 baseos 215 k 2026-02-13T02:15:48.298 INFO:teuthology.orchestra.run.trial060.stdout: librabbitmq x86_64 0.14.0-3.el10 appstream 43 k 2026-02-13T02:15:48.298 INFO:teuthology.orchestra.run.trial060.stdout: libradosstriper1 x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 252 k 2026-02-13T02:15:48.298 INFO:teuthology.orchestra.run.trial060.stdout: librdkafka x86_64 2.1.1-7.el10 appstream 725 k 2026-02-13T02:15:48.299 INFO:teuthology.orchestra.run.trial060.stdout: librgw2 x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 6.7 M 2026-02-13T02:15:48.299 INFO:teuthology.orchestra.run.trial060.stdout: libstoragemgmt x86_64 1.10.1-4.el10 appstream 251 k 2026-02-13T02:15:48.299 INFO:teuthology.orchestra.run.trial060.stdout: libtool-ltdl x86_64 2.4.7-13.el10 appstream 36 k 2026-02-13T02:15:48.299 INFO:teuthology.orchestra.run.trial060.stdout: libunwind x86_64 1.8.0-4.el10_0 epel 73 k 2026-02-13T02:15:48.299 INFO:teuthology.orchestra.run.trial060.stdout: libxslt x86_64 1.1.39-8.el10_0 appstream 189 k 2026-02-13T02:15:48.299 INFO:teuthology.orchestra.run.trial060.stdout: libzstd-devel x86_64 1.5.5-9.el10 appstream 51 k 2026-02-13T02:15:48.299 INFO:teuthology.orchestra.run.trial060.stdout: lttng-ust x86_64 2.13.7-5.el10 crb 334 k 2026-02-13T02:15:48.299 INFO:teuthology.orchestra.run.trial060.stdout: lua x86_64 5.4.6-7.el10 appstream 190 k 2026-02-13T02:15:48.299 INFO:teuthology.orchestra.run.trial060.stdout: lua-devel x86_64 5.4.6-7.el10 crb 22 k 2026-02-13T02:15:48.299 INFO:teuthology.orchestra.run.trial060.stdout: luarocks noarch 3.9.2-6.el10_0 epel 152 k 2026-02-13T02:15:48.299 INFO:teuthology.orchestra.run.trial060.stdout: mailcap noarch 2.1.54-8.el10 baseos 34 k 2026-02-13T02:15:48.299 INFO:teuthology.orchestra.run.trial060.stdout: ndctl-libs x86_64 80-4.el10 baseos 89 k 2026-02-13T02:15:48.299 INFO:teuthology.orchestra.run.trial060.stdout: ocl-icd x86_64 2.3.2-8.el10 baseos 66 k 2026-02-13T02:15:48.300 INFO:teuthology.orchestra.run.trial060.stdout: openblas x86_64 0.3.29-2.el10 appstream 43 k 2026-02-13T02:15:48.300 INFO:teuthology.orchestra.run.trial060.stdout: openblas-openmp x86_64 0.3.29-2.el10 appstream 5.3 M 2026-02-13T02:15:48.300 INFO:teuthology.orchestra.run.trial060.stdout: parquet-libs x86_64 17.0.0-9.el10_2 epel 1.0 M 2026-02-13T02:15:48.300 INFO:teuthology.orchestra.run.trial060.stdout: pciutils x86_64 3.13.0-6.el10 baseos 122 k 2026-02-13T02:15:48.300 INFO:teuthology.orchestra.run.trial060.stdout: perl-Thread-Queue noarch 3.14-511.el10 appstream 21 k 2026-02-13T02:15:48.300 INFO:teuthology.orchestra.run.trial060.stdout: perl-threads x86_64 1:2.40-511.el10 appstream 58 k 2026-02-13T02:15:48.300 INFO:teuthology.orchestra.run.trial060.stdout: perl-threads-shared x86_64 1.69-511.el10 appstream 45 k 2026-02-13T02:15:48.300 INFO:teuthology.orchestra.run.trial060.stdout: postgresql-private-libs x86_64 16.11-1.el10_1 appstream 143 k 2026-02-13T02:15:48.300 INFO:teuthology.orchestra.run.trial060.stdout: protobuf x86_64 3.19.6-11.el10 appstream 1.0 M 2026-02-13T02:15:48.300 INFO:teuthology.orchestra.run.trial060.stdout: protobuf-compiler x86_64 3.19.6-11.el10 crb 787 k 2026-02-13T02:15:48.300 INFO:teuthology.orchestra.run.trial060.stdout: python3-asyncssh noarch 2.17.0-1.el10_0 epel 756 k 2026-02-13T02:15:48.300 INFO:teuthology.orchestra.run.trial060.stdout: python3-autocommand noarch 2.2.2-9.el10_0 epel 32 k 2026-02-13T02:15:48.300 INFO:teuthology.orchestra.run.trial060.stdout: python3-bcrypt x86_64 4.3.0-3.el10_1 epel 238 k 2026-02-13T02:15:48.301 INFO:teuthology.orchestra.run.trial060.stdout: python3-cachetools noarch 5.4.0-6.el10_0 epel 37 k 2026-02-13T02:15:48.301 INFO:teuthology.orchestra.run.trial060.stdout: python3-ceph-argparse x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 57 k 2026-02-13T02:15:48.301 INFO:teuthology.orchestra.run.trial060.stdout: python3-ceph-common x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 237 k 2026-02-13T02:15:48.301 INFO:teuthology.orchestra.run.trial060.stdout: python3-certifi noarch 2023.05.07-6.el10_0 epel 14 k 2026-02-13T02:15:48.301 INFO:teuthology.orchestra.run.trial060.stdout: python3-cffi x86_64 1.16.0-7.el10 baseos 310 k 2026-02-13T02:15:48.301 INFO:teuthology.orchestra.run.trial060.stdout: python3-cheroot noarch 10.0.1-4.el10_0 epel 215 k 2026-02-13T02:15:48.301 INFO:teuthology.orchestra.run.trial060.stdout: python3-cherrypy noarch 18.10.0-4.el10_0 epel 359 k 2026-02-13T02:15:48.301 INFO:teuthology.orchestra.run.trial060.stdout: python3-cmd2 noarch 2.5.8-1.el10_2 epel 375 k 2026-02-13T02:15:48.301 INFO:teuthology.orchestra.run.trial060.stdout: python3-colorama noarch 0.4.6-13.el10 appstream 74 k 2026-02-13T02:15:48.301 INFO:teuthology.orchestra.run.trial060.stdout: python3-cryptography x86_64 43.0.0-4.el10 baseos 1.3 M 2026-02-13T02:15:48.301 INFO:teuthology.orchestra.run.trial060.stdout: python3-devel x86_64 3.12.12-2.el10_1 appstream 329 k 2026-02-13T02:15:48.301 INFO:teuthology.orchestra.run.trial060.stdout: python3-durationpy noarch 0.9-2.el10_0 epel 15 k 2026-02-13T02:15:48.301 INFO:teuthology.orchestra.run.trial060.stdout: python3-google-auth noarch 1:2.40.3-1.el10_1 epel 286 k 2026-02-13T02:15:48.301 INFO:teuthology.orchestra.run.trial060.stdout: python3-grpcio x86_64 1.48.4-44.el10_0 epel 2.3 M 2026-02-13T02:15:48.302 INFO:teuthology.orchestra.run.trial060.stdout: python3-grpcio-tools x86_64 1.48.4-44.el10_0 epel 157 k 2026-02-13T02:15:48.302 INFO:teuthology.orchestra.run.trial060.stdout: python3-isodate noarch 0.6.1-14.el10_0 epel 66 k 2026-02-13T02:15:48.302 INFO:teuthology.orchestra.run.trial060.stdout: python3-jaraco-collections noarch 5.1.0-1.el10_0 epel 29 k 2026-02-13T02:15:48.302 INFO:teuthology.orchestra.run.trial060.stdout: python3-jaraco-context noarch 6.0.1-4.el10_0 epel 21 k 2026-02-13T02:15:48.302 INFO:teuthology.orchestra.run.trial060.stdout: python3-jaraco-functools noarch 4.0.2-4.el10_0 epel 23 k 2026-02-13T02:15:48.302 INFO:teuthology.orchestra.run.trial060.stdout: python3-jaraco-text noarch 4.0.0-3.el10_0 epel 29 k 2026-02-13T02:15:48.302 INFO:teuthology.orchestra.run.trial060.stdout: python3-jinja2 noarch 3.1.6-1.el10_0 appstream 330 k 2026-02-13T02:15:48.302 INFO:teuthology.orchestra.run.trial060.stdout: python3-jmespath noarch 1.0.1-8.el10 appstream 60 k 2026-02-13T02:15:48.302 INFO:teuthology.orchestra.run.trial060.stdout: python3-kubernetes noarch 1:32.0.1-1.el10_1 epel 1.3 M 2026-02-13T02:15:48.302 INFO:teuthology.orchestra.run.trial060.stdout: python3-libstoragemgmt x86_64 1.10.1-4.el10 appstream 219 k 2026-02-13T02:15:48.302 INFO:teuthology.orchestra.run.trial060.stdout: python3-lxml x86_64 5.2.1-4.el10 appstream 1.4 M 2026-02-13T02:15:48.302 INFO:teuthology.orchestra.run.trial060.stdout: python3-markupsafe x86_64 2.1.3-6.el10 appstream 34 k 2026-02-13T02:15:48.302 INFO:teuthology.orchestra.run.trial060.stdout: python3-more-itertools noarch 10.1.0-8.el10_0 epel 100 k 2026-02-13T02:15:48.303 INFO:teuthology.orchestra.run.trial060.stdout: python3-natsort noarch 8.4.0-2.el10_0 epel 72 k 2026-02-13T02:15:48.303 INFO:teuthology.orchestra.run.trial060.stdout: python3-numpy x86_64 1:1.26.4-5.el10 appstream 6.7 M 2026-02-13T02:15:48.303 INFO:teuthology.orchestra.run.trial060.stdout: python3-numpy-f2py x86_64 1:1.26.4-5.el10 appstream 490 k 2026-02-13T02:15:48.303 INFO:teuthology.orchestra.run.trial060.stdout: python3-packaging noarch 24.2-2.el10 baseos 155 k 2026-02-13T02:15:48.303 INFO:teuthology.orchestra.run.trial060.stdout: python3-ply noarch 3.11-25.el10 baseos 137 k 2026-02-13T02:15:48.303 INFO:teuthology.orchestra.run.trial060.stdout: python3-portend noarch 3.2.0-6.el10_0 epel 18 k 2026-02-13T02:15:48.303 INFO:teuthology.orchestra.run.trial060.stdout: python3-prettytable noarch 3.6.0-10.el10 appstream 70 k 2026-02-13T02:15:48.303 INFO:teuthology.orchestra.run.trial060.stdout: python3-protobuf x86_64 3.19.6-11.el10 appstream 419 k 2026-02-13T02:15:48.303 INFO:teuthology.orchestra.run.trial060.stdout: python3-pyOpenSSL noarch 25.0.0-1.el10_1 epel 113 k 2026-02-13T02:15:48.303 INFO:teuthology.orchestra.run.trial060.stdout: python3-pyasn1 noarch 0.6.1-1.el10 appstream 198 k 2026-02-13T02:15:48.303 INFO:teuthology.orchestra.run.trial060.stdout: python3-pyasn1-modules noarch 0.6.1-1.el10 appstream 402 k 2026-02-13T02:15:48.303 INFO:teuthology.orchestra.run.trial060.stdout: python3-pycparser noarch 2.20-16.el10 baseos 160 k 2026-02-13T02:15:48.303 INFO:teuthology.orchestra.run.trial060.stdout: python3-pyperclip noarch 1.8.2-1.el10_0 epel 28 k 2026-02-13T02:15:48.304 INFO:teuthology.orchestra.run.trial060.stdout: python3-repoze-lru noarch 0.7-23.el10_0 epel 36 k 2026-02-13T02:15:48.304 INFO:teuthology.orchestra.run.trial060.stdout: python3-requests noarch 2.32.4-1.el10_0 baseos 160 k 2026-02-13T02:15:48.304 INFO:teuthology.orchestra.run.trial060.stdout: python3-requests-oauthlib noarch 1.3.1-11.el10 appstream 60 k 2026-02-13T02:15:48.304 INFO:teuthology.orchestra.run.trial060.stdout: python3-routes noarch 2.5.1-11.el10_0 epel 201 k 2026-02-13T02:15:48.304 INFO:teuthology.orchestra.run.trial060.stdout: python3-rsa noarch 4.9-7.el10_0 epel 70 k 2026-02-13T02:15:48.304 INFO:teuthology.orchestra.run.trial060.stdout: python3-scipy x86_64 1.11.3-17.el10 appstream 16 M 2026-02-13T02:15:48.304 INFO:teuthology.orchestra.run.trial060.stdout: python3-tempora noarch 5.7.0-1.el10_0 epel 37 k 2026-02-13T02:15:48.304 INFO:teuthology.orchestra.run.trial060.stdout: python3-urllib3 noarch 1.26.19-2.el10_1.1 baseos 285 k 2026-02-13T02:15:48.304 INFO:teuthology.orchestra.run.trial060.stdout: python3-websocket-client noarch 1.8.0-2.el10_0 epel 124 k 2026-02-13T02:15:48.304 INFO:teuthology.orchestra.run.trial060.stdout: python3-xmlsec x86_64 1.3.16-1.el10 lab-extras 49 k 2026-02-13T02:15:48.304 INFO:teuthology.orchestra.run.trial060.stdout: python3-xmltodict noarch 0.13.0-5.el10_0 epel 26 k 2026-02-13T02:15:48.304 INFO:teuthology.orchestra.run.trial060.stdout: python3-zc-lockfile noarch 3.0.post1-11.el10_0 epel 23 k 2026-02-13T02:15:48.304 INFO:teuthology.orchestra.run.trial060.stdout: qatlib x86_64 24.09.0-2.el10 appstream 229 k 2026-02-13T02:15:48.305 INFO:teuthology.orchestra.run.trial060.stdout: qatzip-libs x86_64 1.3.1-1.el10 appstream 66 k 2026-02-13T02:15:48.305 INFO:teuthology.orchestra.run.trial060.stdout: re2 x86_64 2:20251105-1.el10_2 epel 221 k 2026-02-13T02:15:48.305 INFO:teuthology.orchestra.run.trial060.stdout: socat x86_64 1.7.4.4-8.el10 appstream 303 k 2026-02-13T02:15:48.305 INFO:teuthology.orchestra.run.trial060.stdout: thrift x86_64 0.20.0-4.el10_1 epel 1.7 M 2026-02-13T02:15:48.305 INFO:teuthology.orchestra.run.trial060.stdout: unzip x86_64 6.0-69.el10 baseos 188 k 2026-02-13T02:15:48.305 INFO:teuthology.orchestra.run.trial060.stdout: utf8proc x86_64 2.7.0-9.el10 appstream 80 k 2026-02-13T02:15:48.305 INFO:teuthology.orchestra.run.trial060.stdout: uuid x86_64 1.6.2-65.el10 appstream 59 k 2026-02-13T02:15:48.305 INFO:teuthology.orchestra.run.trial060.stdout: xmlsec1 x86_64 1:1.2.39-3.el10 appstream 193 k 2026-02-13T02:15:48.305 INFO:teuthology.orchestra.run.trial060.stdout: xmlsec1-openssl x86_64 1:1.2.39-3.el10 appstream 96 k 2026-02-13T02:15:48.305 INFO:teuthology.orchestra.run.trial060.stdout: xmlstarlet x86_64 1.6.1-27.el10 appstream 63 k 2026-02-13T02:15:48.305 INFO:teuthology.orchestra.run.trial060.stdout: yaml-cpp0.7 x86_64 0.7.0-1.el10_2 epel 127 k 2026-02-13T02:15:48.305 INFO:teuthology.orchestra.run.trial060.stdout: zip x86_64 3.0-45.el10 baseos 271 k 2026-02-13T02:15:48.305 INFO:teuthology.orchestra.run.trial060.stdout: zlib-ng-compat-devel x86_64 2.2.3-2.el10 appstream 38 k 2026-02-13T02:15:48.306 INFO:teuthology.orchestra.run.trial060.stdout:Installing weak dependencies: 2026-02-13T02:15:48.306 INFO:teuthology.orchestra.run.trial060.stdout: ceph-mgr-k8sevents noarch 2:20.3.0-5241.g8f8d3829.el10 ceph-noarch 22 k 2026-02-13T02:15:48.306 INFO:teuthology.orchestra.run.trial060.stdout: libcephfs-daemon x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 37 k 2026-02-13T02:15:48.306 INFO:teuthology.orchestra.run.trial060.stdout: python3-saml noarch 1.16.0-11.el10 lab-extras 150 k 2026-02-13T02:15:48.306 INFO:teuthology.orchestra.run.trial060.stdout: qatlib-service x86_64 24.09.0-2.el10 appstream 37 k 2026-02-13T02:15:48.306 INFO:teuthology.orchestra.run.trial060.stdout: 2026-02-13T02:15:48.306 INFO:teuthology.orchestra.run.trial060.stdout:Transaction Summary 2026-02-13T02:15:48.306 INFO:teuthology.orchestra.run.trial060.stdout:======================================================================================== 2026-02-13T02:15:48.306 INFO:teuthology.orchestra.run.trial060.stdout:Install 173 Packages 2026-02-13T02:15:48.306 INFO:teuthology.orchestra.run.trial060.stdout:Upgrade 12 Packages 2026-02-13T02:15:48.306 INFO:teuthology.orchestra.run.trial060.stdout: 2026-02-13T02:15:48.307 INFO:teuthology.orchestra.run.trial060.stdout:Total download size: 305 M 2026-02-13T02:15:48.307 INFO:teuthology.orchestra.run.trial060.stdout:Downloading Packages: 2026-02-13T02:15:48.359 INFO:teuthology.orchestra.run.trial078.stdout:Package librados2-2:18.2.1-4.el10.x86_64 is already installed. 2026-02-13T02:15:48.359 INFO:teuthology.orchestra.run.trial078.stdout:Package librbd1-2:18.2.1-4.el10.x86_64 is already installed. 2026-02-13T02:15:48.362 INFO:teuthology.orchestra.run.trial078.stdout:Package NetworkManager-1:1.54.0-2.el10_1.x86_64 is already installed. 2026-02-13T02:15:48.363 INFO:teuthology.orchestra.run.trial078.stdout:Package iproute-6.14.0-2.el10.x86_64 is already installed. 2026-02-13T02:15:48.364 INFO:teuthology.orchestra.run.trial078.stdout:Package util-linux-2.40.2-13.el10.x86_64 is already installed. 2026-02-13T02:15:48.364 INFO:teuthology.orchestra.run.trial078.stdout:Package libacl-devel-2.3.2-4.el10.x86_64 is already installed. 2026-02-13T02:15:48.364 INFO:teuthology.orchestra.run.trial078.stdout:Package libattr-devel-2.5.2-5.el10.x86_64 is already installed. 2026-02-13T02:15:48.365 INFO:teuthology.orchestra.run.trial078.stdout:Package xfsdump-3.2.0-1.el10.x86_64 is already installed. 2026-02-13T02:15:48.365 INFO:teuthology.orchestra.run.trial078.stdout:Package xfsprogs-6.11.0-2.el10.x86_64 is already installed. 2026-02-13T02:15:48.381 INFO:teuthology.orchestra.run.trial078.stdout:Dependencies resolved. 2026-02-13T02:15:48.388 INFO:teuthology.orchestra.run.trial078.stdout:======================================================================================== 2026-02-13T02:15:48.389 INFO:teuthology.orchestra.run.trial078.stdout: Package Arch Version Repository Size 2026-02-13T02:15:48.389 INFO:teuthology.orchestra.run.trial078.stdout:======================================================================================== 2026-02-13T02:15:48.389 INFO:teuthology.orchestra.run.trial078.stdout:Installing: 2026-02-13T02:15:48.389 INFO:teuthology.orchestra.run.trial078.stdout: bison x86_64 3.8.2-9.el10 appstream 1.0 M 2026-02-13T02:15:48.389 INFO:teuthology.orchestra.run.trial078.stdout: ceph x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 6.6 k 2026-02-13T02:15:48.389 INFO:teuthology.orchestra.run.trial078.stdout: ceph-base x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 5.4 M 2026-02-13T02:15:48.389 INFO:teuthology.orchestra.run.trial078.stdout: ceph-fuse x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 1.1 M 2026-02-13T02:15:48.389 INFO:teuthology.orchestra.run.trial078.stdout: ceph-immutable-object-cache x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 151 k 2026-02-13T02:15:48.389 INFO:teuthology.orchestra.run.trial078.stdout: ceph-mgr x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 984 k 2026-02-13T02:15:48.389 INFO:teuthology.orchestra.run.trial078.stdout: ceph-mgr-cephadm noarch 2:20.3.0-5241.g8f8d3829.el10 ceph-noarch 183 k 2026-02-13T02:15:48.389 INFO:teuthology.orchestra.run.trial078.stdout: ceph-mgr-dashboard noarch 2:20.3.0-5241.g8f8d3829.el10 ceph-noarch 15 M 2026-02-13T02:15:48.389 INFO:teuthology.orchestra.run.trial078.stdout: ceph-mgr-diskprediction-local noarch 2:20.3.0-5241.g8f8d3829.el10 ceph-noarch 7.4 M 2026-02-13T02:15:48.389 INFO:teuthology.orchestra.run.trial078.stdout: ceph-mgr-rook noarch 2:20.3.0-5241.g8f8d3829.el10 ceph-noarch 50 k 2026-02-13T02:15:48.390 INFO:teuthology.orchestra.run.trial078.stdout: ceph-osd x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 176 k 2026-02-13T02:15:48.390 INFO:teuthology.orchestra.run.trial078.stdout: ceph-osd-classic x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 17 M 2026-02-13T02:15:48.390 INFO:teuthology.orchestra.run.trial078.stdout: ceph-radosgw x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 14 M 2026-02-13T02:15:48.390 INFO:teuthology.orchestra.run.trial078.stdout: ceph-test x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 81 M 2026-02-13T02:15:48.390 INFO:teuthology.orchestra.run.trial078.stdout: ceph-volume noarch 2:20.3.0-5241.g8f8d3829.el10 ceph-noarch 374 k 2026-02-13T02:15:48.390 INFO:teuthology.orchestra.run.trial078.stdout: cephadm noarch 2:20.3.0-5241.g8f8d3829.el10 ceph-noarch 1.3 M 2026-02-13T02:15:48.390 INFO:teuthology.orchestra.run.trial078.stdout: cephfs-mirror x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 252 k 2026-02-13T02:15:48.390 INFO:teuthology.orchestra.run.trial078.stdout: cephfs-shell x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 27 k 2026-02-13T02:15:48.390 INFO:teuthology.orchestra.run.trial078.stdout: cephfs-top noarch 2:20.3.0-5241.g8f8d3829.el10 ceph-noarch 18 k 2026-02-13T02:15:48.390 INFO:teuthology.orchestra.run.trial078.stdout: elfutils-libelf-devel x86_64 0.193-1.el10.rocky.0.1 appstream 48 k 2026-02-13T02:15:48.390 INFO:teuthology.orchestra.run.trial078.stdout: flex x86_64 2.6.4-19.el10 appstream 300 k 2026-02-13T02:15:48.390 INFO:teuthology.orchestra.run.trial078.stdout: libaio-devel x86_64 0.3.111-22.el10 appstream 10 k 2026-02-13T02:15:48.391 INFO:teuthology.orchestra.run.trial078.stdout: libcephfs-devel x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 37 k 2026-02-13T02:15:48.391 INFO:teuthology.orchestra.run.trial078.stdout: libcephfs2 x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 937 k 2026-02-13T02:15:48.391 INFO:teuthology.orchestra.run.trial078.stdout: librados-devel x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 128 k 2026-02-13T02:15:48.391 INFO:teuthology.orchestra.run.trial078.stdout: libtool x86_64 2.4.7-13.el10 appstream 601 k 2026-02-13T02:15:48.391 INFO:teuthology.orchestra.run.trial078.stdout: libuuid-devel x86_64 2.40.2-15.el10_1 appstream 37 k 2026-02-13T02:15:48.391 INFO:teuthology.orchestra.run.trial078.stdout: openssl-devel x86_64 1:3.5.1-7.el10_1 appstream 3.0 M 2026-02-13T02:15:48.391 INFO:teuthology.orchestra.run.trial078.stdout: postgresql x86_64 16.11-1.el10_1 appstream 2.0 M 2026-02-13T02:15:48.391 INFO:teuthology.orchestra.run.trial078.stdout: postgresql-contrib x86_64 16.11-1.el10_1 appstream 1.0 M 2026-02-13T02:15:48.391 INFO:teuthology.orchestra.run.trial078.stdout: postgresql-server x86_64 16.11-1.el10_1 appstream 7.0 M 2026-02-13T02:15:48.391 INFO:teuthology.orchestra.run.trial078.stdout: python3-cephfs x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 253 k 2026-02-13T02:15:48.391 INFO:teuthology.orchestra.run.trial078.stdout: python3-rados x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 352 k 2026-02-13T02:15:48.391 INFO:teuthology.orchestra.run.trial078.stdout: python3-rbd x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 372 k 2026-02-13T02:15:48.391 INFO:teuthology.orchestra.run.trial078.stdout: python3-rgw x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 130 k 2026-02-13T02:15:48.392 INFO:teuthology.orchestra.run.trial078.stdout: rbd-fuse x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 87 k 2026-02-13T02:15:48.392 INFO:teuthology.orchestra.run.trial078.stdout: rbd-mirror x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 2.9 M 2026-02-13T02:15:48.392 INFO:teuthology.orchestra.run.trial078.stdout: rbd-nbd x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 180 k 2026-02-13T02:15:48.392 INFO:teuthology.orchestra.run.trial078.stdout: xfsprogs-devel x86_64 6.11.0-2.el10 appstream 105 k 2026-02-13T02:15:48.392 INFO:teuthology.orchestra.run.trial078.stdout:Upgrading: 2026-02-13T02:15:48.392 INFO:teuthology.orchestra.run.trial078.stdout: libblkid x86_64 2.40.2-15.el10_1 baseos 124 k 2026-02-13T02:15:48.392 INFO:teuthology.orchestra.run.trial078.stdout: libfdisk x86_64 2.40.2-15.el10_1 baseos 159 k 2026-02-13T02:15:48.392 INFO:teuthology.orchestra.run.trial078.stdout: libmount x86_64 2.40.2-15.el10_1 baseos 154 k 2026-02-13T02:15:48.392 INFO:teuthology.orchestra.run.trial078.stdout: librados2 x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 3.6 M 2026-02-13T02:15:48.392 INFO:teuthology.orchestra.run.trial078.stdout: librbd1 x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 2.8 M 2026-02-13T02:15:48.392 INFO:teuthology.orchestra.run.trial078.stdout: libsmartcols x86_64 2.40.2-15.el10_1 baseos 83 k 2026-02-13T02:15:48.392 INFO:teuthology.orchestra.run.trial078.stdout: libuuid x86_64 2.40.2-15.el10_1 baseos 28 k 2026-02-13T02:15:48.392 INFO:teuthology.orchestra.run.trial078.stdout: openssl x86_64 1:3.5.1-7.el10_1 baseos 1.2 M 2026-02-13T02:15:48.393 INFO:teuthology.orchestra.run.trial078.stdout: openssl-fips-provider x86_64 1:3.5.1-7.el10_1 baseos 812 k 2026-02-13T02:15:48.393 INFO:teuthology.orchestra.run.trial078.stdout: openssl-libs x86_64 1:3.5.1-7.el10_1 baseos 2.2 M 2026-02-13T02:15:48.393 INFO:teuthology.orchestra.run.trial078.stdout: util-linux x86_64 2.40.2-15.el10_1 baseos 1.2 M 2026-02-13T02:15:48.393 INFO:teuthology.orchestra.run.trial078.stdout: util-linux-core x86_64 2.40.2-15.el10_1 baseos 542 k 2026-02-13T02:15:48.393 INFO:teuthology.orchestra.run.trial078.stdout:Installing dependencies: 2026-02-13T02:15:48.393 INFO:teuthology.orchestra.run.trial078.stdout: abseil-cpp x86_64 20240722.1-1.el10_0 epel 590 k 2026-02-13T02:15:48.393 INFO:teuthology.orchestra.run.trial078.stdout: automake noarch 1.16.5-20.el10 appstream 704 k 2026-02-13T02:15:48.393 INFO:teuthology.orchestra.run.trial078.stdout: boost-program-options x86_64 1.83.0-5.el10 appstream 109 k 2026-02-13T02:15:48.393 INFO:teuthology.orchestra.run.trial078.stdout: ceph-common x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 25 M 2026-02-13T02:15:48.393 INFO:teuthology.orchestra.run.trial078.stdout: ceph-grafana-dashboards noarch 2:20.3.0-5241.g8f8d3829.el10 ceph-noarch 57 k 2026-02-13T02:15:48.393 INFO:teuthology.orchestra.run.trial078.stdout: ceph-mds x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 2.4 M 2026-02-13T02:15:48.393 INFO:teuthology.orchestra.run.trial078.stdout: ceph-mgr-modules-core noarch 2:20.3.0-5241.g8f8d3829.el10 ceph-noarch 297 k 2026-02-13T02:15:48.393 INFO:teuthology.orchestra.run.trial078.stdout: ceph-mon x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 6.0 M 2026-02-13T02:15:48.393 INFO:teuthology.orchestra.run.trial078.stdout: ceph-osd-crimson x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 20 M 2026-02-13T02:15:48.394 INFO:teuthology.orchestra.run.trial078.stdout: ceph-prometheus-alerts noarch 2:20.3.0-5241.g8f8d3829.el10 ceph-noarch 17 k 2026-02-13T02:15:48.394 INFO:teuthology.orchestra.run.trial078.stdout: ceph-selinux x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 25 k 2026-02-13T02:15:48.394 INFO:teuthology.orchestra.run.trial078.stdout: cmake-filesystem x86_64 3.30.5-3.el10_0 appstream 15 k 2026-02-13T02:15:48.394 INFO:teuthology.orchestra.run.trial078.stdout: cryptsetup x86_64 2.7.5-2.el10 baseos 335 k 2026-02-13T02:15:48.394 INFO:teuthology.orchestra.run.trial078.stdout: daxctl-libs x86_64 80-4.el10 baseos 42 k 2026-02-13T02:15:48.394 INFO:teuthology.orchestra.run.trial078.stdout: flexiblas x86_64 3.4.2-3.el10 appstream 25 k 2026-02-13T02:15:48.394 INFO:teuthology.orchestra.run.trial078.stdout: flexiblas-netlib x86_64 3.4.2-3.el10 appstream 3.2 M 2026-02-13T02:15:48.394 INFO:teuthology.orchestra.run.trial078.stdout: flexiblas-openblas-openmp x86_64 3.4.2-3.el10 appstream 17 k 2026-02-13T02:15:48.394 INFO:teuthology.orchestra.run.trial078.stdout: fuse3 x86_64 3.16.2-5.el10 baseos 58 k 2026-02-13T02:15:48.394 INFO:teuthology.orchestra.run.trial078.stdout: gperftools-libs x86_64 2.15-4.el10_0 epel 303 k 2026-02-13T02:15:48.394 INFO:teuthology.orchestra.run.trial078.stdout: grpc-data noarch 1.48.4-44.el10_0 epel 21 k 2026-02-13T02:15:48.394 INFO:teuthology.orchestra.run.trial078.stdout: hwloc-libs x86_64 2.11.1-3.el10 baseos 2.1 M 2026-02-13T02:15:48.394 INFO:teuthology.orchestra.run.trial078.stdout: ledmon-libs x86_64 1.1.0-2.el10 appstream 42 k 2026-02-13T02:15:48.394 INFO:teuthology.orchestra.run.trial078.stdout: libarrow x86_64 17.0.0-9.el10_2 epel 5.7 M 2026-02-13T02:15:48.394 INFO:teuthology.orchestra.run.trial078.stdout: libarrow-doc noarch 17.0.0-9.el10_2 epel 27 k 2026-02-13T02:15:48.395 INFO:teuthology.orchestra.run.trial078.stdout: libcephfs-proxy2 x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 25 k 2026-02-13T02:15:48.395 INFO:teuthology.orchestra.run.trial078.stdout: libcephsqlite x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 168 k 2026-02-13T02:15:48.395 INFO:teuthology.orchestra.run.trial078.stdout: libconfig x86_64 1.7.3-10.el10 baseos 72 k 2026-02-13T02:15:48.395 INFO:teuthology.orchestra.run.trial078.stdout: libgfortran x86_64 14.3.1-2.1.el10 baseos 827 k 2026-02-13T02:15:48.395 INFO:teuthology.orchestra.run.trial078.stdout: libnbd x86_64 1.22.2-3.el10_1 appstream 175 k 2026-02-13T02:15:48.395 INFO:teuthology.orchestra.run.trial078.stdout: liboath x86_64 2.6.12-1.el10_0 epel 48 k 2026-02-13T02:15:48.395 INFO:teuthology.orchestra.run.trial078.stdout: liborc2 x86_64 2.0.7-1.el10_2 epel 515 k 2026-02-13T02:15:48.395 INFO:teuthology.orchestra.run.trial078.stdout: libpciaccess x86_64 0.16-16.el10 baseos 27 k 2026-02-13T02:15:48.395 INFO:teuthology.orchestra.run.trial078.stdout: libpmem x86_64 2.1.0-2.el10_0 epel 112 k 2026-02-13T02:15:48.395 INFO:teuthology.orchestra.run.trial078.stdout: libpmemobj x86_64 2.1.0-2.el10_0 epel 161 k 2026-02-13T02:15:48.395 INFO:teuthology.orchestra.run.trial078.stdout: libquadmath x86_64 14.3.1-2.1.el10 baseos 215 k 2026-02-13T02:15:48.395 INFO:teuthology.orchestra.run.trial078.stdout: librabbitmq x86_64 0.14.0-3.el10 appstream 43 k 2026-02-13T02:15:48.395 INFO:teuthology.orchestra.run.trial078.stdout: libradosstriper1 x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 252 k 2026-02-13T02:15:48.395 INFO:teuthology.orchestra.run.trial078.stdout: librdkafka x86_64 2.1.1-7.el10 appstream 725 k 2026-02-13T02:15:48.396 INFO:teuthology.orchestra.run.trial078.stdout: librgw2 x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 6.7 M 2026-02-13T02:15:48.396 INFO:teuthology.orchestra.run.trial078.stdout: libstoragemgmt x86_64 1.10.1-4.el10 appstream 251 k 2026-02-13T02:15:48.396 INFO:teuthology.orchestra.run.trial078.stdout: libtool-ltdl x86_64 2.4.7-13.el10 appstream 36 k 2026-02-13T02:15:48.396 INFO:teuthology.orchestra.run.trial078.stdout: libunwind x86_64 1.8.0-4.el10_0 epel 73 k 2026-02-13T02:15:48.396 INFO:teuthology.orchestra.run.trial078.stdout: libxslt x86_64 1.1.39-8.el10_0 appstream 189 k 2026-02-13T02:15:48.396 INFO:teuthology.orchestra.run.trial078.stdout: libzstd-devel x86_64 1.5.5-9.el10 appstream 51 k 2026-02-13T02:15:48.396 INFO:teuthology.orchestra.run.trial078.stdout: lttng-ust x86_64 2.13.7-5.el10 crb 334 k 2026-02-13T02:15:48.396 INFO:teuthology.orchestra.run.trial078.stdout: lua x86_64 5.4.6-7.el10 appstream 190 k 2026-02-13T02:15:48.396 INFO:teuthology.orchestra.run.trial078.stdout: lua-devel x86_64 5.4.6-7.el10 crb 22 k 2026-02-13T02:15:48.396 INFO:teuthology.orchestra.run.trial078.stdout: luarocks noarch 3.9.2-6.el10_0 epel 152 k 2026-02-13T02:15:48.396 INFO:teuthology.orchestra.run.trial078.stdout: mailcap noarch 2.1.54-8.el10 baseos 34 k 2026-02-13T02:15:48.396 INFO:teuthology.orchestra.run.trial078.stdout: ndctl-libs x86_64 80-4.el10 baseos 89 k 2026-02-13T02:15:48.396 INFO:teuthology.orchestra.run.trial078.stdout: ocl-icd x86_64 2.3.2-8.el10 baseos 66 k 2026-02-13T02:15:48.396 INFO:teuthology.orchestra.run.trial078.stdout: openblas x86_64 0.3.29-2.el10 appstream 43 k 2026-02-13T02:15:48.397 INFO:teuthology.orchestra.run.trial078.stdout: openblas-openmp x86_64 0.3.29-2.el10 appstream 5.3 M 2026-02-13T02:15:48.397 INFO:teuthology.orchestra.run.trial078.stdout: parquet-libs x86_64 17.0.0-9.el10_2 epel 1.0 M 2026-02-13T02:15:48.397 INFO:teuthology.orchestra.run.trial078.stdout: pciutils x86_64 3.13.0-6.el10 baseos 122 k 2026-02-13T02:15:48.397 INFO:teuthology.orchestra.run.trial078.stdout: perl-Thread-Queue noarch 3.14-511.el10 appstream 21 k 2026-02-13T02:15:48.397 INFO:teuthology.orchestra.run.trial078.stdout: perl-threads x86_64 1:2.40-511.el10 appstream 58 k 2026-02-13T02:15:48.397 INFO:teuthology.orchestra.run.trial078.stdout: perl-threads-shared x86_64 1.69-511.el10 appstream 45 k 2026-02-13T02:15:48.397 INFO:teuthology.orchestra.run.trial078.stdout: postgresql-private-libs x86_64 16.11-1.el10_1 appstream 143 k 2026-02-13T02:15:48.397 INFO:teuthology.orchestra.run.trial078.stdout: protobuf x86_64 3.19.6-11.el10 appstream 1.0 M 2026-02-13T02:15:48.397 INFO:teuthology.orchestra.run.trial078.stdout: protobuf-compiler x86_64 3.19.6-11.el10 crb 787 k 2026-02-13T02:15:48.397 INFO:teuthology.orchestra.run.trial078.stdout: python3-asyncssh noarch 2.17.0-1.el10_0 epel 756 k 2026-02-13T02:15:48.397 INFO:teuthology.orchestra.run.trial078.stdout: python3-autocommand noarch 2.2.2-9.el10_0 epel 32 k 2026-02-13T02:15:48.397 INFO:teuthology.orchestra.run.trial078.stdout: python3-bcrypt x86_64 4.3.0-3.el10_1 epel 238 k 2026-02-13T02:15:48.397 INFO:teuthology.orchestra.run.trial078.stdout: python3-cachetools noarch 5.4.0-6.el10_0 epel 37 k 2026-02-13T02:15:48.397 INFO:teuthology.orchestra.run.trial078.stdout: python3-ceph-argparse x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 57 k 2026-02-13T02:15:48.397 INFO:teuthology.orchestra.run.trial078.stdout: python3-ceph-common x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 237 k 2026-02-13T02:15:48.398 INFO:teuthology.orchestra.run.trial078.stdout: python3-certifi noarch 2023.05.07-6.el10_0 epel 14 k 2026-02-13T02:15:48.398 INFO:teuthology.orchestra.run.trial078.stdout: python3-cffi x86_64 1.16.0-7.el10 baseos 310 k 2026-02-13T02:15:48.398 INFO:teuthology.orchestra.run.trial078.stdout: python3-cheroot noarch 10.0.1-4.el10_0 epel 215 k 2026-02-13T02:15:48.398 INFO:teuthology.orchestra.run.trial078.stdout: python3-cherrypy noarch 18.10.0-4.el10_0 epel 359 k 2026-02-13T02:15:48.398 INFO:teuthology.orchestra.run.trial078.stdout: python3-cmd2 noarch 2.5.8-1.el10_2 epel 375 k 2026-02-13T02:15:48.398 INFO:teuthology.orchestra.run.trial078.stdout: python3-colorama noarch 0.4.6-13.el10 appstream 74 k 2026-02-13T02:15:48.398 INFO:teuthology.orchestra.run.trial078.stdout: python3-cryptography x86_64 43.0.0-4.el10 baseos 1.3 M 2026-02-13T02:15:48.398 INFO:teuthology.orchestra.run.trial078.stdout: python3-devel x86_64 3.12.12-2.el10_1 appstream 329 k 2026-02-13T02:15:48.398 INFO:teuthology.orchestra.run.trial078.stdout: python3-durationpy noarch 0.9-2.el10_0 epel 15 k 2026-02-13T02:15:48.398 INFO:teuthology.orchestra.run.trial078.stdout: python3-google-auth noarch 1:2.40.3-1.el10_1 epel 286 k 2026-02-13T02:15:48.398 INFO:teuthology.orchestra.run.trial078.stdout: python3-grpcio x86_64 1.48.4-44.el10_0 epel 2.3 M 2026-02-13T02:15:48.398 INFO:teuthology.orchestra.run.trial078.stdout: python3-grpcio-tools x86_64 1.48.4-44.el10_0 epel 157 k 2026-02-13T02:15:48.398 INFO:teuthology.orchestra.run.trial078.stdout: python3-isodate noarch 0.6.1-14.el10_0 epel 66 k 2026-02-13T02:15:48.398 INFO:teuthology.orchestra.run.trial078.stdout: python3-jaraco-collections noarch 5.1.0-1.el10_0 epel 29 k 2026-02-13T02:15:48.398 INFO:teuthology.orchestra.run.trial078.stdout: python3-jaraco-context noarch 6.0.1-4.el10_0 epel 21 k 2026-02-13T02:15:48.399 INFO:teuthology.orchestra.run.trial078.stdout: python3-jaraco-functools noarch 4.0.2-4.el10_0 epel 23 k 2026-02-13T02:15:48.399 INFO:teuthology.orchestra.run.trial078.stdout: python3-jaraco-text noarch 4.0.0-3.el10_0 epel 29 k 2026-02-13T02:15:48.399 INFO:teuthology.orchestra.run.trial078.stdout: python3-jinja2 noarch 3.1.6-1.el10_0 appstream 330 k 2026-02-13T02:15:48.399 INFO:teuthology.orchestra.run.trial078.stdout: python3-jmespath noarch 1.0.1-8.el10 appstream 60 k 2026-02-13T02:15:48.399 INFO:teuthology.orchestra.run.trial078.stdout: python3-kubernetes noarch 1:32.0.1-1.el10_1 epel 1.3 M 2026-02-13T02:15:48.399 INFO:teuthology.orchestra.run.trial078.stdout: python3-libstoragemgmt x86_64 1.10.1-4.el10 appstream 219 k 2026-02-13T02:15:48.399 INFO:teuthology.orchestra.run.trial078.stdout: python3-lxml x86_64 5.2.1-4.el10 appstream 1.4 M 2026-02-13T02:15:48.399 INFO:teuthology.orchestra.run.trial078.stdout: python3-markupsafe x86_64 2.1.3-6.el10 appstream 34 k 2026-02-13T02:15:48.399 INFO:teuthology.orchestra.run.trial078.stdout: python3-more-itertools noarch 10.1.0-8.el10_0 epel 100 k 2026-02-13T02:15:48.399 INFO:teuthology.orchestra.run.trial078.stdout: python3-natsort noarch 8.4.0-2.el10_0 epel 72 k 2026-02-13T02:15:48.399 INFO:teuthology.orchestra.run.trial078.stdout: python3-numpy x86_64 1:1.26.4-5.el10 appstream 6.7 M 2026-02-13T02:15:48.399 INFO:teuthology.orchestra.run.trial078.stdout: python3-numpy-f2py x86_64 1:1.26.4-5.el10 appstream 490 k 2026-02-13T02:15:48.399 INFO:teuthology.orchestra.run.trial078.stdout: python3-packaging noarch 24.2-2.el10 baseos 155 k 2026-02-13T02:15:48.399 INFO:teuthology.orchestra.run.trial078.stdout: python3-ply noarch 3.11-25.el10 baseos 137 k 2026-02-13T02:15:48.399 INFO:teuthology.orchestra.run.trial078.stdout: python3-portend noarch 3.2.0-6.el10_0 epel 18 k 2026-02-13T02:15:48.399 INFO:teuthology.orchestra.run.trial078.stdout: python3-prettytable noarch 3.6.0-10.el10 appstream 70 k 2026-02-13T02:15:48.400 INFO:teuthology.orchestra.run.trial078.stdout: python3-protobuf x86_64 3.19.6-11.el10 appstream 419 k 2026-02-13T02:15:48.400 INFO:teuthology.orchestra.run.trial078.stdout: python3-pyOpenSSL noarch 25.0.0-1.el10_1 epel 113 k 2026-02-13T02:15:48.400 INFO:teuthology.orchestra.run.trial078.stdout: python3-pyasn1 noarch 0.6.1-1.el10 appstream 198 k 2026-02-13T02:15:48.400 INFO:teuthology.orchestra.run.trial078.stdout: python3-pyasn1-modules noarch 0.6.1-1.el10 appstream 402 k 2026-02-13T02:15:48.400 INFO:teuthology.orchestra.run.trial078.stdout: python3-pycparser noarch 2.20-16.el10 baseos 160 k 2026-02-13T02:15:48.400 INFO:teuthology.orchestra.run.trial078.stdout: python3-pyperclip noarch 1.8.2-1.el10_0 epel 28 k 2026-02-13T02:15:48.400 INFO:teuthology.orchestra.run.trial078.stdout: python3-repoze-lru noarch 0.7-23.el10_0 epel 36 k 2026-02-13T02:15:48.400 INFO:teuthology.orchestra.run.trial078.stdout: python3-requests noarch 2.32.4-1.el10_0 baseos 160 k 2026-02-13T02:15:48.400 INFO:teuthology.orchestra.run.trial078.stdout: python3-requests-oauthlib noarch 1.3.1-11.el10 appstream 60 k 2026-02-13T02:15:48.400 INFO:teuthology.orchestra.run.trial078.stdout: python3-routes noarch 2.5.1-11.el10_0 epel 201 k 2026-02-13T02:15:48.400 INFO:teuthology.orchestra.run.trial078.stdout: python3-rsa noarch 4.9-7.el10_0 epel 70 k 2026-02-13T02:15:48.400 INFO:teuthology.orchestra.run.trial078.stdout: python3-scipy x86_64 1.11.3-17.el10 appstream 16 M 2026-02-13T02:15:48.400 INFO:teuthology.orchestra.run.trial078.stdout: python3-tempora noarch 5.7.0-1.el10_0 epel 37 k 2026-02-13T02:15:48.400 INFO:teuthology.orchestra.run.trial078.stdout: python3-urllib3 noarch 1.26.19-2.el10_1.1 baseos 285 k 2026-02-13T02:15:48.400 INFO:teuthology.orchestra.run.trial078.stdout: python3-websocket-client noarch 1.8.0-2.el10_0 epel 124 k 2026-02-13T02:15:48.401 INFO:teuthology.orchestra.run.trial078.stdout: python3-xmlsec x86_64 1.3.16-1.el10 lab-extras 49 k 2026-02-13T02:15:48.401 INFO:teuthology.orchestra.run.trial078.stdout: python3-xmltodict noarch 0.13.0-5.el10_0 epel 26 k 2026-02-13T02:15:48.401 INFO:teuthology.orchestra.run.trial078.stdout: python3-zc-lockfile noarch 3.0.post1-11.el10_0 epel 23 k 2026-02-13T02:15:48.401 INFO:teuthology.orchestra.run.trial078.stdout: qatlib x86_64 24.09.0-2.el10 appstream 229 k 2026-02-13T02:15:48.401 INFO:teuthology.orchestra.run.trial078.stdout: qatzip-libs x86_64 1.3.1-1.el10 appstream 66 k 2026-02-13T02:15:48.401 INFO:teuthology.orchestra.run.trial078.stdout: re2 x86_64 2:20251105-1.el10_2 epel 221 k 2026-02-13T02:15:48.401 INFO:teuthology.orchestra.run.trial078.stdout: socat x86_64 1.7.4.4-8.el10 appstream 303 k 2026-02-13T02:15:48.401 INFO:teuthology.orchestra.run.trial078.stdout: thrift x86_64 0.20.0-4.el10_1 epel 1.7 M 2026-02-13T02:15:48.401 INFO:teuthology.orchestra.run.trial078.stdout: unzip x86_64 6.0-69.el10 baseos 188 k 2026-02-13T02:15:48.401 INFO:teuthology.orchestra.run.trial078.stdout: utf8proc x86_64 2.7.0-9.el10 appstream 80 k 2026-02-13T02:15:48.401 INFO:teuthology.orchestra.run.trial078.stdout: uuid x86_64 1.6.2-65.el10 appstream 59 k 2026-02-13T02:15:48.401 INFO:teuthology.orchestra.run.trial078.stdout: xmlsec1 x86_64 1:1.2.39-3.el10 appstream 193 k 2026-02-13T02:15:48.401 INFO:teuthology.orchestra.run.trial078.stdout: xmlsec1-openssl x86_64 1:1.2.39-3.el10 appstream 96 k 2026-02-13T02:15:48.401 INFO:teuthology.orchestra.run.trial078.stdout: xmlstarlet x86_64 1.6.1-27.el10 appstream 63 k 2026-02-13T02:15:48.401 INFO:teuthology.orchestra.run.trial078.stdout: yaml-cpp0.7 x86_64 0.7.0-1.el10_2 epel 127 k 2026-02-13T02:15:48.401 INFO:teuthology.orchestra.run.trial078.stdout: zip x86_64 3.0-45.el10 baseos 271 k 2026-02-13T02:15:48.402 INFO:teuthology.orchestra.run.trial078.stdout: zlib-ng-compat-devel x86_64 2.2.3-2.el10 appstream 38 k 2026-02-13T02:15:48.402 INFO:teuthology.orchestra.run.trial078.stdout:Installing weak dependencies: 2026-02-13T02:15:48.402 INFO:teuthology.orchestra.run.trial078.stdout: ceph-mgr-k8sevents noarch 2:20.3.0-5241.g8f8d3829.el10 ceph-noarch 22 k 2026-02-13T02:15:48.402 INFO:teuthology.orchestra.run.trial078.stdout: libcephfs-daemon x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 37 k 2026-02-13T02:15:48.402 INFO:teuthology.orchestra.run.trial078.stdout: python3-saml noarch 1.16.0-11.el10 lab-extras 150 k 2026-02-13T02:15:48.402 INFO:teuthology.orchestra.run.trial078.stdout: qatlib-service x86_64 24.09.0-2.el10 appstream 37 k 2026-02-13T02:15:48.402 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:15:48.402 INFO:teuthology.orchestra.run.trial078.stdout:Transaction Summary 2026-02-13T02:15:48.402 INFO:teuthology.orchestra.run.trial078.stdout:======================================================================================== 2026-02-13T02:15:48.402 INFO:teuthology.orchestra.run.trial078.stdout:Install 173 Packages 2026-02-13T02:15:48.402 INFO:teuthology.orchestra.run.trial078.stdout:Upgrade 12 Packages 2026-02-13T02:15:48.402 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:15:48.403 INFO:teuthology.orchestra.run.trial078.stdout:Total download size: 305 M 2026-02-13T02:15:48.403 INFO:teuthology.orchestra.run.trial078.stdout:Downloading Packages: 2026-02-13T02:15:48.507 INFO:teuthology.orchestra.run.trial060.stdout:(1/185): ceph-20.3.0-5241.g8f8d3829.el10.x86_64 104 kB/s | 6.6 kB 00:00 2026-02-13T02:15:48.641 INFO:teuthology.orchestra.run.trial060.stdout:(2/185): ceph-fuse-20.3.0-5241.g8f8d3829.el10.x 7.8 MB/s | 1.1 MB 00:00 2026-02-13T02:15:48.646 INFO:teuthology.orchestra.run.trial078.stdout:(1/185): ceph-20.3.0-5241.g8f8d3829.el10.x86_64 62 kB/s | 6.6 kB 00:00 2026-02-13T02:15:48.687 INFO:teuthology.orchestra.run.trial060.stdout:(3/185): ceph-immutable-object-cache-20.3.0-524 3.2 MB/s | 151 kB 00:00 2026-02-13T02:15:48.716 INFO:teuthology.orchestra.run.trial011.stdout:lab-extras 294 kB/s | 3.7 kB 00:00 2026-02-13T02:15:48.791 INFO:teuthology.orchestra.run.trial060.stdout:(4/185): ceph-base-20.3.0-5241.g8f8d3829.el10.x 15 MB/s | 5.4 MB 00:00 2026-02-13T02:15:48.853 INFO:teuthology.orchestra.run.trial060.stdout:(5/185): ceph-mgr-20.3.0-5241.g8f8d3829.el10.x8 16 MB/s | 984 kB 00:00 2026-02-13T02:15:48.958 INFO:teuthology.orchestra.run.trial060.stdout:(6/185): ceph-mds-20.3.0-5241.g8f8d3829.el10.x8 9.0 MB/s | 2.4 MB 00:00 2026-02-13T02:15:49.022 INFO:teuthology.orchestra.run.trial060.stdout:(7/185): ceph-osd-20.3.0-5241.g8f8d3829.el10.x8 2.7 MB/s | 176 kB 00:00 2026-02-13T02:15:49.214 INFO:teuthology.orchestra.run.trial060.stdout:(8/185): ceph-mon-20.3.0-5241.g8f8d3829.el10.x8 17 MB/s | 6.0 MB 00:00 2026-02-13T02:15:49.225 INFO:teuthology.orchestra.run.trial011.stdout:Package librados2-2:18.2.1-4.el10.x86_64 is already installed. 2026-02-13T02:15:49.226 INFO:teuthology.orchestra.run.trial011.stdout:Package librbd1-2:18.2.1-4.el10.x86_64 is already installed. 2026-02-13T02:15:49.230 INFO:teuthology.orchestra.run.trial011.stdout:Package NetworkManager-1:1.54.0-2.el10_1.x86_64 is already installed. 2026-02-13T02:15:49.230 INFO:teuthology.orchestra.run.trial011.stdout:Package iproute-6.14.0-2.el10.x86_64 is already installed. 2026-02-13T02:15:49.230 INFO:teuthology.orchestra.run.trial011.stdout:Package util-linux-2.40.2-13.el10.x86_64 is already installed. 2026-02-13T02:15:49.231 INFO:teuthology.orchestra.run.trial011.stdout:Package libacl-devel-2.3.2-4.el10.x86_64 is already installed. 2026-02-13T02:15:49.231 INFO:teuthology.orchestra.run.trial011.stdout:Package libattr-devel-2.5.2-5.el10.x86_64 is already installed. 2026-02-13T02:15:49.232 INFO:teuthology.orchestra.run.trial011.stdout:Package xfsdump-3.2.0-1.el10.x86_64 is already installed. 2026-02-13T02:15:49.232 INFO:teuthology.orchestra.run.trial011.stdout:Package xfsprogs-6.11.0-2.el10.x86_64 is already installed. 2026-02-13T02:15:49.249 INFO:teuthology.orchestra.run.trial011.stdout:Dependencies resolved. 2026-02-13T02:15:49.256 INFO:teuthology.orchestra.run.trial011.stdout:======================================================================================== 2026-02-13T02:15:49.256 INFO:teuthology.orchestra.run.trial011.stdout: Package Arch Version Repository Size 2026-02-13T02:15:49.257 INFO:teuthology.orchestra.run.trial011.stdout:======================================================================================== 2026-02-13T02:15:49.257 INFO:teuthology.orchestra.run.trial011.stdout:Installing: 2026-02-13T02:15:49.257 INFO:teuthology.orchestra.run.trial011.stdout: bison x86_64 3.8.2-9.el10 appstream 1.0 M 2026-02-13T02:15:49.257 INFO:teuthology.orchestra.run.trial011.stdout: ceph x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 6.6 k 2026-02-13T02:15:49.257 INFO:teuthology.orchestra.run.trial011.stdout: ceph-base x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 5.4 M 2026-02-13T02:15:49.257 INFO:teuthology.orchestra.run.trial011.stdout: ceph-fuse x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 1.1 M 2026-02-13T02:15:49.257 INFO:teuthology.orchestra.run.trial011.stdout: ceph-immutable-object-cache x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 151 k 2026-02-13T02:15:49.257 INFO:teuthology.orchestra.run.trial011.stdout: ceph-mgr x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 984 k 2026-02-13T02:15:49.257 INFO:teuthology.orchestra.run.trial011.stdout: ceph-mgr-cephadm noarch 2:20.3.0-5241.g8f8d3829.el10 ceph-noarch 183 k 2026-02-13T02:15:49.257 INFO:teuthology.orchestra.run.trial011.stdout: ceph-mgr-dashboard noarch 2:20.3.0-5241.g8f8d3829.el10 ceph-noarch 15 M 2026-02-13T02:15:49.258 INFO:teuthology.orchestra.run.trial011.stdout: ceph-mgr-diskprediction-local noarch 2:20.3.0-5241.g8f8d3829.el10 ceph-noarch 7.4 M 2026-02-13T02:15:49.258 INFO:teuthology.orchestra.run.trial011.stdout: ceph-mgr-rook noarch 2:20.3.0-5241.g8f8d3829.el10 ceph-noarch 50 k 2026-02-13T02:15:49.258 INFO:teuthology.orchestra.run.trial011.stdout: ceph-osd x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 176 k 2026-02-13T02:15:49.258 INFO:teuthology.orchestra.run.trial011.stdout: ceph-osd-classic x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 17 M 2026-02-13T02:15:49.258 INFO:teuthology.orchestra.run.trial011.stdout: ceph-radosgw x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 14 M 2026-02-13T02:15:49.258 INFO:teuthology.orchestra.run.trial011.stdout: ceph-test x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 81 M 2026-02-13T02:15:49.258 INFO:teuthology.orchestra.run.trial011.stdout: ceph-volume noarch 2:20.3.0-5241.g8f8d3829.el10 ceph-noarch 374 k 2026-02-13T02:15:49.258 INFO:teuthology.orchestra.run.trial011.stdout: cephadm noarch 2:20.3.0-5241.g8f8d3829.el10 ceph-noarch 1.3 M 2026-02-13T02:15:49.258 INFO:teuthology.orchestra.run.trial011.stdout: cephfs-mirror x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 252 k 2026-02-13T02:15:49.258 INFO:teuthology.orchestra.run.trial011.stdout: cephfs-shell x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 27 k 2026-02-13T02:15:49.259 INFO:teuthology.orchestra.run.trial011.stdout: cephfs-top noarch 2:20.3.0-5241.g8f8d3829.el10 ceph-noarch 18 k 2026-02-13T02:15:49.259 INFO:teuthology.orchestra.run.trial011.stdout: elfutils-libelf-devel x86_64 0.193-1.el10.rocky.0.1 appstream 48 k 2026-02-13T02:15:49.259 INFO:teuthology.orchestra.run.trial011.stdout: flex x86_64 2.6.4-19.el10 appstream 300 k 2026-02-13T02:15:49.259 INFO:teuthology.orchestra.run.trial011.stdout: libaio-devel x86_64 0.3.111-22.el10 appstream 10 k 2026-02-13T02:15:49.259 INFO:teuthology.orchestra.run.trial011.stdout: libcephfs-devel x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 37 k 2026-02-13T02:15:49.259 INFO:teuthology.orchestra.run.trial011.stdout: libcephfs2 x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 937 k 2026-02-13T02:15:49.259 INFO:teuthology.orchestra.run.trial011.stdout: librados-devel x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 128 k 2026-02-13T02:15:49.259 INFO:teuthology.orchestra.run.trial011.stdout: libtool x86_64 2.4.7-13.el10 appstream 601 k 2026-02-13T02:15:49.259 INFO:teuthology.orchestra.run.trial011.stdout: libuuid-devel x86_64 2.40.2-15.el10_1 appstream 37 k 2026-02-13T02:15:49.259 INFO:teuthology.orchestra.run.trial011.stdout: openssl-devel x86_64 1:3.5.1-7.el10_1 appstream 3.0 M 2026-02-13T02:15:49.259 INFO:teuthology.orchestra.run.trial011.stdout: postgresql x86_64 16.11-1.el10_1 appstream 2.0 M 2026-02-13T02:15:49.260 INFO:teuthology.orchestra.run.trial011.stdout: postgresql-contrib x86_64 16.11-1.el10_1 appstream 1.0 M 2026-02-13T02:15:49.260 INFO:teuthology.orchestra.run.trial011.stdout: postgresql-server x86_64 16.11-1.el10_1 appstream 7.0 M 2026-02-13T02:15:49.260 INFO:teuthology.orchestra.run.trial011.stdout: python3-cephfs x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 253 k 2026-02-13T02:15:49.260 INFO:teuthology.orchestra.run.trial011.stdout: python3-rados x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 352 k 2026-02-13T02:15:49.260 INFO:teuthology.orchestra.run.trial011.stdout: python3-rbd x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 372 k 2026-02-13T02:15:49.260 INFO:teuthology.orchestra.run.trial011.stdout: python3-rgw x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 130 k 2026-02-13T02:15:49.260 INFO:teuthology.orchestra.run.trial011.stdout: rbd-fuse x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 87 k 2026-02-13T02:15:49.260 INFO:teuthology.orchestra.run.trial011.stdout: rbd-mirror x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 2.9 M 2026-02-13T02:15:49.260 INFO:teuthology.orchestra.run.trial011.stdout: rbd-nbd x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 180 k 2026-02-13T02:15:49.260 INFO:teuthology.orchestra.run.trial011.stdout: xfsprogs-devel x86_64 6.11.0-2.el10 appstream 105 k 2026-02-13T02:15:49.260 INFO:teuthology.orchestra.run.trial011.stdout:Upgrading: 2026-02-13T02:15:49.261 INFO:teuthology.orchestra.run.trial011.stdout: libblkid x86_64 2.40.2-15.el10_1 baseos 124 k 2026-02-13T02:15:49.261 INFO:teuthology.orchestra.run.trial011.stdout: libfdisk x86_64 2.40.2-15.el10_1 baseos 159 k 2026-02-13T02:15:49.261 INFO:teuthology.orchestra.run.trial011.stdout: libmount x86_64 2.40.2-15.el10_1 baseos 154 k 2026-02-13T02:15:49.261 INFO:teuthology.orchestra.run.trial011.stdout: librados2 x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 3.6 M 2026-02-13T02:15:49.261 INFO:teuthology.orchestra.run.trial011.stdout: librbd1 x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 2.8 M 2026-02-13T02:15:49.261 INFO:teuthology.orchestra.run.trial011.stdout: libsmartcols x86_64 2.40.2-15.el10_1 baseos 83 k 2026-02-13T02:15:49.261 INFO:teuthology.orchestra.run.trial011.stdout: libuuid x86_64 2.40.2-15.el10_1 baseos 28 k 2026-02-13T02:15:49.261 INFO:teuthology.orchestra.run.trial011.stdout: openssl x86_64 1:3.5.1-7.el10_1 baseos 1.2 M 2026-02-13T02:15:49.261 INFO:teuthology.orchestra.run.trial011.stdout: openssl-fips-provider x86_64 1:3.5.1-7.el10_1 baseos 812 k 2026-02-13T02:15:49.261 INFO:teuthology.orchestra.run.trial011.stdout: openssl-libs x86_64 1:3.5.1-7.el10_1 baseos 2.2 M 2026-02-13T02:15:49.262 INFO:teuthology.orchestra.run.trial011.stdout: util-linux x86_64 2.40.2-15.el10_1 baseos 1.2 M 2026-02-13T02:15:49.262 INFO:teuthology.orchestra.run.trial011.stdout: util-linux-core x86_64 2.40.2-15.el10_1 baseos 542 k 2026-02-13T02:15:49.262 INFO:teuthology.orchestra.run.trial011.stdout:Installing dependencies: 2026-02-13T02:15:49.262 INFO:teuthology.orchestra.run.trial011.stdout: abseil-cpp x86_64 20240722.1-1.el10_0 epel 590 k 2026-02-13T02:15:49.262 INFO:teuthology.orchestra.run.trial011.stdout: automake noarch 1.16.5-20.el10 appstream 704 k 2026-02-13T02:15:49.262 INFO:teuthology.orchestra.run.trial011.stdout: boost-program-options x86_64 1.83.0-5.el10 appstream 109 k 2026-02-13T02:15:49.262 INFO:teuthology.orchestra.run.trial011.stdout: ceph-common x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 25 M 2026-02-13T02:15:49.262 INFO:teuthology.orchestra.run.trial011.stdout: ceph-grafana-dashboards noarch 2:20.3.0-5241.g8f8d3829.el10 ceph-noarch 57 k 2026-02-13T02:15:49.262 INFO:teuthology.orchestra.run.trial011.stdout: ceph-mds x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 2.4 M 2026-02-13T02:15:49.262 INFO:teuthology.orchestra.run.trial011.stdout: ceph-mgr-modules-core noarch 2:20.3.0-5241.g8f8d3829.el10 ceph-noarch 297 k 2026-02-13T02:15:49.262 INFO:teuthology.orchestra.run.trial011.stdout: ceph-mon x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 6.0 M 2026-02-13T02:15:49.263 INFO:teuthology.orchestra.run.trial011.stdout: ceph-osd-crimson x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 20 M 2026-02-13T02:15:49.263 INFO:teuthology.orchestra.run.trial011.stdout: ceph-prometheus-alerts noarch 2:20.3.0-5241.g8f8d3829.el10 ceph-noarch 17 k 2026-02-13T02:15:49.263 INFO:teuthology.orchestra.run.trial011.stdout: ceph-selinux x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 25 k 2026-02-13T02:15:49.263 INFO:teuthology.orchestra.run.trial011.stdout: cmake-filesystem x86_64 3.30.5-3.el10_0 appstream 15 k 2026-02-13T02:15:49.263 INFO:teuthology.orchestra.run.trial011.stdout: cryptsetup x86_64 2.7.5-2.el10 baseos 335 k 2026-02-13T02:15:49.263 INFO:teuthology.orchestra.run.trial011.stdout: daxctl-libs x86_64 80-4.el10 baseos 42 k 2026-02-13T02:15:49.263 INFO:teuthology.orchestra.run.trial011.stdout: flexiblas x86_64 3.4.2-3.el10 appstream 25 k 2026-02-13T02:15:49.263 INFO:teuthology.orchestra.run.trial011.stdout: flexiblas-netlib x86_64 3.4.2-3.el10 appstream 3.2 M 2026-02-13T02:15:49.263 INFO:teuthology.orchestra.run.trial011.stdout: flexiblas-openblas-openmp x86_64 3.4.2-3.el10 appstream 17 k 2026-02-13T02:15:49.263 INFO:teuthology.orchestra.run.trial011.stdout: fuse3 x86_64 3.16.2-5.el10 baseos 58 k 2026-02-13T02:15:49.263 INFO:teuthology.orchestra.run.trial011.stdout: gperftools-libs x86_64 2.15-4.el10_0 epel 303 k 2026-02-13T02:15:49.264 INFO:teuthology.orchestra.run.trial011.stdout: grpc-data noarch 1.48.4-44.el10_0 epel 21 k 2026-02-13T02:15:49.264 INFO:teuthology.orchestra.run.trial011.stdout: hwloc-libs x86_64 2.11.1-3.el10 baseos 2.1 M 2026-02-13T02:15:49.264 INFO:teuthology.orchestra.run.trial011.stdout: ledmon-libs x86_64 1.1.0-2.el10 appstream 42 k 2026-02-13T02:15:49.264 INFO:teuthology.orchestra.run.trial011.stdout: libarrow x86_64 17.0.0-9.el10_2 epel 5.7 M 2026-02-13T02:15:49.264 INFO:teuthology.orchestra.run.trial011.stdout: libarrow-doc noarch 17.0.0-9.el10_2 epel 27 k 2026-02-13T02:15:49.264 INFO:teuthology.orchestra.run.trial011.stdout: libcephfs-proxy2 x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 25 k 2026-02-13T02:15:49.264 INFO:teuthology.orchestra.run.trial011.stdout: libcephsqlite x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 168 k 2026-02-13T02:15:49.264 INFO:teuthology.orchestra.run.trial011.stdout: libconfig x86_64 1.7.3-10.el10 baseos 72 k 2026-02-13T02:15:49.264 INFO:teuthology.orchestra.run.trial011.stdout: libgfortran x86_64 14.3.1-2.1.el10 baseos 827 k 2026-02-13T02:15:49.264 INFO:teuthology.orchestra.run.trial011.stdout: libnbd x86_64 1.22.2-3.el10_1 appstream 175 k 2026-02-13T02:15:49.264 INFO:teuthology.orchestra.run.trial011.stdout: liboath x86_64 2.6.12-1.el10_0 epel 48 k 2026-02-13T02:15:49.264 INFO:teuthology.orchestra.run.trial011.stdout: liborc2 x86_64 2.0.7-1.el10_2 epel 515 k 2026-02-13T02:15:49.265 INFO:teuthology.orchestra.run.trial011.stdout: libpciaccess x86_64 0.16-16.el10 baseos 27 k 2026-02-13T02:15:49.265 INFO:teuthology.orchestra.run.trial011.stdout: libpmem x86_64 2.1.0-2.el10_0 epel 112 k 2026-02-13T02:15:49.265 INFO:teuthology.orchestra.run.trial011.stdout: libpmemobj x86_64 2.1.0-2.el10_0 epel 161 k 2026-02-13T02:15:49.265 INFO:teuthology.orchestra.run.trial011.stdout: libquadmath x86_64 14.3.1-2.1.el10 baseos 215 k 2026-02-13T02:15:49.265 INFO:teuthology.orchestra.run.trial011.stdout: librabbitmq x86_64 0.14.0-3.el10 appstream 43 k 2026-02-13T02:15:49.265 INFO:teuthology.orchestra.run.trial011.stdout: libradosstriper1 x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 252 k 2026-02-13T02:15:49.265 INFO:teuthology.orchestra.run.trial011.stdout: librdkafka x86_64 2.1.1-7.el10 appstream 725 k 2026-02-13T02:15:49.265 INFO:teuthology.orchestra.run.trial011.stdout: librgw2 x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 6.7 M 2026-02-13T02:15:49.265 INFO:teuthology.orchestra.run.trial011.stdout: libstoragemgmt x86_64 1.10.1-4.el10 appstream 251 k 2026-02-13T02:15:49.265 INFO:teuthology.orchestra.run.trial011.stdout: libtool-ltdl x86_64 2.4.7-13.el10 appstream 36 k 2026-02-13T02:15:49.265 INFO:teuthology.orchestra.run.trial011.stdout: libunwind x86_64 1.8.0-4.el10_0 epel 73 k 2026-02-13T02:15:49.265 INFO:teuthology.orchestra.run.trial011.stdout: libxslt x86_64 1.1.39-8.el10_0 appstream 189 k 2026-02-13T02:15:49.266 INFO:teuthology.orchestra.run.trial011.stdout: libzstd-devel x86_64 1.5.5-9.el10 appstream 51 k 2026-02-13T02:15:49.266 INFO:teuthology.orchestra.run.trial011.stdout: lttng-ust x86_64 2.13.7-5.el10 crb 334 k 2026-02-13T02:15:49.266 INFO:teuthology.orchestra.run.trial011.stdout: lua x86_64 5.4.6-7.el10 appstream 190 k 2026-02-13T02:15:49.266 INFO:teuthology.orchestra.run.trial011.stdout: lua-devel x86_64 5.4.6-7.el10 crb 22 k 2026-02-13T02:15:49.266 INFO:teuthology.orchestra.run.trial011.stdout: luarocks noarch 3.9.2-6.el10_0 epel 152 k 2026-02-13T02:15:49.266 INFO:teuthology.orchestra.run.trial011.stdout: mailcap noarch 2.1.54-8.el10 baseos 34 k 2026-02-13T02:15:49.266 INFO:teuthology.orchestra.run.trial011.stdout: ndctl-libs x86_64 80-4.el10 baseos 89 k 2026-02-13T02:15:49.266 INFO:teuthology.orchestra.run.trial011.stdout: ocl-icd x86_64 2.3.2-8.el10 baseos 66 k 2026-02-13T02:15:49.266 INFO:teuthology.orchestra.run.trial011.stdout: openblas x86_64 0.3.29-2.el10 appstream 43 k 2026-02-13T02:15:49.266 INFO:teuthology.orchestra.run.trial011.stdout: openblas-openmp x86_64 0.3.29-2.el10 appstream 5.3 M 2026-02-13T02:15:49.266 INFO:teuthology.orchestra.run.trial011.stdout: parquet-libs x86_64 17.0.0-9.el10_2 epel 1.0 M 2026-02-13T02:15:49.266 INFO:teuthology.orchestra.run.trial011.stdout: pciutils x86_64 3.13.0-6.el10 baseos 122 k 2026-02-13T02:15:49.266 INFO:teuthology.orchestra.run.trial011.stdout: perl-Thread-Queue noarch 3.14-511.el10 appstream 21 k 2026-02-13T02:15:49.267 INFO:teuthology.orchestra.run.trial011.stdout: perl-threads x86_64 1:2.40-511.el10 appstream 58 k 2026-02-13T02:15:49.267 INFO:teuthology.orchestra.run.trial011.stdout: perl-threads-shared x86_64 1.69-511.el10 appstream 45 k 2026-02-13T02:15:49.267 INFO:teuthology.orchestra.run.trial011.stdout: postgresql-private-libs x86_64 16.11-1.el10_1 appstream 143 k 2026-02-13T02:15:49.267 INFO:teuthology.orchestra.run.trial011.stdout: protobuf x86_64 3.19.6-11.el10 appstream 1.0 M 2026-02-13T02:15:49.267 INFO:teuthology.orchestra.run.trial011.stdout: protobuf-compiler x86_64 3.19.6-11.el10 crb 787 k 2026-02-13T02:15:49.267 INFO:teuthology.orchestra.run.trial011.stdout: python3-asyncssh noarch 2.17.0-1.el10_0 epel 756 k 2026-02-13T02:15:49.267 INFO:teuthology.orchestra.run.trial011.stdout: python3-autocommand noarch 2.2.2-9.el10_0 epel 32 k 2026-02-13T02:15:49.267 INFO:teuthology.orchestra.run.trial011.stdout: python3-bcrypt x86_64 4.3.0-3.el10_1 epel 238 k 2026-02-13T02:15:49.267 INFO:teuthology.orchestra.run.trial011.stdout: python3-cachetools noarch 5.4.0-6.el10_0 epel 37 k 2026-02-13T02:15:49.267 INFO:teuthology.orchestra.run.trial011.stdout: python3-ceph-argparse x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 57 k 2026-02-13T02:15:49.267 INFO:teuthology.orchestra.run.trial011.stdout: python3-ceph-common x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 237 k 2026-02-13T02:15:49.268 INFO:teuthology.orchestra.run.trial011.stdout: python3-certifi noarch 2023.05.07-6.el10_0 epel 14 k 2026-02-13T02:15:49.268 INFO:teuthology.orchestra.run.trial011.stdout: python3-cffi x86_64 1.16.0-7.el10 baseos 310 k 2026-02-13T02:15:49.268 INFO:teuthology.orchestra.run.trial011.stdout: python3-cheroot noarch 10.0.1-4.el10_0 epel 215 k 2026-02-13T02:15:49.268 INFO:teuthology.orchestra.run.trial011.stdout: python3-cherrypy noarch 18.10.0-4.el10_0 epel 359 k 2026-02-13T02:15:49.268 INFO:teuthology.orchestra.run.trial011.stdout: python3-cmd2 noarch 2.5.8-1.el10_2 epel 375 k 2026-02-13T02:15:49.268 INFO:teuthology.orchestra.run.trial011.stdout: python3-colorama noarch 0.4.6-13.el10 appstream 74 k 2026-02-13T02:15:49.268 INFO:teuthology.orchestra.run.trial011.stdout: python3-cryptography x86_64 43.0.0-4.el10 baseos 1.3 M 2026-02-13T02:15:49.268 INFO:teuthology.orchestra.run.trial011.stdout: python3-devel x86_64 3.12.12-2.el10_1 appstream 329 k 2026-02-13T02:15:49.268 INFO:teuthology.orchestra.run.trial011.stdout: python3-durationpy noarch 0.9-2.el10_0 epel 15 k 2026-02-13T02:15:49.268 INFO:teuthology.orchestra.run.trial011.stdout: python3-google-auth noarch 1:2.40.3-1.el10_1 epel 286 k 2026-02-13T02:15:49.268 INFO:teuthology.orchestra.run.trial011.stdout: python3-grpcio x86_64 1.48.4-44.el10_0 epel 2.3 M 2026-02-13T02:15:49.269 INFO:teuthology.orchestra.run.trial011.stdout: python3-grpcio-tools x86_64 1.48.4-44.el10_0 epel 157 k 2026-02-13T02:15:49.269 INFO:teuthology.orchestra.run.trial011.stdout: python3-isodate noarch 0.6.1-14.el10_0 epel 66 k 2026-02-13T02:15:49.269 INFO:teuthology.orchestra.run.trial011.stdout: python3-jaraco-collections noarch 5.1.0-1.el10_0 epel 29 k 2026-02-13T02:15:49.269 INFO:teuthology.orchestra.run.trial011.stdout: python3-jaraco-context noarch 6.0.1-4.el10_0 epel 21 k 2026-02-13T02:15:49.269 INFO:teuthology.orchestra.run.trial011.stdout: python3-jaraco-functools noarch 4.0.2-4.el10_0 epel 23 k 2026-02-13T02:15:49.269 INFO:teuthology.orchestra.run.trial011.stdout: python3-jaraco-text noarch 4.0.0-3.el10_0 epel 29 k 2026-02-13T02:15:49.269 INFO:teuthology.orchestra.run.trial011.stdout: python3-jinja2 noarch 3.1.6-1.el10_0 appstream 330 k 2026-02-13T02:15:49.269 INFO:teuthology.orchestra.run.trial011.stdout: python3-jmespath noarch 1.0.1-8.el10 appstream 60 k 2026-02-13T02:15:49.269 INFO:teuthology.orchestra.run.trial011.stdout: python3-kubernetes noarch 1:32.0.1-1.el10_1 epel 1.3 M 2026-02-13T02:15:49.269 INFO:teuthology.orchestra.run.trial011.stdout: python3-libstoragemgmt x86_64 1.10.1-4.el10 appstream 219 k 2026-02-13T02:15:49.269 INFO:teuthology.orchestra.run.trial011.stdout: python3-lxml x86_64 5.2.1-4.el10 appstream 1.4 M 2026-02-13T02:15:49.270 INFO:teuthology.orchestra.run.trial011.stdout: python3-markupsafe x86_64 2.1.3-6.el10 appstream 34 k 2026-02-13T02:15:49.270 INFO:teuthology.orchestra.run.trial011.stdout: python3-more-itertools noarch 10.1.0-8.el10_0 epel 100 k 2026-02-13T02:15:49.270 INFO:teuthology.orchestra.run.trial011.stdout: python3-natsort noarch 8.4.0-2.el10_0 epel 72 k 2026-02-13T02:15:49.270 INFO:teuthology.orchestra.run.trial011.stdout: python3-numpy x86_64 1:1.26.4-5.el10 appstream 6.7 M 2026-02-13T02:15:49.270 INFO:teuthology.orchestra.run.trial011.stdout: python3-numpy-f2py x86_64 1:1.26.4-5.el10 appstream 490 k 2026-02-13T02:15:49.270 INFO:teuthology.orchestra.run.trial011.stdout: python3-packaging noarch 24.2-2.el10 baseos 155 k 2026-02-13T02:15:49.270 INFO:teuthology.orchestra.run.trial011.stdout: python3-ply noarch 3.11-25.el10 baseos 137 k 2026-02-13T02:15:49.270 INFO:teuthology.orchestra.run.trial011.stdout: python3-portend noarch 3.2.0-6.el10_0 epel 18 k 2026-02-13T02:15:49.270 INFO:teuthology.orchestra.run.trial011.stdout: python3-prettytable noarch 3.6.0-10.el10 appstream 70 k 2026-02-13T02:15:49.270 INFO:teuthology.orchestra.run.trial011.stdout: python3-protobuf x86_64 3.19.6-11.el10 appstream 419 k 2026-02-13T02:15:49.270 INFO:teuthology.orchestra.run.trial011.stdout: python3-pyOpenSSL noarch 25.0.0-1.el10_1 epel 113 k 2026-02-13T02:15:49.271 INFO:teuthology.orchestra.run.trial011.stdout: python3-pyasn1 noarch 0.6.1-1.el10 appstream 198 k 2026-02-13T02:15:49.271 INFO:teuthology.orchestra.run.trial011.stdout: python3-pyasn1-modules noarch 0.6.1-1.el10 appstream 402 k 2026-02-13T02:15:49.271 INFO:teuthology.orchestra.run.trial011.stdout: python3-pycparser noarch 2.20-16.el10 baseos 160 k 2026-02-13T02:15:49.271 INFO:teuthology.orchestra.run.trial011.stdout: python3-pyperclip noarch 1.8.2-1.el10_0 epel 28 k 2026-02-13T02:15:49.271 INFO:teuthology.orchestra.run.trial011.stdout: python3-repoze-lru noarch 0.7-23.el10_0 epel 36 k 2026-02-13T02:15:49.271 INFO:teuthology.orchestra.run.trial011.stdout: python3-requests noarch 2.32.4-1.el10_0 baseos 160 k 2026-02-13T02:15:49.271 INFO:teuthology.orchestra.run.trial011.stdout: python3-requests-oauthlib noarch 1.3.1-11.el10 appstream 60 k 2026-02-13T02:15:49.271 INFO:teuthology.orchestra.run.trial011.stdout: python3-routes noarch 2.5.1-11.el10_0 epel 201 k 2026-02-13T02:15:49.271 INFO:teuthology.orchestra.run.trial011.stdout: python3-rsa noarch 4.9-7.el10_0 epel 70 k 2026-02-13T02:15:49.271 INFO:teuthology.orchestra.run.trial011.stdout: python3-scipy x86_64 1.11.3-17.el10 appstream 16 M 2026-02-13T02:15:49.271 INFO:teuthology.orchestra.run.trial011.stdout: python3-tempora noarch 5.7.0-1.el10_0 epel 37 k 2026-02-13T02:15:49.271 INFO:teuthology.orchestra.run.trial011.stdout: python3-urllib3 noarch 1.26.19-2.el10_1.1 baseos 285 k 2026-02-13T02:15:49.272 INFO:teuthology.orchestra.run.trial011.stdout: python3-websocket-client noarch 1.8.0-2.el10_0 epel 124 k 2026-02-13T02:15:49.272 INFO:teuthology.orchestra.run.trial011.stdout: python3-xmlsec x86_64 1.3.16-1.el10 lab-extras 49 k 2026-02-13T02:15:49.272 INFO:teuthology.orchestra.run.trial011.stdout: python3-xmltodict noarch 0.13.0-5.el10_0 epel 26 k 2026-02-13T02:15:49.272 INFO:teuthology.orchestra.run.trial011.stdout: python3-zc-lockfile noarch 3.0.post1-11.el10_0 epel 23 k 2026-02-13T02:15:49.272 INFO:teuthology.orchestra.run.trial011.stdout: qatlib x86_64 24.09.0-2.el10 appstream 229 k 2026-02-13T02:15:49.272 INFO:teuthology.orchestra.run.trial011.stdout: qatzip-libs x86_64 1.3.1-1.el10 appstream 66 k 2026-02-13T02:15:49.272 INFO:teuthology.orchestra.run.trial011.stdout: re2 x86_64 2:20251105-1.el10_2 epel 221 k 2026-02-13T02:15:49.272 INFO:teuthology.orchestra.run.trial011.stdout: socat x86_64 1.7.4.4-8.el10 appstream 303 k 2026-02-13T02:15:49.272 INFO:teuthology.orchestra.run.trial011.stdout: thrift x86_64 0.20.0-4.el10_1 epel 1.7 M 2026-02-13T02:15:49.272 INFO:teuthology.orchestra.run.trial011.stdout: unzip x86_64 6.0-69.el10 baseos 188 k 2026-02-13T02:15:49.272 INFO:teuthology.orchestra.run.trial011.stdout: utf8proc x86_64 2.7.0-9.el10 appstream 80 k 2026-02-13T02:15:49.272 INFO:teuthology.orchestra.run.trial011.stdout: uuid x86_64 1.6.2-65.el10 appstream 59 k 2026-02-13T02:15:49.273 INFO:teuthology.orchestra.run.trial011.stdout: xmlsec1 x86_64 1:1.2.39-3.el10 appstream 193 k 2026-02-13T02:15:49.273 INFO:teuthology.orchestra.run.trial011.stdout: xmlsec1-openssl x86_64 1:1.2.39-3.el10 appstream 96 k 2026-02-13T02:15:49.273 INFO:teuthology.orchestra.run.trial011.stdout: xmlstarlet x86_64 1.6.1-27.el10 appstream 63 k 2026-02-13T02:15:49.273 INFO:teuthology.orchestra.run.trial011.stdout: yaml-cpp0.7 x86_64 0.7.0-1.el10_2 epel 127 k 2026-02-13T02:15:49.273 INFO:teuthology.orchestra.run.trial011.stdout: zip x86_64 3.0-45.el10 baseos 271 k 2026-02-13T02:15:49.273 INFO:teuthology.orchestra.run.trial011.stdout: zlib-ng-compat-devel x86_64 2.2.3-2.el10 appstream 38 k 2026-02-13T02:15:49.273 INFO:teuthology.orchestra.run.trial011.stdout:Installing weak dependencies: 2026-02-13T02:15:49.273 INFO:teuthology.orchestra.run.trial011.stdout: ceph-mgr-k8sevents noarch 2:20.3.0-5241.g8f8d3829.el10 ceph-noarch 22 k 2026-02-13T02:15:49.273 INFO:teuthology.orchestra.run.trial011.stdout: libcephfs-daemon x86_64 2:20.3.0-5241.g8f8d3829.el10 ceph 37 k 2026-02-13T02:15:49.273 INFO:teuthology.orchestra.run.trial011.stdout: python3-saml noarch 1.16.0-11.el10 lab-extras 150 k 2026-02-13T02:15:49.274 INFO:teuthology.orchestra.run.trial011.stdout: qatlib-service x86_64 24.09.0-2.el10 appstream 37 k 2026-02-13T02:15:49.274 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:15:49.274 INFO:teuthology.orchestra.run.trial011.stdout:Transaction Summary 2026-02-13T02:15:49.274 INFO:teuthology.orchestra.run.trial011.stdout:======================================================================================== 2026-02-13T02:15:49.274 INFO:teuthology.orchestra.run.trial011.stdout:Install 173 Packages 2026-02-13T02:15:49.274 INFO:teuthology.orchestra.run.trial011.stdout:Upgrade 12 Packages 2026-02-13T02:15:49.274 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:15:49.275 INFO:teuthology.orchestra.run.trial011.stdout:Total download size: 305 M 2026-02-13T02:15:49.275 INFO:teuthology.orchestra.run.trial011.stdout:Downloading Packages: 2026-02-13T02:15:49.421 INFO:teuthology.orchestra.run.trial060.stdout:(9/185): ceph-common-20.3.0-5241.g8f8d3829.el10 26 MB/s | 25 MB 00:00 2026-02-13T02:15:49.529 INFO:teuthology.orchestra.run.trial011.stdout:(1/185): ceph-20.3.0-5241.g8f8d3829.el10.x86_64 43 kB/s | 6.6 kB 00:00 2026-02-13T02:15:49.540 INFO:teuthology.orchestra.run.trial078.stdout:(2/185): ceph-fuse-20.3.0-5241.g8f8d3829.el10.x 1.2 MB/s | 1.1 MB 00:00 2026-02-13T02:15:49.658 INFO:teuthology.orchestra.run.trial078.stdout:(3/185): ceph-immutable-object-cache-20.3.0-524 1.2 MB/s | 151 kB 00:00 2026-02-13T02:15:49.977 INFO:teuthology.orchestra.run.trial060.stdout:(10/185): ceph-radosgw-20.3.0-5241.g8f8d3829.el 25 MB/s | 14 MB 00:00 2026-02-13T02:15:50.018 INFO:teuthology.orchestra.run.trial060.stdout:(11/185): ceph-selinux-20.3.0-5241.g8f8d3829.el 614 kB/s | 25 kB 00:00 2026-02-13T02:15:50.385 INFO:teuthology.orchestra.run.trial060.stdout:(12/185): ceph-osd-crimson-20.3.0-5241.g8f8d382 17 MB/s | 20 MB 00:01 2026-02-13T02:15:50.442 INFO:teuthology.orchestra.run.trial060.stdout:(13/185): cephfs-mirror-20.3.0-5241.g8f8d3829.e 4.4 MB/s | 252 kB 00:00 2026-02-13T02:15:50.497 INFO:teuthology.orchestra.run.trial060.stdout:(14/185): cephfs-shell-20.3.0-5241.g8f8d3829.el 500 kB/s | 27 kB 00:00 2026-02-13T02:15:50.552 INFO:teuthology.orchestra.run.trial060.stdout:(15/185): libcephfs-daemon-20.3.0-5241.g8f8d382 665 kB/s | 37 kB 00:00 2026-02-13T02:15:50.580 INFO:teuthology.orchestra.run.trial011.stdout:(2/185): ceph-fuse-20.3.0-5241.g8f8d3829.el10.x 1.0 MB/s | 1.1 MB 00:01 2026-02-13T02:15:50.609 INFO:teuthology.orchestra.run.trial060.stdout:(16/185): libcephfs-devel-20.3.0-5241.g8f8d3829 666 kB/s | 37 kB 00:00 2026-02-13T02:15:50.649 INFO:teuthology.orchestra.run.trial078.stdout:(4/185): ceph-mds-20.3.0-5241.g8f8d3829.el10.x8 2.5 MB/s | 2.4 MB 00:00 2026-02-13T02:15:50.662 INFO:teuthology.orchestra.run.trial060.stdout:(17/185): libcephfs-proxy2-20.3.0-5241.g8f8d382 465 kB/s | 25 kB 00:00 2026-02-13T02:15:50.689 INFO:teuthology.orchestra.run.trial011.stdout:(3/185): ceph-immutable-object-cache-20.3.0-524 1.4 MB/s | 151 kB 00:00 2026-02-13T02:15:50.868 INFO:teuthology.orchestra.run.trial078.stdout:(5/185): ceph-mgr-20.3.0-5241.g8f8d3829.el10.x8 4.4 MB/s | 984 kB 00:00 2026-02-13T02:15:50.938 INFO:teuthology.orchestra.run.trial060.stdout:(18/185): ceph-osd-classic-20.3.0-5241.g8f8d382 8.9 MB/s | 17 MB 00:01 2026-02-13T02:15:50.980 INFO:teuthology.orchestra.run.trial060.stdout:(19/185): libcephsqlite-20.3.0-5241.g8f8d3829.e 4.0 MB/s | 168 kB 00:00 2026-02-13T02:15:50.996 INFO:teuthology.orchestra.run.trial060.stdout:(20/185): libcephfs2-20.3.0-5241.g8f8d3829.el10 2.7 MB/s | 937 kB 00:00 2026-02-13T02:15:51.021 INFO:teuthology.orchestra.run.trial060.stdout:(21/185): librados-devel-20.3.0-5241.g8f8d3829. 3.1 MB/s | 128 kB 00:00 2026-02-13T02:15:51.041 INFO:teuthology.orchestra.run.trial060.stdout:(22/185): libradosstriper1-20.3.0-5241.g8f8d382 5.4 MB/s | 252 kB 00:00 2026-02-13T02:15:51.088 INFO:teuthology.orchestra.run.trial060.stdout:(23/185): python3-ceph-argparse-20.3.0-5241.g8f 1.2 MB/s | 57 kB 00:00 2026-02-13T02:15:51.139 INFO:teuthology.orchestra.run.trial060.stdout:(24/185): python3-ceph-common-20.3.0-5241.g8f8d 4.6 MB/s | 237 kB 00:00 2026-02-13T02:15:51.190 INFO:teuthology.orchestra.run.trial060.stdout:(25/185): python3-cephfs-20.3.0-5241.g8f8d3829. 4.8 MB/s | 253 kB 00:00 2026-02-13T02:15:51.243 INFO:teuthology.orchestra.run.trial060.stdout:(26/185): python3-rados-20.3.0-5241.g8f8d3829.e 6.4 MB/s | 352 kB 00:00 2026-02-13T02:15:51.298 INFO:teuthology.orchestra.run.trial060.stdout:(27/185): python3-rbd-20.3.0-5241.g8f8d3829.el1 6.6 MB/s | 372 kB 00:00 2026-02-13T02:15:51.349 INFO:teuthology.orchestra.run.trial060.stdout:(28/185): python3-rgw-20.3.0-5241.g8f8d3829.el1 2.5 MB/s | 130 kB 00:00 2026-02-13T02:15:51.399 INFO:teuthology.orchestra.run.trial060.stdout:(29/185): rbd-fuse-20.3.0-5241.g8f8d3829.el10.x 1.7 MB/s | 87 kB 00:00 2026-02-13T02:15:51.654 INFO:teuthology.orchestra.run.trial060.stdout:(30/185): rbd-mirror-20.3.0-5241.g8f8d3829.el10 11 MB/s | 2.9 MB 00:00 2026-02-13T02:15:51.689 INFO:teuthology.orchestra.run.trial078.stdout:(6/185): ceph-mon-20.3.0-5241.g8f8d3829.el10.x8 7.3 MB/s | 6.0 MB 00:00 2026-02-13T02:15:51.703 INFO:teuthology.orchestra.run.trial060.stdout:(31/185): rbd-nbd-20.3.0-5241.g8f8d3829.el10.x8 3.6 MB/s | 180 kB 00:00 2026-02-13T02:15:51.738 INFO:teuthology.orchestra.run.trial078.stdout:(7/185): ceph-osd-20.3.0-5241.g8f8d3829.el10.x8 3.5 MB/s | 176 kB 00:00 2026-02-13T02:15:51.751 INFO:teuthology.orchestra.run.trial060.stdout:(32/185): ceph-grafana-dashboards-20.3.0-5241.g 1.2 MB/s | 57 kB 00:00 2026-02-13T02:15:51.777 INFO:teuthology.orchestra.run.trial078.stdout:(8/185): ceph-base-20.3.0-5241.g8f8d3829.el10.x 1.7 MB/s | 5.4 MB 00:03 2026-02-13T02:15:51.807 INFO:teuthology.orchestra.run.trial060.stdout:(33/185): ceph-mgr-cephadm-20.3.0-5241.g8f8d382 3.2 MB/s | 183 kB 00:00 2026-02-13T02:15:51.956 INFO:teuthology.orchestra.run.trial060.stdout:(34/185): librgw2-20.3.0-5241.g8f8d3829.el10.x8 7.2 MB/s | 6.7 MB 00:00 2026-02-13T02:15:52.299 INFO:teuthology.orchestra.run.trial011.stdout:(4/185): ceph-mds-20.3.0-5241.g8f8d3829.el10.x8 1.5 MB/s | 2.4 MB 00:01 2026-02-13T02:15:52.541 INFO:teuthology.orchestra.run.trial011.stdout:(5/185): ceph-base-20.3.0-5241.g8f8d3829.el10.x 1.7 MB/s | 5.4 MB 00:03 2026-02-13T02:15:52.920 INFO:teuthology.orchestra.run.trial011.stdout:(6/185): ceph-mgr-20.3.0-5241.g8f8d3829.el10.x8 1.5 MB/s | 984 kB 00:00 2026-02-13T02:15:53.038 INFO:teuthology.orchestra.run.trial060.stdout:(35/185): ceph-mgr-dashboard-20.3.0-5241.g8f8d3 12 MB/s | 15 MB 00:01 2026-02-13T02:15:53.040 INFO:teuthology.orchestra.run.trial011.stdout:(7/185): ceph-osd-20.3.0-5241.g8f8d3829.el10.x8 1.4 MB/s | 176 kB 00:00 2026-02-13T02:15:53.047 INFO:teuthology.orchestra.run.trial060.stdout:(36/185): ceph-mgr-diskprediction-local-20.3.0- 6.8 MB/s | 7.4 MB 00:01 2026-02-13T02:15:53.081 INFO:teuthology.orchestra.run.trial060.stdout:(37/185): ceph-mgr-k8sevents-20.3.0-5241.g8f8d3 534 kB/s | 22 kB 00:00 2026-02-13T02:15:53.096 INFO:teuthology.orchestra.run.trial060.stdout:(38/185): ceph-mgr-modules-core-20.3.0-5241.g8f 6.0 MB/s | 297 kB 00:00 2026-02-13T02:15:53.129 INFO:teuthology.orchestra.run.trial060.stdout:(39/185): ceph-mgr-rook-20.3.0-5241.g8f8d3829.e 1.0 MB/s | 50 kB 00:00 2026-02-13T02:15:53.140 INFO:teuthology.orchestra.run.trial060.stdout:(40/185): ceph-prometheus-alerts-20.3.0-5241.g8 404 kB/s | 17 kB 00:00 2026-02-13T02:15:53.180 INFO:teuthology.orchestra.run.trial060.stdout:(41/185): ceph-volume-20.3.0-5241.g8f8d3829.el1 7.2 MB/s | 374 kB 00:00 2026-02-13T02:15:53.231 INFO:teuthology.orchestra.run.trial060.stdout:(42/185): cephfs-top-20.3.0-5241.g8f8d3829.el10 359 kB/s | 18 kB 00:00 2026-02-13T02:15:53.299 INFO:teuthology.orchestra.run.trial060.stdout:(43/185): cephadm-20.3.0-5241.g8f8d3829.el10.no 8.3 MB/s | 1.3 MB 00:00 2026-02-13T02:15:53.306 INFO:teuthology.orchestra.run.trial060.stdout:(44/185): automake-1.16.5-20.el10.noarch.rpm 9.1 MB/s | 704 kB 00:00 2026-02-13T02:15:53.324 INFO:teuthology.orchestra.run.trial060.stdout:(45/185): boost-program-options-1.83.0-5.el10.x 6.1 MB/s | 109 kB 00:00 2026-02-13T02:15:53.332 INFO:teuthology.orchestra.run.trial060.stdout:(46/185): bison-3.8.2-9.el10.x86_64.rpm 31 MB/s | 1.0 MB 00:00 2026-02-13T02:15:53.338 INFO:teuthology.orchestra.run.trial060.stdout:(47/185): cmake-filesystem-3.30.5-3.el10_0.x86_ 1.0 MB/s | 15 kB 00:00 2026-02-13T02:15:53.348 INFO:teuthology.orchestra.run.trial060.stdout:(48/185): elfutils-libelf-devel-0.193-1.el10.ro 3.0 MB/s | 48 kB 00:00 2026-02-13T02:15:53.358 INFO:teuthology.orchestra.run.trial060.stdout:(49/185): flex-2.6.4-19.el10.x86_64.rpm 15 MB/s | 300 kB 00:00 2026-02-13T02:15:53.364 INFO:teuthology.orchestra.run.trial060.stdout:(50/185): flexiblas-3.4.2-3.el10.x86_64.rpm 1.5 MB/s | 25 kB 00:00 2026-02-13T02:15:53.364 INFO:teuthology.orchestra.run.trial078.stdout:(9/185): ceph-osd-classic-20.3.0-5241.g8f8d3829 10 MB/s | 17 MB 00:01 2026-02-13T02:15:53.377 INFO:teuthology.orchestra.run.trial060.stdout:(51/185): flexiblas-openblas-openmp-3.4.2-3.el1 1.3 MB/s | 17 kB 00:00 2026-02-13T02:15:53.390 INFO:teuthology.orchestra.run.trial060.stdout:(52/185): ledmon-libs-1.1.0-2.el10.x86_64.rpm 3.1 MB/s | 42 kB 00:00 2026-02-13T02:15:53.404 INFO:teuthology.orchestra.run.trial060.stdout:(53/185): libaio-devel-0.3.111-22.el10.x86_64.r 730 kB/s | 10 kB 00:00 2026-02-13T02:15:53.423 INFO:teuthology.orchestra.run.trial060.stdout:(54/185): flexiblas-netlib-3.4.2-3.el10.x86_64. 49 MB/s | 3.2 MB 00:00 2026-02-13T02:15:53.424 INFO:teuthology.orchestra.run.trial060.stdout:(55/185): libnbd-1.22.2-3.el10_1.x86_64.rpm 8.6 MB/s | 175 kB 00:00 2026-02-13T02:15:53.428 INFO:teuthology.orchestra.run.trial078.stdout:(10/185): ceph-common-20.3.0-5241.g8f8d3829.el1 5.1 MB/s | 25 MB 00:04 2026-02-13T02:15:53.441 INFO:teuthology.orchestra.run.trial060.stdout:(56/185): librabbitmq-0.14.0-3.el10.x86_64.rpm 2.4 MB/s | 43 kB 00:00 2026-02-13T02:15:53.444 INFO:teuthology.orchestra.run.trial060.stdout:(57/185): librdkafka-2.1.1-7.el10.x86_64.rpm 36 MB/s | 725 kB 00:00 2026-02-13T02:15:53.456 INFO:teuthology.orchestra.run.trial060.stdout:(58/185): libstoragemgmt-1.10.1-4.el10.x86_64.r 16 MB/s | 251 kB 00:00 2026-02-13T02:15:53.462 INFO:teuthology.orchestra.run.trial078.stdout:(11/185): ceph-selinux-20.3.0-5241.g8f8d3829.el 747 kB/s | 25 kB 00:00 2026-02-13T02:15:53.464 INFO:teuthology.orchestra.run.trial060.stdout:(59/185): libtool-2.4.7-13.el10.x86_64.rpm 30 MB/s | 601 kB 00:00 2026-02-13T02:15:53.470 INFO:teuthology.orchestra.run.trial060.stdout:(60/185): libtool-ltdl-2.4.7-13.el10.x86_64.rpm 2.6 MB/s | 36 kB 00:00 2026-02-13T02:15:53.477 INFO:teuthology.orchestra.run.trial060.stdout:(61/185): libuuid-devel-2.40.2-15.el10_1.x86_64 2.8 MB/s | 37 kB 00:00 2026-02-13T02:15:53.485 INFO:teuthology.orchestra.run.trial060.stdout:(62/185): libxslt-1.1.39-8.el10_0.x86_64.rpm 12 MB/s | 189 kB 00:00 2026-02-13T02:15:53.491 INFO:teuthology.orchestra.run.trial060.stdout:(63/185): libzstd-devel-1.5.5-9.el10.x86_64.rpm 3.5 MB/s | 51 kB 00:00 2026-02-13T02:15:53.501 INFO:teuthology.orchestra.run.trial060.stdout:(64/185): lua-5.4.6-7.el10.x86_64.rpm 12 MB/s | 190 kB 00:00 2026-02-13T02:15:53.513 INFO:teuthology.orchestra.run.trial060.stdout:(65/185): openblas-0.3.29-2.el10.x86_64.rpm 1.9 MB/s | 43 kB 00:00 2026-02-13T02:15:53.562 INFO:teuthology.orchestra.run.trial060.stdout:(66/185): openssl-devel-3.5.1-7.el10_1.x86_64.r 62 MB/s | 3.0 MB 00:00 2026-02-13T02:15:53.576 INFO:teuthology.orchestra.run.trial060.stdout:(67/185): perl-Thread-Queue-3.14-511.el10.noarc 1.5 MB/s | 21 kB 00:00 2026-02-13T02:15:53.592 INFO:teuthology.orchestra.run.trial060.stdout:(68/185): openblas-openmp-0.3.29-2.el10.x86_64. 59 MB/s | 5.3 MB 00:00 2026-02-13T02:15:53.592 INFO:teuthology.orchestra.run.trial060.stdout:(69/185): perl-threads-2.40-511.el10.x86_64.rpm 3.6 MB/s | 58 kB 00:00 2026-02-13T02:15:53.605 INFO:teuthology.orchestra.run.trial060.stdout:(70/185): perl-threads-shared-1.69-511.el10.x86 3.4 MB/s | 45 kB 00:00 2026-02-13T02:15:53.632 INFO:teuthology.orchestra.run.trial060.stdout:(71/185): postgresql-contrib-16.11-1.el10_1.x86 38 MB/s | 1.0 MB 00:00 2026-02-13T02:15:53.635 INFO:teuthology.orchestra.run.trial060.stdout:(72/185): postgresql-16.11-1.el10_1.x86_64.rpm 46 MB/s | 2.0 MB 00:00 2026-02-13T02:15:53.652 INFO:teuthology.orchestra.run.trial060.stdout:(73/185): postgresql-private-libs-16.11-1.el10_ 7.1 MB/s | 143 kB 00:00 2026-02-13T02:15:53.685 INFO:teuthology.orchestra.run.trial060.stdout:(74/185): protobuf-3.19.6-11.el10.x86_64.rpm 30 MB/s | 1.0 MB 00:00 2026-02-13T02:15:53.701 INFO:teuthology.orchestra.run.trial060.stdout:(75/185): python3-colorama-0.4.6-13.el10.noarch 4.5 MB/s | 74 kB 00:00 2026-02-13T02:15:53.722 INFO:teuthology.orchestra.run.trial060.stdout:(76/185): python3-devel-3.12.12-2.el10_1.x86_64 16 MB/s | 329 kB 00:00 2026-02-13T02:15:53.844 INFO:teuthology.orchestra.run.trial060.stdout:(77/185): ceph-test-20.3.0-5241.g8f8d3829.el10. 21 MB/s | 81 MB 00:03 2026-02-13T02:15:53.854 INFO:teuthology.orchestra.run.trial060.stdout:(78/185): postgresql-server-16.11-1.el10_1.x86_ 32 MB/s | 7.0 MB 00:00 2026-02-13T02:15:53.855 INFO:teuthology.orchestra.run.trial060.stdout:(79/185): python3-jinja2-3.1.6-1.el10_0.noarch. 2.4 MB/s | 330 kB 00:00 2026-02-13T02:15:53.859 INFO:teuthology.orchestra.run.trial060.stdout:(80/185): python3-jmespath-1.0.1-8.el10.noarch. 3.8 MB/s | 60 kB 00:00 2026-02-13T02:15:53.871 INFO:teuthology.orchestra.run.trial060.stdout:(81/185): python3-libstoragemgmt-1.10.1-4.el10. 13 MB/s | 219 kB 00:00 2026-02-13T02:15:53.873 INFO:teuthology.orchestra.run.trial060.stdout:(82/185): python3-markupsafe-2.1.3-6.el10.x86_6 2.4 MB/s | 34 kB 00:00 2026-02-13T02:15:53.884 INFO:teuthology.orchestra.run.trial060.stdout:(83/185): python3-lxml-5.2.1-4.el10.x86_64.rpm 48 MB/s | 1.4 MB 00:00 2026-02-13T02:15:53.892 INFO:teuthology.orchestra.run.trial060.stdout:(84/185): python3-numpy-f2py-1.26.4-5.el10.x86_ 26 MB/s | 490 kB 00:00 2026-02-13T02:15:53.899 INFO:teuthology.orchestra.run.trial060.stdout:(85/185): python3-prettytable-3.6.0-10.el10.noa 4.5 MB/s | 70 kB 00:00 2026-02-13T02:15:53.909 INFO:teuthology.orchestra.run.trial060.stdout:(86/185): python3-protobuf-3.19.6-11.el10.x86_6 24 MB/s | 419 kB 00:00 2026-02-13T02:15:53.926 INFO:teuthology.orchestra.run.trial060.stdout:(87/185): python3-pyasn1-modules-0.6.1-1.el10.n 23 MB/s | 402 kB 00:00 2026-02-13T02:15:53.933 INFO:teuthology.orchestra.run.trial060.stdout:(88/185): python3-pyasn1-0.6.1-1.el10.noarch.rp 5.8 MB/s | 198 kB 00:00 2026-02-13T02:15:53.939 INFO:teuthology.orchestra.run.trial060.stdout:(89/185): python3-requests-oauthlib-1.3.1-11.el 4.7 MB/s | 60 kB 00:00 2026-02-13T02:15:53.968 INFO:teuthology.orchestra.run.trial060.stdout:(90/185): qatlib-24.09.0-2.el10.x86_64.rpm 7.7 MB/s | 229 kB 00:00 2026-02-13T02:15:53.983 INFO:teuthology.orchestra.run.trial060.stdout:(91/185): qatlib-service-24.09.0-2.el10.x86_64. 2.4 MB/s | 37 kB 00:00 2026-02-13T02:15:54.000 INFO:teuthology.orchestra.run.trial060.stdout:(92/185): qatzip-libs-1.3.1-1.el10.x86_64.rpm 3.9 MB/s | 66 kB 00:00 2026-02-13T02:15:54.020 INFO:teuthology.orchestra.run.trial060.stdout:(93/185): socat-1.7.4.4-8.el10.x86_64.rpm 15 MB/s | 303 kB 00:00 2026-02-13T02:15:54.029 INFO:teuthology.orchestra.run.trial060.stdout:(94/185): python3-numpy-1.26.4-5.el10.x86_64.rp 42 MB/s | 6.7 MB 00:00 2026-02-13T02:15:54.036 INFO:teuthology.orchestra.run.trial060.stdout:(95/185): utf8proc-2.7.0-9.el10.x86_64.rpm 4.8 MB/s | 80 kB 00:00 2026-02-13T02:15:54.042 INFO:teuthology.orchestra.run.trial060.stdout:(96/185): uuid-1.6.2-65.el10.x86_64.rpm 4.5 MB/s | 59 kB 00:00 2026-02-13T02:15:54.053 INFO:teuthology.orchestra.run.trial060.stdout:(97/185): xfsprogs-devel-6.11.0-2.el10.x86_64.r 6.2 MB/s | 105 kB 00:00 2026-02-13T02:15:54.062 INFO:teuthology.orchestra.run.trial060.stdout:(98/185): xmlsec1-1.2.39-3.el10.x86_64.rpm 9.7 MB/s | 193 kB 00:00 2026-02-13T02:15:54.074 INFO:teuthology.orchestra.run.trial060.stdout:(99/185): xmlsec1-openssl-1.2.39-3.el10.x86_64. 4.4 MB/s | 96 kB 00:00 2026-02-13T02:15:54.081 INFO:teuthology.orchestra.run.trial060.stdout:(100/185): xmlstarlet-1.6.1-27.el10.x86_64.rpm 3.3 MB/s | 63 kB 00:00 2026-02-13T02:15:54.089 INFO:teuthology.orchestra.run.trial060.stdout:(101/185): zlib-ng-compat-devel-2.2.3-2.el10.x8 2.5 MB/s | 38 kB 00:00 2026-02-13T02:15:54.091 INFO:teuthology.orchestra.run.trial078.stdout:(12/185): ceph-radosgw-20.3.0-5241.g8f8d3829.el 19 MB/s | 14 MB 00:00 2026-02-13T02:15:54.101 INFO:teuthology.orchestra.run.trial060.stdout:(102/185): cryptsetup-2.7.5-2.el10.x86_64.rpm 16 MB/s | 335 kB 00:00 2026-02-13T02:15:54.108 INFO:teuthology.orchestra.run.trial060.stdout:(103/185): daxctl-libs-80-4.el10.x86_64.rpm 2.2 MB/s | 42 kB 00:00 2026-02-13T02:15:54.112 INFO:teuthology.orchestra.run.trial078.stdout:(13/185): cephfs-mirror-20.3.0-5241.g8f8d3829.e 12 MB/s | 252 kB 00:00 2026-02-13T02:15:54.118 INFO:teuthology.orchestra.run.trial060.stdout:(104/185): fuse3-3.16.2-5.el10.x86_64.rpm 3.5 MB/s | 58 kB 00:00 2026-02-13T02:15:54.131 INFO:teuthology.orchestra.run.trial078.stdout:(14/185): cephfs-shell-20.3.0-5241.g8f8d3829.el 1.4 MB/s | 27 kB 00:00 2026-02-13T02:15:54.152 INFO:teuthology.orchestra.run.trial078.stdout:(15/185): libcephfs-daemon-20.3.0-5241.g8f8d382 1.7 MB/s | 37 kB 00:00 2026-02-13T02:15:54.157 INFO:teuthology.orchestra.run.trial060.stdout:(105/185): python3-scipy-1.11.3-17.el10.x86_64. 72 MB/s | 16 MB 00:00 2026-02-13T02:15:54.158 INFO:teuthology.orchestra.run.trial060.stdout:(106/185): libconfig-1.7.3-10.el10.x86_64.rpm 1.7 MB/s | 72 kB 00:00 2026-02-13T02:15:54.162 INFO:teuthology.orchestra.run.trial060.stdout:(107/185): hwloc-libs-2.11.1-3.el10.x86_64.rpm 39 MB/s | 2.1 MB 00:00 2026-02-13T02:15:54.170 INFO:teuthology.orchestra.run.trial078.stdout:(16/185): libcephfs-devel-20.3.0-5241.g8f8d3829 2.1 MB/s | 37 kB 00:00 2026-02-13T02:15:54.174 INFO:teuthology.orchestra.run.trial060.stdout:(108/185): libpciaccess-0.16-16.el10.x86_64.rpm 1.7 MB/s | 27 kB 00:00 2026-02-13T02:15:54.182 INFO:teuthology.orchestra.run.trial060.stdout:(109/185): libgfortran-14.3.1-2.1.el10.x86_64.r 33 MB/s | 827 kB 00:00 2026-02-13T02:15:54.183 INFO:teuthology.orchestra.run.trial060.stdout:(110/185): libquadmath-14.3.1-2.1.el10.x86_64.r 10 MB/s | 215 kB 00:00 2026-02-13T02:15:54.187 INFO:teuthology.orchestra.run.trial078.stdout:(17/185): libcephfs-proxy2-20.3.0-5241.g8f8d382 1.4 MB/s | 25 kB 00:00 2026-02-13T02:15:54.187 INFO:teuthology.orchestra.run.trial060.stdout:(111/185): mailcap-2.1.54-8.el10.noarch.rpm 2.5 MB/s | 34 kB 00:00 2026-02-13T02:15:54.202 INFO:teuthology.orchestra.run.trial060.stdout:(112/185): ocl-icd-2.3.2-8.el10.x86_64.rpm 3.3 MB/s | 66 kB 00:00 2026-02-13T02:15:54.203 INFO:teuthology.orchestra.run.trial011.stdout:(8/185): ceph-mon-20.3.0-5241.g8f8d3829.el10.x8 3.6 MB/s | 6.0 MB 00:01 2026-02-13T02:15:54.203 INFO:teuthology.orchestra.run.trial060.stdout:(113/185): ndctl-libs-80-4.el10.x86_64.rpm 4.2 MB/s | 89 kB 00:00 2026-02-13T02:15:54.212 INFO:teuthology.orchestra.run.trial060.stdout:(114/185): pciutils-3.13.0-6.el10.x86_64.rpm 4.8 MB/s | 122 kB 00:00 2026-02-13T02:15:54.226 INFO:teuthology.orchestra.run.trial060.stdout:(115/185): python3-cffi-1.16.0-7.el10.x86_64.rp 13 MB/s | 310 kB 00:00 2026-02-13T02:15:54.233 INFO:teuthology.orchestra.run.trial060.stdout:(116/185): python3-cryptography-43.0.0-4.el10.x 44 MB/s | 1.3 MB 00:00 2026-02-13T02:15:54.241 INFO:teuthology.orchestra.run.trial060.stdout:(117/185): python3-packaging-24.2-2.el10.noarch 5.2 MB/s | 155 kB 00:00 2026-02-13T02:15:54.242 INFO:teuthology.orchestra.run.trial078.stdout:(18/185): libcephfs2-20.3.0-5241.g8f8d3829.el10 17 MB/s | 937 kB 00:00 2026-02-13T02:15:54.250 INFO:teuthology.orchestra.run.trial060.stdout:(118/185): python3-ply-3.11-25.el10.noarch.rpm 5.5 MB/s | 137 kB 00:00 2026-02-13T02:15:54.254 INFO:teuthology.orchestra.run.trial060.stdout:(119/185): python3-pycparser-2.20-16.el10.noarc 7.6 MB/s | 160 kB 00:00 2026-02-13T02:15:54.259 INFO:teuthology.orchestra.run.trial060.stdout:(120/185): python3-requests-2.32.4-1.el10_0.noa 8.7 MB/s | 160 kB 00:00 2026-02-13T02:15:54.263 INFO:teuthology.orchestra.run.trial078.stdout:(19/185): libcephsqlite-20.3.0-5241.g8f8d3829.e 7.7 MB/s | 168 kB 00:00 2026-02-13T02:15:54.272 INFO:teuthology.orchestra.run.trial060.stdout:(121/185): unzip-6.0-69.el10.x86_64.rpm 9.9 MB/s | 188 kB 00:00 2026-02-13T02:15:54.273 INFO:teuthology.orchestra.run.trial060.stdout:(122/185): python3-urllib3-1.26.19-2.el10_1.1.n 12 MB/s | 285 kB 00:00 2026-02-13T02:15:54.280 INFO:teuthology.orchestra.run.trial060.stdout:(123/185): zip-3.0-45.el10.x86_64.rpm 13 MB/s | 271 kB 00:00 2026-02-13T02:15:54.283 INFO:teuthology.orchestra.run.trial078.stdout:(20/185): librados-devel-20.3.0-5241.g8f8d3829. 6.3 MB/s | 128 kB 00:00 2026-02-13T02:15:54.297 INFO:teuthology.orchestra.run.trial060.stdout:(124/185): lua-devel-5.4.6-7.el10.x86_64.rpm 937 kB/s | 22 kB 00:00 2026-02-13T02:15:54.306 INFO:teuthology.orchestra.run.trial060.stdout:(125/185): lttng-ust-2.13.7-5.el10.x86_64.rpm 9.8 MB/s | 334 kB 00:00 2026-02-13T02:15:54.306 INFO:teuthology.orchestra.run.trial078.stdout:(21/185): libradosstriper1-20.3.0-5241.g8f8d382 11 MB/s | 252 kB 00:00 2026-02-13T02:15:54.402 INFO:teuthology.orchestra.run.trial060.stdout:(126/185): protobuf-compiler-3.19.6-11.el10.x86 6.3 MB/s | 787 kB 00:00 2026-02-13T02:15:54.428 INFO:teuthology.orchestra.run.trial060.stdout:(127/185): gperftools-libs-2.15-4.el10_0.x86_64 2.4 MB/s | 303 kB 00:00 2026-02-13T02:15:54.467 INFO:teuthology.orchestra.run.trial060.stdout:(128/185): grpc-data-1.48.4-44.el10_0.noarch.rp 320 kB/s | 21 kB 00:00 2026-02-13T02:15:54.490 INFO:teuthology.orchestra.run.trial060.stdout:(129/185): abseil-cpp-20240722.1-1.el10_0.x86_6 3.0 MB/s | 590 kB 00:00 2026-02-13T02:15:54.490 INFO:teuthology.orchestra.run.trial060.stdout:(130/185): libarrow-doc-17.0.0-9.el10_2.noarch. 1.1 MB/s | 27 kB 00:00 2026-02-13T02:15:54.517 INFO:teuthology.orchestra.run.trial060.stdout:(131/185): liboath-2.6.12-1.el10_0.x86_64.rpm 1.7 MB/s | 48 kB 00:00 2026-02-13T02:15:54.542 INFO:teuthology.orchestra.run.trial060.stdout:(132/185): libarrow-17.0.0-9.el10_2.x86_64.rpm 50 MB/s | 5.7 MB 00:00 2026-02-13T02:15:54.545 INFO:teuthology.orchestra.run.trial060.stdout:(133/185): libpmem-2.1.0-2.el10_0.x86_64.rpm 3.9 MB/s | 112 kB 00:00 2026-02-13T02:15:54.569 INFO:teuthology.orchestra.run.trial060.stdout:(134/185): libpmemobj-2.1.0-2.el10_0.x86_64.rpm 5.7 MB/s | 161 kB 00:00 2026-02-13T02:15:54.572 INFO:teuthology.orchestra.run.trial060.stdout:(135/185): liborc2-2.0.7-1.el10_2.x86_64.rpm 6.1 MB/s | 515 kB 00:00 2026-02-13T02:15:54.573 INFO:teuthology.orchestra.run.trial060.stdout:(136/185): libunwind-1.8.0-4.el10_0.x86_64.rpm 2.6 MB/s | 73 kB 00:00 2026-02-13T02:15:54.598 INFO:teuthology.orchestra.run.trial060.stdout:(137/185): luarocks-3.9.2-6.el10_0.noarch.rpm 5.2 MB/s | 152 kB 00:00 2026-02-13T02:15:54.605 INFO:teuthology.orchestra.run.trial078.stdout:(22/185): librgw2-20.3.0-5241.g8f8d3829.el10.x8 22 MB/s | 6.7 MB 00:00 2026-02-13T02:15:54.621 INFO:teuthology.orchestra.run.trial060.stdout:(138/185): python3-asyncssh-2.17.0-1.el10_0.noa 15 MB/s | 756 kB 00:00 2026-02-13T02:15:54.623 INFO:teuthology.orchestra.run.trial060.stdout:(139/185): parquet-libs-17.0.0-9.el10_2.x86_64. 20 MB/s | 1.0 MB 00:00 2026-02-13T02:15:54.623 INFO:teuthology.orchestra.run.trial060.stdout:(140/185): python3-autocommand-2.2.2-9.el10_0.n 1.2 MB/s | 32 kB 00:00 2026-02-13T02:15:54.624 INFO:teuthology.orchestra.run.trial078.stdout:(23/185): python3-ceph-argparse-20.3.0-5241.g8f 2.9 MB/s | 57 kB 00:00 2026-02-13T02:15:54.644 INFO:teuthology.orchestra.run.trial060.stdout:(141/185): python3-bcrypt-4.3.0-3.el10_1.x86_64 10 MB/s | 238 kB 00:00 2026-02-13T02:15:54.644 INFO:teuthology.orchestra.run.trial060.stdout:(142/185): python3-certifi-2023.05.07-6.el10_0. 691 kB/s | 14 kB 00:00 2026-02-13T02:15:54.646 INFO:teuthology.orchestra.run.trial078.stdout:(24/185): python3-ceph-common-20.3.0-5241.g8f8d 11 MB/s | 237 kB 00:00 2026-02-13T02:15:54.650 INFO:teuthology.orchestra.run.trial060.stdout:(143/185): python3-cachetools-5.4.0-6.el10_0.no 1.3 MB/s | 37 kB 00:00 2026-02-13T02:15:54.668 INFO:teuthology.orchestra.run.trial060.stdout:(144/185): python3-cheroot-10.0.1-4.el10_0.noar 9.0 MB/s | 215 kB 00:00 2026-02-13T02:15:54.669 INFO:teuthology.orchestra.run.trial078.stdout:(25/185): python3-cephfs-20.3.0-5241.g8f8d3829. 11 MB/s | 253 kB 00:00 2026-02-13T02:15:54.674 INFO:teuthology.orchestra.run.trial060.stdout:(145/185): python3-cherrypy-18.10.0-4.el10_0.no 12 MB/s | 359 kB 00:00 2026-02-13T02:15:54.677 INFO:teuthology.orchestra.run.trial060.stdout:(146/185): python3-cmd2-2.5.8-1.el10_2.noarch.r 14 MB/s | 375 kB 00:00 2026-02-13T02:15:54.689 INFO:teuthology.orchestra.run.trial060.stdout:(147/185): python3-durationpy-0.9-2.el10_0.noar 696 kB/s | 15 kB 00:00 2026-02-13T02:15:54.694 INFO:teuthology.orchestra.run.trial078.stdout:(26/185): python3-rados-20.3.0-5241.g8f8d3829.e 14 MB/s | 352 kB 00:00 2026-02-13T02:15:54.700 INFO:teuthology.orchestra.run.trial060.stdout:(148/185): python3-google-auth-2.40.3-1.el10_1. 11 MB/s | 286 kB 00:00 2026-02-13T02:15:54.712 INFO:teuthology.orchestra.run.trial060.stdout:(149/185): python3-grpcio-tools-1.48.4-44.el10_ 6.6 MB/s | 157 kB 00:00 2026-02-13T02:15:54.719 INFO:teuthology.orchestra.run.trial078.stdout:(27/185): python3-rbd-20.3.0-5241.g8f8d3829.el1 15 MB/s | 372 kB 00:00 2026-02-13T02:15:54.722 INFO:teuthology.orchestra.run.trial060.stdout:(150/185): python3-isodate-0.6.1-14.el10_0.noar 3.0 MB/s | 66 kB 00:00 2026-02-13T02:15:54.733 INFO:teuthology.orchestra.run.trial060.stdout:(151/185): python3-jaraco-collections-5.1.0-1.e 1.3 MB/s | 29 kB 00:00 2026-02-13T02:15:54.740 INFO:teuthology.orchestra.run.trial078.stdout:(28/185): python3-rgw-20.3.0-5241.g8f8d3829.el1 6.2 MB/s | 130 kB 00:00 2026-02-13T02:15:54.743 INFO:teuthology.orchestra.run.trial060.stdout:(152/185): python3-jaraco-context-6.0.1-4.el10_ 1.0 MB/s | 21 kB 00:00 2026-02-13T02:15:54.755 INFO:teuthology.orchestra.run.trial060.stdout:(153/185): python3-jaraco-functools-4.0.2-4.el1 1.0 MB/s | 23 kB 00:00 2026-02-13T02:15:54.759 INFO:teuthology.orchestra.run.trial078.stdout:(29/185): rbd-fuse-20.3.0-5241.g8f8d3829.el10.x 4.4 MB/s | 87 kB 00:00 2026-02-13T02:15:54.765 INFO:teuthology.orchestra.run.trial060.stdout:(154/185): python3-jaraco-text-4.0.0-3.el10_0.n 1.3 MB/s | 29 kB 00:00 2026-02-13T02:15:54.769 INFO:teuthology.orchestra.run.trial060.stdout:(155/185): python3-grpcio-1.48.4-44.el10_0.x86_ 25 MB/s | 2.3 MB 00:00 2026-02-13T02:15:54.786 INFO:teuthology.orchestra.run.trial060.stdout:(156/185): python3-kubernetes-32.0.1-1.el10_1.n 44 MB/s | 1.3 MB 00:00 2026-02-13T02:15:54.788 INFO:teuthology.orchestra.run.trial060.stdout:(157/185): python3-more-itertools-10.1.0-8.el10 4.2 MB/s | 100 kB 00:00 2026-02-13T02:15:54.798 INFO:teuthology.orchestra.run.trial060.stdout:(158/185): python3-natsort-8.4.0-2.el10_0.noarc 2.4 MB/s | 72 kB 00:00 2026-02-13T02:15:54.809 INFO:teuthology.orchestra.run.trial060.stdout:(159/185): python3-portend-3.2.0-6.el10_0.noarc 772 kB/s | 18 kB 00:00 2026-02-13T02:15:54.815 INFO:teuthology.orchestra.run.trial060.stdout:(160/185): python3-pyOpenSSL-25.0.0-1.el10_1.no 4.2 MB/s | 113 kB 00:00 2026-02-13T02:15:54.825 INFO:teuthology.orchestra.run.trial060.stdout:(161/185): python3-pyperclip-1.8.2-1.el10_0.noa 1.0 MB/s | 28 kB 00:00 2026-02-13T02:15:54.831 INFO:teuthology.orchestra.run.trial060.stdout:(162/185): python3-repoze-lru-0.7-23.el10_0.noa 1.6 MB/s | 36 kB 00:00 2026-02-13T02:15:54.840 INFO:teuthology.orchestra.run.trial060.stdout:(163/185): python3-routes-2.5.1-11.el10_0.noarc 7.7 MB/s | 201 kB 00:00 2026-02-13T02:15:54.852 INFO:teuthology.orchestra.run.trial060.stdout:(164/185): python3-rsa-4.9-7.el10_0.noarch.rpm 2.5 MB/s | 70 kB 00:00 2026-02-13T02:15:54.854 INFO:teuthology.orchestra.run.trial060.stdout:(165/185): python3-tempora-5.7.0-1.el10_0.noarc 1.6 MB/s | 37 kB 00:00 2026-02-13T02:15:54.863 INFO:teuthology.orchestra.run.trial060.stdout:(166/185): python3-websocket-client-1.8.0-2.el1 5.3 MB/s | 124 kB 00:00 2026-02-13T02:15:54.877 INFO:teuthology.orchestra.run.trial060.stdout:(167/185): python3-zc-lockfile-3.0.post1-11.el1 992 kB/s | 23 kB 00:00 2026-02-13T02:15:54.878 INFO:teuthology.orchestra.run.trial060.stdout:(168/185): python3-xmltodict-0.13.0-5.el10_0.no 1.0 MB/s | 26 kB 00:00 2026-02-13T02:15:54.889 INFO:teuthology.orchestra.run.trial060.stdout:(169/185): re2-20251105-1.el10_2.x86_64.rpm 8.6 MB/s | 221 kB 00:00 2026-02-13T02:15:54.894 INFO:teuthology.orchestra.run.trial060.stdout:(170/185): python3-saml-1.16.0-11.el10.noarch.r 27 MB/s | 150 kB 00:00 2026-02-13T02:15:54.896 INFO:teuthology.orchestra.run.trial060.stdout:(171/185): python3-xmlsec-1.3.16-1.el10.x86_64. 28 MB/s | 49 kB 00:00 2026-02-13T02:15:54.905 INFO:teuthology.orchestra.run.trial060.stdout:(172/185): thrift-0.20.0-4.el10_1.x86_64.rpm 60 MB/s | 1.7 MB 00:00 2026-02-13T02:15:54.905 INFO:teuthology.orchestra.run.trial060.stdout:(173/185): yaml-cpp0.7-0.7.0-1.el10_2.x86_64.rp 4.6 MB/s | 127 kB 00:00 2026-02-13T02:15:54.906 INFO:teuthology.orchestra.run.trial078.stdout:(30/185): rbd-mirror-20.3.0-5241.g8f8d3829.el10 20 MB/s | 2.9 MB 00:00 2026-02-13T02:15:54.921 INFO:teuthology.orchestra.run.trial060.stdout:(174/185): libblkid-2.40.2-15.el10_1.x86_64.rpm 7.4 MB/s | 124 kB 00:00 2026-02-13T02:15:54.930 INFO:teuthology.orchestra.run.trial078.stdout:(31/185): rbd-nbd-20.3.0-5241.g8f8d3829.el10.x8 7.4 MB/s | 180 kB 00:00 2026-02-13T02:15:54.937 INFO:teuthology.orchestra.run.trial060.stdout:(175/185): libfdisk-2.40.2-15.el10_1.x86_64.rpm 10 MB/s | 159 kB 00:00 2026-02-13T02:15:54.950 INFO:teuthology.orchestra.run.trial078.stdout:(32/185): ceph-grafana-dashboards-20.3.0-5241.g 2.8 MB/s | 57 kB 00:00 2026-02-13T02:15:54.953 INFO:teuthology.orchestra.run.trial060.stdout:(176/185): libmount-2.40.2-15.el10_1.x86_64.rpm 9.3 MB/s | 154 kB 00:00 2026-02-13T02:15:54.968 INFO:teuthology.orchestra.run.trial060.stdout:(177/185): libsmartcols-2.40.2-15.el10_1.x86_64 5.5 MB/s | 83 kB 00:00 2026-02-13T02:15:54.974 INFO:teuthology.orchestra.run.trial078.stdout:(33/185): ceph-mgr-cephadm-20.3.0-5241.g8f8d382 7.5 MB/s | 183 kB 00:00 2026-02-13T02:15:54.981 INFO:teuthology.orchestra.run.trial060.stdout:(178/185): libuuid-2.40.2-15.el10_1.x86_64.rpm 2.2 MB/s | 28 kB 00:00 2026-02-13T02:15:55.128 INFO:teuthology.orchestra.run.trial060.stdout:(179/185): openssl-3.5.1-7.el10_1.x86_64.rpm 8.4 MB/s | 1.2 MB 00:00 2026-02-13T02:15:55.158 INFO:teuthology.orchestra.run.trial060.stdout:(180/185): openssl-fips-provider-3.5.1-7.el10_1 27 MB/s | 812 kB 00:00 2026-02-13T02:15:55.203 INFO:teuthology.orchestra.run.trial060.stdout:(181/185): openssl-libs-3.5.1-7.el10_1.x86_64.r 50 MB/s | 2.2 MB 00:00 2026-02-13T02:15:55.224 INFO:teuthology.orchestra.run.trial060.stdout:(182/185): librbd1-20.3.0-5241.g8f8d3829.el10.x 8.9 MB/s | 2.8 MB 00:00 2026-02-13T02:15:55.229 INFO:teuthology.orchestra.run.trial060.stdout:(183/185): util-linux-2.40.2-15.el10_1.x86_64.r 48 MB/s | 1.2 MB 00:00 2026-02-13T02:15:55.246 INFO:teuthology.orchestra.run.trial060.stdout:(184/185): util-linux-core-2.40.2-15.el10_1.x86 25 MB/s | 542 kB 00:00 2026-02-13T02:15:55.367 INFO:teuthology.orchestra.run.trial060.stdout:(185/185): librados2-20.3.0-5241.g8f8d3829.el10 7.7 MB/s | 3.6 MB 00:00 2026-02-13T02:15:55.369 INFO:teuthology.orchestra.run.trial060.stdout:-------------------------------------------------------------------------------- 2026-02-13T02:15:55.369 INFO:teuthology.orchestra.run.trial060.stdout:Total 43 MB/s | 305 MB 00:07 2026-02-13T02:15:55.370 INFO:teuthology.orchestra.run.trial060.stdout:Running transaction check 2026-02-13T02:15:55.455 INFO:teuthology.orchestra.run.trial060.stdout:Transaction check succeeded. 2026-02-13T02:15:55.455 INFO:teuthology.orchestra.run.trial060.stdout:Running transaction test 2026-02-13T02:15:55.750 INFO:teuthology.orchestra.run.trial078.stdout:(34/185): ceph-mgr-dashboard-20.3.0-5241.g8f8d3 19 MB/s | 15 MB 00:00 2026-02-13T02:15:56.084 INFO:teuthology.orchestra.run.trial078.stdout:(35/185): ceph-mgr-diskprediction-local-20.3.0- 22 MB/s | 7.4 MB 00:00 2026-02-13T02:15:56.105 INFO:teuthology.orchestra.run.trial078.stdout:(36/185): ceph-mgr-k8sevents-20.3.0-5241.g8f8d3 1.0 MB/s | 22 kB 00:00 2026-02-13T02:15:56.131 INFO:teuthology.orchestra.run.trial078.stdout:(37/185): ceph-mgr-modules-core-20.3.0-5241.g8f 11 MB/s | 297 kB 00:00 2026-02-13T02:15:56.152 INFO:teuthology.orchestra.run.trial078.stdout:(38/185): ceph-mgr-rook-20.3.0-5241.g8f8d3829.e 2.3 MB/s | 50 kB 00:00 2026-02-13T02:15:56.173 INFO:teuthology.orchestra.run.trial078.stdout:(39/185): ceph-prometheus-alerts-20.3.0-5241.g8 848 kB/s | 17 kB 00:00 2026-02-13T02:15:56.201 INFO:teuthology.orchestra.run.trial078.stdout:(40/185): ceph-volume-20.3.0-5241.g8f8d3829.el1 13 MB/s | 374 kB 00:00 2026-02-13T02:15:56.266 INFO:teuthology.orchestra.run.trial078.stdout:(41/185): cephadm-20.3.0-5241.g8f8d3829.el10.no 20 MB/s | 1.3 MB 00:00 2026-02-13T02:15:56.287 INFO:teuthology.orchestra.run.trial078.stdout:(42/185): cephfs-top-20.3.0-5241.g8f8d3829.el10 878 kB/s | 18 kB 00:00 2026-02-13T02:15:56.336 INFO:teuthology.orchestra.run.trial078.stdout:(43/185): automake-1.16.5-20.el10.noarch.rpm 14 MB/s | 704 kB 00:00 2026-02-13T02:15:56.366 INFO:teuthology.orchestra.run.trial078.stdout:(44/185): bison-3.8.2-9.el10.x86_64.rpm 33 MB/s | 1.0 MB 00:00 2026-02-13T02:15:56.384 INFO:teuthology.orchestra.run.trial078.stdout:(45/185): boost-program-options-1.83.0-5.el10.x 6.1 MB/s | 109 kB 00:00 2026-02-13T02:15:56.401 INFO:teuthology.orchestra.run.trial078.stdout:(46/185): cmake-filesystem-3.30.5-3.el10_0.x86_ 925 kB/s | 15 kB 00:00 2026-02-13T02:15:56.415 INFO:teuthology.orchestra.run.trial078.stdout:(47/185): elfutils-libelf-devel-0.193-1.el10.ro 3.3 MB/s | 48 kB 00:00 2026-02-13T02:15:56.434 INFO:teuthology.orchestra.run.trial078.stdout:(48/185): flex-2.6.4-19.el10.x86_64.rpm 15 MB/s | 300 kB 00:00 2026-02-13T02:15:56.451 INFO:teuthology.orchestra.run.trial078.stdout:(49/185): flexiblas-3.4.2-3.el10.x86_64.rpm 1.5 MB/s | 25 kB 00:00 2026-02-13T02:15:56.506 INFO:teuthology.orchestra.run.trial011.stdout:(9/185): ceph-common-20.3.0-5241.g8f8d3829.el10 3.5 MB/s | 25 MB 00:07 2026-02-13T02:15:56.513 INFO:teuthology.orchestra.run.trial078.stdout:(50/185): flexiblas-netlib-3.4.2-3.el10.x86_64. 52 MB/s | 3.2 MB 00:00 2026-02-13T02:15:56.527 INFO:teuthology.orchestra.run.trial078.stdout:(51/185): flexiblas-openblas-openmp-3.4.2-3.el1 1.2 MB/s | 17 kB 00:00 2026-02-13T02:15:56.528 INFO:teuthology.orchestra.run.trial011.stdout:(10/185): ceph-osd-classic-20.3.0-5241.g8f8d382 4.9 MB/s | 17 MB 00:03 2026-02-13T02:15:56.536 INFO:teuthology.orchestra.run.trial060.stdout:Transaction test succeeded. 2026-02-13T02:15:56.537 INFO:teuthology.orchestra.run.trial060.stdout:Running transaction 2026-02-13T02:15:56.543 INFO:teuthology.orchestra.run.trial078.stdout:(52/185): ledmon-libs-1.1.0-2.el10.x86_64.rpm 2.6 MB/s | 42 kB 00:00 2026-02-13T02:15:56.547 INFO:teuthology.orchestra.run.trial011.stdout:(11/185): ceph-selinux-20.3.0-5241.g8f8d3829.el 1.3 MB/s | 25 kB 00:00 2026-02-13T02:15:56.557 INFO:teuthology.orchestra.run.trial078.stdout:(53/185): libaio-devel-0.3.111-22.el10.x86_64.r 737 kB/s | 10 kB 00:00 2026-02-13T02:15:56.575 INFO:teuthology.orchestra.run.trial078.stdout:(54/185): libnbd-1.22.2-3.el10_1.x86_64.rpm 9.7 MB/s | 175 kB 00:00 2026-02-13T02:15:56.589 INFO:teuthology.orchestra.run.trial078.stdout:(55/185): librabbitmq-0.14.0-3.el10.x86_64.rpm 3.0 MB/s | 43 kB 00:00 2026-02-13T02:15:56.610 INFO:teuthology.orchestra.run.trial078.stdout:(56/185): librdkafka-2.1.1-7.el10.x86_64.rpm 34 MB/s | 725 kB 00:00 2026-02-13T02:15:56.628 INFO:teuthology.orchestra.run.trial078.stdout:(57/185): libstoragemgmt-1.10.1-4.el10.x86_64.r 13 MB/s | 251 kB 00:00 2026-02-13T02:15:56.650 INFO:teuthology.orchestra.run.trial078.stdout:(58/185): libtool-2.4.7-13.el10.x86_64.rpm 28 MB/s | 601 kB 00:00 2026-02-13T02:15:56.669 INFO:teuthology.orchestra.run.trial078.stdout:(59/185): libtool-ltdl-2.4.7-13.el10.x86_64.rpm 1.8 MB/s | 36 kB 00:00 2026-02-13T02:15:56.684 INFO:teuthology.orchestra.run.trial078.stdout:(60/185): libuuid-devel-2.40.2-15.el10_1.x86_64 2.4 MB/s | 37 kB 00:00 2026-02-13T02:15:56.702 INFO:teuthology.orchestra.run.trial078.stdout:(61/185): libxslt-1.1.39-8.el10_0.x86_64.rpm 10 MB/s | 189 kB 00:00 2026-02-13T02:15:56.716 INFO:teuthology.orchestra.run.trial078.stdout:(62/185): libzstd-devel-1.5.5-9.el10.x86_64.rpm 3.5 MB/s | 51 kB 00:00 2026-02-13T02:15:56.734 INFO:teuthology.orchestra.run.trial078.stdout:(63/185): lua-5.4.6-7.el10.x86_64.rpm 10 MB/s | 190 kB 00:00 2026-02-13T02:15:56.762 INFO:teuthology.orchestra.run.trial078.stdout:(64/185): ceph-osd-crimson-20.3.0-5241.g8f8d382 4.0 MB/s | 20 MB 00:04 2026-02-13T02:15:56.762 INFO:teuthology.orchestra.run.trial078.stdout:(65/185): openblas-0.3.29-2.el10.x86_64.rpm 1.5 MB/s | 43 kB 00:00 2026-02-13T02:15:56.816 INFO:teuthology.orchestra.run.trial078.stdout:(66/185): openssl-devel-3.5.1-7.el10_1.x86_64.r 56 MB/s | 3.0 MB 00:00 2026-02-13T02:15:56.833 INFO:teuthology.orchestra.run.trial078.stdout:(67/185): perl-Thread-Queue-3.14-511.el10.noarc 1.3 MB/s | 21 kB 00:00 2026-02-13T02:15:56.846 INFO:teuthology.orchestra.run.trial078.stdout:(68/185): openblas-openmp-0.3.29-2.el10.x86_64. 63 MB/s | 5.3 MB 00:00 2026-02-13T02:15:56.848 INFO:teuthology.orchestra.run.trial078.stdout:(69/185): perl-threads-2.40-511.el10.x86_64.rpm 3.9 MB/s | 58 kB 00:00 2026-02-13T02:15:56.861 INFO:teuthology.orchestra.run.trial078.stdout:(70/185): perl-threads-shared-1.69-511.el10.x86 3.0 MB/s | 45 kB 00:00 2026-02-13T02:15:56.889 INFO:teuthology.orchestra.run.trial078.stdout:(71/185): postgresql-contrib-16.11-1.el10_1.x86 36 MB/s | 1.0 MB 00:00 2026-02-13T02:15:56.892 INFO:teuthology.orchestra.run.trial078.stdout:(72/185): postgresql-16.11-1.el10_1.x86_64.rpm 44 MB/s | 2.0 MB 00:00 2026-02-13T02:15:56.929 INFO:teuthology.orchestra.run.trial078.stdout:(73/185): postgresql-private-libs-16.11-1.el10_ 3.5 MB/s | 143 kB 00:00 2026-02-13T02:15:56.965 INFO:teuthology.orchestra.run.trial078.stdout:(74/185): protobuf-3.19.6-11.el10.x86_64.rpm 29 MB/s | 1.0 MB 00:00 2026-02-13T02:15:56.976 INFO:teuthology.orchestra.run.trial011.stdout:(12/185): ceph-osd-crimson-20.3.0-5241.g8f8d382 7.1 MB/s | 20 MB 00:02 2026-02-13T02:15:56.983 INFO:teuthology.orchestra.run.trial078.stdout:(75/185): python3-colorama-0.4.6-13.el10.noarch 4.0 MB/s | 74 kB 00:00 2026-02-13T02:15:56.991 INFO:teuthology.orchestra.run.trial078.stdout:(76/185): postgresql-server-16.11-1.el10_1.x86_ 70 MB/s | 7.0 MB 00:00 2026-02-13T02:15:57.002 INFO:teuthology.orchestra.run.trial078.stdout:(77/185): python3-devel-3.12.12-2.el10_1.x86_64 17 MB/s | 329 kB 00:00 2026-02-13T02:15:57.007 INFO:teuthology.orchestra.run.trial011.stdout:(13/185): cephfs-mirror-20.3.0-5241.g8f8d3829.e 8.0 MB/s | 252 kB 00:00 2026-02-13T02:15:57.012 INFO:teuthology.orchestra.run.trial078.stdout:(78/185): python3-jinja2-3.1.6-1.el10_0.noarch. 16 MB/s | 330 kB 00:00 2026-02-13T02:15:57.022 INFO:teuthology.orchestra.run.trial011.stdout:(14/185): cephfs-shell-20.3.0-5241.g8f8d3829.el 1.8 MB/s | 27 kB 00:00 2026-02-13T02:15:57.030 INFO:teuthology.orchestra.run.trial078.stdout:(79/185): python3-libstoragemgmt-1.10.1-4.el10. 12 MB/s | 219 kB 00:00 2026-02-13T02:15:57.030 INFO:teuthology.orchestra.run.trial078.stdout:(80/185): python3-jmespath-1.0.1-8.el10.noarch. 2.1 MB/s | 60 kB 00:00 2026-02-13T02:15:57.037 INFO:teuthology.orchestra.run.trial011.stdout:(15/185): libcephfs-daemon-20.3.0-5241.g8f8d382 2.4 MB/s | 37 kB 00:00 2026-02-13T02:15:57.045 INFO:teuthology.orchestra.run.trial078.stdout:(81/185): python3-markupsafe-2.1.3-6.el10.x86_6 2.3 MB/s | 34 kB 00:00 2026-02-13T02:15:57.053 INFO:teuthology.orchestra.run.trial011.stdout:(16/185): libcephfs-devel-20.3.0-5241.g8f8d3829 2.4 MB/s | 37 kB 00:00 2026-02-13T02:15:57.060 INFO:teuthology.orchestra.run.trial078.stdout:(82/185): python3-lxml-5.2.1-4.el10.x86_64.rpm 46 MB/s | 1.4 MB 00:00 2026-02-13T02:15:57.068 INFO:teuthology.orchestra.run.trial011.stdout:(17/185): libcephfs-proxy2-20.3.0-5241.g8f8d382 1.6 MB/s | 25 kB 00:00 2026-02-13T02:15:57.081 INFO:teuthology.orchestra.run.trial078.stdout:(83/185): python3-numpy-f2py-1.26.4-5.el10.x86_ 23 MB/s | 490 kB 00:00 2026-02-13T02:15:57.100 INFO:teuthology.orchestra.run.trial078.stdout:(84/185): python3-prettytable-3.6.0-10.el10.noa 3.8 MB/s | 70 kB 00:00 2026-02-13T02:15:57.118 INFO:teuthology.orchestra.run.trial078.stdout:(85/185): python3-protobuf-3.19.6-11.el10.x86_6 22 MB/s | 419 kB 00:00 2026-02-13T02:15:57.136 INFO:teuthology.orchestra.run.trial078.stdout:(86/185): python3-pyasn1-0.6.1-1.el10.noarch.rp 11 MB/s | 198 kB 00:00 2026-02-13T02:15:57.146 INFO:teuthology.orchestra.run.trial078.stdout:(87/185): python3-numpy-1.26.4-5.el10.x86_64.rp 66 MB/s | 6.7 MB 00:00 2026-02-13T02:15:57.156 INFO:teuthology.orchestra.run.trial078.stdout:(88/185): python3-pyasn1-modules-0.6.1-1.el10.n 19 MB/s | 402 kB 00:00 2026-02-13T02:15:57.158 INFO:teuthology.orchestra.run.trial011.stdout:(18/185): libcephfs2-20.3.0-5241.g8f8d3829.el10 10 MB/s | 937 kB 00:00 2026-02-13T02:15:57.161 INFO:teuthology.orchestra.run.trial078.stdout:(89/185): python3-requests-oauthlib-1.3.1-11.el 3.9 MB/s | 60 kB 00:00 2026-02-13T02:15:57.177 INFO:teuthology.orchestra.run.trial011.stdout:(19/185): libcephsqlite-20.3.0-5241.g8f8d3829.e 8.8 MB/s | 168 kB 00:00 2026-02-13T02:15:57.180 INFO:teuthology.orchestra.run.trial078.stdout:(90/185): qatlib-24.09.0-2.el10.x86_64.rpm 12 MB/s | 229 kB 00:00 2026-02-13T02:15:57.195 INFO:teuthology.orchestra.run.trial011.stdout:(20/185): librados-devel-20.3.0-5241.g8f8d3829. 7.1 MB/s | 128 kB 00:00 2026-02-13T02:15:57.202 INFO:teuthology.orchestra.run.trial078.stdout:(91/185): qatlib-service-24.09.0-2.el10.x86_64. 1.7 MB/s | 37 kB 00:00 2026-02-13T02:15:57.219 INFO:teuthology.orchestra.run.trial078.stdout:(92/185): qatzip-libs-1.3.1-1.el10.x86_64.rpm 3.7 MB/s | 66 kB 00:00 2026-02-13T02:15:57.230 INFO:teuthology.orchestra.run.trial011.stdout:(21/185): libradosstriper1-20.3.0-5241.g8f8d382 7.1 MB/s | 252 kB 00:00 2026-02-13T02:15:57.284 INFO:teuthology.orchestra.run.trial078.stdout:(93/185): socat-1.7.4.4-8.el10.x86_64.rpm 4.6 MB/s | 303 kB 00:00 2026-02-13T02:15:57.301 INFO:teuthology.orchestra.run.trial078.stdout:(94/185): utf8proc-2.7.0-9.el10.x86_64.rpm 4.4 MB/s | 80 kB 00:00 2026-02-13T02:15:57.317 INFO:teuthology.orchestra.run.trial078.stdout:(95/185): uuid-1.6.2-65.el10.x86_64.rpm 3.9 MB/s | 59 kB 00:00 2026-02-13T02:15:57.336 INFO:teuthology.orchestra.run.trial078.stdout:(96/185): xfsprogs-devel-6.11.0-2.el10.x86_64.r 5.2 MB/s | 105 kB 00:00 2026-02-13T02:15:57.369 INFO:teuthology.orchestra.run.trial078.stdout:(97/185): python3-scipy-1.11.3-17.el10.x86_64.r 76 MB/s | 16 MB 00:00 2026-02-13T02:15:57.373 INFO:teuthology.orchestra.run.trial078.stdout:(98/185): xmlsec1-1.2.39-3.el10.x86_64.rpm 5.1 MB/s | 193 kB 00:00 2026-02-13T02:15:57.386 INFO:teuthology.orchestra.run.trial078.stdout:(99/185): xmlsec1-openssl-1.2.39-3.el10.x86_64. 5.4 MB/s | 96 kB 00:00 2026-02-13T02:15:57.388 INFO:teuthology.orchestra.run.trial078.stdout:(100/185): xmlstarlet-1.6.1-27.el10.x86_64.rpm 4.1 MB/s | 63 kB 00:00 2026-02-13T02:15:57.401 INFO:teuthology.orchestra.run.trial078.stdout:(101/185): zlib-ng-compat-devel-2.2.3-2.el10.x8 2.5 MB/s | 38 kB 00:00 2026-02-13T02:15:57.408 INFO:teuthology.orchestra.run.trial078.stdout:(102/185): cryptsetup-2.7.5-2.el10.x86_64.rpm 17 MB/s | 335 kB 00:00 2026-02-13T02:15:57.416 INFO:teuthology.orchestra.run.trial078.stdout:(103/185): daxctl-libs-80-4.el10.x86_64.rpm 2.8 MB/s | 42 kB 00:00 2026-02-13T02:15:57.421 INFO:teuthology.orchestra.run.trial078.stdout:(104/185): fuse3-3.16.2-5.el10.x86_64.rpm 4.2 MB/s | 58 kB 00:00 2026-02-13T02:15:57.439 INFO:teuthology.orchestra.run.trial078.stdout:(105/185): libconfig-1.7.3-10.el10.x86_64.rpm 4.0 MB/s | 72 kB 00:00 2026-02-13T02:15:57.463 INFO:teuthology.orchestra.run.trial078.stdout:(106/185): libgfortran-14.3.1-2.1.el10.x86_64.r 34 MB/s | 827 kB 00:00 2026-02-13T02:15:57.476 INFO:teuthology.orchestra.run.trial078.stdout:(107/185): libpciaccess-0.16-16.el10.x86_64.rpm 1.9 MB/s | 27 kB 00:00 2026-02-13T02:15:57.495 INFO:teuthology.orchestra.run.trial078.stdout:(108/185): libquadmath-14.3.1-2.1.el10.x86_64.r 11 MB/s | 215 kB 00:00 2026-02-13T02:15:57.509 INFO:teuthology.orchestra.run.trial078.stdout:(109/185): mailcap-2.1.54-8.el10.noarch.rpm 2.5 MB/s | 34 kB 00:00 2026-02-13T02:15:57.527 INFO:teuthology.orchestra.run.trial078.stdout:(110/185): ndctl-libs-80-4.el10.x86_64.rpm 4.7 MB/s | 89 kB 00:00 2026-02-13T02:15:57.545 INFO:teuthology.orchestra.run.trial078.stdout:(111/185): ocl-icd-2.3.2-8.el10.x86_64.rpm 3.8 MB/s | 66 kB 00:00 2026-02-13T02:15:57.563 INFO:teuthology.orchestra.run.trial078.stdout:(112/185): pciutils-3.13.0-6.el10.x86_64.rpm 6.5 MB/s | 122 kB 00:00 2026-02-13T02:15:57.584 INFO:teuthology.orchestra.run.trial078.stdout:(113/185): python3-cffi-1.16.0-7.el10.x86_64.rp 14 MB/s | 310 kB 00:00 2026-02-13T02:15:57.616 INFO:teuthology.orchestra.run.trial078.stdout:(114/185): python3-cryptography-43.0.0-4.el10.x 43 MB/s | 1.3 MB 00:00 2026-02-13T02:15:57.634 INFO:teuthology.orchestra.run.trial078.stdout:(115/185): python3-packaging-24.2-2.el10.noarch 8.4 MB/s | 155 kB 00:00 2026-02-13T02:15:57.651 INFO:teuthology.orchestra.run.trial078.stdout:(116/185): python3-ply-3.11-25.el10.noarch.rpm 7.7 MB/s | 137 kB 00:00 2026-02-13T02:15:57.670 INFO:teuthology.orchestra.run.trial078.stdout:(117/185): python3-pycparser-2.20-16.el10.noarc 8.2 MB/s | 160 kB 00:00 2026-02-13T02:15:57.689 INFO:teuthology.orchestra.run.trial078.stdout:(118/185): python3-requests-2.32.4-1.el10_0.noa 8.5 MB/s | 160 kB 00:00 2026-02-13T02:15:57.692 INFO:teuthology.orchestra.run.trial060.stdout: Preparing : 1/1 2026-02-13T02:15:57.694 INFO:teuthology.orchestra.run.trial060.stdout: Upgrading : libuuid-2.40.2-15.el10_1.x86_64 1/197 2026-02-13T02:15:57.702 INFO:teuthology.orchestra.run.trial060.stdout: Upgrading : libblkid-2.40.2-15.el10_1.x86_64 2/197 2026-02-13T02:15:57.706 INFO:teuthology.orchestra.run.trial060.stdout: Installing : protobuf-3.19.6-11.el10.x86_64 3/197 2026-02-13T02:15:57.707 INFO:teuthology.orchestra.run.trial078.stdout:(119/185): python3-urllib3-1.26.19-2.el10_1.1.n 16 MB/s | 285 kB 00:00 2026-02-13T02:15:57.709 INFO:teuthology.orchestra.run.trial060.stdout: Installing : libxslt-1.1.39-8.el10_0.x86_64 4/197 2026-02-13T02:15:57.717 INFO:teuthology.orchestra.run.trial060.stdout: Installing : python3-more-itertools-10.1.0-8.el10_0.noarch 5/197 2026-02-13T02:15:57.720 INFO:teuthology.orchestra.run.trial060.stdout: Installing : lttng-ust-2.13.7-5.el10.x86_64 6/197 2026-02-13T02:15:57.722 INFO:teuthology.orchestra.run.trial060.stdout: Installing : python3-jaraco-functools-4.0.2-4.el10_0.noarch 7/197 2026-02-13T02:15:57.725 INFO:teuthology.orchestra.run.trial078.stdout:(120/185): unzip-6.0-69.el10.x86_64.rpm 9.9 MB/s | 188 kB 00:00 2026-02-13T02:15:57.728 INFO:teuthology.orchestra.run.trial060.stdout: Installing : daxctl-libs-80-4.el10.x86_64 8/197 2026-02-13T02:15:57.731 INFO:teuthology.orchestra.run.trial060.stdout: Installing : libgfortran-14.3.1-2.1.el10.x86_64 9/197 2026-02-13T02:15:57.734 INFO:teuthology.orchestra.run.trial060.stdout: Installing : libnbd-1.22.2-3.el10_1.x86_64 10/197 2026-02-13T02:15:57.739 INFO:teuthology.orchestra.run.trial078.stdout:(121/185): hwloc-libs-2.11.1-3.el10.x86_64.rpm 6.5 MB/s | 2.1 MB 00:00 2026-02-13T02:15:57.746 INFO:teuthology.orchestra.run.trial078.stdout:(122/185): zip-3.0-45.el10.x86_64.rpm 13 MB/s | 271 kB 00:00 2026-02-13T02:15:57.752 INFO:teuthology.orchestra.run.trial060.stdout: Installing : ndctl-libs-80-4.el10.x86_64 11/197 2026-02-13T02:15:57.756 INFO:teuthology.orchestra.run.trial060.stdout: Installing : python3-lxml-5.2.1-4.el10.x86_64 12/197 2026-02-13T02:15:57.758 INFO:teuthology.orchestra.run.trial078.stdout:(123/185): lttng-ust-2.13.7-5.el10.x86_64.rpm 17 MB/s | 334 kB 00:00 2026-02-13T02:15:57.759 INFO:teuthology.orchestra.run.trial060.stdout: Upgrading : libmount-2.40.2-15.el10_1.x86_64 13/197 2026-02-13T02:15:57.761 INFO:teuthology.orchestra.run.trial078.stdout:(124/185): lua-devel-5.4.6-7.el10.x86_64.rpm 1.5 MB/s | 22 kB 00:00 2026-02-13T02:15:57.761 INFO:teuthology.orchestra.run.trial060.stdout: Upgrading : libsmartcols-2.40.2-15.el10_1.x86_64 14/197 2026-02-13T02:15:57.763 INFO:teuthology.orchestra.run.trial060.stdout: Installing : yaml-cpp0.7-0.7.0-1.el10_2.x86_64 15/197 2026-02-13T02:15:57.764 INFO:teuthology.orchestra.run.trial060.stdout: Installing : liboath-2.6.12-1.el10_0.x86_64 16/197 2026-02-13T02:15:57.777 INFO:teuthology.orchestra.run.trial011.stdout:(22/185): ceph-radosgw-20.3.0-5241.g8f8d3829.el 11 MB/s | 14 MB 00:01 2026-02-13T02:15:57.780 INFO:teuthology.orchestra.run.trial078.stdout:(125/185): protobuf-compiler-3.19.6-11.el10.x86 36 MB/s | 787 kB 00:00 2026-02-13T02:15:57.785 INFO:teuthology.orchestra.run.trial011.stdout:(23/185): librgw2-20.3.0-5241.g8f8d3829.el10.x8 12 MB/s | 6.7 MB 00:00 2026-02-13T02:15:57.787 INFO:teuthology.orchestra.run.trial060.stdout: Installing : libarrow-doc-17.0.0-9.el10_2.noarch 17/197 2026-02-13T02:15:57.791 INFO:teuthology.orchestra.run.trial060.stdout: Installing : abseil-cpp-20240722.1-1.el10_0.x86_64 18/197 2026-02-13T02:15:57.792 INFO:teuthology.orchestra.run.trial011.stdout:(24/185): python3-ceph-argparse-20.3.0-5241.g8f 3.8 MB/s | 57 kB 00:00 2026-02-13T02:15:57.796 INFO:teuthology.orchestra.run.trial060.stdout: Installing : re2-2:20251105-1.el10_2.x86_64 19/197 2026-02-13T02:15:57.802 INFO:teuthology.orchestra.run.trial011.stdout:(25/185): python3-ceph-common-20.3.0-5241.g8f8d 14 MB/s | 237 kB 00:00 2026-02-13T02:15:57.806 INFO:teuthology.orchestra.run.trial060.stdout: Installing : unzip-6.0-69.el10.x86_64 20/197 2026-02-13T02:15:57.811 INFO:teuthology.orchestra.run.trial060.stdout: Installing : python3-urllib3-1.26.19-2.el10_1.1.noarch 21/197 2026-02-13T02:15:57.816 INFO:teuthology.orchestra.run.trial060.stdout: Installing : python3-requests-2.32.4-1.el10_0.noarch 22/197 2026-02-13T02:15:57.825 INFO:teuthology.orchestra.run.trial060.stdout: Installing : python3-packaging-24.2-2.el10.noarch 23/197 2026-02-13T02:15:57.828 INFO:teuthology.orchestra.run.trial060.stdout: Installing : python3-pyasn1-0.6.1-1.el10.noarch 24/197 2026-02-13T02:15:57.829 INFO:teuthology.orchestra.run.trial011.stdout:(26/185): python3-cephfs-20.3.0-5241.g8f8d3829. 6.7 MB/s | 253 kB 00:00 2026-02-13T02:15:57.831 INFO:teuthology.orchestra.run.trial060.stdout: Installing : perl-threads-1:2.40-511.el10.x86_64 25/197 2026-02-13T02:15:57.833 INFO:teuthology.orchestra.run.trial060.stdout: Installing : lua-5.4.6-7.el10.x86_64 26/197 2026-02-13T02:15:57.836 INFO:teuthology.orchestra.run.trial060.stdout: Installing : libtool-ltdl-2.4.7-13.el10.x86_64 27/197 2026-02-13T02:15:57.837 INFO:teuthology.orchestra.run.trial060.stdout: Installing : xmlsec1-1:1.2.39-3.el10.x86_64 28/197 2026-02-13T02:15:57.838 INFO:teuthology.orchestra.run.trial011.stdout:(27/185): python3-rados-20.3.0-5241.g8f8d3829.e 9.7 MB/s | 352 kB 00:00 2026-02-13T02:15:57.854 INFO:teuthology.orchestra.run.trial060.stdout: Installing : ledmon-libs-1.1.0-2.el10.x86_64 29/197 2026-02-13T02:15:57.857 INFO:teuthology.orchestra.run.trial011.stdout:(28/185): python3-rgw-20.3.0-5241.g8f8d3829.el1 6.6 MB/s | 130 kB 00:00 2026-02-13T02:15:57.858 INFO:teuthology.orchestra.run.trial060.stdout: Installing : python3-ceph-common-2:20.3.0-5241.g8f8d3829.el10 30/197 2026-02-13T02:15:57.859 INFO:teuthology.orchestra.run.trial060.stdout: Installing : python3-ceph-argparse-2:20.3.0-5241.g8f8d3829.el 31/197 2026-02-13T02:15:57.861 INFO:teuthology.orchestra.run.trial060.stdout: Installing : lua-devel-5.4.6-7.el10.x86_64 32/197 2026-02-13T02:15:57.863 INFO:teuthology.orchestra.run.trial060.stdout: Installing : perl-threads-shared-1.69-511.el10.x86_64 33/197 2026-02-13T02:15:57.864 INFO:teuthology.orchestra.run.trial011.stdout:(29/185): python3-rbd-20.3.0-5241.g8f8d3829.el1 10 MB/s | 372 kB 00:00 2026-02-13T02:15:57.873 INFO:teuthology.orchestra.run.trial011.stdout:(30/185): rbd-fuse-20.3.0-5241.g8f8d3829.el10.x 5.2 MB/s | 87 kB 00:00 2026-02-13T02:15:57.873 INFO:teuthology.orchestra.run.trial060.stdout: Installing : perl-Thread-Queue-3.14-511.el10.noarch 34/197 2026-02-13T02:15:57.893 INFO:teuthology.orchestra.run.trial011.stdout:(31/185): rbd-nbd-20.3.0-5241.g8f8d3829.el10.x8 8.9 MB/s | 180 kB 00:00 2026-02-13T02:15:57.896 INFO:teuthology.orchestra.run.trial060.stdout: Installing : automake-1.16.5-20.el10.noarch 35/197 2026-02-13T02:15:57.901 INFO:teuthology.orchestra.run.trial060.stdout: Installing : python3-pyasn1-modules-0.6.1-1.el10.noarch 36/197 2026-02-13T02:15:57.906 INFO:teuthology.orchestra.run.trial060.stdout: Installing : python3-rsa-4.9-7.el10_0.noarch 37/197 2026-02-13T02:15:57.910 INFO:teuthology.orchestra.run.trial060.stdout: Installing : python3-requests-oauthlib-1.3.1-11.el10.noarch 38/197 2026-02-13T02:15:57.911 INFO:teuthology.orchestra.run.trial011.stdout:(32/185): ceph-grafana-dashboards-20.3.0-5241.g 3.2 MB/s | 57 kB 00:00 2026-02-13T02:15:57.919 INFO:teuthology.orchestra.run.trial060.stdout: Installing : zip-3.0-45.el10.x86_64 39/197 2026-02-13T02:15:57.926 INFO:teuthology.orchestra.run.trial011.stdout:(33/185): ceph-mgr-cephadm-20.3.0-5241.g8f8d382 11 MB/s | 183 kB 00:00 2026-02-13T02:15:57.936 INFO:teuthology.orchestra.run.trial060.stdout: Installing : luarocks-3.9.2-6.el10_0.noarch 40/197 2026-02-13T02:15:57.940 INFO:teuthology.orchestra.run.trial060.stdout: Upgrading : util-linux-core-2.40.2-15.el10_1.x86_64 41/197 2026-02-13T02:15:57.942 INFO:teuthology.orchestra.run.trial060.stdout: Installing : libpmem-2.1.0-2.el10_0.x86_64 42/197 2026-02-13T02:15:57.945 INFO:teuthology.orchestra.run.trial060.stdout: Installing : libpmemobj-2.1.0-2.el10_0.x86_64 43/197 2026-02-13T02:15:57.947 INFO:teuthology.orchestra.run.trial060.stdout: Installing : python3-tempora-5.7.0-1.el10_0.noarch 44/197 2026-02-13T02:15:57.949 INFO:teuthology.orchestra.run.trial060.stdout: Installing : python3-portend-3.2.0-6.el10_0.noarch 45/197 2026-02-13T02:15:57.961 INFO:teuthology.orchestra.run.trial060.stdout: Installing : xmlstarlet-1.6.1-27.el10.x86_64 46/197 2026-02-13T02:15:57.970 INFO:teuthology.orchestra.run.trial060.stdout: Installing : python3-protobuf-3.19.6-11.el10.x86_64 47/197 2026-02-13T02:15:57.974 INFO:teuthology.orchestra.run.trial060.stdout: Installing : protobuf-compiler-3.19.6-11.el10.x86_64 48/197 2026-02-13T02:15:57.982 INFO:teuthology.orchestra.run.trial060.stdout: Installing : liborc2-2.0.7-1.el10_2.x86_64 49/197 2026-02-13T02:15:57.985 INFO:teuthology.orchestra.run.trial060.stdout: Installing : cryptsetup-2.7.5-2.el10.x86_64 50/197 2026-02-13T02:15:58.023 INFO:teuthology.orchestra.run.trial060.stdout: Upgrading : libfdisk-2.40.2-15.el10_1.x86_64 51/197 2026-02-13T02:15:58.027 INFO:teuthology.orchestra.run.trial060.stdout: Upgrading : util-linux-2.40.2-15.el10_1.x86_64 52/197 2026-02-13T02:15:58.031 INFO:teuthology.orchestra.run.trial078.stdout:(126/185): ceph-test-20.3.0-5241.g8f8d3829.el10 18 MB/s | 81 MB 00:04 2026-02-13T02:15:58.037 INFO:teuthology.orchestra.run.trial060.stdout: Running scriptlet: util-linux-2.40.2-15.el10_1.x86_64 52/197 2026-02-13T02:15:58.045 INFO:teuthology.orchestra.run.trial011.stdout:(34/185): rbd-mirror-20.3.0-5241.g8f8d3829.el10 16 MB/s | 2.9 MB 00:00 2026-02-13T02:15:58.054 INFO:teuthology.orchestra.run.trial060.stdout: Installing : libuuid-devel-2.40.2-15.el10_1.x86_64 53/197 2026-02-13T02:15:58.061 INFO:teuthology.orchestra.run.trial060.stdout: Upgrading : openssl-libs-1:3.5.1-7.el10_1.x86_64 54/197 2026-02-13T02:15:58.152 INFO:teuthology.orchestra.run.trial078.stdout:(127/185): grpc-data-1.48.4-44.el10_0.noarch.rp 173 kB/s | 21 kB 00:00 2026-02-13T02:15:58.178 INFO:teuthology.orchestra.run.trial060.stdout: Upgrading : openssl-fips-provider-1:3.5.1-7.el10_1.x86_64 55/197 2026-02-13T02:15:58.184 INFO:teuthology.orchestra.run.trial060.stdout: Upgrading : librados2-2:20.3.0-5241.g8f8d3829.el10.x86_64 56/197 2026-02-13T02:15:58.186 INFO:teuthology.orchestra.run.trial078.stdout:(128/185): gperftools-libs-2.15-4.el10_0.x86_64 746 kB/s | 303 kB 00:00 2026-02-13T02:15:58.227 INFO:teuthology.orchestra.run.trial060.stdout: Running scriptlet: librados2-2:20.3.0-5241.g8f8d3829.el10.x86_64 56/197 2026-02-13T02:15:58.228 INFO:teuthology.orchestra.run.trial060.stdout: Installing : libcephfs2-2:20.3.0-5241.g8f8d3829.el10.x86_64 57/197 2026-02-13T02:15:58.239 INFO:teuthology.orchestra.run.trial078.stdout:(129/185): libarrow-doc-17.0.0-9.el10_2.noarch. 510 kB/s | 27 kB 00:00 2026-02-13T02:15:58.241 INFO:teuthology.orchestra.run.trial060.stdout: Running scriptlet: libcephfs2-2:20.3.0-5241.g8f8d3829.el10.x86_64 57/197 2026-02-13T02:15:58.242 INFO:teuthology.orchestra.run.trial060.stdout: Installing : libcephfs-daemon-2:20.3.0-5241.g8f8d3829.el10.x8 58/197 2026-02-13T02:15:58.243 INFO:teuthology.orchestra.run.trial060.stdout: Installing : libcephfs-proxy2-2:20.3.0-5241.g8f8d3829.el10.x8 59/197 2026-02-13T02:15:58.258 INFO:teuthology.orchestra.run.trial078.stdout:(130/185): abseil-cpp-20240722.1-1.el10_0.x86_6 1.2 MB/s | 590 kB 00:00 2026-02-13T02:15:58.317 INFO:teuthology.orchestra.run.trial078.stdout:(131/185): liboath-2.6.12-1.el10_0.x86_64.rpm 617 kB/s | 48 kB 00:00 2026-02-13T02:15:58.346 INFO:teuthology.orchestra.run.trial060.stdout: Running scriptlet: libcephfs-proxy2-2:20.3.0-5241.g8f8d3829.el10.x8 59/197 2026-02-13T02:15:58.347 INFO:teuthology.orchestra.run.trial060.stdout: Upgrading : librbd1-2:20.3.0-5241.g8f8d3829.el10.x86_64 60/197 2026-02-13T02:15:58.370 INFO:teuthology.orchestra.run.trial060.stdout: Running scriptlet: librbd1-2:20.3.0-5241.g8f8d3829.el10.x86_64 60/197 2026-02-13T02:15:58.372 INFO:teuthology.orchestra.run.trial060.stdout: Installing : python3-rados-2:20.3.0-5241.g8f8d3829.el10.x86_6 61/197 2026-02-13T02:15:58.379 INFO:teuthology.orchestra.run.trial060.stdout: Installing : librabbitmq-0.14.0-3.el10.x86_64 62/197 2026-02-13T02:15:58.381 INFO:teuthology.orchestra.run.trial060.stdout: Installing : librdkafka-2.1.1-7.el10.x86_64 63/197 2026-02-13T02:15:58.412 INFO:teuthology.orchestra.run.trial060.stdout: Installing : postgresql-private-libs-16.11-1.el10_1.x86_64 64/197 2026-02-13T02:15:58.420 INFO:teuthology.orchestra.run.trial078.stdout:(132/185): libpmem-2.1.0-2.el10_0.x86_64.rpm 1.1 MB/s | 112 kB 00:00 2026-02-13T02:15:58.423 INFO:teuthology.orchestra.run.trial078.stdout:(133/185): liborc2-2.0.7-1.el10_2.x86_64.rpm 3.0 MB/s | 515 kB 00:00 2026-02-13T02:15:58.424 INFO:teuthology.orchestra.run.trial060.stdout: Installing : postgresql-16.11-1.el10_1.x86_64 65/197 2026-02-13T02:15:58.429 INFO:teuthology.orchestra.run.trial060.stdout: Installing : python3-cephfs-2:20.3.0-5241.g8f8d3829.el10.x86_ 66/197 2026-02-13T02:15:58.430 INFO:teuthology.orchestra.run.trial060.stdout: Installing : libcephsqlite-2:20.3.0-5241.g8f8d3829.el10.x86_6 67/197 2026-02-13T02:15:58.448 INFO:teuthology.orchestra.run.trial011.stdout:(35/185): ceph-mgr-diskprediction-local-20.3.0- 18 MB/s | 7.4 MB 00:00 2026-02-13T02:15:58.449 INFO:teuthology.orchestra.run.trial060.stdout: Running scriptlet: libcephsqlite-2:20.3.0-5241.g8f8d3829.el10.x86_6 67/197 2026-02-13T02:15:58.450 INFO:teuthology.orchestra.run.trial060.stdout: Installing : libradosstriper1-2:20.3.0-5241.g8f8d3829.el10.x8 68/197 2026-02-13T02:15:58.460 INFO:teuthology.orchestra.run.trial011.stdout:(36/185): ceph-mgr-k8sevents-20.3.0-5241.g8f8d3 1.9 MB/s | 22 kB 00:00 2026-02-13T02:15:58.471 INFO:teuthology.orchestra.run.trial060.stdout: Running scriptlet: libradosstriper1-2:20.3.0-5241.g8f8d3829.el10.x8 68/197 2026-02-13T02:15:58.477 INFO:teuthology.orchestra.run.trial060.stdout: Installing : python3-rbd-2:20.3.0-5241.g8f8d3829.el10.x86_64 69/197 2026-02-13T02:15:58.482 INFO:teuthology.orchestra.run.trial060.stdout: Installing : librados-devel-2:20.3.0-5241.g8f8d3829.el10.x86_ 70/197 2026-02-13T02:15:58.483 INFO:teuthology.orchestra.run.trial011.stdout:(37/185): ceph-mgr-modules-core-20.3.0-5241.g8f 13 MB/s | 297 kB 00:00 2026-02-13T02:15:58.484 INFO:teuthology.orchestra.run.trial060.stdout: Installing : socat-1.7.4.4-8.el10.x86_64 71/197 2026-02-13T02:15:58.484 INFO:teuthology.orchestra.run.trial078.stdout:(134/185): libunwind-1.8.0-4.el10_0.x86_64.rpm 1.2 MB/s | 73 kB 00:00 2026-02-13T02:15:58.486 INFO:teuthology.orchestra.run.trial060.stdout: Installing : xmlsec1-openssl-1:1.2.39-3.el10.x86_64 72/197 2026-02-13T02:15:58.494 INFO:teuthology.orchestra.run.trial011.stdout:(38/185): ceph-mgr-rook-20.3.0-5241.g8f8d3829.e 4.4 MB/s | 50 kB 00:00 2026-02-13T02:15:58.497 INFO:teuthology.orchestra.run.trial060.stdout: Installing : python3-xmlsec-1.3.16-1.el10.x86_64 73/197 2026-02-13T02:15:58.499 INFO:teuthology.orchestra.run.trial060.stdout: Installing : thrift-0.20.0-4.el10_1.x86_64 74/197 2026-02-13T02:15:58.501 INFO:teuthology.orchestra.run.trial060.stdout: Installing : python3-zc-lockfile-3.0.post1-11.el10_0.noarch 75/197 2026-02-13T02:15:58.503 INFO:teuthology.orchestra.run.trial078.stdout:(135/185): libarrow-17.0.0-9.el10_2.x86_64.rpm 16 MB/s | 5.7 MB 00:00 2026-02-13T02:15:58.506 INFO:teuthology.orchestra.run.trial011.stdout:(39/185): ceph-prometheus-alerts-20.3.0-5241.g8 1.5 MB/s | 17 kB 00:00 2026-02-13T02:15:58.507 INFO:teuthology.orchestra.run.trial060.stdout: Installing : python3-xmltodict-0.13.0-5.el10_0.noarch 76/197 2026-02-13T02:15:58.509 INFO:teuthology.orchestra.run.trial060.stdout: Installing : python3-websocket-client-1.8.0-2.el10_0.noarch 77/197 2026-02-13T02:15:58.514 INFO:teuthology.orchestra.run.trial060.stdout: Installing : python3-repoze-lru-0.7-23.el10_0.noarch 78/197 2026-02-13T02:15:58.516 INFO:teuthology.orchestra.run.trial060.stdout: Installing : python3-routes-2.5.1-11.el10_0.noarch 79/197 2026-02-13T02:15:58.527 INFO:teuthology.orchestra.run.trial060.stdout: Installing : python3-pyperclip-1.8.2-1.el10_0.noarch 80/197 2026-02-13T02:15:58.531 INFO:teuthology.orchestra.run.trial011.stdout:(40/185): ceph-volume-20.3.0-5241.g8f8d3829.el1 15 MB/s | 374 kB 00:00 2026-02-13T02:15:58.531 INFO:teuthology.orchestra.run.trial060.stdout: Installing : python3-cmd2-2.5.8-1.el10_2.noarch 81/197 2026-02-13T02:15:58.533 INFO:teuthology.orchestra.run.trial078.stdout:(136/185): libpmemobj-2.1.0-2.el10_0.x86_64.rpm 1.4 MB/s | 161 kB 00:00 2026-02-13T02:15:58.534 INFO:teuthology.orchestra.run.trial060.stdout: Installing : python3-natsort-8.4.0-2.el10_0.noarch 82/197 2026-02-13T02:15:58.538 INFO:teuthology.orchestra.run.trial060.stdout: Installing : python3-jaraco-context-6.0.1-4.el10_0.noarch 83/197 2026-02-13T02:15:58.544 INFO:teuthology.orchestra.run.trial060.stdout: Installing : python3-isodate-0.6.1-14.el10_0.noarch 84/197 2026-02-13T02:15:58.547 INFO:teuthology.orchestra.run.trial060.stdout: Installing : python3-saml-1.16.0-11.el10.noarch 85/197 2026-02-13T02:15:58.549 INFO:teuthology.orchestra.run.trial060.stdout: Installing : python3-durationpy-0.9-2.el10_0.noarch 86/197 2026-02-13T02:15:58.551 INFO:teuthology.orchestra.run.trial060.stdout: Installing : python3-certifi-2023.05.07-6.el10_0.noarch 87/197 2026-02-13T02:15:58.565 INFO:teuthology.orchestra.run.trial060.stdout: Installing : python3-cachetools-5.4.0-6.el10_0.noarch 88/197 2026-02-13T02:15:58.583 INFO:teuthology.orchestra.run.trial078.stdout:(137/185): luarocks-3.9.2-6.el10_0.noarch.rpm 1.5 MB/s | 152 kB 00:00 2026-02-13T02:15:58.601 INFO:teuthology.orchestra.run.trial078.stdout:(138/185): parquet-libs-17.0.0-9.el10_2.x86_64. 10 MB/s | 1.0 MB 00:00 2026-02-13T02:15:58.604 INFO:teuthology.orchestra.run.trial011.stdout:(41/185): cephadm-20.3.0-5241.g8f8d3829.el10.no 18 MB/s | 1.3 MB 00:00 2026-02-13T02:15:58.615 INFO:teuthology.orchestra.run.trial011.stdout:(42/185): cephfs-top-20.3.0-5241.g8f8d3829.el10 1.6 MB/s | 18 kB 00:00 2026-02-13T02:15:58.639 INFO:teuthology.orchestra.run.trial078.stdout:(139/185): python3-bcrypt-4.3.0-3.el10_1.x86_64 6.2 MB/s | 238 kB 00:00 2026-02-13T02:15:58.639 INFO:teuthology.orchestra.run.trial078.stdout:(140/185): python3-autocommand-2.2.2-9.el10_0.n 565 kB/s | 32 kB 00:00 2026-02-13T02:15:58.667 INFO:teuthology.orchestra.run.trial011.stdout:(43/185): ceph-mgr-dashboard-20.3.0-5241.g8f8d3 20 MB/s | 15 MB 00:00 2026-02-13T02:15:58.677 INFO:teuthology.orchestra.run.trial011.stdout:(44/185): automake-1.16.5-20.el10.noarch.rpm 11 MB/s | 704 kB 00:00 2026-02-13T02:15:58.685 INFO:teuthology.orchestra.run.trial078.stdout:(141/185): python3-certifi-2023.05.07-6.el10_0. 311 kB/s | 14 kB 00:00 2026-02-13T02:15:58.692 INFO:teuthology.orchestra.run.trial011.stdout:(45/185): bison-3.8.2-9.el10.x86_64.rpm 40 MB/s | 1.0 MB 00:00 2026-02-13T02:15:58.693 INFO:teuthology.orchestra.run.trial011.stdout:(46/185): boost-program-options-1.83.0-5.el10.x 7.0 MB/s | 109 kB 00:00 2026-02-13T02:15:58.696 INFO:teuthology.orchestra.run.trial078.stdout:(142/185): python3-cachetools-5.4.0-6.el10_0.no 641 kB/s | 37 kB 00:00 2026-02-13T02:15:58.701 INFO:teuthology.orchestra.run.trial060.stdout: Installing : python3-google-auth-1:2.40.3-1.el10_1.noarch 89/197 2026-02-13T02:15:58.704 INFO:teuthology.orchestra.run.trial011.stdout:(47/185): cmake-filesystem-3.30.5-3.el10_0.x86_ 1.3 MB/s | 15 kB 00:00 2026-02-13T02:15:58.708 INFO:teuthology.orchestra.run.trial011.stdout:(48/185): elfutils-libelf-devel-0.193-1.el10.ro 3.1 MB/s | 48 kB 00:00 2026-02-13T02:15:58.708 INFO:teuthology.orchestra.run.trial060.stdout: Installing : python3-kubernetes-1:32.0.1-1.el10_1.noarch 90/197 2026-02-13T02:15:58.711 INFO:teuthology.orchestra.run.trial060.stdout: Installing : python3-bcrypt-4.3.0-3.el10_1.x86_64 91/197 2026-02-13T02:15:58.714 INFO:teuthology.orchestra.run.trial060.stdout: Installing : python3-autocommand-2.2.2-9.el10_0.noarch 92/197 2026-02-13T02:15:58.716 INFO:teuthology.orchestra.run.trial060.stdout: Installing : python3-jaraco-text-4.0.0-3.el10_0.noarch 93/197 2026-02-13T02:15:58.719 INFO:teuthology.orchestra.run.trial060.stdout: Installing : python3-jaraco-collections-5.1.0-1.el10_0.noarch 94/197 2026-02-13T02:15:58.723 INFO:teuthology.orchestra.run.trial060.stdout: Installing : libunwind-1.8.0-4.el10_0.x86_64 95/197 2026-02-13T02:15:58.725 INFO:teuthology.orchestra.run.trial060.stdout: Installing : gperftools-libs-2.15-4.el10_0.x86_64 96/197 2026-02-13T02:15:58.730 INFO:teuthology.orchestra.run.trial011.stdout:(49/185): flex-2.6.4-19.el10.x86_64.rpm 11 MB/s | 300 kB 00:00 2026-02-13T02:15:58.730 INFO:teuthology.orchestra.run.trial011.stdout:(50/185): flexiblas-3.4.2-3.el10.x86_64.rpm 1.1 MB/s | 25 kB 00:00 2026-02-13T02:15:58.739 INFO:teuthology.orchestra.run.trial078.stdout:(143/185): python3-cheroot-10.0.1-4.el10_0.noar 3.9 MB/s | 215 kB 00:00 2026-02-13T02:15:58.747 INFO:teuthology.orchestra.run.trial011.stdout:(51/185): flexiblas-openblas-openmp-3.4.2-3.el1 1.0 MB/s | 17 kB 00:00 2026-02-13T02:15:58.748 INFO:teuthology.orchestra.run.trial060.stdout: Installing : grpc-data-1.48.4-44.el10_0.noarch 97/197 2026-02-13T02:15:58.753 INFO:teuthology.orchestra.run.trial060.stdout: Installing : python3-grpcio-1.48.4-44.el10_0.x86_64 98/197 2026-02-13T02:15:58.757 INFO:teuthology.orchestra.run.trial060.stdout: Installing : python3-grpcio-tools-1.48.4-44.el10_0.x86_64 99/197 2026-02-13T02:15:58.761 INFO:teuthology.orchestra.run.trial011.stdout:(52/185): ledmon-libs-1.1.0-2.el10.x86_64.rpm 2.9 MB/s | 42 kB 00:00 2026-02-13T02:15:58.763 INFO:teuthology.orchestra.run.trial060.stdout: Installing : python3-ply-3.11-25.el10.noarch 100/197 2026-02-13T02:15:58.770 INFO:teuthology.orchestra.run.trial060.stdout: Installing : python3-pycparser-2.20-16.el10.noarch 101/197 2026-02-13T02:15:58.774 INFO:teuthology.orchestra.run.trial011.stdout:(53/185): libaio-devel-0.3.111-22.el10.x86_64.r 806 kB/s | 10 kB 00:00 2026-02-13T02:15:58.780 INFO:teuthology.orchestra.run.trial011.stdout:(54/185): flexiblas-netlib-3.4.2-3.el10.x86_64. 65 MB/s | 3.2 MB 00:00 2026-02-13T02:15:58.784 INFO:teuthology.orchestra.run.trial078.stdout:(144/185): python3-asyncssh-2.17.0-1.el10_0.noa 2.9 MB/s | 756 kB 00:00 2026-02-13T02:15:58.789 INFO:teuthology.orchestra.run.trial078.stdout:(145/185): python3-cmd2-2.5.8-1.el10_2.noarch.r 7.3 MB/s | 375 kB 00:00 2026-02-13T02:15:58.798 INFO:teuthology.orchestra.run.trial011.stdout:(55/185): libnbd-1.22.2-3.el10_1.x86_64.rpm 7.1 MB/s | 175 kB 00:00 2026-02-13T02:15:58.800 INFO:teuthology.orchestra.run.trial011.stdout:(56/185): librabbitmq-0.14.0-3.el10.x86_64.rpm 2.1 MB/s | 43 kB 00:00 2026-02-13T02:15:58.801 INFO:teuthology.orchestra.run.trial060.stdout: Installing : python3-cffi-1.16.0-7.el10.x86_64 102/197 2026-02-13T02:15:58.804 INFO:teuthology.orchestra.run.trial078.stdout:(146/185): python3-cherrypy-18.10.0-4.el10_0.no 3.3 MB/s | 359 kB 00:00 2026-02-13T02:15:58.806 INFO:teuthology.orchestra.run.trial060.stdout: Installing : python3-cryptography-43.0.0-4.el10.x86_64 103/197 2026-02-13T02:15:58.815 INFO:teuthology.orchestra.run.trial060.stdout: Installing : python3-pyOpenSSL-25.0.0-1.el10_1.noarch 104/197 2026-02-13T02:15:58.817 INFO:teuthology.orchestra.run.trial011.stdout:(57/185): libstoragemgmt-1.10.1-4.el10.x86_64.r 14 MB/s | 251 kB 00:00 2026-02-13T02:15:58.823 INFO:teuthology.orchestra.run.trial011.stdout:(58/185): librdkafka-2.1.1-7.el10.x86_64.rpm 29 MB/s | 725 kB 00:00 2026-02-13T02:15:58.827 INFO:teuthology.orchestra.run.trial060.stdout: Installing : python3-cheroot-10.0.1-4.el10_0.noarch 105/197 2026-02-13T02:15:58.832 INFO:teuthology.orchestra.run.trial078.stdout:(147/185): python3-durationpy-0.9-2.el10_0.noar 311 kB/s | 15 kB 00:00 2026-02-13T02:15:58.835 INFO:teuthology.orchestra.run.trial011.stdout:(59/185): libtool-2.4.7-13.el10.x86_64.rpm 34 MB/s | 601 kB 00:00 2026-02-13T02:15:58.835 INFO:teuthology.orchestra.run.trial011.stdout:(60/185): libtool-ltdl-2.4.7-13.el10.x86_64.rpm 2.8 MB/s | 36 kB 00:00 2026-02-13T02:15:58.838 INFO:teuthology.orchestra.run.trial078.stdout:(148/185): python3-google-auth-2.40.3-1.el10_1. 5.7 MB/s | 286 kB 00:00 2026-02-13T02:15:58.847 INFO:teuthology.orchestra.run.trial060.stdout: Installing : python3-cherrypy-18.10.0-4.el10_0.noarch 106/197 2026-02-13T02:15:58.848 INFO:teuthology.orchestra.run.trial011.stdout:(61/185): libuuid-devel-2.40.2-15.el10_1.x86_64 2.8 MB/s | 37 kB 00:00 2026-02-13T02:15:58.851 INFO:teuthology.orchestra.run.trial060.stdout: Installing : python3-asyncssh-2.17.0-1.el10_0.noarch 107/197 2026-02-13T02:15:58.851 INFO:teuthology.orchestra.run.trial011.stdout:(62/185): libxslt-1.1.39-8.el10_0.x86_64.rpm 11 MB/s | 189 kB 00:00 2026-02-13T02:15:58.853 INFO:teuthology.orchestra.run.trial060.stdout: Installing : pciutils-3.13.0-6.el10.x86_64 108/197 2026-02-13T02:15:58.854 INFO:teuthology.orchestra.run.trial060.stdout: Installing : qatlib-service-24.09.0-2.el10.x86_64 109/197 2026-02-13T02:15:58.859 INFO:teuthology.orchestra.run.trial011.stdout:(63/185): libzstd-devel-1.5.5-9.el10.x86_64.rpm 4.1 MB/s | 51 kB 00:00 2026-02-13T02:15:58.867 INFO:teuthology.orchestra.run.trial011.stdout:(64/185): lua-5.4.6-7.el10.x86_64.rpm 12 MB/s | 190 kB 00:00 2026-02-13T02:15:58.868 INFO:teuthology.orchestra.run.trial060.stdout: Running scriptlet: qatlib-service-24.09.0-2.el10.x86_64 109/197 2026-02-13T02:15:58.873 INFO:teuthology.orchestra.run.trial011.stdout:(65/185): openblas-0.3.29-2.el10.x86_64.rpm 3.1 MB/s | 43 kB 00:00 2026-02-13T02:15:58.881 INFO:teuthology.orchestra.run.trial078.stdout:(149/185): python3-isodate-0.6.1-14.el10_0.noar 1.5 MB/s | 66 kB 00:00 2026-02-13T02:15:58.885 INFO:teuthology.orchestra.run.trial060.stdout: Running scriptlet: qatlib-24.09.0-2.el10.x86_64 110/197 2026-02-13T02:15:58.888 INFO:teuthology.orchestra.run.trial060.stdout: Installing : qatlib-24.09.0-2.el10.x86_64 110/197 2026-02-13T02:15:58.890 INFO:teuthology.orchestra.run.trial060.stdout: Installing : qatzip-libs-1.3.1-1.el10.x86_64 111/197 2026-02-13T02:15:58.892 INFO:teuthology.orchestra.run.trial060.stdout: Installing : ocl-icd-2.3.2-8.el10.x86_64 112/197 2026-02-13T02:15:58.894 INFO:teuthology.orchestra.run.trial060.stdout: Installing : mailcap-2.1.54-8.el10.noarch 113/197 2026-02-13T02:15:58.896 INFO:teuthology.orchestra.run.trial060.stdout: Installing : libquadmath-14.3.1-2.1.el10.x86_64 114/197 2026-02-13T02:15:58.901 INFO:teuthology.orchestra.run.trial078.stdout:(150/185): python3-grpcio-tools-1.48.4-44.el10_ 2.2 MB/s | 157 kB 00:00 2026-02-13T02:15:58.902 INFO:teuthology.orchestra.run.trial060.stdout: Installing : libpciaccess-0.16-16.el10.x86_64 115/197 2026-02-13T02:15:58.906 INFO:teuthology.orchestra.run.trial060.stdout: Installing : hwloc-libs-2.11.1-3.el10.x86_64 116/197 2026-02-13T02:15:58.907 INFO:teuthology.orchestra.run.trial060.stdout: Installing : libconfig-1.7.3-10.el10.x86_64 117/197 2026-02-13T02:15:58.917 INFO:teuthology.orchestra.run.trial011.stdout:(66/185): openssl-devel-3.5.1-7.el10_1.x86_64.r 70 MB/s | 3.0 MB 00:00 2026-02-13T02:15:58.922 INFO:teuthology.orchestra.run.trial078.stdout:(151/185): python3-jaraco-collections-5.1.0-1.e 706 kB/s | 29 kB 00:00 2026-02-13T02:15:58.928 INFO:teuthology.orchestra.run.trial060.stdout: Running scriptlet: libstoragemgmt-1.10.1-4.el10.x86_64 118/197 2026-02-13T02:15:58.928 INFO:teuthology.orchestra.run.trial060.stdout:Creating group 'libstoragemgmt' with GID 992. 2026-02-13T02:15:58.928 INFO:teuthology.orchestra.run.trial060.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 992 and GID 992. 2026-02-13T02:15:58.928 INFO:teuthology.orchestra.run.trial060.stdout: 2026-02-13T02:15:58.933 INFO:teuthology.orchestra.run.trial011.stdout:(67/185): perl-Thread-Queue-3.14-511.el10.noarc 1.3 MB/s | 21 kB 00:00 2026-02-13T02:15:58.940 INFO:teuthology.orchestra.run.trial078.stdout:(152/185): python3-jaraco-context-6.0.1-4.el10_ 540 kB/s | 21 kB 00:00 2026-02-13T02:15:58.941 INFO:teuthology.orchestra.run.trial060.stdout: Installing : libstoragemgmt-1.10.1-4.el10.x86_64 118/197 2026-02-13T02:15:58.946 INFO:teuthology.orchestra.run.trial011.stdout:(68/185): openblas-openmp-0.3.29-2.el10.x86_64. 68 MB/s | 5.3 MB 00:00 2026-02-13T02:15:58.947 INFO:teuthology.orchestra.run.trial011.stdout:(69/185): perl-threads-2.40-511.el10.x86_64.rpm 4.3 MB/s | 58 kB 00:00 2026-02-13T02:15:58.958 INFO:teuthology.orchestra.run.trial078.stdout:(153/185): python3-jaraco-functools-4.0.2-4.el1 626 kB/s | 23 kB 00:00 2026-02-13T02:15:58.961 INFO:teuthology.orchestra.run.trial011.stdout:(70/185): perl-threads-shared-1.69-511.el10.x86 2.9 MB/s | 45 kB 00:00 2026-02-13T02:15:58.965 INFO:teuthology.orchestra.run.trial060.stdout: Running scriptlet: libstoragemgmt-1.10.1-4.el10.x86_64 118/197 2026-02-13T02:15:58.965 INFO:teuthology.orchestra.run.trial060.stdout:Created symlink '/etc/systemd/system/multi-user.target.wants/libstoragemgmt.service' → '/usr/lib/systemd/system/libstoragemgmt.service'. 2026-02-13T02:15:58.965 INFO:teuthology.orchestra.run.trial060.stdout: 2026-02-13T02:15:58.974 INFO:teuthology.orchestra.run.trial011.stdout:(71/185): postgresql-16.11-1.el10_1.x86_64.rpm 71 MB/s | 2.0 MB 00:00 2026-02-13T02:15:58.975 INFO:teuthology.orchestra.run.trial060.stdout: Installing : python3-libstoragemgmt-1.10.1-4.el10.x86_64 119/197 2026-02-13T02:15:58.977 INFO:teuthology.orchestra.run.trial060.stdout: Installing : fuse3-3.16.2-5.el10.x86_64 120/197 2026-02-13T02:15:58.979 INFO:teuthology.orchestra.run.trial060.stdout: Installing : uuid-1.6.2-65.el10.x86_64 121/197 2026-02-13T02:15:58.981 INFO:teuthology.orchestra.run.trial011.stdout:(72/185): postgresql-contrib-16.11-1.el10_1.x86 52 MB/s | 1.0 MB 00:00 2026-02-13T02:15:58.981 INFO:teuthology.orchestra.run.trial078.stdout:(154/185): python3-jaraco-text-4.0.0-3.el10_0.n 706 kB/s | 29 kB 00:00 2026-02-13T02:15:58.992 INFO:teuthology.orchestra.run.trial011.stdout:(73/185): postgresql-private-libs-16.11-1.el10_ 7.9 MB/s | 143 kB 00:00 2026-02-13T02:15:59.012 INFO:teuthology.orchestra.run.trial078.stdout:(155/185): python3-kubernetes-32.0.1-1.el10_1.n 25 MB/s | 1.3 MB 00:00 2026-02-13T02:15:59.016 INFO:teuthology.orchestra.run.trial060.stdout: Installing : utf8proc-2.7.0-9.el10.x86_64 122/197 2026-02-13T02:15:59.017 INFO:teuthology.orchestra.run.trial011.stdout:(74/185): protobuf-3.19.6-11.el10.x86_64.rpm 42 MB/s | 1.0 MB 00:00 2026-02-13T02:15:59.019 INFO:teuthology.orchestra.run.trial060.stdout: Installing : libarrow-17.0.0-9.el10_2.x86_64 123/197 2026-02-13T02:15:59.021 INFO:teuthology.orchestra.run.trial060.stdout: Installing : python3-prettytable-3.6.0-10.el10.noarch 124/197 2026-02-13T02:15:59.028 INFO:teuthology.orchestra.run.trial060.stdout: Installing : python3-markupsafe-2.1.3-6.el10.x86_64 125/197 2026-02-13T02:15:59.032 INFO:teuthology.orchestra.run.trial060.stdout: Installing : python3-jinja2-3.1.6-1.el10_0.noarch 126/197 2026-02-13T02:15:59.032 INFO:teuthology.orchestra.run.trial011.stdout:(75/185): python3-colorama-0.4.6-13.el10.noarch 4.6 MB/s | 74 kB 00:00 2026-02-13T02:15:59.045 INFO:teuthology.orchestra.run.trial060.stdout: Installing : python3-jmespath-1.0.1-8.el10.noarch 127/197 2026-02-13T02:15:59.046 INFO:teuthology.orchestra.run.trial078.stdout:(156/185): python3-more-itertools-10.1.0-8.el10 1.5 MB/s | 100 kB 00:00 2026-02-13T02:15:59.050 INFO:teuthology.orchestra.run.trial060.stdout: Installing : python3-devel-3.12.12-2.el10_1.x86_64 128/197 2026-02-13T02:15:59.052 INFO:teuthology.orchestra.run.trial060.stdout: Installing : python3-colorama-0.4.6-13.el10.noarch 129/197 2026-02-13T02:15:59.056 INFO:teuthology.orchestra.run.trial078.stdout:(157/185): python3-natsort-8.4.0-2.el10_0.noarc 1.6 MB/s | 72 kB 00:00 2026-02-13T02:15:59.059 INFO:teuthology.orchestra.run.trial011.stdout:(76/185): postgresql-server-16.11-1.el10_1.x86_ 90 MB/s | 7.0 MB 00:00 2026-02-13T02:15:59.060 INFO:teuthology.orchestra.run.trial011.stdout:(77/185): python3-devel-3.12.12-2.el10_1.x86_64 12 MB/s | 329 kB 00:00 2026-02-13T02:15:59.073 INFO:teuthology.orchestra.run.trial011.stdout:(78/185): python3-jmespath-1.0.1-8.el10.noarch. 4.6 MB/s | 60 kB 00:00 2026-02-13T02:15:59.076 INFO:teuthology.orchestra.run.trial011.stdout:(79/185): python3-jinja2-3.1.6-1.el10_0.noarch. 18 MB/s | 330 kB 00:00 2026-02-13T02:15:59.090 INFO:teuthology.orchestra.run.trial011.stdout:(80/185): python3-libstoragemgmt-1.10.1-4.el10. 13 MB/s | 219 kB 00:00 2026-02-13T02:15:59.094 INFO:teuthology.orchestra.run.trial078.stdout:(158/185): python3-portend-3.2.0-6.el10_0.noarc 373 kB/s | 18 kB 00:00 2026-02-13T02:15:59.098 INFO:teuthology.orchestra.run.trial078.stdout:(159/185): python3-pyOpenSSL-25.0.0-1.el10_1.no 2.7 MB/s | 113 kB 00:00 2026-02-13T02:15:59.102 INFO:teuthology.orchestra.run.trial011.stdout:(81/185): python3-lxml-5.2.1-4.el10.x86_64.rpm 54 MB/s | 1.4 MB 00:00 2026-02-13T02:15:59.103 INFO:teuthology.orchestra.run.trial011.stdout:(82/185): python3-markupsafe-2.1.3-6.el10.x86_6 2.5 MB/s | 34 kB 00:00 2026-02-13T02:15:59.106 INFO:teuthology.orchestra.run.trial060.stdout: Installing : openblas-0.3.29-2.el10.x86_64 130/197 2026-02-13T02:15:59.126 INFO:teuthology.orchestra.run.trial011.stdout:(83/185): python3-numpy-f2py-1.26.4-5.el10.x86_ 21 MB/s | 490 kB 00:00 2026-02-13T02:15:59.127 INFO:teuthology.orchestra.run.trial060.stdout: Installing : openblas-openmp-0.3.29-2.el10.x86_64 131/197 2026-02-13T02:15:59.129 INFO:teuthology.orchestra.run.trial060.stdout: Installing : flexiblas-netlib-3.4.2-3.el10.x86_64 132/197 2026-02-13T02:15:59.130 INFO:teuthology.orchestra.run.trial060.stdout: Installing : flexiblas-openblas-openmp-3.4.2-3.el10.x86_64 133/197 2026-02-13T02:15:59.139 INFO:teuthology.orchestra.run.trial078.stdout:(160/185): python3-pyperclip-1.8.2-1.el10_0.noa 619 kB/s | 28 kB 00:00 2026-02-13T02:15:59.144 INFO:teuthology.orchestra.run.trial078.stdout:(161/185): python3-repoze-lru-0.7-23.el10_0.noa 783 kB/s | 36 kB 00:00 2026-02-13T02:15:59.144 INFO:teuthology.orchestra.run.trial011.stdout:(84/185): python3-prettytable-3.6.0-10.el10.noa 3.9 MB/s | 70 kB 00:00 2026-02-13T02:15:59.162 INFO:teuthology.orchestra.run.trial011.stdout:(85/185): python3-protobuf-3.19.6-11.el10.x86_6 24 MB/s | 419 kB 00:00 2026-02-13T02:15:59.182 INFO:teuthology.orchestra.run.trial078.stdout:(162/185): python3-rsa-4.9-7.el10_0.noarch.rpm 1.8 MB/s | 70 kB 00:00 2026-02-13T02:15:59.182 INFO:teuthology.orchestra.run.trial011.stdout:(86/185): python3-numpy-1.26.4-5.el10.x86_64.rp 84 MB/s | 6.7 MB 00:00 2026-02-13T02:15:59.187 INFO:teuthology.orchestra.run.trial078.stdout:(163/185): python3-grpcio-1.48.4-44.el10_0.x86_ 6.0 MB/s | 2.3 MB 00:00 2026-02-13T02:15:59.188 INFO:teuthology.orchestra.run.trial011.stdout:(87/185): python3-pyasn1-0.6.1-1.el10.noarch.rp 7.7 MB/s | 198 kB 00:00 2026-02-13T02:15:59.200 INFO:teuthology.orchestra.run.trial011.stdout:(88/185): python3-pyasn1-modules-0.6.1-1.el10.n 22 MB/s | 402 kB 00:00 2026-02-13T02:15:59.200 INFO:teuthology.orchestra.run.trial011.stdout:(89/185): python3-requests-oauthlib-1.3.1-11.el 4.5 MB/s | 60 kB 00:00 2026-02-13T02:15:59.219 INFO:teuthology.orchestra.run.trial011.stdout:(90/185): qatlib-24.09.0-2.el10.x86_64.rpm 12 MB/s | 229 kB 00:00 2026-02-13T02:15:59.221 INFO:teuthology.orchestra.run.trial078.stdout:(164/185): python3-tempora-5.7.0-1.el10_0.noarc 936 kB/s | 37 kB 00:00 2026-02-13T02:15:59.223 INFO:teuthology.orchestra.run.trial078.stdout:(165/185): python3-routes-2.5.1-11.el10_0.noarc 2.4 MB/s | 201 kB 00:00 2026-02-13T02:15:59.232 INFO:teuthology.orchestra.run.trial011.stdout:(91/185): qatlib-service-24.09.0-2.el10.x86_64. 2.8 MB/s | 37 kB 00:00 2026-02-13T02:15:59.243 INFO:teuthology.orchestra.run.trial078.stdout:(166/185): python3-websocket-client-1.8.0-2.el1 2.2 MB/s | 124 kB 00:00 2026-02-13T02:15:59.247 INFO:teuthology.orchestra.run.trial011.stdout:(92/185): qatzip-libs-1.3.1-1.el10.x86_64.rpm 4.2 MB/s | 66 kB 00:00 2026-02-13T02:15:59.254 INFO:teuthology.orchestra.run.trial060.stdout: Installing : flexiblas-3.4.2-3.el10.x86_64 134/197 2026-02-13T02:15:59.259 INFO:teuthology.orchestra.run.trial078.stdout:(167/185): python3-xmltodict-0.13.0-5.el10_0.no 686 kB/s | 26 kB 00:00 2026-02-13T02:15:59.263 INFO:teuthology.orchestra.run.trial078.stdout:(168/185): python3-zc-lockfile-3.0.post1-11.el1 563 kB/s | 23 kB 00:00 2026-02-13T02:15:59.267 INFO:teuthology.orchestra.run.trial011.stdout:(93/185): socat-1.7.4.4-8.el10.x86_64.rpm 15 MB/s | 303 kB 00:00 2026-02-13T02:15:59.279 INFO:teuthology.orchestra.run.trial060.stdout: Installing : python3-numpy-1:1.26.4-5.el10.x86_64 135/197 2026-02-13T02:15:59.288 INFO:teuthology.orchestra.run.trial011.stdout:(94/185): utf8proc-2.7.0-9.el10.x86_64.rpm 3.8 MB/s | 80 kB 00:00 2026-02-13T02:15:59.303 INFO:teuthology.orchestra.run.trial011.stdout:(95/185): uuid-1.6.2-65.el10.x86_64.rpm 4.1 MB/s | 59 kB 00:00 2026-02-13T02:15:59.319 INFO:teuthology.orchestra.run.trial011.stdout:(96/185): xfsprogs-devel-6.11.0-2.el10.x86_64.r 6.1 MB/s | 105 kB 00:00 2026-02-13T02:15:59.321 INFO:teuthology.orchestra.run.trial078.stdout:(169/185): re2-20251105-1.el10_2.x86_64.rpm 2.8 MB/s | 221 kB 00:00 2026-02-13T02:15:59.327 INFO:teuthology.orchestra.run.trial078.stdout:(170/185): python3-saml-1.16.0-11.el10.noarch.r 24 MB/s | 150 kB 00:00 2026-02-13T02:15:59.329 INFO:teuthology.orchestra.run.trial078.stdout:(171/185): python3-xmlsec-1.3.16-1.el10.x86_64. 27 MB/s | 49 kB 00:00 2026-02-13T02:15:59.338 INFO:teuthology.orchestra.run.trial011.stdout:(97/185): xmlsec1-1.2.39-3.el10.x86_64.rpm 10 MB/s | 193 kB 00:00 2026-02-13T02:15:59.349 INFO:teuthology.orchestra.run.trial078.stdout:(172/185): yaml-cpp0.7-0.7.0-1.el10_2.x86_64.rp 1.5 MB/s | 127 kB 00:00 2026-02-13T02:15:59.356 INFO:teuthology.orchestra.run.trial011.stdout:(98/185): xmlsec1-openssl-1.2.39-3.el10.x86_64. 5.3 MB/s | 96 kB 00:00 2026-02-13T02:15:59.368 INFO:teuthology.orchestra.run.trial078.stdout:(173/185): thrift-0.20.0-4.el10_1.x86_64.rpm 15 MB/s | 1.7 MB 00:00 2026-02-13T02:15:59.378 INFO:teuthology.orchestra.run.trial011.stdout:(99/185): python3-scipy-1.11.3-17.el10.x86_64.r 91 MB/s | 16 MB 00:00 2026-02-13T02:15:59.379 INFO:teuthology.orchestra.run.trial011.stdout:(100/185): xmlstarlet-1.6.1-27.el10.x86_64.rpm 2.7 MB/s | 63 kB 00:00 2026-02-13T02:15:59.385 INFO:teuthology.orchestra.run.trial078.stdout:(174/185): libblkid-2.40.2-15.el10_1.x86_64.rpm 7.1 MB/s | 124 kB 00:00 2026-02-13T02:15:59.393 INFO:teuthology.orchestra.run.trial011.stdout:(101/185): zlib-ng-compat-devel-2.2.3-2.el10.x8 2.6 MB/s | 38 kB 00:00 2026-02-13T02:15:59.396 INFO:teuthology.orchestra.run.trial011.stdout:(102/185): cryptsetup-2.7.5-2.el10.x86_64.rpm 20 MB/s | 335 kB 00:00 2026-02-13T02:15:59.404 INFO:teuthology.orchestra.run.trial078.stdout:(175/185): libfdisk-2.40.2-15.el10_1.x86_64.rpm 8.0 MB/s | 159 kB 00:00 2026-02-13T02:15:59.406 INFO:teuthology.orchestra.run.trial011.stdout:(103/185): daxctl-libs-80-4.el10.x86_64.rpm 3.1 MB/s | 42 kB 00:00 2026-02-13T02:15:59.408 INFO:teuthology.orchestra.run.trial011.stdout:(104/185): fuse3-3.16.2-5.el10.x86_64.rpm 4.5 MB/s | 58 kB 00:00 2026-02-13T02:15:59.422 INFO:teuthology.orchestra.run.trial078.stdout:(176/185): libmount-2.40.2-15.el10_1.x86_64.rpm 8.6 MB/s | 154 kB 00:00 2026-02-13T02:15:59.424 INFO:teuthology.orchestra.run.trial011.stdout:(105/185): libconfig-1.7.3-10.el10.x86_64.rpm 4.4 MB/s | 72 kB 00:00 2026-02-13T02:15:59.439 INFO:teuthology.orchestra.run.trial011.stdout:(106/185): hwloc-libs-2.11.1-3.el10.x86_64.rpm 65 MB/s | 2.1 MB 00:00 2026-02-13T02:15:59.439 INFO:teuthology.orchestra.run.trial078.stdout:(177/185): libsmartcols-2.40.2-15.el10_1.x86_64 4.8 MB/s | 83 kB 00:00 2026-02-13T02:15:59.447 INFO:teuthology.orchestra.run.trial011.stdout:(107/185): libgfortran-14.3.1-2.1.el10.x86_64.r 35 MB/s | 827 kB 00:00 2026-02-13T02:15:59.452 INFO:teuthology.orchestra.run.trial011.stdout:(108/185): libpciaccess-0.16-16.el10.x86_64.rpm 1.9 MB/s | 27 kB 00:00 2026-02-13T02:15:59.454 INFO:teuthology.orchestra.run.trial078.stdout:(178/185): libuuid-2.40.2-15.el10_1.x86_64.rpm 1.8 MB/s | 28 kB 00:00 2026-02-13T02:15:59.463 INFO:teuthology.orchestra.run.trial011.stdout:(109/185): libquadmath-14.3.1-2.1.el10.x86_64.r 13 MB/s | 215 kB 00:00 2026-02-13T02:15:59.464 INFO:teuthology.orchestra.run.trial060.stdout: Installing : python3-numpy-f2py-1:1.26.4-5.el10.x86_64 136/197 2026-02-13T02:15:59.465 INFO:teuthology.orchestra.run.trial011.stdout:(110/185): mailcap-2.1.54-8.el10.noarch.rpm 2.6 MB/s | 34 kB 00:00 2026-02-13T02:15:59.472 INFO:teuthology.orchestra.run.trial060.stdout: Installing : python3-scipy-1.11.3-17.el10.x86_64 137/197 2026-02-13T02:15:59.475 INFO:teuthology.orchestra.run.trial060.stdout: Installing : libzstd-devel-1.5.5-9.el10.x86_64 138/197 2026-02-13T02:15:59.476 INFO:teuthology.orchestra.run.trial060.stdout: Installing : cmake-filesystem-3.30.5-3.el10_0.x86_64 139/197 2026-02-13T02:15:59.478 INFO:teuthology.orchestra.run.trial060.stdout: Installing : zlib-ng-compat-devel-2.2.3-2.el10.x86_64 140/197 2026-02-13T02:15:59.480 INFO:teuthology.orchestra.run.trial011.stdout:(111/185): ndctl-libs-80-4.el10.x86_64.rpm 5.2 MB/s | 89 kB 00:00 2026-02-13T02:15:59.482 INFO:teuthology.orchestra.run.trial078.stdout:(179/185): librados2-20.3.0-5241.g8f8d3829.el10 24 MB/s | 3.6 MB 00:00 2026-02-13T02:15:59.482 INFO:teuthology.orchestra.run.trial011.stdout:(112/185): ocl-icd-2.3.2-8.el10.x86_64.rpm 3.9 MB/s | 66 kB 00:00 2026-02-13T02:15:59.484 INFO:teuthology.orchestra.run.trial060.stdout: Installing : boost-program-options-1.83.0-5.el10.x86_64 141/197 2026-02-13T02:15:59.484 INFO:teuthology.orchestra.run.trial078.stdout:(180/185): openssl-3.5.1-7.el10_1.x86_64.rpm 41 MB/s | 1.2 MB 00:00 2026-02-13T02:15:59.495 INFO:teuthology.orchestra.run.trial011.stdout:(113/185): pciutils-3.13.0-6.el10.x86_64.rpm 7.8 MB/s | 122 kB 00:00 2026-02-13T02:15:59.502 INFO:teuthology.orchestra.run.trial011.stdout:(114/185): python3-cffi-1.16.0-7.el10.x86_64.rp 15 MB/s | 310 kB 00:00 2026-02-13T02:15:59.508 INFO:teuthology.orchestra.run.trial078.stdout:(181/185): openssl-fips-provider-3.5.1-7.el10_1 31 MB/s | 812 kB 00:00 2026-02-13T02:15:59.522 INFO:teuthology.orchestra.run.trial078.stdout:(182/185): openssl-libs-3.5.1-7.el10_1.x86_64.r 60 MB/s | 2.2 MB 00:00 2026-02-13T02:15:59.539 INFO:teuthology.orchestra.run.trial011.stdout:(115/185): python3-packaging-24.2-2.el10.noarch 4.2 MB/s | 155 kB 00:00 2026-02-13T02:15:59.541 INFO:teuthology.orchestra.run.trial078.stdout:(183/185): util-linux-2.40.2-15.el10_1.x86_64.r 38 MB/s | 1.2 MB 00:00 2026-02-13T02:15:59.548 INFO:teuthology.orchestra.run.trial078.stdout:(184/185): util-linux-core-2.40.2-15.el10_1.x86 21 MB/s | 542 kB 00:00 2026-02-13T02:15:59.555 INFO:teuthology.orchestra.run.trial011.stdout:(116/185): python3-ply-3.11-25.el10.noarch.rpm 8.2 MB/s | 137 kB 00:00 2026-02-13T02:15:59.570 INFO:teuthology.orchestra.run.trial011.stdout:(117/185): python3-pycparser-2.20-16.el10.noarc 10 MB/s | 160 kB 00:00 2026-02-13T02:15:59.586 INFO:teuthology.orchestra.run.trial011.stdout:(118/185): python3-requests-2.32.4-1.el10_0.noa 10 MB/s | 160 kB 00:00 2026-02-13T02:15:59.595 INFO:teuthology.orchestra.run.trial078.stdout:(185/185): librbd1-20.3.0-5241.g8f8d3829.el10.x 12 MB/s | 2.8 MB 00:00 2026-02-13T02:15:59.596 INFO:teuthology.orchestra.run.trial078.stdout:-------------------------------------------------------------------------------- 2026-02-13T02:15:59.596 INFO:teuthology.orchestra.run.trial078.stdout:Total 27 MB/s | 305 MB 00:11 2026-02-13T02:15:59.596 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction check 2026-02-13T02:15:59.603 INFO:teuthology.orchestra.run.trial011.stdout:(119/185): python3-urllib3-1.26.19-2.el10_1.1.n 16 MB/s | 285 kB 00:00 2026-02-13T02:15:59.620 INFO:teuthology.orchestra.run.trial011.stdout:(120/185): unzip-6.0-69.el10.x86_64.rpm 11 MB/s | 188 kB 00:00 2026-02-13T02:15:59.677 INFO:teuthology.orchestra.run.trial011.stdout:(121/185): zip-3.0-45.el10.x86_64.rpm 4.6 MB/s | 271 kB 00:00 2026-02-13T02:15:59.682 INFO:teuthology.orchestra.run.trial078.stdout:Transaction check succeeded. 2026-02-13T02:15:59.682 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction test 2026-02-13T02:15:59.693 INFO:teuthology.orchestra.run.trial011.stdout:(122/185): lttng-ust-2.13.7-5.el10.x86_64.rpm 21 MB/s | 334 kB 00:00 2026-02-13T02:15:59.694 INFO:teuthology.orchestra.run.trial060.stdout: Installing : parquet-libs-17.0.0-9.el10_2.x86_64 142/197 2026-02-13T02:15:59.695 INFO:teuthology.orchestra.run.trial060.stdout: Installing : librgw2-2:20.3.0-5241.g8f8d3829.el10.x86_64 143/197 2026-02-13T02:15:59.705 INFO:teuthology.orchestra.run.trial011.stdout:(123/185): lua-devel-5.4.6-7.el10.x86_64.rpm 1.8 MB/s | 22 kB 00:00 2026-02-13T02:15:59.709 INFO:teuthology.orchestra.run.trial011.stdout:(124/185): python3-cryptography-43.0.0-4.el10.x 6.3 MB/s | 1.3 MB 00:00 2026-02-13T02:15:59.713 INFO:teuthology.orchestra.run.trial060.stdout: Running scriptlet: librgw2-2:20.3.0-5241.g8f8d3829.el10.x86_64 143/197 2026-02-13T02:15:59.714 INFO:teuthology.orchestra.run.trial060.stdout: Installing : python3-rgw-2:20.3.0-5241.g8f8d3829.el10.x86_64 144/197 2026-02-13T02:15:59.725 INFO:teuthology.orchestra.run.trial011.stdout:(125/185): protobuf-compiler-3.19.6-11.el10.x86 39 MB/s | 787 kB 00:00 2026-02-13T02:16:00.034 INFO:teuthology.orchestra.run.trial011.stdout:(126/185): gperftools-libs-2.15-4.el10_0.x86_64 980 kB/s | 303 kB 00:00 2026-02-13T02:16:00.068 INFO:teuthology.orchestra.run.trial011.stdout:(127/185): abseil-cpp-20240722.1-1.el10_0.x86_6 1.6 MB/s | 590 kB 00:00 2026-02-13T02:16:00.077 INFO:teuthology.orchestra.run.trial011.stdout:(128/185): grpc-data-1.48.4-44.el10_0.noarch.rp 492 kB/s | 21 kB 00:00 2026-02-13T02:16:00.119 INFO:teuthology.orchestra.run.trial011.stdout:(129/185): libarrow-doc-17.0.0-9.el10_2.noarch. 628 kB/s | 27 kB 00:00 2026-02-13T02:16:00.164 INFO:teuthology.orchestra.run.trial011.stdout:(130/185): liboath-2.6.12-1.el10_0.x86_64.rpm 1.1 MB/s | 48 kB 00:00 2026-02-13T02:16:00.255 INFO:teuthology.orchestra.run.trial011.stdout:(131/185): liborc2-2.0.7-1.el10_2.x86_64.rpm 5.5 MB/s | 515 kB 00:00 2026-02-13T02:16:00.265 INFO:teuthology.orchestra.run.trial011.stdout:(132/185): libarrow-17.0.0-9.el10_2.x86_64.rpm 29 MB/s | 5.7 MB 00:00 2026-02-13T02:16:00.299 INFO:teuthology.orchestra.run.trial011.stdout:(133/185): libpmem-2.1.0-2.el10_0.x86_64.rpm 2.5 MB/s | 112 kB 00:00 2026-02-13T02:16:00.409 INFO:teuthology.orchestra.run.trial011.stdout:(134/185): ceph-test-20.3.0-5241.g8f8d3829.el10 21 MB/s | 81 MB 00:03 2026-02-13T02:16:00.410 INFO:teuthology.orchestra.run.trial011.stdout:(135/185): libpmemobj-2.1.0-2.el10_0.x86_64.rpm 1.1 MB/s | 161 kB 00:00 2026-02-13T02:16:00.410 INFO:teuthology.orchestra.run.trial011.stdout:(136/185): libunwind-1.8.0-4.el10_0.x86_64.rpm 653 kB/s | 73 kB 00:00 2026-02-13T02:16:00.451 INFO:teuthology.orchestra.run.trial011.stdout:(137/185): luarocks-3.9.2-6.el10_0.noarch.rpm 3.6 MB/s | 152 kB 00:00 2026-02-13T02:16:00.493 INFO:teuthology.orchestra.run.trial011.stdout:(138/185): python3-autocommand-2.2.2-9.el10_0.n 776 kB/s | 32 kB 00:00 2026-02-13T02:16:00.495 INFO:teuthology.orchestra.run.trial011.stdout:(139/185): parquet-libs-17.0.0-9.el10_2.x86_64. 12 MB/s | 1.0 MB 00:00 2026-02-13T02:16:00.521 INFO:teuthology.orchestra.run.trial060.stdout: Running scriptlet: ceph-common-2:20.3.0-5241.g8f8d3829.el10.x86_64 145/197 2026-02-13T02:16:00.523 INFO:teuthology.orchestra.run.trial060.stdout: Installing : ceph-common-2:20.3.0-5241.g8f8d3829.el10.x86_64 145/197 2026-02-13T02:16:00.535 INFO:teuthology.orchestra.run.trial011.stdout:(140/185): python3-bcrypt-4.3.0-3.el10_1.x86_64 5.5 MB/s | 238 kB 00:00 2026-02-13T02:16:00.536 INFO:teuthology.orchestra.run.trial011.stdout:(141/185): python3-cachetools-5.4.0-6.el10_0.no 898 kB/s | 37 kB 00:00 2026-02-13T02:16:00.576 INFO:teuthology.orchestra.run.trial011.stdout:(142/185): python3-certifi-2023.05.07-6.el10_0. 353 kB/s | 14 kB 00:00 2026-02-13T02:16:00.581 INFO:teuthology.orchestra.run.trial011.stdout:(143/185): python3-cheroot-10.0.1-4.el10_0.noar 4.8 MB/s | 215 kB 00:00 2026-02-13T02:16:00.619 INFO:teuthology.orchestra.run.trial011.stdout:(144/185): python3-cherrypy-18.10.0-4.el10_0.no 8.2 MB/s | 359 kB 00:00 2026-02-13T02:16:00.627 INFO:teuthology.orchestra.run.trial011.stdout:(145/185): python3-cmd2-2.5.8-1.el10_2.noarch.r 7.9 MB/s | 375 kB 00:00 2026-02-13T02:16:00.660 INFO:teuthology.orchestra.run.trial011.stdout:(146/185): python3-durationpy-0.9-2.el10_0.noar 361 kB/s | 15 kB 00:00 2026-02-13T02:16:00.672 INFO:teuthology.orchestra.run.trial011.stdout:(147/185): python3-google-auth-2.40.3-1.el10_1. 6.2 MB/s | 286 kB 00:00 2026-02-13T02:16:00.714 INFO:teuthology.orchestra.run.trial011.stdout:(148/185): python3-grpcio-1.48.4-44.el10_0.x86_ 43 MB/s | 2.3 MB 00:00 2026-02-13T02:16:00.716 INFO:teuthology.orchestra.run.trial011.stdout:(149/185): python3-grpcio-tools-1.48.4-44.el10_ 3.6 MB/s | 157 kB 00:00 2026-02-13T02:16:00.719 INFO:teuthology.orchestra.run.trial060.stdout: Running scriptlet: ceph-common-2:20.3.0-5241.g8f8d3829.el10.x86_64 145/197 2026-02-13T02:16:00.722 INFO:teuthology.orchestra.run.trial060.stdout: Installing : ceph-base-2:20.3.0-5241.g8f8d3829.el10.x86_64 146/197 2026-02-13T02:16:00.753 INFO:teuthology.orchestra.run.trial060.stdout: Running scriptlet: ceph-base-2:20.3.0-5241.g8f8d3829.el10.x86_64 146/197 2026-02-13T02:16:00.753 INFO:teuthology.orchestra.run.trial060.stdout:Created symlink '/etc/systemd/system/multi-user.target.wants/ceph.target' → '/usr/lib/systemd/system/ceph.target'. 2026-02-13T02:16:00.753 INFO:teuthology.orchestra.run.trial060.stdout:Created symlink '/etc/systemd/system/ceph.target.wants/ceph-crash.service' → '/usr/lib/systemd/system/ceph-crash.service'. 2026-02-13T02:16:00.753 INFO:teuthology.orchestra.run.trial060.stdout: 2026-02-13T02:16:00.755 INFO:teuthology.orchestra.run.trial011.stdout:(150/185): python3-isodate-0.6.1-14.el10_0.noar 1.6 MB/s | 66 kB 00:00 2026-02-13T02:16:00.755 INFO:teuthology.orchestra.run.trial060.stdout: Installing : ceph-selinux-2:20.3.0-5241.g8f8d3829.el10.x86_64 147/197 2026-02-13T02:16:00.757 INFO:teuthology.orchestra.run.trial011.stdout:(151/185): python3-jaraco-collections-5.1.0-1.e 703 kB/s | 29 kB 00:00 2026-02-13T02:16:00.762 INFO:teuthology.orchestra.run.trial078.stdout:Transaction test succeeded. 2026-02-13T02:16:00.762 INFO:teuthology.orchestra.run.trial078.stdout:Running transaction 2026-02-13T02:16:00.775 INFO:teuthology.orchestra.run.trial011.stdout:(152/185): python3-asyncssh-2.17.0-1.el10_0.noa 2.0 MB/s | 756 kB 00:00 2026-02-13T02:16:00.796 INFO:teuthology.orchestra.run.trial011.stdout:(153/185): python3-jaraco-context-6.0.1-4.el10_ 520 kB/s | 21 kB 00:00 2026-02-13T02:16:00.798 INFO:teuthology.orchestra.run.trial011.stdout:(154/185): python3-jaraco-functools-4.0.2-4.el1 552 kB/s | 23 kB 00:00 2026-02-13T02:16:00.817 INFO:teuthology.orchestra.run.trial011.stdout:(155/185): python3-jaraco-text-4.0.0-3.el10_0.n 709 kB/s | 29 kB 00:00 2026-02-13T02:16:00.841 INFO:teuthology.orchestra.run.trial011.stdout:(156/185): python3-more-itertools-10.1.0-8.el10 2.3 MB/s | 100 kB 00:00 2026-02-13T02:16:00.845 INFO:teuthology.orchestra.run.trial011.stdout:(157/185): python3-kubernetes-32.0.1-1.el10_1.n 28 MB/s | 1.3 MB 00:00 2026-02-13T02:16:00.859 INFO:teuthology.orchestra.run.trial011.stdout:(158/185): python3-natsort-8.4.0-2.el10_0.noarc 1.6 MB/s | 72 kB 00:00 2026-02-13T02:16:00.882 INFO:teuthology.orchestra.run.trial011.stdout:(159/185): python3-portend-3.2.0-6.el10_0.noarc 431 kB/s | 18 kB 00:00 2026-02-13T02:16:00.886 INFO:teuthology.orchestra.run.trial011.stdout:(160/185): python3-pyOpenSSL-25.0.0-1.el10_1.no 2.7 MB/s | 113 kB 00:00 2026-02-13T02:16:00.900 INFO:teuthology.orchestra.run.trial011.stdout:(161/185): python3-pyperclip-1.8.2-1.el10_0.noa 685 kB/s | 28 kB 00:00 2026-02-13T02:16:00.923 INFO:teuthology.orchestra.run.trial011.stdout:(162/185): python3-repoze-lru-0.7-23.el10_0.noa 871 kB/s | 36 kB 00:00 2026-02-13T02:16:00.928 INFO:teuthology.orchestra.run.trial011.stdout:(163/185): python3-routes-2.5.1-11.el10_0.noarc 4.7 MB/s | 201 kB 00:00 2026-02-13T02:16:00.944 INFO:teuthology.orchestra.run.trial011.stdout:(164/185): python3-rsa-4.9-7.el10_0.noarch.rpm 1.6 MB/s | 70 kB 00:00 2026-02-13T02:16:00.965 INFO:teuthology.orchestra.run.trial011.stdout:(165/185): python3-tempora-5.7.0-1.el10_0.noarc 897 kB/s | 37 kB 00:00 2026-02-13T02:16:00.970 INFO:teuthology.orchestra.run.trial011.stdout:(166/185): python3-websocket-client-1.8.0-2.el1 2.9 MB/s | 124 kB 00:00 2026-02-13T02:16:00.984 INFO:teuthology.orchestra.run.trial011.stdout:(167/185): python3-xmltodict-0.13.0-5.el10_0.no 634 kB/s | 26 kB 00:00 2026-02-13T02:16:01.006 INFO:teuthology.orchestra.run.trial011.stdout:(168/185): python3-zc-lockfile-3.0.post1-11.el1 553 kB/s | 23 kB 00:00 2026-02-13T02:16:01.011 INFO:teuthology.orchestra.run.trial011.stdout:(169/185): re2-20251105-1.el10_2.x86_64.rpm 5.2 MB/s | 221 kB 00:00 2026-02-13T02:16:01.017 INFO:teuthology.orchestra.run.trial011.stdout:(170/185): python3-saml-1.16.0-11.el10.noarch.r 27 MB/s | 150 kB 00:00 2026-02-13T02:16:01.019 INFO:teuthology.orchestra.run.trial011.stdout:(171/185): python3-xmlsec-1.3.16-1.el10.x86_64. 29 MB/s | 49 kB 00:00 2026-02-13T02:16:01.048 INFO:teuthology.orchestra.run.trial011.stdout:(172/185): yaml-cpp0.7-0.7.0-1.el10_2.x86_64.rp 2.9 MB/s | 127 kB 00:00 2026-02-13T02:16:01.093 INFO:teuthology.orchestra.run.trial011.stdout:(173/185): thrift-0.20.0-4.el10_1.x86_64.rpm 15 MB/s | 1.7 MB 00:00 2026-02-13T02:16:01.109 INFO:teuthology.orchestra.run.trial011.stdout:(174/185): libblkid-2.40.2-15.el10_1.x86_64.rpm 7.5 MB/s | 124 kB 00:00 2026-02-13T02:16:01.137 INFO:teuthology.orchestra.run.trial011.stdout:(175/185): libfdisk-2.40.2-15.el10_1.x86_64.rpm 5.6 MB/s | 159 kB 00:00 2026-02-13T02:16:01.153 INFO:teuthology.orchestra.run.trial011.stdout:(176/185): libmount-2.40.2-15.el10_1.x86_64.rpm 9.7 MB/s | 154 kB 00:00 2026-02-13T02:16:01.171 INFO:teuthology.orchestra.run.trial011.stdout:(177/185): libsmartcols-2.40.2-15.el10_1.x86_64 4.4 MB/s | 83 kB 00:00 2026-02-13T02:16:01.185 INFO:teuthology.orchestra.run.trial011.stdout:(178/185): libuuid-2.40.2-15.el10_1.x86_64.rpm 1.9 MB/s | 28 kB 00:00 2026-02-13T02:16:01.193 INFO:teuthology.orchestra.run.trial011.stdout:(179/185): librbd1-20.3.0-5241.g8f8d3829.el10.x 20 MB/s | 2.8 MB 00:00 2026-02-13T02:16:01.208 INFO:teuthology.orchestra.run.trial011.stdout:(180/185): librados2-20.3.0-5241.g8f8d3829.el10 19 MB/s | 3.6 MB 00:00 2026-02-13T02:16:01.213 INFO:teuthology.orchestra.run.trial011.stdout:(181/185): openssl-3.5.1-7.el10_1.x86_64.rpm 44 MB/s | 1.2 MB 00:00 2026-02-13T02:16:01.222 INFO:teuthology.orchestra.run.trial011.stdout:(182/185): openssl-fips-provider-3.5.1-7.el10_1 28 MB/s | 812 kB 00:00 2026-02-13T02:16:01.244 INFO:teuthology.orchestra.run.trial011.stdout:(183/185): util-linux-core-2.40.2-15.el10_1.x86 24 MB/s | 542 kB 00:00 2026-02-13T02:16:01.248 INFO:teuthology.orchestra.run.trial011.stdout:(184/185): util-linux-2.40.2-15.el10_1.x86_64.r 35 MB/s | 1.2 MB 00:00 2026-02-13T02:16:01.253 INFO:teuthology.orchestra.run.trial011.stdout:(185/185): openssl-libs-3.5.1-7.el10_1.x86_64.r 51 MB/s | 2.2 MB 00:00 2026-02-13T02:16:01.254 INFO:teuthology.orchestra.run.trial011.stdout:-------------------------------------------------------------------------------- 2026-02-13T02:16:01.254 INFO:teuthology.orchestra.run.trial011.stdout:Total 25 MB/s | 305 MB 00:11 2026-02-13T02:16:01.255 INFO:teuthology.orchestra.run.trial011.stdout:Running transaction check 2026-02-13T02:16:01.338 INFO:teuthology.orchestra.run.trial011.stdout:Transaction check succeeded. 2026-02-13T02:16:01.339 INFO:teuthology.orchestra.run.trial011.stdout:Running transaction test 2026-02-13T02:16:01.905 INFO:teuthology.orchestra.run.trial078.stdout: Preparing : 1/1 2026-02-13T02:16:01.908 INFO:teuthology.orchestra.run.trial078.stdout: Upgrading : libuuid-2.40.2-15.el10_1.x86_64 1/197 2026-02-13T02:16:01.915 INFO:teuthology.orchestra.run.trial078.stdout: Upgrading : libblkid-2.40.2-15.el10_1.x86_64 2/197 2026-02-13T02:16:01.919 INFO:teuthology.orchestra.run.trial078.stdout: Installing : protobuf-3.19.6-11.el10.x86_64 3/197 2026-02-13T02:16:01.922 INFO:teuthology.orchestra.run.trial078.stdout: Installing : libxslt-1.1.39-8.el10_0.x86_64 4/197 2026-02-13T02:16:01.929 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-more-itertools-10.1.0-8.el10_0.noarch 5/197 2026-02-13T02:16:01.931 INFO:teuthology.orchestra.run.trial078.stdout: Installing : lttng-ust-2.13.7-5.el10.x86_64 6/197 2026-02-13T02:16:01.933 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-jaraco-functools-4.0.2-4.el10_0.noarch 7/197 2026-02-13T02:16:01.940 INFO:teuthology.orchestra.run.trial078.stdout: Installing : daxctl-libs-80-4.el10.x86_64 8/197 2026-02-13T02:16:01.943 INFO:teuthology.orchestra.run.trial078.stdout: Installing : libgfortran-14.3.1-2.1.el10.x86_64 9/197 2026-02-13T02:16:01.945 INFO:teuthology.orchestra.run.trial078.stdout: Installing : libnbd-1.22.2-3.el10_1.x86_64 10/197 2026-02-13T02:16:01.964 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ndctl-libs-80-4.el10.x86_64 11/197 2026-02-13T02:16:01.970 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-lxml-5.2.1-4.el10.x86_64 12/197 2026-02-13T02:16:01.972 INFO:teuthology.orchestra.run.trial078.stdout: Upgrading : libmount-2.40.2-15.el10_1.x86_64 13/197 2026-02-13T02:16:01.974 INFO:teuthology.orchestra.run.trial078.stdout: Upgrading : libsmartcols-2.40.2-15.el10_1.x86_64 14/197 2026-02-13T02:16:01.976 INFO:teuthology.orchestra.run.trial078.stdout: Installing : yaml-cpp0.7-0.7.0-1.el10_2.x86_64 15/197 2026-02-13T02:16:01.977 INFO:teuthology.orchestra.run.trial078.stdout: Installing : liboath-2.6.12-1.el10_0.x86_64 16/197 2026-02-13T02:16:02.000 INFO:teuthology.orchestra.run.trial078.stdout: Installing : libarrow-doc-17.0.0-9.el10_2.noarch 17/197 2026-02-13T02:16:02.006 INFO:teuthology.orchestra.run.trial078.stdout: Installing : abseil-cpp-20240722.1-1.el10_0.x86_64 18/197 2026-02-13T02:16:02.009 INFO:teuthology.orchestra.run.trial078.stdout: Installing : re2-2:20251105-1.el10_2.x86_64 19/197 2026-02-13T02:16:02.018 INFO:teuthology.orchestra.run.trial078.stdout: Installing : unzip-6.0-69.el10.x86_64 20/197 2026-02-13T02:16:02.023 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-urllib3-1.26.19-2.el10_1.1.noarch 21/197 2026-02-13T02:16:02.029 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-requests-2.32.4-1.el10_0.noarch 22/197 2026-02-13T02:16:02.037 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-packaging-24.2-2.el10.noarch 23/197 2026-02-13T02:16:02.040 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-pyasn1-0.6.1-1.el10.noarch 24/197 2026-02-13T02:16:02.044 INFO:teuthology.orchestra.run.trial078.stdout: Installing : perl-threads-1:2.40-511.el10.x86_64 25/197 2026-02-13T02:16:02.045 INFO:teuthology.orchestra.run.trial078.stdout: Installing : lua-5.4.6-7.el10.x86_64 26/197 2026-02-13T02:16:02.048 INFO:teuthology.orchestra.run.trial078.stdout: Installing : libtool-ltdl-2.4.7-13.el10.x86_64 27/197 2026-02-13T02:16:02.050 INFO:teuthology.orchestra.run.trial078.stdout: Installing : xmlsec1-1:1.2.39-3.el10.x86_64 28/197 2026-02-13T02:16:02.067 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ledmon-libs-1.1.0-2.el10.x86_64 29/197 2026-02-13T02:16:02.071 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-ceph-common-2:20.3.0-5241.g8f8d3829.el10 30/197 2026-02-13T02:16:02.072 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-ceph-argparse-2:20.3.0-5241.g8f8d3829.el 31/197 2026-02-13T02:16:02.074 INFO:teuthology.orchestra.run.trial078.stdout: Installing : lua-devel-5.4.6-7.el10.x86_64 32/197 2026-02-13T02:16:02.075 INFO:teuthology.orchestra.run.trial078.stdout: Installing : perl-threads-shared-1.69-511.el10.x86_64 33/197 2026-02-13T02:16:02.086 INFO:teuthology.orchestra.run.trial078.stdout: Installing : perl-Thread-Queue-3.14-511.el10.noarch 34/197 2026-02-13T02:16:02.108 INFO:teuthology.orchestra.run.trial078.stdout: Installing : automake-1.16.5-20.el10.noarch 35/197 2026-02-13T02:16:02.113 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-pyasn1-modules-0.6.1-1.el10.noarch 36/197 2026-02-13T02:16:02.118 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-rsa-4.9-7.el10_0.noarch 37/197 2026-02-13T02:16:02.122 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-requests-oauthlib-1.3.1-11.el10.noarch 38/197 2026-02-13T02:16:02.131 INFO:teuthology.orchestra.run.trial078.stdout: Installing : zip-3.0-45.el10.x86_64 39/197 2026-02-13T02:16:02.147 INFO:teuthology.orchestra.run.trial078.stdout: Installing : luarocks-3.9.2-6.el10_0.noarch 40/197 2026-02-13T02:16:02.152 INFO:teuthology.orchestra.run.trial078.stdout: Upgrading : util-linux-core-2.40.2-15.el10_1.x86_64 41/197 2026-02-13T02:16:02.154 INFO:teuthology.orchestra.run.trial078.stdout: Installing : libpmem-2.1.0-2.el10_0.x86_64 42/197 2026-02-13T02:16:02.157 INFO:teuthology.orchestra.run.trial078.stdout: Installing : libpmemobj-2.1.0-2.el10_0.x86_64 43/197 2026-02-13T02:16:02.159 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-tempora-5.7.0-1.el10_0.noarch 44/197 2026-02-13T02:16:02.161 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-portend-3.2.0-6.el10_0.noarch 45/197 2026-02-13T02:16:02.172 INFO:teuthology.orchestra.run.trial078.stdout: Installing : xmlstarlet-1.6.1-27.el10.x86_64 46/197 2026-02-13T02:16:02.179 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-protobuf-3.19.6-11.el10.x86_64 47/197 2026-02-13T02:16:02.183 INFO:teuthology.orchestra.run.trial078.stdout: Installing : protobuf-compiler-3.19.6-11.el10.x86_64 48/197 2026-02-13T02:16:02.191 INFO:teuthology.orchestra.run.trial078.stdout: Installing : liborc2-2.0.7-1.el10_2.x86_64 49/197 2026-02-13T02:16:02.194 INFO:teuthology.orchestra.run.trial078.stdout: Installing : cryptsetup-2.7.5-2.el10.x86_64 50/197 2026-02-13T02:16:02.232 INFO:teuthology.orchestra.run.trial078.stdout: Upgrading : libfdisk-2.40.2-15.el10_1.x86_64 51/197 2026-02-13T02:16:02.236 INFO:teuthology.orchestra.run.trial078.stdout: Upgrading : util-linux-2.40.2-15.el10_1.x86_64 52/197 2026-02-13T02:16:02.246 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: util-linux-2.40.2-15.el10_1.x86_64 52/197 2026-02-13T02:16:02.266 INFO:teuthology.orchestra.run.trial078.stdout: Installing : libuuid-devel-2.40.2-15.el10_1.x86_64 53/197 2026-02-13T02:16:02.273 INFO:teuthology.orchestra.run.trial078.stdout: Upgrading : openssl-libs-1:3.5.1-7.el10_1.x86_64 54/197 2026-02-13T02:16:02.390 INFO:teuthology.orchestra.run.trial078.stdout: Upgrading : openssl-fips-provider-1:3.5.1-7.el10_1.x86_64 55/197 2026-02-13T02:16:02.395 INFO:teuthology.orchestra.run.trial078.stdout: Upgrading : librados2-2:20.3.0-5241.g8f8d3829.el10.x86_64 56/197 2026-02-13T02:16:02.424 INFO:teuthology.orchestra.run.trial011.stdout:Transaction test succeeded. 2026-02-13T02:16:02.424 INFO:teuthology.orchestra.run.trial011.stdout:Running transaction 2026-02-13T02:16:02.437 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: librados2-2:20.3.0-5241.g8f8d3829.el10.x86_64 56/197 2026-02-13T02:16:02.438 INFO:teuthology.orchestra.run.trial078.stdout: Installing : libcephfs2-2:20.3.0-5241.g8f8d3829.el10.x86_64 57/197 2026-02-13T02:16:02.450 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: libcephfs2-2:20.3.0-5241.g8f8d3829.el10.x86_64 57/197 2026-02-13T02:16:02.451 INFO:teuthology.orchestra.run.trial078.stdout: Installing : libcephfs-daemon-2:20.3.0-5241.g8f8d3829.el10.x8 58/197 2026-02-13T02:16:02.452 INFO:teuthology.orchestra.run.trial078.stdout: Installing : libcephfs-proxy2-2:20.3.0-5241.g8f8d3829.el10.x8 59/197 2026-02-13T02:16:02.552 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: libcephfs-proxy2-2:20.3.0-5241.g8f8d3829.el10.x8 59/197 2026-02-13T02:16:02.553 INFO:teuthology.orchestra.run.trial078.stdout: Upgrading : librbd1-2:20.3.0-5241.g8f8d3829.el10.x86_64 60/197 2026-02-13T02:16:02.575 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: librbd1-2:20.3.0-5241.g8f8d3829.el10.x86_64 60/197 2026-02-13T02:16:02.576 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-rados-2:20.3.0-5241.g8f8d3829.el10.x86_6 61/197 2026-02-13T02:16:02.584 INFO:teuthology.orchestra.run.trial078.stdout: Installing : librabbitmq-0.14.0-3.el10.x86_64 62/197 2026-02-13T02:16:02.586 INFO:teuthology.orchestra.run.trial078.stdout: Installing : librdkafka-2.1.1-7.el10.x86_64 63/197 2026-02-13T02:16:02.619 INFO:teuthology.orchestra.run.trial078.stdout: Installing : postgresql-private-libs-16.11-1.el10_1.x86_64 64/197 2026-02-13T02:16:02.630 INFO:teuthology.orchestra.run.trial078.stdout: Installing : postgresql-16.11-1.el10_1.x86_64 65/197 2026-02-13T02:16:02.636 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-cephfs-2:20.3.0-5241.g8f8d3829.el10.x86_ 66/197 2026-02-13T02:16:02.636 INFO:teuthology.orchestra.run.trial078.stdout: Installing : libcephsqlite-2:20.3.0-5241.g8f8d3829.el10.x86_6 67/197 2026-02-13T02:16:02.654 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: libcephsqlite-2:20.3.0-5241.g8f8d3829.el10.x86_6 67/197 2026-02-13T02:16:02.655 INFO:teuthology.orchestra.run.trial078.stdout: Installing : libradosstriper1-2:20.3.0-5241.g8f8d3829.el10.x8 68/197 2026-02-13T02:16:02.679 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: libradosstriper1-2:20.3.0-5241.g8f8d3829.el10.x8 68/197 2026-02-13T02:16:02.684 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-rbd-2:20.3.0-5241.g8f8d3829.el10.x86_64 69/197 2026-02-13T02:16:02.689 INFO:teuthology.orchestra.run.trial078.stdout: Installing : librados-devel-2:20.3.0-5241.g8f8d3829.el10.x86_ 70/197 2026-02-13T02:16:02.692 INFO:teuthology.orchestra.run.trial078.stdout: Installing : socat-1.7.4.4-8.el10.x86_64 71/197 2026-02-13T02:16:02.695 INFO:teuthology.orchestra.run.trial078.stdout: Installing : xmlsec1-openssl-1:1.2.39-3.el10.x86_64 72/197 2026-02-13T02:16:02.706 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-xmlsec-1.3.16-1.el10.x86_64 73/197 2026-02-13T02:16:02.708 INFO:teuthology.orchestra.run.trial078.stdout: Installing : thrift-0.20.0-4.el10_1.x86_64 74/197 2026-02-13T02:16:02.710 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-zc-lockfile-3.0.post1-11.el10_0.noarch 75/197 2026-02-13T02:16:02.715 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-xmltodict-0.13.0-5.el10_0.noarch 76/197 2026-02-13T02:16:02.718 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-websocket-client-1.8.0-2.el10_0.noarch 77/197 2026-02-13T02:16:02.723 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-repoze-lru-0.7-23.el10_0.noarch 78/197 2026-02-13T02:16:02.725 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-routes-2.5.1-11.el10_0.noarch 79/197 2026-02-13T02:16:02.735 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-pyperclip-1.8.2-1.el10_0.noarch 80/197 2026-02-13T02:16:02.740 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-cmd2-2.5.8-1.el10_2.noarch 81/197 2026-02-13T02:16:02.742 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-natsort-8.4.0-2.el10_0.noarch 82/197 2026-02-13T02:16:02.746 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-jaraco-context-6.0.1-4.el10_0.noarch 83/197 2026-02-13T02:16:02.753 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-isodate-0.6.1-14.el10_0.noarch 84/197 2026-02-13T02:16:02.755 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-saml-1.16.0-11.el10.noarch 85/197 2026-02-13T02:16:02.757 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-durationpy-0.9-2.el10_0.noarch 86/197 2026-02-13T02:16:02.760 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-certifi-2023.05.07-6.el10_0.noarch 87/197 2026-02-13T02:16:02.773 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-cachetools-5.4.0-6.el10_0.noarch 88/197 2026-02-13T02:16:02.908 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-google-auth-1:2.40.3-1.el10_1.noarch 89/197 2026-02-13T02:16:02.916 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-kubernetes-1:32.0.1-1.el10_1.noarch 90/197 2026-02-13T02:16:02.919 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-bcrypt-4.3.0-3.el10_1.x86_64 91/197 2026-02-13T02:16:02.922 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-autocommand-2.2.2-9.el10_0.noarch 92/197 2026-02-13T02:16:02.924 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-jaraco-text-4.0.0-3.el10_0.noarch 93/197 2026-02-13T02:16:02.926 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-jaraco-collections-5.1.0-1.el10_0.noarch 94/197 2026-02-13T02:16:02.931 INFO:teuthology.orchestra.run.trial078.stdout: Installing : libunwind-1.8.0-4.el10_0.x86_64 95/197 2026-02-13T02:16:02.932 INFO:teuthology.orchestra.run.trial078.stdout: Installing : gperftools-libs-2.15-4.el10_0.x86_64 96/197 2026-02-13T02:16:02.955 INFO:teuthology.orchestra.run.trial078.stdout: Installing : grpc-data-1.48.4-44.el10_0.noarch 97/197 2026-02-13T02:16:02.960 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-grpcio-1.48.4-44.el10_0.x86_64 98/197 2026-02-13T02:16:02.964 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-grpcio-tools-1.48.4-44.el10_0.x86_64 99/197 2026-02-13T02:16:02.970 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-ply-3.11-25.el10.noarch 100/197 2026-02-13T02:16:02.977 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-pycparser-2.20-16.el10.noarch 101/197 2026-02-13T02:16:03.007 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-cffi-1.16.0-7.el10.x86_64 102/197 2026-02-13T02:16:03.013 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-cryptography-43.0.0-4.el10.x86_64 103/197 2026-02-13T02:16:03.022 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-pyOpenSSL-25.0.0-1.el10_1.noarch 104/197 2026-02-13T02:16:03.033 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-cheroot-10.0.1-4.el10_0.noarch 105/197 2026-02-13T02:16:03.054 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-cherrypy-18.10.0-4.el10_0.noarch 106/197 2026-02-13T02:16:03.057 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-asyncssh-2.17.0-1.el10_0.noarch 107/197 2026-02-13T02:16:03.059 INFO:teuthology.orchestra.run.trial078.stdout: Installing : pciutils-3.13.0-6.el10.x86_64 108/197 2026-02-13T02:16:03.060 INFO:teuthology.orchestra.run.trial078.stdout: Installing : qatlib-service-24.09.0-2.el10.x86_64 109/197 2026-02-13T02:16:03.075 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: qatlib-service-24.09.0-2.el10.x86_64 109/197 2026-02-13T02:16:03.092 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: qatlib-24.09.0-2.el10.x86_64 110/197 2026-02-13T02:16:03.094 INFO:teuthology.orchestra.run.trial078.stdout: Installing : qatlib-24.09.0-2.el10.x86_64 110/197 2026-02-13T02:16:03.096 INFO:teuthology.orchestra.run.trial078.stdout: Installing : qatzip-libs-1.3.1-1.el10.x86_64 111/197 2026-02-13T02:16:03.098 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ocl-icd-2.3.2-8.el10.x86_64 112/197 2026-02-13T02:16:03.100 INFO:teuthology.orchestra.run.trial078.stdout: Installing : mailcap-2.1.54-8.el10.noarch 113/197 2026-02-13T02:16:03.102 INFO:teuthology.orchestra.run.trial078.stdout: Installing : libquadmath-14.3.1-2.1.el10.x86_64 114/197 2026-02-13T02:16:03.109 INFO:teuthology.orchestra.run.trial078.stdout: Installing : libpciaccess-0.16-16.el10.x86_64 115/197 2026-02-13T02:16:03.111 INFO:teuthology.orchestra.run.trial078.stdout: Installing : hwloc-libs-2.11.1-3.el10.x86_64 116/197 2026-02-13T02:16:03.112 INFO:teuthology.orchestra.run.trial078.stdout: Installing : libconfig-1.7.3-10.el10.x86_64 117/197 2026-02-13T02:16:03.131 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: libstoragemgmt-1.10.1-4.el10.x86_64 118/197 2026-02-13T02:16:03.132 INFO:teuthology.orchestra.run.trial078.stdout:Creating group 'libstoragemgmt' with GID 992. 2026-02-13T02:16:03.132 INFO:teuthology.orchestra.run.trial078.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 992 and GID 992. 2026-02-13T02:16:03.132 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:16:03.145 INFO:teuthology.orchestra.run.trial078.stdout: Installing : libstoragemgmt-1.10.1-4.el10.x86_64 118/197 2026-02-13T02:16:03.169 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: libstoragemgmt-1.10.1-4.el10.x86_64 118/197 2026-02-13T02:16:03.170 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink '/etc/systemd/system/multi-user.target.wants/libstoragemgmt.service' → '/usr/lib/systemd/system/libstoragemgmt.service'. 2026-02-13T02:16:03.170 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:16:03.178 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-libstoragemgmt-1.10.1-4.el10.x86_64 119/197 2026-02-13T02:16:03.180 INFO:teuthology.orchestra.run.trial078.stdout: Installing : fuse3-3.16.2-5.el10.x86_64 120/197 2026-02-13T02:16:03.182 INFO:teuthology.orchestra.run.trial078.stdout: Installing : uuid-1.6.2-65.el10.x86_64 121/197 2026-02-13T02:16:03.229 INFO:teuthology.orchestra.run.trial078.stdout: Installing : utf8proc-2.7.0-9.el10.x86_64 122/197 2026-02-13T02:16:03.232 INFO:teuthology.orchestra.run.trial078.stdout: Installing : libarrow-17.0.0-9.el10_2.x86_64 123/197 2026-02-13T02:16:03.234 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-prettytable-3.6.0-10.el10.noarch 124/197 2026-02-13T02:16:03.242 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-markupsafe-2.1.3-6.el10.x86_64 125/197 2026-02-13T02:16:03.245 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-jinja2-3.1.6-1.el10_0.noarch 126/197 2026-02-13T02:16:03.259 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-jmespath-1.0.1-8.el10.noarch 127/197 2026-02-13T02:16:03.264 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-devel-3.12.12-2.el10_1.x86_64 128/197 2026-02-13T02:16:03.266 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-colorama-0.4.6-13.el10.noarch 129/197 2026-02-13T02:16:03.322 INFO:teuthology.orchestra.run.trial078.stdout: Installing : openblas-0.3.29-2.el10.x86_64 130/197 2026-02-13T02:16:03.342 INFO:teuthology.orchestra.run.trial078.stdout: Installing : openblas-openmp-0.3.29-2.el10.x86_64 131/197 2026-02-13T02:16:03.343 INFO:teuthology.orchestra.run.trial078.stdout: Installing : flexiblas-netlib-3.4.2-3.el10.x86_64 132/197 2026-02-13T02:16:03.344 INFO:teuthology.orchestra.run.trial078.stdout: Installing : flexiblas-openblas-openmp-3.4.2-3.el10.x86_64 133/197 2026-02-13T02:16:03.468 INFO:teuthology.orchestra.run.trial078.stdout: Installing : flexiblas-3.4.2-3.el10.x86_64 134/197 2026-02-13T02:16:03.494 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-numpy-1:1.26.4-5.el10.x86_64 135/197 2026-02-13T02:16:03.566 INFO:teuthology.orchestra.run.trial011.stdout: Preparing : 1/1 2026-02-13T02:16:03.568 INFO:teuthology.orchestra.run.trial011.stdout: Upgrading : libuuid-2.40.2-15.el10_1.x86_64 1/197 2026-02-13T02:16:03.576 INFO:teuthology.orchestra.run.trial011.stdout: Upgrading : libblkid-2.40.2-15.el10_1.x86_64 2/197 2026-02-13T02:16:03.579 INFO:teuthology.orchestra.run.trial011.stdout: Installing : protobuf-3.19.6-11.el10.x86_64 3/197 2026-02-13T02:16:03.583 INFO:teuthology.orchestra.run.trial011.stdout: Installing : libxslt-1.1.39-8.el10_0.x86_64 4/197 2026-02-13T02:16:03.589 INFO:teuthology.orchestra.run.trial011.stdout: Installing : python3-more-itertools-10.1.0-8.el10_0.noarch 5/197 2026-02-13T02:16:03.592 INFO:teuthology.orchestra.run.trial011.stdout: Installing : lttng-ust-2.13.7-5.el10.x86_64 6/197 2026-02-13T02:16:03.594 INFO:teuthology.orchestra.run.trial011.stdout: Installing : python3-jaraco-functools-4.0.2-4.el10_0.noarch 7/197 2026-02-13T02:16:03.600 INFO:teuthology.orchestra.run.trial011.stdout: Installing : daxctl-libs-80-4.el10.x86_64 8/197 2026-02-13T02:16:03.603 INFO:teuthology.orchestra.run.trial011.stdout: Installing : libgfortran-14.3.1-2.1.el10.x86_64 9/197 2026-02-13T02:16:03.605 INFO:teuthology.orchestra.run.trial011.stdout: Installing : libnbd-1.22.2-3.el10_1.x86_64 10/197 2026-02-13T02:16:03.624 INFO:teuthology.orchestra.run.trial011.stdout: Installing : ndctl-libs-80-4.el10.x86_64 11/197 2026-02-13T02:16:03.627 INFO:teuthology.orchestra.run.trial011.stdout: Installing : python3-lxml-5.2.1-4.el10.x86_64 12/197 2026-02-13T02:16:03.630 INFO:teuthology.orchestra.run.trial011.stdout: Upgrading : libmount-2.40.2-15.el10_1.x86_64 13/197 2026-02-13T02:16:03.632 INFO:teuthology.orchestra.run.trial011.stdout: Upgrading : libsmartcols-2.40.2-15.el10_1.x86_64 14/197 2026-02-13T02:16:03.634 INFO:teuthology.orchestra.run.trial011.stdout: Installing : yaml-cpp0.7-0.7.0-1.el10_2.x86_64 15/197 2026-02-13T02:16:03.635 INFO:teuthology.orchestra.run.trial011.stdout: Installing : liboath-2.6.12-1.el10_0.x86_64 16/197 2026-02-13T02:16:03.658 INFO:teuthology.orchestra.run.trial011.stdout: Installing : libarrow-doc-17.0.0-9.el10_2.noarch 17/197 2026-02-13T02:16:03.663 INFO:teuthology.orchestra.run.trial011.stdout: Installing : abseil-cpp-20240722.1-1.el10_0.x86_64 18/197 2026-02-13T02:16:03.667 INFO:teuthology.orchestra.run.trial011.stdout: Installing : re2-2:20251105-1.el10_2.x86_64 19/197 2026-02-13T02:16:03.677 INFO:teuthology.orchestra.run.trial011.stdout: Installing : unzip-6.0-69.el10.x86_64 20/197 2026-02-13T02:16:03.679 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-numpy-f2py-1:1.26.4-5.el10.x86_64 136/197 2026-02-13T02:16:03.682 INFO:teuthology.orchestra.run.trial011.stdout: Installing : python3-urllib3-1.26.19-2.el10_1.1.noarch 21/197 2026-02-13T02:16:03.686 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-scipy-1.11.3-17.el10.x86_64 137/197 2026-02-13T02:16:03.688 INFO:teuthology.orchestra.run.trial011.stdout: Installing : python3-requests-2.32.4-1.el10_0.noarch 22/197 2026-02-13T02:16:03.689 INFO:teuthology.orchestra.run.trial078.stdout: Installing : libzstd-devel-1.5.5-9.el10.x86_64 138/197 2026-02-13T02:16:03.691 INFO:teuthology.orchestra.run.trial078.stdout: Installing : cmake-filesystem-3.30.5-3.el10_0.x86_64 139/197 2026-02-13T02:16:03.692 INFO:teuthology.orchestra.run.trial078.stdout: Installing : zlib-ng-compat-devel-2.2.3-2.el10.x86_64 140/197 2026-02-13T02:16:03.696 INFO:teuthology.orchestra.run.trial011.stdout: Installing : python3-packaging-24.2-2.el10.noarch 23/197 2026-02-13T02:16:03.699 INFO:teuthology.orchestra.run.trial078.stdout: Installing : boost-program-options-1.83.0-5.el10.x86_64 141/197 2026-02-13T02:16:03.699 INFO:teuthology.orchestra.run.trial011.stdout: Installing : python3-pyasn1-0.6.1-1.el10.noarch 24/197 2026-02-13T02:16:03.702 INFO:teuthology.orchestra.run.trial011.stdout: Installing : perl-threads-1:2.40-511.el10.x86_64 25/197 2026-02-13T02:16:03.704 INFO:teuthology.orchestra.run.trial011.stdout: Installing : lua-5.4.6-7.el10.x86_64 26/197 2026-02-13T02:16:03.706 INFO:teuthology.orchestra.run.trial011.stdout: Installing : libtool-ltdl-2.4.7-13.el10.x86_64 27/197 2026-02-13T02:16:03.708 INFO:teuthology.orchestra.run.trial011.stdout: Installing : xmlsec1-1:1.2.39-3.el10.x86_64 28/197 2026-02-13T02:16:03.725 INFO:teuthology.orchestra.run.trial011.stdout: Installing : ledmon-libs-1.1.0-2.el10.x86_64 29/197 2026-02-13T02:16:03.728 INFO:teuthology.orchestra.run.trial011.stdout: Installing : python3-ceph-common-2:20.3.0-5241.g8f8d3829.el10 30/197 2026-02-13T02:16:03.730 INFO:teuthology.orchestra.run.trial011.stdout: Installing : python3-ceph-argparse-2:20.3.0-5241.g8f8d3829.el 31/197 2026-02-13T02:16:03.731 INFO:teuthology.orchestra.run.trial011.stdout: Installing : lua-devel-5.4.6-7.el10.x86_64 32/197 2026-02-13T02:16:03.733 INFO:teuthology.orchestra.run.trial011.stdout: Installing : perl-threads-shared-1.69-511.el10.x86_64 33/197 2026-02-13T02:16:03.743 INFO:teuthology.orchestra.run.trial011.stdout: Installing : perl-Thread-Queue-3.14-511.el10.noarch 34/197 2026-02-13T02:16:03.765 INFO:teuthology.orchestra.run.trial011.stdout: Installing : automake-1.16.5-20.el10.noarch 35/197 2026-02-13T02:16:03.771 INFO:teuthology.orchestra.run.trial011.stdout: Installing : python3-pyasn1-modules-0.6.1-1.el10.noarch 36/197 2026-02-13T02:16:03.775 INFO:teuthology.orchestra.run.trial011.stdout: Installing : python3-rsa-4.9-7.el10_0.noarch 37/197 2026-02-13T02:16:03.779 INFO:teuthology.orchestra.run.trial011.stdout: Installing : python3-requests-oauthlib-1.3.1-11.el10.noarch 38/197 2026-02-13T02:16:03.788 INFO:teuthology.orchestra.run.trial011.stdout: Installing : zip-3.0-45.el10.x86_64 39/197 2026-02-13T02:16:03.804 INFO:teuthology.orchestra.run.trial011.stdout: Installing : luarocks-3.9.2-6.el10_0.noarch 40/197 2026-02-13T02:16:03.808 INFO:teuthology.orchestra.run.trial011.stdout: Upgrading : util-linux-core-2.40.2-15.el10_1.x86_64 41/197 2026-02-13T02:16:03.811 INFO:teuthology.orchestra.run.trial011.stdout: Installing : libpmem-2.1.0-2.el10_0.x86_64 42/197 2026-02-13T02:16:03.813 INFO:teuthology.orchestra.run.trial011.stdout: Installing : libpmemobj-2.1.0-2.el10_0.x86_64 43/197 2026-02-13T02:16:03.815 INFO:teuthology.orchestra.run.trial011.stdout: Installing : python3-tempora-5.7.0-1.el10_0.noarch 44/197 2026-02-13T02:16:03.817 INFO:teuthology.orchestra.run.trial011.stdout: Installing : python3-portend-3.2.0-6.el10_0.noarch 45/197 2026-02-13T02:16:03.829 INFO:teuthology.orchestra.run.trial011.stdout: Installing : xmlstarlet-1.6.1-27.el10.x86_64 46/197 2026-02-13T02:16:03.837 INFO:teuthology.orchestra.run.trial011.stdout: Installing : python3-protobuf-3.19.6-11.el10.x86_64 47/197 2026-02-13T02:16:03.841 INFO:teuthology.orchestra.run.trial011.stdout: Installing : protobuf-compiler-3.19.6-11.el10.x86_64 48/197 2026-02-13T02:16:03.849 INFO:teuthology.orchestra.run.trial011.stdout: Installing : liborc2-2.0.7-1.el10_2.x86_64 49/197 2026-02-13T02:16:03.851 INFO:teuthology.orchestra.run.trial011.stdout: Installing : cryptsetup-2.7.5-2.el10.x86_64 50/197 2026-02-13T02:16:03.889 INFO:teuthology.orchestra.run.trial011.stdout: Upgrading : libfdisk-2.40.2-15.el10_1.x86_64 51/197 2026-02-13T02:16:03.893 INFO:teuthology.orchestra.run.trial011.stdout: Upgrading : util-linux-2.40.2-15.el10_1.x86_64 52/197 2026-02-13T02:16:03.903 INFO:teuthology.orchestra.run.trial011.stdout: Running scriptlet: util-linux-2.40.2-15.el10_1.x86_64 52/197 2026-02-13T02:16:03.913 INFO:teuthology.orchestra.run.trial078.stdout: Installing : parquet-libs-17.0.0-9.el10_2.x86_64 142/197 2026-02-13T02:16:03.914 INFO:teuthology.orchestra.run.trial078.stdout: Installing : librgw2-2:20.3.0-5241.g8f8d3829.el10.x86_64 143/197 2026-02-13T02:16:03.922 INFO:teuthology.orchestra.run.trial011.stdout: Installing : libuuid-devel-2.40.2-15.el10_1.x86_64 53/197 2026-02-13T02:16:03.929 INFO:teuthology.orchestra.run.trial011.stdout: Upgrading : openssl-libs-1:3.5.1-7.el10_1.x86_64 54/197 2026-02-13T02:16:03.933 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: librgw2-2:20.3.0-5241.g8f8d3829.el10.x86_64 143/197 2026-02-13T02:16:03.934 INFO:teuthology.orchestra.run.trial078.stdout: Installing : python3-rgw-2:20.3.0-5241.g8f8d3829.el10.x86_64 144/197 2026-02-13T02:16:04.045 INFO:teuthology.orchestra.run.trial011.stdout: Upgrading : openssl-fips-provider-1:3.5.1-7.el10_1.x86_64 55/197 2026-02-13T02:16:04.050 INFO:teuthology.orchestra.run.trial011.stdout: Upgrading : librados2-2:20.3.0-5241.g8f8d3829.el10.x86_64 56/197 2026-02-13T02:16:04.090 INFO:teuthology.orchestra.run.trial011.stdout: Running scriptlet: librados2-2:20.3.0-5241.g8f8d3829.el10.x86_64 56/197 2026-02-13T02:16:04.091 INFO:teuthology.orchestra.run.trial011.stdout: Installing : libcephfs2-2:20.3.0-5241.g8f8d3829.el10.x86_64 57/197 2026-02-13T02:16:04.104 INFO:teuthology.orchestra.run.trial011.stdout: Running scriptlet: libcephfs2-2:20.3.0-5241.g8f8d3829.el10.x86_64 57/197 2026-02-13T02:16:04.106 INFO:teuthology.orchestra.run.trial011.stdout: Installing : libcephfs-daemon-2:20.3.0-5241.g8f8d3829.el10.x8 58/197 2026-02-13T02:16:04.107 INFO:teuthology.orchestra.run.trial011.stdout: Installing : libcephfs-proxy2-2:20.3.0-5241.g8f8d3829.el10.x8 59/197 2026-02-13T02:16:04.206 INFO:teuthology.orchestra.run.trial011.stdout: Running scriptlet: libcephfs-proxy2-2:20.3.0-5241.g8f8d3829.el10.x8 59/197 2026-02-13T02:16:04.207 INFO:teuthology.orchestra.run.trial011.stdout: Upgrading : librbd1-2:20.3.0-5241.g8f8d3829.el10.x86_64 60/197 2026-02-13T02:16:04.229 INFO:teuthology.orchestra.run.trial011.stdout: Running scriptlet: librbd1-2:20.3.0-5241.g8f8d3829.el10.x86_64 60/197 2026-02-13T02:16:04.231 INFO:teuthology.orchestra.run.trial011.stdout: Installing : python3-rados-2:20.3.0-5241.g8f8d3829.el10.x86_6 61/197 2026-02-13T02:16:04.238 INFO:teuthology.orchestra.run.trial011.stdout: Installing : librabbitmq-0.14.0-3.el10.x86_64 62/197 2026-02-13T02:16:04.240 INFO:teuthology.orchestra.run.trial011.stdout: Installing : librdkafka-2.1.1-7.el10.x86_64 63/197 2026-02-13T02:16:04.270 INFO:teuthology.orchestra.run.trial011.stdout: Installing : postgresql-private-libs-16.11-1.el10_1.x86_64 64/197 2026-02-13T02:16:04.283 INFO:teuthology.orchestra.run.trial011.stdout: Installing : postgresql-16.11-1.el10_1.x86_64 65/197 2026-02-13T02:16:04.289 INFO:teuthology.orchestra.run.trial011.stdout: Installing : python3-cephfs-2:20.3.0-5241.g8f8d3829.el10.x86_ 66/197 2026-02-13T02:16:04.290 INFO:teuthology.orchestra.run.trial011.stdout: Installing : libcephsqlite-2:20.3.0-5241.g8f8d3829.el10.x86_6 67/197 2026-02-13T02:16:04.310 INFO:teuthology.orchestra.run.trial011.stdout: Running scriptlet: libcephsqlite-2:20.3.0-5241.g8f8d3829.el10.x86_6 67/197 2026-02-13T02:16:04.311 INFO:teuthology.orchestra.run.trial011.stdout: Installing : libradosstriper1-2:20.3.0-5241.g8f8d3829.el10.x8 68/197 2026-02-13T02:16:04.336 INFO:teuthology.orchestra.run.trial011.stdout: Running scriptlet: libradosstriper1-2:20.3.0-5241.g8f8d3829.el10.x8 68/197 2026-02-13T02:16:04.341 INFO:teuthology.orchestra.run.trial011.stdout: Installing : python3-rbd-2:20.3.0-5241.g8f8d3829.el10.x86_64 69/197 2026-02-13T02:16:04.347 INFO:teuthology.orchestra.run.trial011.stdout: Installing : librados-devel-2:20.3.0-5241.g8f8d3829.el10.x86_ 70/197 2026-02-13T02:16:04.349 INFO:teuthology.orchestra.run.trial011.stdout: Installing : socat-1.7.4.4-8.el10.x86_64 71/197 2026-02-13T02:16:04.352 INFO:teuthology.orchestra.run.trial011.stdout: Installing : xmlsec1-openssl-1:1.2.39-3.el10.x86_64 72/197 2026-02-13T02:16:04.364 INFO:teuthology.orchestra.run.trial011.stdout: Installing : python3-xmlsec-1.3.16-1.el10.x86_64 73/197 2026-02-13T02:16:04.367 INFO:teuthology.orchestra.run.trial011.stdout: Installing : thrift-0.20.0-4.el10_1.x86_64 74/197 2026-02-13T02:16:04.368 INFO:teuthology.orchestra.run.trial011.stdout: Installing : python3-zc-lockfile-3.0.post1-11.el10_0.noarch 75/197 2026-02-13T02:16:04.374 INFO:teuthology.orchestra.run.trial011.stdout: Installing : python3-xmltodict-0.13.0-5.el10_0.noarch 76/197 2026-02-13T02:16:04.377 INFO:teuthology.orchestra.run.trial011.stdout: Installing : python3-websocket-client-1.8.0-2.el10_0.noarch 77/197 2026-02-13T02:16:04.381 INFO:teuthology.orchestra.run.trial011.stdout: Installing : python3-repoze-lru-0.7-23.el10_0.noarch 78/197 2026-02-13T02:16:04.383 INFO:teuthology.orchestra.run.trial011.stdout: Installing : python3-routes-2.5.1-11.el10_0.noarch 79/197 2026-02-13T02:16:04.394 INFO:teuthology.orchestra.run.trial011.stdout: Installing : python3-pyperclip-1.8.2-1.el10_0.noarch 80/197 2026-02-13T02:16:04.398 INFO:teuthology.orchestra.run.trial011.stdout: Installing : python3-cmd2-2.5.8-1.el10_2.noarch 81/197 2026-02-13T02:16:04.400 INFO:teuthology.orchestra.run.trial011.stdout: Installing : python3-natsort-8.4.0-2.el10_0.noarch 82/197 2026-02-13T02:16:04.404 INFO:teuthology.orchestra.run.trial011.stdout: Installing : python3-jaraco-context-6.0.1-4.el10_0.noarch 83/197 2026-02-13T02:16:04.411 INFO:teuthology.orchestra.run.trial011.stdout: Installing : python3-isodate-0.6.1-14.el10_0.noarch 84/197 2026-02-13T02:16:04.413 INFO:teuthology.orchestra.run.trial011.stdout: Installing : python3-saml-1.16.0-11.el10.noarch 85/197 2026-02-13T02:16:04.415 INFO:teuthology.orchestra.run.trial011.stdout: Installing : python3-durationpy-0.9-2.el10_0.noarch 86/197 2026-02-13T02:16:04.417 INFO:teuthology.orchestra.run.trial011.stdout: Installing : python3-certifi-2023.05.07-6.el10_0.noarch 87/197 2026-02-13T02:16:04.430 INFO:teuthology.orchestra.run.trial011.stdout: Installing : python3-cachetools-5.4.0-6.el10_0.noarch 88/197 2026-02-13T02:16:04.561 INFO:teuthology.orchestra.run.trial011.stdout: Installing : python3-google-auth-1:2.40.3-1.el10_1.noarch 89/197 2026-02-13T02:16:04.568 INFO:teuthology.orchestra.run.trial011.stdout: Installing : python3-kubernetes-1:32.0.1-1.el10_1.noarch 90/197 2026-02-13T02:16:04.570 INFO:teuthology.orchestra.run.trial011.stdout: Installing : python3-bcrypt-4.3.0-3.el10_1.x86_64 91/197 2026-02-13T02:16:04.573 INFO:teuthology.orchestra.run.trial011.stdout: Installing : python3-autocommand-2.2.2-9.el10_0.noarch 92/197 2026-02-13T02:16:04.575 INFO:teuthology.orchestra.run.trial011.stdout: Installing : python3-jaraco-text-4.0.0-3.el10_0.noarch 93/197 2026-02-13T02:16:04.578 INFO:teuthology.orchestra.run.trial011.stdout: Installing : python3-jaraco-collections-5.1.0-1.el10_0.noarch 94/197 2026-02-13T02:16:04.582 INFO:teuthology.orchestra.run.trial011.stdout: Installing : libunwind-1.8.0-4.el10_0.x86_64 95/197 2026-02-13T02:16:04.584 INFO:teuthology.orchestra.run.trial011.stdout: Installing : gperftools-libs-2.15-4.el10_0.x86_64 96/197 2026-02-13T02:16:04.606 INFO:teuthology.orchestra.run.trial011.stdout: Installing : grpc-data-1.48.4-44.el10_0.noarch 97/197 2026-02-13T02:16:04.611 INFO:teuthology.orchestra.run.trial011.stdout: Installing : python3-grpcio-1.48.4-44.el10_0.x86_64 98/197 2026-02-13T02:16:04.615 INFO:teuthology.orchestra.run.trial011.stdout: Installing : python3-grpcio-tools-1.48.4-44.el10_0.x86_64 99/197 2026-02-13T02:16:04.621 INFO:teuthology.orchestra.run.trial011.stdout: Installing : python3-ply-3.11-25.el10.noarch 100/197 2026-02-13T02:16:04.627 INFO:teuthology.orchestra.run.trial011.stdout: Installing : python3-pycparser-2.20-16.el10.noarch 101/197 2026-02-13T02:16:04.657 INFO:teuthology.orchestra.run.trial011.stdout: Installing : python3-cffi-1.16.0-7.el10.x86_64 102/197 2026-02-13T02:16:04.663 INFO:teuthology.orchestra.run.trial011.stdout: Installing : python3-cryptography-43.0.0-4.el10.x86_64 103/197 2026-02-13T02:16:04.671 INFO:teuthology.orchestra.run.trial011.stdout: Installing : python3-pyOpenSSL-25.0.0-1.el10_1.noarch 104/197 2026-02-13T02:16:04.682 INFO:teuthology.orchestra.run.trial011.stdout: Installing : python3-cheroot-10.0.1-4.el10_0.noarch 105/197 2026-02-13T02:16:04.702 INFO:teuthology.orchestra.run.trial011.stdout: Installing : python3-cherrypy-18.10.0-4.el10_0.noarch 106/197 2026-02-13T02:16:04.707 INFO:teuthology.orchestra.run.trial011.stdout: Installing : python3-asyncssh-2.17.0-1.el10_0.noarch 107/197 2026-02-13T02:16:04.709 INFO:teuthology.orchestra.run.trial011.stdout: Installing : pciutils-3.13.0-6.el10.x86_64 108/197 2026-02-13T02:16:04.710 INFO:teuthology.orchestra.run.trial011.stdout: Installing : qatlib-service-24.09.0-2.el10.x86_64 109/197 2026-02-13T02:16:04.726 INFO:teuthology.orchestra.run.trial011.stdout: Running scriptlet: qatlib-service-24.09.0-2.el10.x86_64 109/197 2026-02-13T02:16:04.743 INFO:teuthology.orchestra.run.trial011.stdout: Running scriptlet: qatlib-24.09.0-2.el10.x86_64 110/197 2026-02-13T02:16:04.744 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-common-2:20.3.0-5241.g8f8d3829.el10.x86_64 145/197 2026-02-13T02:16:04.745 INFO:teuthology.orchestra.run.trial011.stdout: Installing : qatlib-24.09.0-2.el10.x86_64 110/197 2026-02-13T02:16:04.746 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-common-2:20.3.0-5241.g8f8d3829.el10.x86_64 145/197 2026-02-13T02:16:04.747 INFO:teuthology.orchestra.run.trial011.stdout: Installing : qatzip-libs-1.3.1-1.el10.x86_64 111/197 2026-02-13T02:16:04.749 INFO:teuthology.orchestra.run.trial011.stdout: Installing : ocl-icd-2.3.2-8.el10.x86_64 112/197 2026-02-13T02:16:04.751 INFO:teuthology.orchestra.run.trial011.stdout: Installing : mailcap-2.1.54-8.el10.noarch 113/197 2026-02-13T02:16:04.752 INFO:teuthology.orchestra.run.trial011.stdout: Installing : libquadmath-14.3.1-2.1.el10.x86_64 114/197 2026-02-13T02:16:04.759 INFO:teuthology.orchestra.run.trial011.stdout: Installing : libpciaccess-0.16-16.el10.x86_64 115/197 2026-02-13T02:16:04.761 INFO:teuthology.orchestra.run.trial011.stdout: Installing : hwloc-libs-2.11.1-3.el10.x86_64 116/197 2026-02-13T02:16:04.770 INFO:teuthology.orchestra.run.trial011.stdout: Installing : libconfig-1.7.3-10.el10.x86_64 117/197 2026-02-13T02:16:04.789 INFO:teuthology.orchestra.run.trial011.stdout: Running scriptlet: libstoragemgmt-1.10.1-4.el10.x86_64 118/197 2026-02-13T02:16:04.790 INFO:teuthology.orchestra.run.trial011.stdout:Creating group 'libstoragemgmt' with GID 992. 2026-02-13T02:16:04.790 INFO:teuthology.orchestra.run.trial011.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 992 and GID 992. 2026-02-13T02:16:04.790 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:16:04.795 INFO:teuthology.orchestra.run.trial011.stdout: Installing : libstoragemgmt-1.10.1-4.el10.x86_64 118/197 2026-02-13T02:16:04.820 INFO:teuthology.orchestra.run.trial011.stdout: Running scriptlet: libstoragemgmt-1.10.1-4.el10.x86_64 118/197 2026-02-13T02:16:04.820 INFO:teuthology.orchestra.run.trial011.stdout:Created symlink '/etc/systemd/system/multi-user.target.wants/libstoragemgmt.service' → '/usr/lib/systemd/system/libstoragemgmt.service'. 2026-02-13T02:16:04.820 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:16:04.829 INFO:teuthology.orchestra.run.trial011.stdout: Installing : python3-libstoragemgmt-1.10.1-4.el10.x86_64 119/197 2026-02-13T02:16:04.831 INFO:teuthology.orchestra.run.trial011.stdout: Installing : fuse3-3.16.2-5.el10.x86_64 120/197 2026-02-13T02:16:04.833 INFO:teuthology.orchestra.run.trial011.stdout: Installing : uuid-1.6.2-65.el10.x86_64 121/197 2026-02-13T02:16:04.870 INFO:teuthology.orchestra.run.trial011.stdout: Installing : utf8proc-2.7.0-9.el10.x86_64 122/197 2026-02-13T02:16:04.872 INFO:teuthology.orchestra.run.trial011.stdout: Installing : libarrow-17.0.0-9.el10_2.x86_64 123/197 2026-02-13T02:16:04.875 INFO:teuthology.orchestra.run.trial011.stdout: Installing : python3-prettytable-3.6.0-10.el10.noarch 124/197 2026-02-13T02:16:04.882 INFO:teuthology.orchestra.run.trial011.stdout: Installing : python3-markupsafe-2.1.3-6.el10.x86_64 125/197 2026-02-13T02:16:04.885 INFO:teuthology.orchestra.run.trial060.stdout: Running scriptlet: ceph-selinux-2:20.3.0-5241.g8f8d3829.el10.x86_64 147/197 2026-02-13T02:16:04.885 INFO:teuthology.orchestra.run.trial060.stdout:skipping the directory /sys 2026-02-13T02:16:04.885 INFO:teuthology.orchestra.run.trial060.stdout:skipping the directory /proc 2026-02-13T02:16:04.886 INFO:teuthology.orchestra.run.trial060.stdout:skipping the directory /mnt 2026-02-13T02:16:04.886 INFO:teuthology.orchestra.run.trial060.stdout:skipping the directory /var/tmp 2026-02-13T02:16:04.886 INFO:teuthology.orchestra.run.trial060.stdout:skipping the directory /home 2026-02-13T02:16:04.886 INFO:teuthology.orchestra.run.trial060.stdout:skipping the directory /root 2026-02-13T02:16:04.886 INFO:teuthology.orchestra.run.trial060.stdout:skipping the directory /tmp 2026-02-13T02:16:04.886 INFO:teuthology.orchestra.run.trial060.stdout: 2026-02-13T02:16:04.886 INFO:teuthology.orchestra.run.trial011.stdout: Installing : python3-jinja2-3.1.6-1.el10_0.noarch 126/197 2026-02-13T02:16:04.899 INFO:teuthology.orchestra.run.trial011.stdout: Installing : python3-jmespath-1.0.1-8.el10.noarch 127/197 2026-02-13T02:16:04.904 INFO:teuthology.orchestra.run.trial011.stdout: Installing : python3-devel-3.12.12-2.el10_1.x86_64 128/197 2026-02-13T02:16:04.905 INFO:teuthology.orchestra.run.trial011.stdout: Installing : python3-colorama-0.4.6-13.el10.noarch 129/197 2026-02-13T02:16:04.944 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-common-2:20.3.0-5241.g8f8d3829.el10.x86_64 145/197 2026-02-13T02:16:04.947 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-base-2:20.3.0-5241.g8f8d3829.el10.x86_64 146/197 2026-02-13T02:16:04.960 INFO:teuthology.orchestra.run.trial011.stdout: Installing : openblas-0.3.29-2.el10.x86_64 130/197 2026-02-13T02:16:04.977 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-base-2:20.3.0-5241.g8f8d3829.el10.x86_64 146/197 2026-02-13T02:16:04.977 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink '/etc/systemd/system/multi-user.target.wants/ceph.target' → '/usr/lib/systemd/system/ceph.target'. 2026-02-13T02:16:04.977 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink '/etc/systemd/system/ceph.target.wants/ceph-crash.service' → '/usr/lib/systemd/system/ceph-crash.service'. 2026-02-13T02:16:04.977 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:16:04.979 INFO:teuthology.orchestra.run.trial011.stdout: Installing : openblas-openmp-0.3.29-2.el10.x86_64 131/197 2026-02-13T02:16:04.979 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-selinux-2:20.3.0-5241.g8f8d3829.el10.x86_64 147/197 2026-02-13T02:16:04.980 INFO:teuthology.orchestra.run.trial011.stdout: Installing : flexiblas-netlib-3.4.2-3.el10.x86_64 132/197 2026-02-13T02:16:04.982 INFO:teuthology.orchestra.run.trial011.stdout: Installing : flexiblas-openblas-openmp-3.4.2-3.el10.x86_64 133/197 2026-02-13T02:16:05.104 INFO:teuthology.orchestra.run.trial011.stdout: Installing : flexiblas-3.4.2-3.el10.x86_64 134/197 2026-02-13T02:16:05.129 INFO:teuthology.orchestra.run.trial011.stdout: Installing : python3-numpy-1:1.26.4-5.el10.x86_64 135/197 2026-02-13T02:16:05.311 INFO:teuthology.orchestra.run.trial011.stdout: Installing : python3-numpy-f2py-1:1.26.4-5.el10.x86_64 136/197 2026-02-13T02:16:05.319 INFO:teuthology.orchestra.run.trial011.stdout: Installing : python3-scipy-1.11.3-17.el10.x86_64 137/197 2026-02-13T02:16:05.321 INFO:teuthology.orchestra.run.trial011.stdout: Installing : libzstd-devel-1.5.5-9.el10.x86_64 138/197 2026-02-13T02:16:05.323 INFO:teuthology.orchestra.run.trial011.stdout: Installing : cmake-filesystem-3.30.5-3.el10_0.x86_64 139/197 2026-02-13T02:16:05.324 INFO:teuthology.orchestra.run.trial011.stdout: Installing : zlib-ng-compat-devel-2.2.3-2.el10.x86_64 140/197 2026-02-13T02:16:05.331 INFO:teuthology.orchestra.run.trial011.stdout: Installing : boost-program-options-1.83.0-5.el10.x86_64 141/197 2026-02-13T02:16:05.542 INFO:teuthology.orchestra.run.trial011.stdout: Installing : parquet-libs-17.0.0-9.el10_2.x86_64 142/197 2026-02-13T02:16:05.543 INFO:teuthology.orchestra.run.trial011.stdout: Installing : librgw2-2:20.3.0-5241.g8f8d3829.el10.x86_64 143/197 2026-02-13T02:16:05.563 INFO:teuthology.orchestra.run.trial011.stdout: Running scriptlet: librgw2-2:20.3.0-5241.g8f8d3829.el10.x86_64 143/197 2026-02-13T02:16:05.564 INFO:teuthology.orchestra.run.trial011.stdout: Installing : python3-rgw-2:20.3.0-5241.g8f8d3829.el10.x86_64 144/197 2026-02-13T02:16:05.967 INFO:teuthology.orchestra.run.trial060.stdout: Installing : ceph-osd-classic-2:20.3.0-5241.g8f8d3829.el10.x8 148/197 2026-02-13T02:16:05.996 INFO:teuthology.orchestra.run.trial060.stdout: Installing : ceph-osd-crimson-2:20.3.0-5241.g8f8d3829.el10.x8 149/197 2026-02-13T02:16:05.998 INFO:teuthology.orchestra.run.trial060.stdout: Installing : ceph-volume-2:20.3.0-5241.g8f8d3829.el10.noarch 150/197 2026-02-13T02:16:06.013 INFO:teuthology.orchestra.run.trial060.stdout: Running scriptlet: ceph-volume-2:20.3.0-5241.g8f8d3829.el10.noarch 150/197 2026-02-13T02:16:06.013 INFO:teuthology.orchestra.run.trial060.stdout:Glob pattern passed to preset, but globs are not supported for this. 2026-02-13T02:16:06.014 INFO:teuthology.orchestra.run.trial060.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-13T02:16:06.014 INFO:teuthology.orchestra.run.trial060.stdout: 2026-02-13T02:16:06.021 INFO:teuthology.orchestra.run.trial060.stdout: Installing : ceph-osd-2:20.3.0-5241.g8f8d3829.el10.x86_64 151/197 2026-02-13T02:16:06.044 INFO:teuthology.orchestra.run.trial060.stdout: Running scriptlet: ceph-osd-2:20.3.0-5241.g8f8d3829.el10.x86_64 151/197 2026-02-13T02:16:06.044 INFO:teuthology.orchestra.run.trial060.stdout:Glob pattern passed to preset, but globs are not supported for this. 2026-02-13T02:16:06.045 INFO:teuthology.orchestra.run.trial060.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-13T02:16:06.045 INFO:teuthology.orchestra.run.trial060.stdout:Created symlink '/etc/systemd/system/multi-user.target.wants/ceph-osd.target' → '/usr/lib/systemd/system/ceph-osd.target'. 2026-02-13T02:16:06.045 INFO:teuthology.orchestra.run.trial060.stdout:Created symlink '/etc/systemd/system/ceph.target.wants/ceph-osd.target' → '/usr/lib/systemd/system/ceph-osd.target'. 2026-02-13T02:16:06.045 INFO:teuthology.orchestra.run.trial060.stdout: 2026-02-13T02:16:06.117 INFO:teuthology.orchestra.run.trial060.stdout: Installing : ceph-mds-2:20.3.0-5241.g8f8d3829.el10.x86_64 152/197 2026-02-13T02:16:06.139 INFO:teuthology.orchestra.run.trial060.stdout: Running scriptlet: ceph-mds-2:20.3.0-5241.g8f8d3829.el10.x86_64 152/197 2026-02-13T02:16:06.139 INFO:teuthology.orchestra.run.trial060.stdout:Glob pattern passed to preset, but globs are not supported for this. 2026-02-13T02:16:06.140 INFO:teuthology.orchestra.run.trial060.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-13T02:16:06.140 INFO:teuthology.orchestra.run.trial060.stdout:Created symlink '/etc/systemd/system/multi-user.target.wants/ceph-mds.target' → '/usr/lib/systemd/system/ceph-mds.target'. 2026-02-13T02:16:06.140 INFO:teuthology.orchestra.run.trial060.stdout:Created symlink '/etc/systemd/system/ceph.target.wants/ceph-mds.target' → '/usr/lib/systemd/system/ceph-mds.target'. 2026-02-13T02:16:06.140 INFO:teuthology.orchestra.run.trial060.stdout: 2026-02-13T02:16:06.327 INFO:teuthology.orchestra.run.trial060.stdout: Installing : ceph-mon-2:20.3.0-5241.g8f8d3829.el10.x86_64 153/197 2026-02-13T02:16:06.350 INFO:teuthology.orchestra.run.trial060.stdout: Running scriptlet: ceph-mon-2:20.3.0-5241.g8f8d3829.el10.x86_64 153/197 2026-02-13T02:16:06.351 INFO:teuthology.orchestra.run.trial060.stdout:Glob pattern passed to preset, but globs are not supported for this. 2026-02-13T02:16:06.351 INFO:teuthology.orchestra.run.trial060.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-13T02:16:06.351 INFO:teuthology.orchestra.run.trial060.stdout:Created symlink '/etc/systemd/system/multi-user.target.wants/ceph-mon.target' → '/usr/lib/systemd/system/ceph-mon.target'. 2026-02-13T02:16:06.351 INFO:teuthology.orchestra.run.trial060.stdout:Created symlink '/etc/systemd/system/ceph.target.wants/ceph-mon.target' → '/usr/lib/systemd/system/ceph-mon.target'. 2026-02-13T02:16:06.351 INFO:teuthology.orchestra.run.trial060.stdout: 2026-02-13T02:16:06.370 INFO:teuthology.orchestra.run.trial011.stdout: Running scriptlet: ceph-common-2:20.3.0-5241.g8f8d3829.el10.x86_64 145/197 2026-02-13T02:16:06.372 INFO:teuthology.orchestra.run.trial011.stdout: Installing : ceph-common-2:20.3.0-5241.g8f8d3829.el10.x86_64 145/197 2026-02-13T02:16:06.386 INFO:teuthology.orchestra.run.trial060.stdout: Running scriptlet: cephadm-2:20.3.0-5241.g8f8d3829.el10.noarch 154/197 2026-02-13T02:16:06.387 INFO:teuthology.orchestra.run.trial060.stdout: Installing : cephadm-2:20.3.0-5241.g8f8d3829.el10.noarch 154/197 2026-02-13T02:16:06.395 INFO:teuthology.orchestra.run.trial060.stdout: Installing : ceph-prometheus-alerts-2:20.3.0-5241.g8f8d3829.e 155/197 2026-02-13T02:16:06.407 INFO:teuthology.orchestra.run.trial060.stdout: Installing : ceph-grafana-dashboards-2:20.3.0-5241.g8f8d3829. 156/197 2026-02-13T02:16:06.408 INFO:teuthology.orchestra.run.trial060.stdout: Installing : ceph-mgr-cephadm-2:20.3.0-5241.g8f8d3829.el10.no 157/197 2026-02-13T02:16:06.566 INFO:teuthology.orchestra.run.trial011.stdout: Running scriptlet: ceph-common-2:20.3.0-5241.g8f8d3829.el10.x86_64 145/197 2026-02-13T02:16:06.568 INFO:teuthology.orchestra.run.trial011.stdout: Installing : ceph-base-2:20.3.0-5241.g8f8d3829.el10.x86_64 146/197 2026-02-13T02:16:06.600 INFO:teuthology.orchestra.run.trial011.stdout: Running scriptlet: ceph-base-2:20.3.0-5241.g8f8d3829.el10.x86_64 146/197 2026-02-13T02:16:06.600 INFO:teuthology.orchestra.run.trial011.stdout:Created symlink '/etc/systemd/system/multi-user.target.wants/ceph.target' → '/usr/lib/systemd/system/ceph.target'. 2026-02-13T02:16:06.600 INFO:teuthology.orchestra.run.trial011.stdout:Created symlink '/etc/systemd/system/ceph.target.wants/ceph-crash.service' → '/usr/lib/systemd/system/ceph-crash.service'. 2026-02-13T02:16:06.600 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:16:06.602 INFO:teuthology.orchestra.run.trial011.stdout: Installing : ceph-selinux-2:20.3.0-5241.g8f8d3829.el10.x86_64 147/197 2026-02-13T02:16:07.312 INFO:teuthology.orchestra.run.trial060.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.3.0-5241.g8f8d3829.el10.no 157/197 2026-02-13T02:16:07.318 INFO:teuthology.orchestra.run.trial060.stdout: Installing : ceph-mgr-dashboard-2:20.3.0-5241.g8f8d3829.el10. 158/197 2026-02-13T02:16:07.676 INFO:teuthology.orchestra.run.trial060.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.3.0-5241.g8f8d3829.el10. 158/197 2026-02-13T02:16:07.676 INFO:teuthology.orchestra.run.trial060.stdout: Installing : ceph-mgr-diskprediction-local-2:20.3.0-5241.g8f8 159/197 2026-02-13T02:16:07.687 INFO:teuthology.orchestra.run.trial060.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.3.0-5241.g8f8 159/197 2026-02-13T02:16:07.688 INFO:teuthology.orchestra.run.trial060.stdout: Installing : ceph-mgr-k8sevents-2:20.3.0-5241.g8f8d3829.el10. 160/197 2026-02-13T02:16:07.720 INFO:teuthology.orchestra.run.trial060.stdout: Running scriptlet: ceph-mgr-k8sevents-2:20.3.0-5241.g8f8d3829.el10. 160/197 2026-02-13T02:16:07.753 INFO:teuthology.orchestra.run.trial060.stdout: Installing : ceph-mgr-modules-core-2:20.3.0-5241.g8f8d3829.el 161/197 2026-02-13T02:16:07.753 INFO:teuthology.orchestra.run.trial060.stdout: Installing : ceph-mgr-2:20.3.0-5241.g8f8d3829.el10.x86_64 162/197 2026-02-13T02:16:07.776 INFO:teuthology.orchestra.run.trial060.stdout: Running scriptlet: ceph-mgr-2:20.3.0-5241.g8f8d3829.el10.x86_64 162/197 2026-02-13T02:16:07.776 INFO:teuthology.orchestra.run.trial060.stdout:Glob pattern passed to preset, but globs are not supported for this. 2026-02-13T02:16:07.776 INFO:teuthology.orchestra.run.trial060.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-13T02:16:07.776 INFO:teuthology.orchestra.run.trial060.stdout:Created symlink '/etc/systemd/system/multi-user.target.wants/ceph-mgr.target' → '/usr/lib/systemd/system/ceph-mgr.target'. 2026-02-13T02:16:07.776 INFO:teuthology.orchestra.run.trial060.stdout:Created symlink '/etc/systemd/system/ceph.target.wants/ceph-mgr.target' → '/usr/lib/systemd/system/ceph-mgr.target'. 2026-02-13T02:16:07.776 INFO:teuthology.orchestra.run.trial060.stdout: 2026-02-13T02:16:07.782 INFO:teuthology.orchestra.run.trial060.stdout: Installing : ceph-mgr-rook-2:20.3.0-5241.g8f8d3829.el10.noarc 163/197 2026-02-13T02:16:07.794 INFO:teuthology.orchestra.run.trial060.stdout: Running scriptlet: ceph-mgr-rook-2:20.3.0-5241.g8f8d3829.el10.noarc 163/197 2026-02-13T02:16:08.225 INFO:teuthology.orchestra.run.trial060.stdout: Installing : ceph-2:20.3.0-5241.g8f8d3829.el10.x86_64 164/197 2026-02-13T02:16:08.226 INFO:teuthology.orchestra.run.trial060.stdout: Installing : ceph-radosgw-2:20.3.0-5241.g8f8d3829.el10.x86_64 165/197 2026-02-13T02:16:08.250 INFO:teuthology.orchestra.run.trial060.stdout: Running scriptlet: ceph-radosgw-2:20.3.0-5241.g8f8d3829.el10.x86_64 165/197 2026-02-13T02:16:08.250 INFO:teuthology.orchestra.run.trial060.stdout:Glob pattern passed to preset, but globs are not supported for this. 2026-02-13T02:16:08.250 INFO:teuthology.orchestra.run.trial060.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-13T02:16:08.250 INFO:teuthology.orchestra.run.trial060.stdout:Created symlink '/etc/systemd/system/multi-user.target.wants/ceph-radosgw.target' → '/usr/lib/systemd/system/ceph-radosgw.target'. 2026-02-13T02:16:08.251 INFO:teuthology.orchestra.run.trial060.stdout:Created symlink '/etc/systemd/system/ceph.target.wants/ceph-radosgw.target' → '/usr/lib/systemd/system/ceph-radosgw.target'. 2026-02-13T02:16:08.251 INFO:teuthology.orchestra.run.trial060.stdout: 2026-02-13T02:16:08.257 INFO:teuthology.orchestra.run.trial060.stdout: Installing : ceph-immutable-object-cache-2:20.3.0-5241.g8f8d3 166/197 2026-02-13T02:16:08.278 INFO:teuthology.orchestra.run.trial060.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.3.0-5241.g8f8d3 166/197 2026-02-13T02:16:08.278 INFO:teuthology.orchestra.run.trial060.stdout:Glob pattern passed to preset, but globs are not supported for this. 2026-02-13T02:16:08.278 INFO:teuthology.orchestra.run.trial060.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-13T02:16:08.278 INFO:teuthology.orchestra.run.trial060.stdout: 2026-02-13T02:16:08.288 INFO:teuthology.orchestra.run.trial060.stdout: Installing : cephfs-mirror-2:20.3.0-5241.g8f8d3829.el10.x86_6 167/197 2026-02-13T02:16:08.306 INFO:teuthology.orchestra.run.trial060.stdout: Running scriptlet: cephfs-mirror-2:20.3.0-5241.g8f8d3829.el10.x86_6 167/197 2026-02-13T02:16:08.307 INFO:teuthology.orchestra.run.trial060.stdout:Glob pattern passed to preset, but globs are not supported for this. 2026-02-13T02:16:08.307 INFO:teuthology.orchestra.run.trial060.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2026-02-13T02:16:08.307 INFO:teuthology.orchestra.run.trial060.stdout:Created symlink '/etc/systemd/system/multi-user.target.wants/cephfs-mirror.target' → '/usr/lib/systemd/system/cephfs-mirror.target'. 2026-02-13T02:16:08.307 INFO:teuthology.orchestra.run.trial060.stdout:Created symlink '/etc/systemd/system/ceph.target.wants/cephfs-mirror.target' → '/usr/lib/systemd/system/cephfs-mirror.target'. 2026-02-13T02:16:08.307 INFO:teuthology.orchestra.run.trial060.stdout: 2026-02-13T02:16:08.399 INFO:teuthology.orchestra.run.trial060.stdout: Installing : rbd-mirror-2:20.3.0-5241.g8f8d3829.el10.x86_64 168/197 2026-02-13T02:16:08.419 INFO:teuthology.orchestra.run.trial060.stdout: Running scriptlet: rbd-mirror-2:20.3.0-5241.g8f8d3829.el10.x86_64 168/197 2026-02-13T02:16:08.419 INFO:teuthology.orchestra.run.trial060.stdout:Glob pattern passed to preset, but globs are not supported for this. 2026-02-13T02:16:08.419 INFO:teuthology.orchestra.run.trial060.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-13T02:16:08.419 INFO:teuthology.orchestra.run.trial060.stdout:Created symlink '/etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target' → '/usr/lib/systemd/system/ceph-rbd-mirror.target'. 2026-02-13T02:16:08.420 INFO:teuthology.orchestra.run.trial060.stdout:Created symlink '/etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target' → '/usr/lib/systemd/system/ceph-rbd-mirror.target'. 2026-02-13T02:16:08.420 INFO:teuthology.orchestra.run.trial060.stdout: 2026-02-13T02:16:09.057 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-selinux-2:20.3.0-5241.g8f8d3829.el10.x86_64 147/197 2026-02-13T02:16:09.057 INFO:teuthology.orchestra.run.trial078.stdout:skipping the directory /sys 2026-02-13T02:16:09.058 INFO:teuthology.orchestra.run.trial078.stdout:skipping the directory /proc 2026-02-13T02:16:09.058 INFO:teuthology.orchestra.run.trial078.stdout:skipping the directory /mnt 2026-02-13T02:16:09.058 INFO:teuthology.orchestra.run.trial078.stdout:skipping the directory /var/tmp 2026-02-13T02:16:09.058 INFO:teuthology.orchestra.run.trial078.stdout:skipping the directory /home 2026-02-13T02:16:09.058 INFO:teuthology.orchestra.run.trial078.stdout:skipping the directory /root 2026-02-13T02:16:09.058 INFO:teuthology.orchestra.run.trial078.stdout:skipping the directory /tmp 2026-02-13T02:16:09.058 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:16:10.145 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-osd-classic-2:20.3.0-5241.g8f8d3829.el10.x8 148/197 2026-02-13T02:16:10.174 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-osd-crimson-2:20.3.0-5241.g8f8d3829.el10.x8 149/197 2026-02-13T02:16:10.176 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-volume-2:20.3.0-5241.g8f8d3829.el10.noarch 150/197 2026-02-13T02:16:10.192 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-volume-2:20.3.0-5241.g8f8d3829.el10.noarch 150/197 2026-02-13T02:16:10.192 INFO:teuthology.orchestra.run.trial078.stdout:Glob pattern passed to preset, but globs are not supported for this. 2026-02-13T02:16:10.192 INFO:teuthology.orchestra.run.trial078.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-13T02:16:10.192 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:16:10.199 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-osd-2:20.3.0-5241.g8f8d3829.el10.x86_64 151/197 2026-02-13T02:16:10.224 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-osd-2:20.3.0-5241.g8f8d3829.el10.x86_64 151/197 2026-02-13T02:16:10.224 INFO:teuthology.orchestra.run.trial078.stdout:Glob pattern passed to preset, but globs are not supported for this. 2026-02-13T02:16:10.224 INFO:teuthology.orchestra.run.trial078.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-13T02:16:10.224 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink '/etc/systemd/system/multi-user.target.wants/ceph-osd.target' → '/usr/lib/systemd/system/ceph-osd.target'. 2026-02-13T02:16:10.224 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink '/etc/systemd/system/ceph.target.wants/ceph-osd.target' → '/usr/lib/systemd/system/ceph-osd.target'. 2026-02-13T02:16:10.224 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:16:10.297 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-mds-2:20.3.0-5241.g8f8d3829.el10.x86_64 152/197 2026-02-13T02:16:10.319 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-mds-2:20.3.0-5241.g8f8d3829.el10.x86_64 152/197 2026-02-13T02:16:10.319 INFO:teuthology.orchestra.run.trial078.stdout:Glob pattern passed to preset, but globs are not supported for this. 2026-02-13T02:16:10.319 INFO:teuthology.orchestra.run.trial078.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-13T02:16:10.319 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink '/etc/systemd/system/multi-user.target.wants/ceph-mds.target' → '/usr/lib/systemd/system/ceph-mds.target'. 2026-02-13T02:16:10.319 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink '/etc/systemd/system/ceph.target.wants/ceph-mds.target' → '/usr/lib/systemd/system/ceph-mds.target'. 2026-02-13T02:16:10.319 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:16:10.507 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-mon-2:20.3.0-5241.g8f8d3829.el10.x86_64 153/197 2026-02-13T02:16:10.529 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-mon-2:20.3.0-5241.g8f8d3829.el10.x86_64 153/197 2026-02-13T02:16:10.529 INFO:teuthology.orchestra.run.trial078.stdout:Glob pattern passed to preset, but globs are not supported for this. 2026-02-13T02:16:10.529 INFO:teuthology.orchestra.run.trial078.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-13T02:16:10.529 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink '/etc/systemd/system/multi-user.target.wants/ceph-mon.target' → '/usr/lib/systemd/system/ceph-mon.target'. 2026-02-13T02:16:10.529 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink '/etc/systemd/system/ceph.target.wants/ceph-mon.target' → '/usr/lib/systemd/system/ceph-mon.target'. 2026-02-13T02:16:10.530 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:16:10.563 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: cephadm-2:20.3.0-5241.g8f8d3829.el10.noarch 154/197 2026-02-13T02:16:10.565 INFO:teuthology.orchestra.run.trial078.stdout: Installing : cephadm-2:20.3.0-5241.g8f8d3829.el10.noarch 154/197 2026-02-13T02:16:10.572 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-prometheus-alerts-2:20.3.0-5241.g8f8d3829.e 155/197 2026-02-13T02:16:10.584 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-grafana-dashboards-2:20.3.0-5241.g8f8d3829. 156/197 2026-02-13T02:16:10.585 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-mgr-cephadm-2:20.3.0-5241.g8f8d3829.el10.no 157/197 2026-02-13T02:16:10.720 INFO:teuthology.orchestra.run.trial011.stdout: Running scriptlet: ceph-selinux-2:20.3.0-5241.g8f8d3829.el10.x86_64 147/197 2026-02-13T02:16:10.720 INFO:teuthology.orchestra.run.trial011.stdout:skipping the directory /sys 2026-02-13T02:16:10.720 INFO:teuthology.orchestra.run.trial011.stdout:skipping the directory /proc 2026-02-13T02:16:10.720 INFO:teuthology.orchestra.run.trial011.stdout:skipping the directory /mnt 2026-02-13T02:16:10.720 INFO:teuthology.orchestra.run.trial011.stdout:skipping the directory /var/tmp 2026-02-13T02:16:10.721 INFO:teuthology.orchestra.run.trial011.stdout:skipping the directory /home 2026-02-13T02:16:10.721 INFO:teuthology.orchestra.run.trial011.stdout:skipping the directory /root 2026-02-13T02:16:10.721 INFO:teuthology.orchestra.run.trial011.stdout:skipping the directory /tmp 2026-02-13T02:16:10.721 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:16:11.025 INFO:teuthology.orchestra.run.trial060.stdout: Installing : ceph-test-2:20.3.0-5241.g8f8d3829.el10.x86_64 169/197 2026-02-13T02:16:11.027 INFO:teuthology.orchestra.run.trial060.stdout: Installing : elfutils-libelf-devel-0.193-1.el10.rocky.0.1.x86 170/197 2026-02-13T02:16:11.059 INFO:teuthology.orchestra.run.trial060.stdout: Installing : cephfs-shell-2:20.3.0-5241.g8f8d3829.el10.x86_64 171/197 2026-02-13T02:16:11.093 INFO:teuthology.orchestra.run.trial060.stdout: Installing : postgresql-contrib-16.11-1.el10_1.x86_64 172/197 2026-02-13T02:16:11.096 INFO:teuthology.orchestra.run.trial060.stdout: Installing : ceph-fuse-2:20.3.0-5241.g8f8d3829.el10.x86_64 173/197 2026-02-13T02:16:11.097 INFO:teuthology.orchestra.run.trial060.stdout: Installing : libcephfs-devel-2:20.3.0-5241.g8f8d3829.el10.x86 174/197 2026-02-13T02:16:11.180 INFO:teuthology.orchestra.run.trial060.stdout: Running scriptlet: postgresql-server-16.11-1.el10_1.x86_64 175/197 2026-02-13T02:16:11.183 INFO:teuthology.orchestra.run.trial060.stdout: Installing : postgresql-server-16.11-1.el10_1.x86_64 175/197 2026-02-13T02:16:11.198 INFO:teuthology.orchestra.run.trial060.stdout: Running scriptlet: postgresql-server-16.11-1.el10_1.x86_64 175/197 2026-02-13T02:16:11.202 INFO:teuthology.orchestra.run.trial060.stdout: Installing : cephfs-top-2:20.3.0-5241.g8f8d3829.el10.noarch 176/197 2026-02-13T02:16:11.208 INFO:teuthology.orchestra.run.trial060.stdout: Installing : rbd-fuse-2:20.3.0-5241.g8f8d3829.el10.x86_64 177/197 2026-02-13T02:16:11.441 INFO:teuthology.orchestra.run.trial060.stdout: Installing : rbd-nbd-2:20.3.0-5241.g8f8d3829.el10.x86_64 178/197 2026-02-13T02:16:11.472 INFO:teuthology.orchestra.run.trial060.stdout: Installing : openssl-devel-1:3.5.1-7.el10_1.x86_64 179/197 2026-02-13T02:16:11.476 INFO:teuthology.orchestra.run.trial060.stdout: Upgrading : openssl-1:3.5.1-7.el10_1.x86_64 180/197 2026-02-13T02:16:11.483 INFO:teuthology.orchestra.run.trial060.stdout: Installing : xfsprogs-devel-6.11.0-2.el10.x86_64 181/197 2026-02-13T02:16:11.483 INFO:teuthology.orchestra.run.trial060.stdout: Installing : libtool-2.4.7-13.el10.x86_64 182/197 2026-02-13T02:16:11.489 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.3.0-5241.g8f8d3829.el10.no 157/197 2026-02-13T02:16:11.489 INFO:teuthology.orchestra.run.trial060.stdout: Installing : libaio-devel-0.3.111-22.el10.x86_64 183/197 2026-02-13T02:16:11.494 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-mgr-dashboard-2:20.3.0-5241.g8f8d3829.el10. 158/197 2026-02-13T02:16:11.503 INFO:teuthology.orchestra.run.trial060.stdout: Installing : flex-2.6.4-19.el10.x86_64 184/197 2026-02-13T02:16:11.505 INFO:teuthology.orchestra.run.trial060.stdout: Installing : bison-3.8.2-9.el10.x86_64 185/197 2026-02-13T02:16:11.513 INFO:teuthology.orchestra.run.trial060.stdout: Running scriptlet: util-linux-2.40.2-13.el10.x86_64 186/197 2026-02-13T02:16:11.513 INFO:teuthology.orchestra.run.trial060.stdout: Cleanup : util-linux-2.40.2-13.el10.x86_64 186/197 2026-02-13T02:16:11.531 INFO:teuthology.orchestra.run.trial060.stdout: Running scriptlet: util-linux-2.40.2-13.el10.x86_64 186/197 2026-02-13T02:16:11.534 INFO:teuthology.orchestra.run.trial060.stdout: Cleanup : util-linux-core-2.40.2-13.el10.x86_64 187/197 2026-02-13T02:16:11.536 INFO:teuthology.orchestra.run.trial060.stdout: Cleanup : openssl-1:3.5.1-5.el10_1.x86_64 188/197 2026-02-13T02:16:11.538 INFO:teuthology.orchestra.run.trial060.stdout: Cleanup : libfdisk-2.40.2-13.el10.x86_64 189/197 2026-02-13T02:16:11.539 INFO:teuthology.orchestra.run.trial060.stdout: Cleanup : librbd1-2:18.2.1-4.el10.x86_64 190/197 2026-02-13T02:16:11.540 INFO:teuthology.orchestra.run.trial060.stdout: Cleanup : libmount-2.40.2-13.el10.x86_64 191/197 2026-02-13T02:16:11.542 INFO:teuthology.orchestra.run.trial060.stdout: Cleanup : librados2-2:18.2.1-4.el10.x86_64 192/197 2026-02-13T02:16:11.543 INFO:teuthology.orchestra.run.trial060.stdout: Cleanup : libblkid-2.40.2-13.el10.x86_64 193/197 2026-02-13T02:16:11.544 INFO:teuthology.orchestra.run.trial060.stdout: Cleanup : openssl-fips-provider-1:3.5.1-5.el10_1.x86_64 194/197 2026-02-13T02:16:11.545 INFO:teuthology.orchestra.run.trial060.stdout: Cleanup : openssl-libs-1:3.5.1-5.el10_1.x86_64 195/197 2026-02-13T02:16:11.546 INFO:teuthology.orchestra.run.trial060.stdout: Cleanup : libuuid-2.40.2-13.el10.x86_64 196/197 2026-02-13T02:16:11.547 INFO:teuthology.orchestra.run.trial060.stdout: Cleanup : libsmartcols-2.40.2-13.el10.x86_64 197/197 2026-02-13T02:16:11.554 INFO:teuthology.orchestra.run.trial060.stdout: Running scriptlet: ceph-osd-classic-2:20.3.0-5241.g8f8d3829.el10.x8 197/197 2026-02-13T02:16:11.580 INFO:teuthology.orchestra.run.trial060.stdout: Running scriptlet: ceph-osd-crimson-2:20.3.0-5241.g8f8d3829.el10.x8 197/197 2026-02-13T02:16:11.796 INFO:teuthology.orchestra.run.trial011.stdout: Installing : ceph-osd-classic-2:20.3.0-5241.g8f8d3829.el10.x8 148/197 2026-02-13T02:16:11.827 INFO:teuthology.orchestra.run.trial011.stdout: Installing : ceph-osd-crimson-2:20.3.0-5241.g8f8d3829.el10.x8 149/197 2026-02-13T02:16:11.829 INFO:teuthology.orchestra.run.trial011.stdout: Installing : ceph-volume-2:20.3.0-5241.g8f8d3829.el10.noarch 150/197 2026-02-13T02:16:11.844 INFO:teuthology.orchestra.run.trial011.stdout: Running scriptlet: ceph-volume-2:20.3.0-5241.g8f8d3829.el10.noarch 150/197 2026-02-13T02:16:11.844 INFO:teuthology.orchestra.run.trial011.stdout:Glob pattern passed to preset, but globs are not supported for this. 2026-02-13T02:16:11.844 INFO:teuthology.orchestra.run.trial011.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-13T02:16:11.845 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:16:11.850 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.3.0-5241.g8f8d3829.el10. 158/197 2026-02-13T02:16:11.850 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-mgr-diskprediction-local-2:20.3.0-5241.g8f8 159/197 2026-02-13T02:16:11.852 INFO:teuthology.orchestra.run.trial011.stdout: Installing : ceph-osd-2:20.3.0-5241.g8f8d3829.el10.x86_64 151/197 2026-02-13T02:16:11.861 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.3.0-5241.g8f8 159/197 2026-02-13T02:16:11.861 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-mgr-k8sevents-2:20.3.0-5241.g8f8d3829.el10. 160/197 2026-02-13T02:16:11.876 INFO:teuthology.orchestra.run.trial011.stdout: Running scriptlet: ceph-osd-2:20.3.0-5241.g8f8d3829.el10.x86_64 151/197 2026-02-13T02:16:11.876 INFO:teuthology.orchestra.run.trial011.stdout:Glob pattern passed to preset, but globs are not supported for this. 2026-02-13T02:16:11.876 INFO:teuthology.orchestra.run.trial011.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-13T02:16:11.877 INFO:teuthology.orchestra.run.trial011.stdout:Created symlink '/etc/systemd/system/multi-user.target.wants/ceph-osd.target' → '/usr/lib/systemd/system/ceph-osd.target'. 2026-02-13T02:16:11.877 INFO:teuthology.orchestra.run.trial011.stdout:Created symlink '/etc/systemd/system/ceph.target.wants/ceph-osd.target' → '/usr/lib/systemd/system/ceph-osd.target'. 2026-02-13T02:16:11.877 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:16:11.894 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-mgr-k8sevents-2:20.3.0-5241.g8f8d3829.el10. 160/197 2026-02-13T02:16:11.926 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-mgr-modules-core-2:20.3.0-5241.g8f8d3829.el 161/197 2026-02-13T02:16:11.927 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-mgr-2:20.3.0-5241.g8f8d3829.el10.x86_64 162/197 2026-02-13T02:16:11.949 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-mgr-2:20.3.0-5241.g8f8d3829.el10.x86_64 162/197 2026-02-13T02:16:11.950 INFO:teuthology.orchestra.run.trial078.stdout:Glob pattern passed to preset, but globs are not supported for this. 2026-02-13T02:16:11.950 INFO:teuthology.orchestra.run.trial078.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-13T02:16:11.950 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink '/etc/systemd/system/multi-user.target.wants/ceph-mgr.target' → '/usr/lib/systemd/system/ceph-mgr.target'. 2026-02-13T02:16:11.950 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink '/etc/systemd/system/ceph.target.wants/ceph-mgr.target' → '/usr/lib/systemd/system/ceph-mgr.target'. 2026-02-13T02:16:11.950 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:16:11.950 INFO:teuthology.orchestra.run.trial011.stdout: Installing : ceph-mds-2:20.3.0-5241.g8f8d3829.el10.x86_64 152/197 2026-02-13T02:16:11.957 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-mgr-rook-2:20.3.0-5241.g8f8d3829.el10.noarc 163/197 2026-02-13T02:16:11.967 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-mgr-rook-2:20.3.0-5241.g8f8d3829.el10.noarc 163/197 2026-02-13T02:16:11.972 INFO:teuthology.orchestra.run.trial011.stdout: Running scriptlet: ceph-mds-2:20.3.0-5241.g8f8d3829.el10.x86_64 152/197 2026-02-13T02:16:11.973 INFO:teuthology.orchestra.run.trial011.stdout:Glob pattern passed to preset, but globs are not supported for this. 2026-02-13T02:16:11.973 INFO:teuthology.orchestra.run.trial011.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-13T02:16:11.973 INFO:teuthology.orchestra.run.trial011.stdout:Created symlink '/etc/systemd/system/multi-user.target.wants/ceph-mds.target' → '/usr/lib/systemd/system/ceph-mds.target'. 2026-02-13T02:16:11.973 INFO:teuthology.orchestra.run.trial011.stdout:Created symlink '/etc/systemd/system/ceph.target.wants/ceph-mds.target' → '/usr/lib/systemd/system/ceph-mds.target'. 2026-02-13T02:16:11.973 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:16:12.160 INFO:teuthology.orchestra.run.trial011.stdout: Installing : ceph-mon-2:20.3.0-5241.g8f8d3829.el10.x86_64 153/197 2026-02-13T02:16:12.183 INFO:teuthology.orchestra.run.trial011.stdout: Running scriptlet: ceph-mon-2:20.3.0-5241.g8f8d3829.el10.x86_64 153/197 2026-02-13T02:16:12.183 INFO:teuthology.orchestra.run.trial011.stdout:Glob pattern passed to preset, but globs are not supported for this. 2026-02-13T02:16:12.184 INFO:teuthology.orchestra.run.trial011.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-13T02:16:12.184 INFO:teuthology.orchestra.run.trial011.stdout:Created symlink '/etc/systemd/system/multi-user.target.wants/ceph-mon.target' → '/usr/lib/systemd/system/ceph-mon.target'. 2026-02-13T02:16:12.184 INFO:teuthology.orchestra.run.trial011.stdout:Created symlink '/etc/systemd/system/ceph.target.wants/ceph-mon.target' → '/usr/lib/systemd/system/ceph-mon.target'. 2026-02-13T02:16:12.184 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:16:12.218 INFO:teuthology.orchestra.run.trial011.stdout: Running scriptlet: cephadm-2:20.3.0-5241.g8f8d3829.el10.noarch 154/197 2026-02-13T02:16:12.228 INFO:teuthology.orchestra.run.trial011.stdout: Installing : cephadm-2:20.3.0-5241.g8f8d3829.el10.noarch 154/197 2026-02-13T02:16:12.228 INFO:teuthology.orchestra.run.trial011.stdout: Installing : ceph-prometheus-alerts-2:20.3.0-5241.g8f8d3829.e 155/197 2026-02-13T02:16:12.238 INFO:teuthology.orchestra.run.trial011.stdout: Installing : ceph-grafana-dashboards-2:20.3.0-5241.g8f8d3829. 156/197 2026-02-13T02:16:12.239 INFO:teuthology.orchestra.run.trial011.stdout: Installing : ceph-mgr-cephadm-2:20.3.0-5241.g8f8d3829.el10.no 157/197 2026-02-13T02:16:12.402 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-2:20.3.0-5241.g8f8d3829.el10.x86_64 164/197 2026-02-13T02:16:12.404 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-radosgw-2:20.3.0-5241.g8f8d3829.el10.x86_64 165/197 2026-02-13T02:16:12.425 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-radosgw-2:20.3.0-5241.g8f8d3829.el10.x86_64 165/197 2026-02-13T02:16:12.425 INFO:teuthology.orchestra.run.trial078.stdout:Glob pattern passed to preset, but globs are not supported for this. 2026-02-13T02:16:12.426 INFO:teuthology.orchestra.run.trial078.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-13T02:16:12.426 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink '/etc/systemd/system/multi-user.target.wants/ceph-radosgw.target' → '/usr/lib/systemd/system/ceph-radosgw.target'. 2026-02-13T02:16:12.426 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink '/etc/systemd/system/ceph.target.wants/ceph-radosgw.target' → '/usr/lib/systemd/system/ceph-radosgw.target'. 2026-02-13T02:16:12.426 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:16:12.432 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-immutable-object-cache-2:20.3.0-5241.g8f8d3 166/197 2026-02-13T02:16:12.453 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.3.0-5241.g8f8d3 166/197 2026-02-13T02:16:12.454 INFO:teuthology.orchestra.run.trial078.stdout:Glob pattern passed to preset, but globs are not supported for this. 2026-02-13T02:16:12.454 INFO:teuthology.orchestra.run.trial078.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-13T02:16:12.454 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:16:12.464 INFO:teuthology.orchestra.run.trial078.stdout: Installing : cephfs-mirror-2:20.3.0-5241.g8f8d3829.el10.x86_6 167/197 2026-02-13T02:16:12.485 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: cephfs-mirror-2:20.3.0-5241.g8f8d3829.el10.x86_6 167/197 2026-02-13T02:16:12.485 INFO:teuthology.orchestra.run.trial078.stdout:Glob pattern passed to preset, but globs are not supported for this. 2026-02-13T02:16:12.485 INFO:teuthology.orchestra.run.trial078.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2026-02-13T02:16:12.486 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink '/etc/systemd/system/multi-user.target.wants/cephfs-mirror.target' → '/usr/lib/systemd/system/cephfs-mirror.target'. 2026-02-13T02:16:12.486 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink '/etc/systemd/system/ceph.target.wants/cephfs-mirror.target' → '/usr/lib/systemd/system/cephfs-mirror.target'. 2026-02-13T02:16:12.486 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:16:12.580 INFO:teuthology.orchestra.run.trial078.stdout: Installing : rbd-mirror-2:20.3.0-5241.g8f8d3829.el10.x86_64 168/197 2026-02-13T02:16:12.601 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: rbd-mirror-2:20.3.0-5241.g8f8d3829.el10.x86_64 168/197 2026-02-13T02:16:12.601 INFO:teuthology.orchestra.run.trial078.stdout:Glob pattern passed to preset, but globs are not supported for this. 2026-02-13T02:16:12.601 INFO:teuthology.orchestra.run.trial078.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-13T02:16:12.601 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink '/etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target' → '/usr/lib/systemd/system/ceph-rbd-mirror.target'. 2026-02-13T02:16:12.601 INFO:teuthology.orchestra.run.trial078.stdout:Created symlink '/etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target' → '/usr/lib/systemd/system/ceph-rbd-mirror.target'. 2026-02-13T02:16:12.601 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:16:12.790 INFO:teuthology.orchestra.run.trial060.stdout: Running scriptlet: libsmartcols-2.40.2-13.el10.x86_64 197/197 2026-02-13T02:16:12.790 INFO:teuthology.orchestra.run.trial060.stdout: 2026-02-13T02:16:12.790 INFO:teuthology.orchestra.run.trial060.stdout:Upgraded: 2026-02-13T02:16:12.790 INFO:teuthology.orchestra.run.trial060.stdout: libblkid-2.40.2-15.el10_1.x86_64 2026-02-13T02:16:12.790 INFO:teuthology.orchestra.run.trial060.stdout: libfdisk-2.40.2-15.el10_1.x86_64 2026-02-13T02:16:12.790 INFO:teuthology.orchestra.run.trial060.stdout: libmount-2.40.2-15.el10_1.x86_64 2026-02-13T02:16:12.790 INFO:teuthology.orchestra.run.trial060.stdout: librados2-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:12.790 INFO:teuthology.orchestra.run.trial060.stdout: librbd1-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:12.790 INFO:teuthology.orchestra.run.trial060.stdout: libsmartcols-2.40.2-15.el10_1.x86_64 2026-02-13T02:16:12.790 INFO:teuthology.orchestra.run.trial060.stdout: libuuid-2.40.2-15.el10_1.x86_64 2026-02-13T02:16:12.790 INFO:teuthology.orchestra.run.trial060.stdout: openssl-1:3.5.1-7.el10_1.x86_64 2026-02-13T02:16:12.790 INFO:teuthology.orchestra.run.trial060.stdout: openssl-fips-provider-1:3.5.1-7.el10_1.x86_64 2026-02-13T02:16:12.790 INFO:teuthology.orchestra.run.trial060.stdout: openssl-libs-1:3.5.1-7.el10_1.x86_64 2026-02-13T02:16:12.790 INFO:teuthology.orchestra.run.trial060.stdout: util-linux-2.40.2-15.el10_1.x86_64 2026-02-13T02:16:12.790 INFO:teuthology.orchestra.run.trial060.stdout: util-linux-core-2.40.2-15.el10_1.x86_64 2026-02-13T02:16:12.790 INFO:teuthology.orchestra.run.trial060.stdout:Installed: 2026-02-13T02:16:12.790 INFO:teuthology.orchestra.run.trial060.stdout: abseil-cpp-20240722.1-1.el10_0.x86_64 2026-02-13T02:16:12.790 INFO:teuthology.orchestra.run.trial060.stdout: automake-1.16.5-20.el10.noarch 2026-02-13T02:16:12.790 INFO:teuthology.orchestra.run.trial060.stdout: bison-3.8.2-9.el10.x86_64 2026-02-13T02:16:12.790 INFO:teuthology.orchestra.run.trial060.stdout: boost-program-options-1.83.0-5.el10.x86_64 2026-02-13T02:16:12.790 INFO:teuthology.orchestra.run.trial060.stdout: ceph-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:12.790 INFO:teuthology.orchestra.run.trial060.stdout: ceph-base-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:12.790 INFO:teuthology.orchestra.run.trial060.stdout: ceph-common-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:12.790 INFO:teuthology.orchestra.run.trial060.stdout: ceph-fuse-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:12.790 INFO:teuthology.orchestra.run.trial060.stdout: ceph-grafana-dashboards-2:20.3.0-5241.g8f8d3829.el10.noarch 2026-02-13T02:16:12.790 INFO:teuthology.orchestra.run.trial060.stdout: ceph-immutable-object-cache-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:12.790 INFO:teuthology.orchestra.run.trial060.stdout: ceph-mds-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:12.790 INFO:teuthology.orchestra.run.trial060.stdout: ceph-mgr-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:12.790 INFO:teuthology.orchestra.run.trial060.stdout: ceph-mgr-cephadm-2:20.3.0-5241.g8f8d3829.el10.noarch 2026-02-13T02:16:12.790 INFO:teuthology.orchestra.run.trial060.stdout: ceph-mgr-dashboard-2:20.3.0-5241.g8f8d3829.el10.noarch 2026-02-13T02:16:12.790 INFO:teuthology.orchestra.run.trial060.stdout: ceph-mgr-diskprediction-local-2:20.3.0-5241.g8f8d3829.el10.noarch 2026-02-13T02:16:12.790 INFO:teuthology.orchestra.run.trial060.stdout: ceph-mgr-k8sevents-2:20.3.0-5241.g8f8d3829.el10.noarch 2026-02-13T02:16:12.790 INFO:teuthology.orchestra.run.trial060.stdout: ceph-mgr-modules-core-2:20.3.0-5241.g8f8d3829.el10.noarch 2026-02-13T02:16:12.790 INFO:teuthology.orchestra.run.trial060.stdout: ceph-mgr-rook-2:20.3.0-5241.g8f8d3829.el10.noarch 2026-02-13T02:16:12.790 INFO:teuthology.orchestra.run.trial060.stdout: ceph-mon-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:12.790 INFO:teuthology.orchestra.run.trial060.stdout: ceph-osd-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:12.790 INFO:teuthology.orchestra.run.trial060.stdout: ceph-osd-classic-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:12.790 INFO:teuthology.orchestra.run.trial060.stdout: ceph-osd-crimson-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:12.791 INFO:teuthology.orchestra.run.trial060.stdout: ceph-prometheus-alerts-2:20.3.0-5241.g8f8d3829.el10.noarch 2026-02-13T02:16:12.791 INFO:teuthology.orchestra.run.trial060.stdout: ceph-radosgw-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:12.791 INFO:teuthology.orchestra.run.trial060.stdout: ceph-selinux-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:12.791 INFO:teuthology.orchestra.run.trial060.stdout: ceph-test-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:12.791 INFO:teuthology.orchestra.run.trial060.stdout: ceph-volume-2:20.3.0-5241.g8f8d3829.el10.noarch 2026-02-13T02:16:12.791 INFO:teuthology.orchestra.run.trial060.stdout: cephadm-2:20.3.0-5241.g8f8d3829.el10.noarch 2026-02-13T02:16:12.791 INFO:teuthology.orchestra.run.trial060.stdout: cephfs-mirror-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:12.791 INFO:teuthology.orchestra.run.trial060.stdout: cephfs-shell-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:12.791 INFO:teuthology.orchestra.run.trial060.stdout: cephfs-top-2:20.3.0-5241.g8f8d3829.el10.noarch 2026-02-13T02:16:12.791 INFO:teuthology.orchestra.run.trial060.stdout: cmake-filesystem-3.30.5-3.el10_0.x86_64 2026-02-13T02:16:12.791 INFO:teuthology.orchestra.run.trial060.stdout: cryptsetup-2.7.5-2.el10.x86_64 2026-02-13T02:16:12.791 INFO:teuthology.orchestra.run.trial060.stdout: daxctl-libs-80-4.el10.x86_64 2026-02-13T02:16:12.791 INFO:teuthology.orchestra.run.trial060.stdout: elfutils-libelf-devel-0.193-1.el10.rocky.0.1.x86_64 2026-02-13T02:16:12.791 INFO:teuthology.orchestra.run.trial060.stdout: flex-2.6.4-19.el10.x86_64 2026-02-13T02:16:12.791 INFO:teuthology.orchestra.run.trial060.stdout: flexiblas-3.4.2-3.el10.x86_64 2026-02-13T02:16:12.791 INFO:teuthology.orchestra.run.trial060.stdout: flexiblas-netlib-3.4.2-3.el10.x86_64 2026-02-13T02:16:12.791 INFO:teuthology.orchestra.run.trial060.stdout: flexiblas-openblas-openmp-3.4.2-3.el10.x86_64 2026-02-13T02:16:12.791 INFO:teuthology.orchestra.run.trial060.stdout: fuse3-3.16.2-5.el10.x86_64 2026-02-13T02:16:12.791 INFO:teuthology.orchestra.run.trial060.stdout: gperftools-libs-2.15-4.el10_0.x86_64 2026-02-13T02:16:12.791 INFO:teuthology.orchestra.run.trial060.stdout: grpc-data-1.48.4-44.el10_0.noarch 2026-02-13T02:16:12.791 INFO:teuthology.orchestra.run.trial060.stdout: hwloc-libs-2.11.1-3.el10.x86_64 2026-02-13T02:16:12.791 INFO:teuthology.orchestra.run.trial060.stdout: ledmon-libs-1.1.0-2.el10.x86_64 2026-02-13T02:16:12.791 INFO:teuthology.orchestra.run.trial060.stdout: libaio-devel-0.3.111-22.el10.x86_64 2026-02-13T02:16:12.791 INFO:teuthology.orchestra.run.trial060.stdout: libarrow-17.0.0-9.el10_2.x86_64 2026-02-13T02:16:12.791 INFO:teuthology.orchestra.run.trial060.stdout: libarrow-doc-17.0.0-9.el10_2.noarch 2026-02-13T02:16:12.791 INFO:teuthology.orchestra.run.trial060.stdout: libcephfs-daemon-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:12.791 INFO:teuthology.orchestra.run.trial060.stdout: libcephfs-devel-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:12.791 INFO:teuthology.orchestra.run.trial060.stdout: libcephfs-proxy2-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:12.791 INFO:teuthology.orchestra.run.trial060.stdout: libcephfs2-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:12.791 INFO:teuthology.orchestra.run.trial060.stdout: libcephsqlite-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:12.791 INFO:teuthology.orchestra.run.trial060.stdout: libconfig-1.7.3-10.el10.x86_64 2026-02-13T02:16:12.791 INFO:teuthology.orchestra.run.trial060.stdout: libgfortran-14.3.1-2.1.el10.x86_64 2026-02-13T02:16:12.791 INFO:teuthology.orchestra.run.trial060.stdout: libnbd-1.22.2-3.el10_1.x86_64 2026-02-13T02:16:12.791 INFO:teuthology.orchestra.run.trial060.stdout: liboath-2.6.12-1.el10_0.x86_64 2026-02-13T02:16:12.791 INFO:teuthology.orchestra.run.trial060.stdout: liborc2-2.0.7-1.el10_2.x86_64 2026-02-13T02:16:12.791 INFO:teuthology.orchestra.run.trial060.stdout: libpciaccess-0.16-16.el10.x86_64 2026-02-13T02:16:12.791 INFO:teuthology.orchestra.run.trial060.stdout: libpmem-2.1.0-2.el10_0.x86_64 2026-02-13T02:16:12.791 INFO:teuthology.orchestra.run.trial060.stdout: libpmemobj-2.1.0-2.el10_0.x86_64 2026-02-13T02:16:12.791 INFO:teuthology.orchestra.run.trial060.stdout: libquadmath-14.3.1-2.1.el10.x86_64 2026-02-13T02:16:12.791 INFO:teuthology.orchestra.run.trial060.stdout: librabbitmq-0.14.0-3.el10.x86_64 2026-02-13T02:16:12.791 INFO:teuthology.orchestra.run.trial060.stdout: librados-devel-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:12.791 INFO:teuthology.orchestra.run.trial060.stdout: libradosstriper1-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:12.791 INFO:teuthology.orchestra.run.trial060.stdout: librdkafka-2.1.1-7.el10.x86_64 2026-02-13T02:16:12.791 INFO:teuthology.orchestra.run.trial060.stdout: librgw2-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:12.791 INFO:teuthology.orchestra.run.trial060.stdout: libstoragemgmt-1.10.1-4.el10.x86_64 2026-02-13T02:16:12.791 INFO:teuthology.orchestra.run.trial060.stdout: libtool-2.4.7-13.el10.x86_64 2026-02-13T02:16:12.792 INFO:teuthology.orchestra.run.trial060.stdout: libtool-ltdl-2.4.7-13.el10.x86_64 2026-02-13T02:16:12.792 INFO:teuthology.orchestra.run.trial060.stdout: libunwind-1.8.0-4.el10_0.x86_64 2026-02-13T02:16:12.792 INFO:teuthology.orchestra.run.trial060.stdout: libuuid-devel-2.40.2-15.el10_1.x86_64 2026-02-13T02:16:12.792 INFO:teuthology.orchestra.run.trial060.stdout: libxslt-1.1.39-8.el10_0.x86_64 2026-02-13T02:16:12.792 INFO:teuthology.orchestra.run.trial060.stdout: libzstd-devel-1.5.5-9.el10.x86_64 2026-02-13T02:16:12.792 INFO:teuthology.orchestra.run.trial060.stdout: lttng-ust-2.13.7-5.el10.x86_64 2026-02-13T02:16:12.792 INFO:teuthology.orchestra.run.trial060.stdout: lua-5.4.6-7.el10.x86_64 2026-02-13T02:16:12.792 INFO:teuthology.orchestra.run.trial060.stdout: lua-devel-5.4.6-7.el10.x86_64 2026-02-13T02:16:12.792 INFO:teuthology.orchestra.run.trial060.stdout: luarocks-3.9.2-6.el10_0.noarch 2026-02-13T02:16:12.792 INFO:teuthology.orchestra.run.trial060.stdout: mailcap-2.1.54-8.el10.noarch 2026-02-13T02:16:12.792 INFO:teuthology.orchestra.run.trial060.stdout: ndctl-libs-80-4.el10.x86_64 2026-02-13T02:16:12.792 INFO:teuthology.orchestra.run.trial060.stdout: ocl-icd-2.3.2-8.el10.x86_64 2026-02-13T02:16:12.792 INFO:teuthology.orchestra.run.trial060.stdout: openblas-0.3.29-2.el10.x86_64 2026-02-13T02:16:12.792 INFO:teuthology.orchestra.run.trial060.stdout: openblas-openmp-0.3.29-2.el10.x86_64 2026-02-13T02:16:12.792 INFO:teuthology.orchestra.run.trial060.stdout: openssl-devel-1:3.5.1-7.el10_1.x86_64 2026-02-13T02:16:12.792 INFO:teuthology.orchestra.run.trial060.stdout: parquet-libs-17.0.0-9.el10_2.x86_64 2026-02-13T02:16:12.792 INFO:teuthology.orchestra.run.trial060.stdout: pciutils-3.13.0-6.el10.x86_64 2026-02-13T02:16:12.792 INFO:teuthology.orchestra.run.trial060.stdout: perl-Thread-Queue-3.14-511.el10.noarch 2026-02-13T02:16:12.792 INFO:teuthology.orchestra.run.trial060.stdout: perl-threads-1:2.40-511.el10.x86_64 2026-02-13T02:16:12.792 INFO:teuthology.orchestra.run.trial060.stdout: perl-threads-shared-1.69-511.el10.x86_64 2026-02-13T02:16:12.792 INFO:teuthology.orchestra.run.trial060.stdout: postgresql-16.11-1.el10_1.x86_64 2026-02-13T02:16:12.792 INFO:teuthology.orchestra.run.trial060.stdout: postgresql-contrib-16.11-1.el10_1.x86_64 2026-02-13T02:16:12.792 INFO:teuthology.orchestra.run.trial060.stdout: postgresql-private-libs-16.11-1.el10_1.x86_64 2026-02-13T02:16:12.792 INFO:teuthology.orchestra.run.trial060.stdout: postgresql-server-16.11-1.el10_1.x86_64 2026-02-13T02:16:12.792 INFO:teuthology.orchestra.run.trial060.stdout: protobuf-3.19.6-11.el10.x86_64 2026-02-13T02:16:12.792 INFO:teuthology.orchestra.run.trial060.stdout: protobuf-compiler-3.19.6-11.el10.x86_64 2026-02-13T02:16:12.792 INFO:teuthology.orchestra.run.trial060.stdout: python3-asyncssh-2.17.0-1.el10_0.noarch 2026-02-13T02:16:12.792 INFO:teuthology.orchestra.run.trial060.stdout: python3-autocommand-2.2.2-9.el10_0.noarch 2026-02-13T02:16:12.792 INFO:teuthology.orchestra.run.trial060.stdout: python3-bcrypt-4.3.0-3.el10_1.x86_64 2026-02-13T02:16:12.792 INFO:teuthology.orchestra.run.trial060.stdout: python3-cachetools-5.4.0-6.el10_0.noarch 2026-02-13T02:16:12.792 INFO:teuthology.orchestra.run.trial060.stdout: python3-ceph-argparse-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:12.792 INFO:teuthology.orchestra.run.trial060.stdout: python3-ceph-common-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:12.792 INFO:teuthology.orchestra.run.trial060.stdout: python3-cephfs-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:12.792 INFO:teuthology.orchestra.run.trial060.stdout: python3-certifi-2023.05.07-6.el10_0.noarch 2026-02-13T02:16:12.792 INFO:teuthology.orchestra.run.trial060.stdout: python3-cffi-1.16.0-7.el10.x86_64 2026-02-13T02:16:12.792 INFO:teuthology.orchestra.run.trial060.stdout: python3-cheroot-10.0.1-4.el10_0.noarch 2026-02-13T02:16:12.792 INFO:teuthology.orchestra.run.trial060.stdout: python3-cherrypy-18.10.0-4.el10_0.noarch 2026-02-13T02:16:12.792 INFO:teuthology.orchestra.run.trial060.stdout: python3-cmd2-2.5.8-1.el10_2.noarch 2026-02-13T02:16:12.792 INFO:teuthology.orchestra.run.trial060.stdout: python3-colorama-0.4.6-13.el10.noarch 2026-02-13T02:16:12.792 INFO:teuthology.orchestra.run.trial060.stdout: python3-cryptography-43.0.0-4.el10.x86_64 2026-02-13T02:16:12.792 INFO:teuthology.orchestra.run.trial060.stdout: python3-devel-3.12.12-2.el10_1.x86_64 2026-02-13T02:16:12.792 INFO:teuthology.orchestra.run.trial060.stdout: python3-durationpy-0.9-2.el10_0.noarch 2026-02-13T02:16:12.792 INFO:teuthology.orchestra.run.trial060.stdout: python3-google-auth-1:2.40.3-1.el10_1.noarch 2026-02-13T02:16:12.792 INFO:teuthology.orchestra.run.trial060.stdout: python3-grpcio-1.48.4-44.el10_0.x86_64 2026-02-13T02:16:12.792 INFO:teuthology.orchestra.run.trial060.stdout: python3-grpcio-tools-1.48.4-44.el10_0.x86_64 2026-02-13T02:16:12.792 INFO:teuthology.orchestra.run.trial060.stdout: python3-isodate-0.6.1-14.el10_0.noarch 2026-02-13T02:16:12.793 INFO:teuthology.orchestra.run.trial060.stdout: python3-jaraco-collections-5.1.0-1.el10_0.noarch 2026-02-13T02:16:12.793 INFO:teuthology.orchestra.run.trial060.stdout: python3-jaraco-context-6.0.1-4.el10_0.noarch 2026-02-13T02:16:12.793 INFO:teuthology.orchestra.run.trial060.stdout: python3-jaraco-functools-4.0.2-4.el10_0.noarch 2026-02-13T02:16:12.793 INFO:teuthology.orchestra.run.trial060.stdout: python3-jaraco-text-4.0.0-3.el10_0.noarch 2026-02-13T02:16:12.793 INFO:teuthology.orchestra.run.trial060.stdout: python3-jinja2-3.1.6-1.el10_0.noarch 2026-02-13T02:16:12.793 INFO:teuthology.orchestra.run.trial060.stdout: python3-jmespath-1.0.1-8.el10.noarch 2026-02-13T02:16:12.793 INFO:teuthology.orchestra.run.trial060.stdout: python3-kubernetes-1:32.0.1-1.el10_1.noarch 2026-02-13T02:16:12.793 INFO:teuthology.orchestra.run.trial060.stdout: python3-libstoragemgmt-1.10.1-4.el10.x86_64 2026-02-13T02:16:12.793 INFO:teuthology.orchestra.run.trial060.stdout: python3-lxml-5.2.1-4.el10.x86_64 2026-02-13T02:16:12.793 INFO:teuthology.orchestra.run.trial060.stdout: python3-markupsafe-2.1.3-6.el10.x86_64 2026-02-13T02:16:12.793 INFO:teuthology.orchestra.run.trial060.stdout: python3-more-itertools-10.1.0-8.el10_0.noarch 2026-02-13T02:16:12.793 INFO:teuthology.orchestra.run.trial060.stdout: python3-natsort-8.4.0-2.el10_0.noarch 2026-02-13T02:16:12.793 INFO:teuthology.orchestra.run.trial060.stdout: python3-numpy-1:1.26.4-5.el10.x86_64 2026-02-13T02:16:12.793 INFO:teuthology.orchestra.run.trial060.stdout: python3-numpy-f2py-1:1.26.4-5.el10.x86_64 2026-02-13T02:16:12.793 INFO:teuthology.orchestra.run.trial060.stdout: python3-packaging-24.2-2.el10.noarch 2026-02-13T02:16:12.793 INFO:teuthology.orchestra.run.trial060.stdout: python3-ply-3.11-25.el10.noarch 2026-02-13T02:16:12.793 INFO:teuthology.orchestra.run.trial060.stdout: python3-portend-3.2.0-6.el10_0.noarch 2026-02-13T02:16:12.793 INFO:teuthology.orchestra.run.trial060.stdout: python3-prettytable-3.6.0-10.el10.noarch 2026-02-13T02:16:12.793 INFO:teuthology.orchestra.run.trial060.stdout: python3-protobuf-3.19.6-11.el10.x86_64 2026-02-13T02:16:12.793 INFO:teuthology.orchestra.run.trial060.stdout: python3-pyOpenSSL-25.0.0-1.el10_1.noarch 2026-02-13T02:16:12.793 INFO:teuthology.orchestra.run.trial060.stdout: python3-pyasn1-0.6.1-1.el10.noarch 2026-02-13T02:16:12.793 INFO:teuthology.orchestra.run.trial060.stdout: python3-pyasn1-modules-0.6.1-1.el10.noarch 2026-02-13T02:16:12.793 INFO:teuthology.orchestra.run.trial060.stdout: python3-pycparser-2.20-16.el10.noarch 2026-02-13T02:16:12.793 INFO:teuthology.orchestra.run.trial060.stdout: python3-pyperclip-1.8.2-1.el10_0.noarch 2026-02-13T02:16:12.793 INFO:teuthology.orchestra.run.trial060.stdout: python3-rados-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:12.793 INFO:teuthology.orchestra.run.trial060.stdout: python3-rbd-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:12.793 INFO:teuthology.orchestra.run.trial060.stdout: python3-repoze-lru-0.7-23.el10_0.noarch 2026-02-13T02:16:12.793 INFO:teuthology.orchestra.run.trial060.stdout: python3-requests-2.32.4-1.el10_0.noarch 2026-02-13T02:16:12.793 INFO:teuthology.orchestra.run.trial060.stdout: python3-requests-oauthlib-1.3.1-11.el10.noarch 2026-02-13T02:16:12.793 INFO:teuthology.orchestra.run.trial060.stdout: python3-rgw-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:12.793 INFO:teuthology.orchestra.run.trial060.stdout: python3-routes-2.5.1-11.el10_0.noarch 2026-02-13T02:16:12.793 INFO:teuthology.orchestra.run.trial060.stdout: python3-rsa-4.9-7.el10_0.noarch 2026-02-13T02:16:12.793 INFO:teuthology.orchestra.run.trial060.stdout: python3-saml-1.16.0-11.el10.noarch 2026-02-13T02:16:12.793 INFO:teuthology.orchestra.run.trial060.stdout: python3-scipy-1.11.3-17.el10.x86_64 2026-02-13T02:16:12.793 INFO:teuthology.orchestra.run.trial060.stdout: python3-tempora-5.7.0-1.el10_0.noarch 2026-02-13T02:16:12.793 INFO:teuthology.orchestra.run.trial060.stdout: python3-urllib3-1.26.19-2.el10_1.1.noarch 2026-02-13T02:16:12.793 INFO:teuthology.orchestra.run.trial060.stdout: python3-websocket-client-1.8.0-2.el10_0.noarch 2026-02-13T02:16:12.793 INFO:teuthology.orchestra.run.trial060.stdout: python3-xmlsec-1.3.16-1.el10.x86_64 2026-02-13T02:16:12.793 INFO:teuthology.orchestra.run.trial060.stdout: python3-xmltodict-0.13.0-5.el10_0.noarch 2026-02-13T02:16:12.793 INFO:teuthology.orchestra.run.trial060.stdout: python3-zc-lockfile-3.0.post1-11.el10_0.noarch 2026-02-13T02:16:12.793 INFO:teuthology.orchestra.run.trial060.stdout: qatlib-24.09.0-2.el10.x86_64 2026-02-13T02:16:12.793 INFO:teuthology.orchestra.run.trial060.stdout: qatlib-service-24.09.0-2.el10.x86_64 2026-02-13T02:16:12.793 INFO:teuthology.orchestra.run.trial060.stdout: qatzip-libs-1.3.1-1.el10.x86_64 2026-02-13T02:16:12.793 INFO:teuthology.orchestra.run.trial060.stdout: rbd-fuse-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:12.793 INFO:teuthology.orchestra.run.trial060.stdout: rbd-mirror-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:12.793 INFO:teuthology.orchestra.run.trial060.stdout: rbd-nbd-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:12.793 INFO:teuthology.orchestra.run.trial060.stdout: re2-2:20251105-1.el10_2.x86_64 2026-02-13T02:16:12.793 INFO:teuthology.orchestra.run.trial060.stdout: socat-1.7.4.4-8.el10.x86_64 2026-02-13T02:16:12.794 INFO:teuthology.orchestra.run.trial060.stdout: thrift-0.20.0-4.el10_1.x86_64 2026-02-13T02:16:12.794 INFO:teuthology.orchestra.run.trial060.stdout: unzip-6.0-69.el10.x86_64 2026-02-13T02:16:12.794 INFO:teuthology.orchestra.run.trial060.stdout: utf8proc-2.7.0-9.el10.x86_64 2026-02-13T02:16:12.794 INFO:teuthology.orchestra.run.trial060.stdout: uuid-1.6.2-65.el10.x86_64 2026-02-13T02:16:12.794 INFO:teuthology.orchestra.run.trial060.stdout: xfsprogs-devel-6.11.0-2.el10.x86_64 2026-02-13T02:16:12.794 INFO:teuthology.orchestra.run.trial060.stdout: xmlsec1-1:1.2.39-3.el10.x86_64 2026-02-13T02:16:12.794 INFO:teuthology.orchestra.run.trial060.stdout: xmlsec1-openssl-1:1.2.39-3.el10.x86_64 2026-02-13T02:16:12.794 INFO:teuthology.orchestra.run.trial060.stdout: xmlstarlet-1.6.1-27.el10.x86_64 2026-02-13T02:16:12.794 INFO:teuthology.orchestra.run.trial060.stdout: yaml-cpp0.7-0.7.0-1.el10_2.x86_64 2026-02-13T02:16:12.794 INFO:teuthology.orchestra.run.trial060.stdout: zip-3.0-45.el10.x86_64 2026-02-13T02:16:12.794 INFO:teuthology.orchestra.run.trial060.stdout: zlib-ng-compat-devel-2.2.3-2.el10.x86_64 2026-02-13T02:16:12.794 INFO:teuthology.orchestra.run.trial060.stdout: 2026-02-13T02:16:12.794 INFO:teuthology.orchestra.run.trial060.stdout:Complete! 2026-02-13T02:16:12.873 DEBUG:teuthology.parallel:result is None 2026-02-13T02:16:13.143 INFO:teuthology.orchestra.run.trial011.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.3.0-5241.g8f8d3829.el10.no 157/197 2026-02-13T02:16:13.148 INFO:teuthology.orchestra.run.trial011.stdout: Installing : ceph-mgr-dashboard-2:20.3.0-5241.g8f8d3829.el10. 158/197 2026-02-13T02:16:13.501 INFO:teuthology.orchestra.run.trial011.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.3.0-5241.g8f8d3829.el10. 158/197 2026-02-13T02:16:13.502 INFO:teuthology.orchestra.run.trial011.stdout: Installing : ceph-mgr-diskprediction-local-2:20.3.0-5241.g8f8 159/197 2026-02-13T02:16:13.515 INFO:teuthology.orchestra.run.trial011.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.3.0-5241.g8f8 159/197 2026-02-13T02:16:13.515 INFO:teuthology.orchestra.run.trial011.stdout: Installing : ceph-mgr-k8sevents-2:20.3.0-5241.g8f8d3829.el10. 160/197 2026-02-13T02:16:13.549 INFO:teuthology.orchestra.run.trial011.stdout: Running scriptlet: ceph-mgr-k8sevents-2:20.3.0-5241.g8f8d3829.el10. 160/197 2026-02-13T02:16:13.583 INFO:teuthology.orchestra.run.trial011.stdout: Installing : ceph-mgr-modules-core-2:20.3.0-5241.g8f8d3829.el 161/197 2026-02-13T02:16:13.584 INFO:teuthology.orchestra.run.trial011.stdout: Installing : ceph-mgr-2:20.3.0-5241.g8f8d3829.el10.x86_64 162/197 2026-02-13T02:16:13.607 INFO:teuthology.orchestra.run.trial011.stdout: Running scriptlet: ceph-mgr-2:20.3.0-5241.g8f8d3829.el10.x86_64 162/197 2026-02-13T02:16:13.607 INFO:teuthology.orchestra.run.trial011.stdout:Glob pattern passed to preset, but globs are not supported for this. 2026-02-13T02:16:13.607 INFO:teuthology.orchestra.run.trial011.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-13T02:16:13.608 INFO:teuthology.orchestra.run.trial011.stdout:Created symlink '/etc/systemd/system/multi-user.target.wants/ceph-mgr.target' → '/usr/lib/systemd/system/ceph-mgr.target'. 2026-02-13T02:16:13.608 INFO:teuthology.orchestra.run.trial011.stdout:Created symlink '/etc/systemd/system/ceph.target.wants/ceph-mgr.target' → '/usr/lib/systemd/system/ceph-mgr.target'. 2026-02-13T02:16:13.608 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:16:13.614 INFO:teuthology.orchestra.run.trial011.stdout: Installing : ceph-mgr-rook-2:20.3.0-5241.g8f8d3829.el10.noarc 163/197 2026-02-13T02:16:13.625 INFO:teuthology.orchestra.run.trial011.stdout: Running scriptlet: ceph-mgr-rook-2:20.3.0-5241.g8f8d3829.el10.noarc 163/197 2026-02-13T02:16:14.053 INFO:teuthology.orchestra.run.trial011.stdout: Installing : ceph-2:20.3.0-5241.g8f8d3829.el10.x86_64 164/197 2026-02-13T02:16:14.055 INFO:teuthology.orchestra.run.trial011.stdout: Installing : ceph-radosgw-2:20.3.0-5241.g8f8d3829.el10.x86_64 165/197 2026-02-13T02:16:14.078 INFO:teuthology.orchestra.run.trial011.stdout: Running scriptlet: ceph-radosgw-2:20.3.0-5241.g8f8d3829.el10.x86_64 165/197 2026-02-13T02:16:14.078 INFO:teuthology.orchestra.run.trial011.stdout:Glob pattern passed to preset, but globs are not supported for this. 2026-02-13T02:16:14.078 INFO:teuthology.orchestra.run.trial011.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-13T02:16:14.078 INFO:teuthology.orchestra.run.trial011.stdout:Created symlink '/etc/systemd/system/multi-user.target.wants/ceph-radosgw.target' → '/usr/lib/systemd/system/ceph-radosgw.target'. 2026-02-13T02:16:14.078 INFO:teuthology.orchestra.run.trial011.stdout:Created symlink '/etc/systemd/system/ceph.target.wants/ceph-radosgw.target' → '/usr/lib/systemd/system/ceph-radosgw.target'. 2026-02-13T02:16:14.078 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:16:14.085 INFO:teuthology.orchestra.run.trial011.stdout: Installing : ceph-immutable-object-cache-2:20.3.0-5241.g8f8d3 166/197 2026-02-13T02:16:14.106 INFO:teuthology.orchestra.run.trial011.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.3.0-5241.g8f8d3 166/197 2026-02-13T02:16:14.106 INFO:teuthology.orchestra.run.trial011.stdout:Glob pattern passed to preset, but globs are not supported for this. 2026-02-13T02:16:14.106 INFO:teuthology.orchestra.run.trial011.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-13T02:16:14.106 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:16:14.116 INFO:teuthology.orchestra.run.trial011.stdout: Installing : cephfs-mirror-2:20.3.0-5241.g8f8d3829.el10.x86_6 167/197 2026-02-13T02:16:14.138 INFO:teuthology.orchestra.run.trial011.stdout: Running scriptlet: cephfs-mirror-2:20.3.0-5241.g8f8d3829.el10.x86_6 167/197 2026-02-13T02:16:14.138 INFO:teuthology.orchestra.run.trial011.stdout:Glob pattern passed to preset, but globs are not supported for this. 2026-02-13T02:16:14.138 INFO:teuthology.orchestra.run.trial011.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2026-02-13T02:16:14.138 INFO:teuthology.orchestra.run.trial011.stdout:Created symlink '/etc/systemd/system/multi-user.target.wants/cephfs-mirror.target' → '/usr/lib/systemd/system/cephfs-mirror.target'. 2026-02-13T02:16:14.138 INFO:teuthology.orchestra.run.trial011.stdout:Created symlink '/etc/systemd/system/ceph.target.wants/cephfs-mirror.target' → '/usr/lib/systemd/system/cephfs-mirror.target'. 2026-02-13T02:16:14.138 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:16:14.232 INFO:teuthology.orchestra.run.trial011.stdout: Installing : rbd-mirror-2:20.3.0-5241.g8f8d3829.el10.x86_64 168/197 2026-02-13T02:16:14.253 INFO:teuthology.orchestra.run.trial011.stdout: Running scriptlet: rbd-mirror-2:20.3.0-5241.g8f8d3829.el10.x86_64 168/197 2026-02-13T02:16:14.253 INFO:teuthology.orchestra.run.trial011.stdout:Glob pattern passed to preset, but globs are not supported for this. 2026-02-13T02:16:14.253 INFO:teuthology.orchestra.run.trial011.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-13T02:16:14.253 INFO:teuthology.orchestra.run.trial011.stdout:Created symlink '/etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target' → '/usr/lib/systemd/system/ceph-rbd-mirror.target'. 2026-02-13T02:16:14.253 INFO:teuthology.orchestra.run.trial011.stdout:Created symlink '/etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target' → '/usr/lib/systemd/system/ceph-rbd-mirror.target'. 2026-02-13T02:16:14.253 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:16:15.216 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-test-2:20.3.0-5241.g8f8d3829.el10.x86_64 169/197 2026-02-13T02:16:15.218 INFO:teuthology.orchestra.run.trial078.stdout: Installing : elfutils-libelf-devel-0.193-1.el10.rocky.0.1.x86 170/197 2026-02-13T02:16:15.250 INFO:teuthology.orchestra.run.trial078.stdout: Installing : cephfs-shell-2:20.3.0-5241.g8f8d3829.el10.x86_64 171/197 2026-02-13T02:16:15.284 INFO:teuthology.orchestra.run.trial078.stdout: Installing : postgresql-contrib-16.11-1.el10_1.x86_64 172/197 2026-02-13T02:16:15.287 INFO:teuthology.orchestra.run.trial078.stdout: Installing : ceph-fuse-2:20.3.0-5241.g8f8d3829.el10.x86_64 173/197 2026-02-13T02:16:15.288 INFO:teuthology.orchestra.run.trial078.stdout: Installing : libcephfs-devel-2:20.3.0-5241.g8f8d3829.el10.x86 174/197 2026-02-13T02:16:15.375 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: postgresql-server-16.11-1.el10_1.x86_64 175/197 2026-02-13T02:16:15.378 INFO:teuthology.orchestra.run.trial078.stdout: Installing : postgresql-server-16.11-1.el10_1.x86_64 175/197 2026-02-13T02:16:15.394 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: postgresql-server-16.11-1.el10_1.x86_64 175/197 2026-02-13T02:16:15.397 INFO:teuthology.orchestra.run.trial078.stdout: Installing : cephfs-top-2:20.3.0-5241.g8f8d3829.el10.noarch 176/197 2026-02-13T02:16:15.403 INFO:teuthology.orchestra.run.trial078.stdout: Installing : rbd-fuse-2:20.3.0-5241.g8f8d3829.el10.x86_64 177/197 2026-02-13T02:16:15.636 INFO:teuthology.orchestra.run.trial078.stdout: Installing : rbd-nbd-2:20.3.0-5241.g8f8d3829.el10.x86_64 178/197 2026-02-13T02:16:15.667 INFO:teuthology.orchestra.run.trial078.stdout: Installing : openssl-devel-1:3.5.1-7.el10_1.x86_64 179/197 2026-02-13T02:16:15.672 INFO:teuthology.orchestra.run.trial078.stdout: Upgrading : openssl-1:3.5.1-7.el10_1.x86_64 180/197 2026-02-13T02:16:15.678 INFO:teuthology.orchestra.run.trial078.stdout: Installing : xfsprogs-devel-6.11.0-2.el10.x86_64 181/197 2026-02-13T02:16:15.679 INFO:teuthology.orchestra.run.trial078.stdout: Installing : libtool-2.4.7-13.el10.x86_64 182/197 2026-02-13T02:16:15.685 INFO:teuthology.orchestra.run.trial078.stdout: Installing : libaio-devel-0.3.111-22.el10.x86_64 183/197 2026-02-13T02:16:15.699 INFO:teuthology.orchestra.run.trial078.stdout: Installing : flex-2.6.4-19.el10.x86_64 184/197 2026-02-13T02:16:15.701 INFO:teuthology.orchestra.run.trial078.stdout: Installing : bison-3.8.2-9.el10.x86_64 185/197 2026-02-13T02:16:15.709 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: util-linux-2.40.2-13.el10.x86_64 186/197 2026-02-13T02:16:15.709 INFO:teuthology.orchestra.run.trial078.stdout: Cleanup : util-linux-2.40.2-13.el10.x86_64 186/197 2026-02-13T02:16:15.726 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: util-linux-2.40.2-13.el10.x86_64 186/197 2026-02-13T02:16:15.729 INFO:teuthology.orchestra.run.trial078.stdout: Cleanup : util-linux-core-2.40.2-13.el10.x86_64 187/197 2026-02-13T02:16:15.731 INFO:teuthology.orchestra.run.trial078.stdout: Cleanup : openssl-1:3.5.1-5.el10_1.x86_64 188/197 2026-02-13T02:16:15.733 INFO:teuthology.orchestra.run.trial078.stdout: Cleanup : libfdisk-2.40.2-13.el10.x86_64 189/197 2026-02-13T02:16:15.735 INFO:teuthology.orchestra.run.trial078.stdout: Cleanup : librbd1-2:18.2.1-4.el10.x86_64 190/197 2026-02-13T02:16:15.736 INFO:teuthology.orchestra.run.trial078.stdout: Cleanup : libmount-2.40.2-13.el10.x86_64 191/197 2026-02-13T02:16:15.737 INFO:teuthology.orchestra.run.trial078.stdout: Cleanup : librados2-2:18.2.1-4.el10.x86_64 192/197 2026-02-13T02:16:15.739 INFO:teuthology.orchestra.run.trial078.stdout: Cleanup : libblkid-2.40.2-13.el10.x86_64 193/197 2026-02-13T02:16:15.740 INFO:teuthology.orchestra.run.trial078.stdout: Cleanup : openssl-fips-provider-1:3.5.1-5.el10_1.x86_64 194/197 2026-02-13T02:16:15.742 INFO:teuthology.orchestra.run.trial078.stdout: Cleanup : openssl-libs-1:3.5.1-5.el10_1.x86_64 195/197 2026-02-13T02:16:15.743 INFO:teuthology.orchestra.run.trial078.stdout: Cleanup : libuuid-2.40.2-13.el10.x86_64 196/197 2026-02-13T02:16:15.743 INFO:teuthology.orchestra.run.trial078.stdout: Cleanup : libsmartcols-2.40.2-13.el10.x86_64 197/197 2026-02-13T02:16:15.751 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-osd-classic-2:20.3.0-5241.g8f8d3829.el10.x8 197/197 2026-02-13T02:16:15.777 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: ceph-osd-crimson-2:20.3.0-5241.g8f8d3829.el10.x8 197/197 2026-02-13T02:16:16.851 INFO:teuthology.orchestra.run.trial011.stdout: Installing : ceph-test-2:20.3.0-5241.g8f8d3829.el10.x86_64 169/197 2026-02-13T02:16:16.853 INFO:teuthology.orchestra.run.trial011.stdout: Installing : elfutils-libelf-devel-0.193-1.el10.rocky.0.1.x86 170/197 2026-02-13T02:16:16.884 INFO:teuthology.orchestra.run.trial011.stdout: Installing : cephfs-shell-2:20.3.0-5241.g8f8d3829.el10.x86_64 171/197 2026-02-13T02:16:16.900 INFO:teuthology.orchestra.run.trial078.stdout: Running scriptlet: libsmartcols-2.40.2-13.el10.x86_64 197/197 2026-02-13T02:16:16.900 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:16:16.900 INFO:teuthology.orchestra.run.trial078.stdout:Upgraded: 2026-02-13T02:16:16.901 INFO:teuthology.orchestra.run.trial078.stdout: libblkid-2.40.2-15.el10_1.x86_64 2026-02-13T02:16:16.901 INFO:teuthology.orchestra.run.trial078.stdout: libfdisk-2.40.2-15.el10_1.x86_64 2026-02-13T02:16:16.901 INFO:teuthology.orchestra.run.trial078.stdout: libmount-2.40.2-15.el10_1.x86_64 2026-02-13T02:16:16.901 INFO:teuthology.orchestra.run.trial078.stdout: librados2-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:16.901 INFO:teuthology.orchestra.run.trial078.stdout: librbd1-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:16.901 INFO:teuthology.orchestra.run.trial078.stdout: libsmartcols-2.40.2-15.el10_1.x86_64 2026-02-13T02:16:16.901 INFO:teuthology.orchestra.run.trial078.stdout: libuuid-2.40.2-15.el10_1.x86_64 2026-02-13T02:16:16.901 INFO:teuthology.orchestra.run.trial078.stdout: openssl-1:3.5.1-7.el10_1.x86_64 2026-02-13T02:16:16.901 INFO:teuthology.orchestra.run.trial078.stdout: openssl-fips-provider-1:3.5.1-7.el10_1.x86_64 2026-02-13T02:16:16.901 INFO:teuthology.orchestra.run.trial078.stdout: openssl-libs-1:3.5.1-7.el10_1.x86_64 2026-02-13T02:16:16.902 INFO:teuthology.orchestra.run.trial078.stdout: util-linux-2.40.2-15.el10_1.x86_64 2026-02-13T02:16:16.902 INFO:teuthology.orchestra.run.trial078.stdout: util-linux-core-2.40.2-15.el10_1.x86_64 2026-02-13T02:16:16.902 INFO:teuthology.orchestra.run.trial078.stdout:Installed: 2026-02-13T02:16:16.902 INFO:teuthology.orchestra.run.trial078.stdout: abseil-cpp-20240722.1-1.el10_0.x86_64 2026-02-13T02:16:16.902 INFO:teuthology.orchestra.run.trial078.stdout: automake-1.16.5-20.el10.noarch 2026-02-13T02:16:16.902 INFO:teuthology.orchestra.run.trial078.stdout: bison-3.8.2-9.el10.x86_64 2026-02-13T02:16:16.902 INFO:teuthology.orchestra.run.trial078.stdout: boost-program-options-1.83.0-5.el10.x86_64 2026-02-13T02:16:16.902 INFO:teuthology.orchestra.run.trial078.stdout: ceph-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:16.902 INFO:teuthology.orchestra.run.trial078.stdout: ceph-base-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:16.902 INFO:teuthology.orchestra.run.trial078.stdout: ceph-common-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:16.902 INFO:teuthology.orchestra.run.trial078.stdout: ceph-fuse-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:16.903 INFO:teuthology.orchestra.run.trial078.stdout: ceph-grafana-dashboards-2:20.3.0-5241.g8f8d3829.el10.noarch 2026-02-13T02:16:16.903 INFO:teuthology.orchestra.run.trial078.stdout: ceph-immutable-object-cache-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:16.903 INFO:teuthology.orchestra.run.trial078.stdout: ceph-mds-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:16.903 INFO:teuthology.orchestra.run.trial078.stdout: ceph-mgr-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:16.903 INFO:teuthology.orchestra.run.trial078.stdout: ceph-mgr-cephadm-2:20.3.0-5241.g8f8d3829.el10.noarch 2026-02-13T02:16:16.903 INFO:teuthology.orchestra.run.trial078.stdout: ceph-mgr-dashboard-2:20.3.0-5241.g8f8d3829.el10.noarch 2026-02-13T02:16:16.903 INFO:teuthology.orchestra.run.trial078.stdout: ceph-mgr-diskprediction-local-2:20.3.0-5241.g8f8d3829.el10.noarch 2026-02-13T02:16:16.903 INFO:teuthology.orchestra.run.trial078.stdout: ceph-mgr-k8sevents-2:20.3.0-5241.g8f8d3829.el10.noarch 2026-02-13T02:16:16.903 INFO:teuthology.orchestra.run.trial078.stdout: ceph-mgr-modules-core-2:20.3.0-5241.g8f8d3829.el10.noarch 2026-02-13T02:16:16.903 INFO:teuthology.orchestra.run.trial078.stdout: ceph-mgr-rook-2:20.3.0-5241.g8f8d3829.el10.noarch 2026-02-13T02:16:16.904 INFO:teuthology.orchestra.run.trial078.stdout: ceph-mon-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:16.904 INFO:teuthology.orchestra.run.trial078.stdout: ceph-osd-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:16.904 INFO:teuthology.orchestra.run.trial078.stdout: ceph-osd-classic-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:16.904 INFO:teuthology.orchestra.run.trial078.stdout: ceph-osd-crimson-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:16.904 INFO:teuthology.orchestra.run.trial078.stdout: ceph-prometheus-alerts-2:20.3.0-5241.g8f8d3829.el10.noarch 2026-02-13T02:16:16.904 INFO:teuthology.orchestra.run.trial078.stdout: ceph-radosgw-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:16.904 INFO:teuthology.orchestra.run.trial078.stdout: ceph-selinux-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:16.904 INFO:teuthology.orchestra.run.trial078.stdout: ceph-test-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:16.904 INFO:teuthology.orchestra.run.trial078.stdout: ceph-volume-2:20.3.0-5241.g8f8d3829.el10.noarch 2026-02-13T02:16:16.904 INFO:teuthology.orchestra.run.trial078.stdout: cephadm-2:20.3.0-5241.g8f8d3829.el10.noarch 2026-02-13T02:16:16.904 INFO:teuthology.orchestra.run.trial078.stdout: cephfs-mirror-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:16.905 INFO:teuthology.orchestra.run.trial078.stdout: cephfs-shell-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:16.905 INFO:teuthology.orchestra.run.trial078.stdout: cephfs-top-2:20.3.0-5241.g8f8d3829.el10.noarch 2026-02-13T02:16:16.905 INFO:teuthology.orchestra.run.trial078.stdout: cmake-filesystem-3.30.5-3.el10_0.x86_64 2026-02-13T02:16:16.905 INFO:teuthology.orchestra.run.trial078.stdout: cryptsetup-2.7.5-2.el10.x86_64 2026-02-13T02:16:16.905 INFO:teuthology.orchestra.run.trial078.stdout: daxctl-libs-80-4.el10.x86_64 2026-02-13T02:16:16.905 INFO:teuthology.orchestra.run.trial078.stdout: elfutils-libelf-devel-0.193-1.el10.rocky.0.1.x86_64 2026-02-13T02:16:16.905 INFO:teuthology.orchestra.run.trial078.stdout: flex-2.6.4-19.el10.x86_64 2026-02-13T02:16:16.905 INFO:teuthology.orchestra.run.trial078.stdout: flexiblas-3.4.2-3.el10.x86_64 2026-02-13T02:16:16.905 INFO:teuthology.orchestra.run.trial078.stdout: flexiblas-netlib-3.4.2-3.el10.x86_64 2026-02-13T02:16:16.905 INFO:teuthology.orchestra.run.trial078.stdout: flexiblas-openblas-openmp-3.4.2-3.el10.x86_64 2026-02-13T02:16:16.905 INFO:teuthology.orchestra.run.trial078.stdout: fuse3-3.16.2-5.el10.x86_64 2026-02-13T02:16:16.906 INFO:teuthology.orchestra.run.trial078.stdout: gperftools-libs-2.15-4.el10_0.x86_64 2026-02-13T02:16:16.906 INFO:teuthology.orchestra.run.trial078.stdout: grpc-data-1.48.4-44.el10_0.noarch 2026-02-13T02:16:16.906 INFO:teuthology.orchestra.run.trial078.stdout: hwloc-libs-2.11.1-3.el10.x86_64 2026-02-13T02:16:16.906 INFO:teuthology.orchestra.run.trial078.stdout: ledmon-libs-1.1.0-2.el10.x86_64 2026-02-13T02:16:16.906 INFO:teuthology.orchestra.run.trial078.stdout: libaio-devel-0.3.111-22.el10.x86_64 2026-02-13T02:16:16.906 INFO:teuthology.orchestra.run.trial078.stdout: libarrow-17.0.0-9.el10_2.x86_64 2026-02-13T02:16:16.906 INFO:teuthology.orchestra.run.trial078.stdout: libarrow-doc-17.0.0-9.el10_2.noarch 2026-02-13T02:16:16.906 INFO:teuthology.orchestra.run.trial078.stdout: libcephfs-daemon-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:16.906 INFO:teuthology.orchestra.run.trial078.stdout: libcephfs-devel-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:16.906 INFO:teuthology.orchestra.run.trial078.stdout: libcephfs-proxy2-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:16.906 INFO:teuthology.orchestra.run.trial078.stdout: libcephfs2-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:16.907 INFO:teuthology.orchestra.run.trial078.stdout: libcephsqlite-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:16.907 INFO:teuthology.orchestra.run.trial078.stdout: libconfig-1.7.3-10.el10.x86_64 2026-02-13T02:16:16.907 INFO:teuthology.orchestra.run.trial078.stdout: libgfortran-14.3.1-2.1.el10.x86_64 2026-02-13T02:16:16.907 INFO:teuthology.orchestra.run.trial078.stdout: libnbd-1.22.2-3.el10_1.x86_64 2026-02-13T02:16:16.907 INFO:teuthology.orchestra.run.trial078.stdout: liboath-2.6.12-1.el10_0.x86_64 2026-02-13T02:16:16.907 INFO:teuthology.orchestra.run.trial078.stdout: liborc2-2.0.7-1.el10_2.x86_64 2026-02-13T02:16:16.907 INFO:teuthology.orchestra.run.trial078.stdout: libpciaccess-0.16-16.el10.x86_64 2026-02-13T02:16:16.907 INFO:teuthology.orchestra.run.trial078.stdout: libpmem-2.1.0-2.el10_0.x86_64 2026-02-13T02:16:16.907 INFO:teuthology.orchestra.run.trial078.stdout: libpmemobj-2.1.0-2.el10_0.x86_64 2026-02-13T02:16:16.907 INFO:teuthology.orchestra.run.trial078.stdout: libquadmath-14.3.1-2.1.el10.x86_64 2026-02-13T02:16:16.907 INFO:teuthology.orchestra.run.trial078.stdout: librabbitmq-0.14.0-3.el10.x86_64 2026-02-13T02:16:16.908 INFO:teuthology.orchestra.run.trial078.stdout: librados-devel-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:16.908 INFO:teuthology.orchestra.run.trial078.stdout: libradosstriper1-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:16.908 INFO:teuthology.orchestra.run.trial078.stdout: librdkafka-2.1.1-7.el10.x86_64 2026-02-13T02:16:16.908 INFO:teuthology.orchestra.run.trial078.stdout: librgw2-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:16.908 INFO:teuthology.orchestra.run.trial078.stdout: libstoragemgmt-1.10.1-4.el10.x86_64 2026-02-13T02:16:16.908 INFO:teuthology.orchestra.run.trial078.stdout: libtool-2.4.7-13.el10.x86_64 2026-02-13T02:16:16.908 INFO:teuthology.orchestra.run.trial078.stdout: libtool-ltdl-2.4.7-13.el10.x86_64 2026-02-13T02:16:16.908 INFO:teuthology.orchestra.run.trial078.stdout: libunwind-1.8.0-4.el10_0.x86_64 2026-02-13T02:16:16.908 INFO:teuthology.orchestra.run.trial078.stdout: libuuid-devel-2.40.2-15.el10_1.x86_64 2026-02-13T02:16:16.908 INFO:teuthology.orchestra.run.trial078.stdout: libxslt-1.1.39-8.el10_0.x86_64 2026-02-13T02:16:16.909 INFO:teuthology.orchestra.run.trial078.stdout: libzstd-devel-1.5.5-9.el10.x86_64 2026-02-13T02:16:16.909 INFO:teuthology.orchestra.run.trial078.stdout: lttng-ust-2.13.7-5.el10.x86_64 2026-02-13T02:16:16.909 INFO:teuthology.orchestra.run.trial078.stdout: lua-5.4.6-7.el10.x86_64 2026-02-13T02:16:16.909 INFO:teuthology.orchestra.run.trial078.stdout: lua-devel-5.4.6-7.el10.x86_64 2026-02-13T02:16:16.909 INFO:teuthology.orchestra.run.trial078.stdout: luarocks-3.9.2-6.el10_0.noarch 2026-02-13T02:16:16.909 INFO:teuthology.orchestra.run.trial078.stdout: mailcap-2.1.54-8.el10.noarch 2026-02-13T02:16:16.909 INFO:teuthology.orchestra.run.trial078.stdout: ndctl-libs-80-4.el10.x86_64 2026-02-13T02:16:16.909 INFO:teuthology.orchestra.run.trial078.stdout: ocl-icd-2.3.2-8.el10.x86_64 2026-02-13T02:16:16.909 INFO:teuthology.orchestra.run.trial078.stdout: openblas-0.3.29-2.el10.x86_64 2026-02-13T02:16:16.909 INFO:teuthology.orchestra.run.trial078.stdout: openblas-openmp-0.3.29-2.el10.x86_64 2026-02-13T02:16:16.910 INFO:teuthology.orchestra.run.trial078.stdout: openssl-devel-1:3.5.1-7.el10_1.x86_64 2026-02-13T02:16:16.910 INFO:teuthology.orchestra.run.trial078.stdout: parquet-libs-17.0.0-9.el10_2.x86_64 2026-02-13T02:16:16.910 INFO:teuthology.orchestra.run.trial078.stdout: pciutils-3.13.0-6.el10.x86_64 2026-02-13T02:16:16.910 INFO:teuthology.orchestra.run.trial078.stdout: perl-Thread-Queue-3.14-511.el10.noarch 2026-02-13T02:16:16.910 INFO:teuthology.orchestra.run.trial078.stdout: perl-threads-1:2.40-511.el10.x86_64 2026-02-13T02:16:16.910 INFO:teuthology.orchestra.run.trial078.stdout: perl-threads-shared-1.69-511.el10.x86_64 2026-02-13T02:16:16.910 INFO:teuthology.orchestra.run.trial078.stdout: postgresql-16.11-1.el10_1.x86_64 2026-02-13T02:16:16.910 INFO:teuthology.orchestra.run.trial078.stdout: postgresql-contrib-16.11-1.el10_1.x86_64 2026-02-13T02:16:16.910 INFO:teuthology.orchestra.run.trial078.stdout: postgresql-private-libs-16.11-1.el10_1.x86_64 2026-02-13T02:16:16.910 INFO:teuthology.orchestra.run.trial078.stdout: postgresql-server-16.11-1.el10_1.x86_64 2026-02-13T02:16:16.910 INFO:teuthology.orchestra.run.trial078.stdout: protobuf-3.19.6-11.el10.x86_64 2026-02-13T02:16:16.911 INFO:teuthology.orchestra.run.trial078.stdout: protobuf-compiler-3.19.6-11.el10.x86_64 2026-02-13T02:16:16.911 INFO:teuthology.orchestra.run.trial078.stdout: python3-asyncssh-2.17.0-1.el10_0.noarch 2026-02-13T02:16:16.911 INFO:teuthology.orchestra.run.trial078.stdout: python3-autocommand-2.2.2-9.el10_0.noarch 2026-02-13T02:16:16.911 INFO:teuthology.orchestra.run.trial078.stdout: python3-bcrypt-4.3.0-3.el10_1.x86_64 2026-02-13T02:16:16.911 INFO:teuthology.orchestra.run.trial078.stdout: python3-cachetools-5.4.0-6.el10_0.noarch 2026-02-13T02:16:16.911 INFO:teuthology.orchestra.run.trial078.stdout: python3-ceph-argparse-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:16.911 INFO:teuthology.orchestra.run.trial078.stdout: python3-ceph-common-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:16.911 INFO:teuthology.orchestra.run.trial078.stdout: python3-cephfs-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:16.911 INFO:teuthology.orchestra.run.trial078.stdout: python3-certifi-2023.05.07-6.el10_0.noarch 2026-02-13T02:16:16.911 INFO:teuthology.orchestra.run.trial078.stdout: python3-cffi-1.16.0-7.el10.x86_64 2026-02-13T02:16:16.912 INFO:teuthology.orchestra.run.trial078.stdout: python3-cheroot-10.0.1-4.el10_0.noarch 2026-02-13T02:16:16.912 INFO:teuthology.orchestra.run.trial078.stdout: python3-cherrypy-18.10.0-4.el10_0.noarch 2026-02-13T02:16:16.912 INFO:teuthology.orchestra.run.trial078.stdout: python3-cmd2-2.5.8-1.el10_2.noarch 2026-02-13T02:16:16.912 INFO:teuthology.orchestra.run.trial078.stdout: python3-colorama-0.4.6-13.el10.noarch 2026-02-13T02:16:16.912 INFO:teuthology.orchestra.run.trial078.stdout: python3-cryptography-43.0.0-4.el10.x86_64 2026-02-13T02:16:16.912 INFO:teuthology.orchestra.run.trial078.stdout: python3-devel-3.12.12-2.el10_1.x86_64 2026-02-13T02:16:16.912 INFO:teuthology.orchestra.run.trial078.stdout: python3-durationpy-0.9-2.el10_0.noarch 2026-02-13T02:16:16.912 INFO:teuthology.orchestra.run.trial078.stdout: python3-google-auth-1:2.40.3-1.el10_1.noarch 2026-02-13T02:16:16.912 INFO:teuthology.orchestra.run.trial078.stdout: python3-grpcio-1.48.4-44.el10_0.x86_64 2026-02-13T02:16:16.912 INFO:teuthology.orchestra.run.trial078.stdout: python3-grpcio-tools-1.48.4-44.el10_0.x86_64 2026-02-13T02:16:16.912 INFO:teuthology.orchestra.run.trial078.stdout: python3-isodate-0.6.1-14.el10_0.noarch 2026-02-13T02:16:16.913 INFO:teuthology.orchestra.run.trial078.stdout: python3-jaraco-collections-5.1.0-1.el10_0.noarch 2026-02-13T02:16:16.913 INFO:teuthology.orchestra.run.trial078.stdout: python3-jaraco-context-6.0.1-4.el10_0.noarch 2026-02-13T02:16:16.913 INFO:teuthology.orchestra.run.trial078.stdout: python3-jaraco-functools-4.0.2-4.el10_0.noarch 2026-02-13T02:16:16.913 INFO:teuthology.orchestra.run.trial078.stdout: python3-jaraco-text-4.0.0-3.el10_0.noarch 2026-02-13T02:16:16.913 INFO:teuthology.orchestra.run.trial078.stdout: python3-jinja2-3.1.6-1.el10_0.noarch 2026-02-13T02:16:16.913 INFO:teuthology.orchestra.run.trial078.stdout: python3-jmespath-1.0.1-8.el10.noarch 2026-02-13T02:16:16.913 INFO:teuthology.orchestra.run.trial078.stdout: python3-kubernetes-1:32.0.1-1.el10_1.noarch 2026-02-13T02:16:16.913 INFO:teuthology.orchestra.run.trial078.stdout: python3-libstoragemgmt-1.10.1-4.el10.x86_64 2026-02-13T02:16:16.913 INFO:teuthology.orchestra.run.trial078.stdout: python3-lxml-5.2.1-4.el10.x86_64 2026-02-13T02:16:16.914 INFO:teuthology.orchestra.run.trial078.stdout: python3-markupsafe-2.1.3-6.el10.x86_64 2026-02-13T02:16:16.914 INFO:teuthology.orchestra.run.trial078.stdout: python3-more-itertools-10.1.0-8.el10_0.noarch 2026-02-13T02:16:16.914 INFO:teuthology.orchestra.run.trial078.stdout: python3-natsort-8.4.0-2.el10_0.noarch 2026-02-13T02:16:16.914 INFO:teuthology.orchestra.run.trial078.stdout: python3-numpy-1:1.26.4-5.el10.x86_64 2026-02-13T02:16:16.914 INFO:teuthology.orchestra.run.trial078.stdout: python3-numpy-f2py-1:1.26.4-5.el10.x86_64 2026-02-13T02:16:16.914 INFO:teuthology.orchestra.run.trial078.stdout: python3-packaging-24.2-2.el10.noarch 2026-02-13T02:16:16.914 INFO:teuthology.orchestra.run.trial078.stdout: python3-ply-3.11-25.el10.noarch 2026-02-13T02:16:16.914 INFO:teuthology.orchestra.run.trial078.stdout: python3-portend-3.2.0-6.el10_0.noarch 2026-02-13T02:16:16.914 INFO:teuthology.orchestra.run.trial078.stdout: python3-prettytable-3.6.0-10.el10.noarch 2026-02-13T02:16:16.914 INFO:teuthology.orchestra.run.trial078.stdout: python3-protobuf-3.19.6-11.el10.x86_64 2026-02-13T02:16:16.914 INFO:teuthology.orchestra.run.trial078.stdout: python3-pyOpenSSL-25.0.0-1.el10_1.noarch 2026-02-13T02:16:16.915 INFO:teuthology.orchestra.run.trial078.stdout: python3-pyasn1-0.6.1-1.el10.noarch 2026-02-13T02:16:16.915 INFO:teuthology.orchestra.run.trial078.stdout: python3-pyasn1-modules-0.6.1-1.el10.noarch 2026-02-13T02:16:16.915 INFO:teuthology.orchestra.run.trial078.stdout: python3-pycparser-2.20-16.el10.noarch 2026-02-13T02:16:16.915 INFO:teuthology.orchestra.run.trial078.stdout: python3-pyperclip-1.8.2-1.el10_0.noarch 2026-02-13T02:16:16.915 INFO:teuthology.orchestra.run.trial078.stdout: python3-rados-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:16.915 INFO:teuthology.orchestra.run.trial078.stdout: python3-rbd-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:16.915 INFO:teuthology.orchestra.run.trial078.stdout: python3-repoze-lru-0.7-23.el10_0.noarch 2026-02-13T02:16:16.915 INFO:teuthology.orchestra.run.trial078.stdout: python3-requests-2.32.4-1.el10_0.noarch 2026-02-13T02:16:16.915 INFO:teuthology.orchestra.run.trial078.stdout: python3-requests-oauthlib-1.3.1-11.el10.noarch 2026-02-13T02:16:16.915 INFO:teuthology.orchestra.run.trial078.stdout: python3-rgw-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:16.915 INFO:teuthology.orchestra.run.trial078.stdout: python3-routes-2.5.1-11.el10_0.noarch 2026-02-13T02:16:16.916 INFO:teuthology.orchestra.run.trial078.stdout: python3-rsa-4.9-7.el10_0.noarch 2026-02-13T02:16:16.916 INFO:teuthology.orchestra.run.trial078.stdout: python3-saml-1.16.0-11.el10.noarch 2026-02-13T02:16:16.916 INFO:teuthology.orchestra.run.trial078.stdout: python3-scipy-1.11.3-17.el10.x86_64 2026-02-13T02:16:16.916 INFO:teuthology.orchestra.run.trial078.stdout: python3-tempora-5.7.0-1.el10_0.noarch 2026-02-13T02:16:16.916 INFO:teuthology.orchestra.run.trial078.stdout: python3-urllib3-1.26.19-2.el10_1.1.noarch 2026-02-13T02:16:16.916 INFO:teuthology.orchestra.run.trial078.stdout: python3-websocket-client-1.8.0-2.el10_0.noarch 2026-02-13T02:16:16.916 INFO:teuthology.orchestra.run.trial078.stdout: python3-xmlsec-1.3.16-1.el10.x86_64 2026-02-13T02:16:16.916 INFO:teuthology.orchestra.run.trial078.stdout: python3-xmltodict-0.13.0-5.el10_0.noarch 2026-02-13T02:16:16.916 INFO:teuthology.orchestra.run.trial078.stdout: python3-zc-lockfile-3.0.post1-11.el10_0.noarch 2026-02-13T02:16:16.916 INFO:teuthology.orchestra.run.trial078.stdout: qatlib-24.09.0-2.el10.x86_64 2026-02-13T02:16:16.916 INFO:teuthology.orchestra.run.trial078.stdout: qatlib-service-24.09.0-2.el10.x86_64 2026-02-13T02:16:16.917 INFO:teuthology.orchestra.run.trial078.stdout: qatzip-libs-1.3.1-1.el10.x86_64 2026-02-13T02:16:16.917 INFO:teuthology.orchestra.run.trial078.stdout: rbd-fuse-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:16.917 INFO:teuthology.orchestra.run.trial078.stdout: rbd-mirror-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:16.917 INFO:teuthology.orchestra.run.trial078.stdout: rbd-nbd-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:16.917 INFO:teuthology.orchestra.run.trial078.stdout: re2-2:20251105-1.el10_2.x86_64 2026-02-13T02:16:16.917 INFO:teuthology.orchestra.run.trial078.stdout: socat-1.7.4.4-8.el10.x86_64 2026-02-13T02:16:16.917 INFO:teuthology.orchestra.run.trial078.stdout: thrift-0.20.0-4.el10_1.x86_64 2026-02-13T02:16:16.917 INFO:teuthology.orchestra.run.trial078.stdout: unzip-6.0-69.el10.x86_64 2026-02-13T02:16:16.917 INFO:teuthology.orchestra.run.trial078.stdout: utf8proc-2.7.0-9.el10.x86_64 2026-02-13T02:16:16.917 INFO:teuthology.orchestra.run.trial078.stdout: uuid-1.6.2-65.el10.x86_64 2026-02-13T02:16:16.917 INFO:teuthology.orchestra.run.trial078.stdout: xfsprogs-devel-6.11.0-2.el10.x86_64 2026-02-13T02:16:16.918 INFO:teuthology.orchestra.run.trial078.stdout: xmlsec1-1:1.2.39-3.el10.x86_64 2026-02-13T02:16:16.918 INFO:teuthology.orchestra.run.trial078.stdout: xmlsec1-openssl-1:1.2.39-3.el10.x86_64 2026-02-13T02:16:16.918 INFO:teuthology.orchestra.run.trial078.stdout: xmlstarlet-1.6.1-27.el10.x86_64 2026-02-13T02:16:16.918 INFO:teuthology.orchestra.run.trial078.stdout: yaml-cpp0.7-0.7.0-1.el10_2.x86_64 2026-02-13T02:16:16.918 INFO:teuthology.orchestra.run.trial078.stdout: zip-3.0-45.el10.x86_64 2026-02-13T02:16:16.918 INFO:teuthology.orchestra.run.trial078.stdout: zlib-ng-compat-devel-2.2.3-2.el10.x86_64 2026-02-13T02:16:16.918 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:16:16.918 INFO:teuthology.orchestra.run.trial078.stdout:Complete! 2026-02-13T02:16:16.919 INFO:teuthology.orchestra.run.trial011.stdout: Installing : postgresql-contrib-16.11-1.el10_1.x86_64 172/197 2026-02-13T02:16:16.921 INFO:teuthology.orchestra.run.trial011.stdout: Installing : ceph-fuse-2:20.3.0-5241.g8f8d3829.el10.x86_64 173/197 2026-02-13T02:16:16.922 INFO:teuthology.orchestra.run.trial011.stdout: Installing : libcephfs-devel-2:20.3.0-5241.g8f8d3829.el10.x86 174/197 2026-02-13T02:16:16.983 DEBUG:teuthology.parallel:result is None 2026-02-13T02:16:17.004 INFO:teuthology.orchestra.run.trial011.stdout: Running scriptlet: postgresql-server-16.11-1.el10_1.x86_64 175/197 2026-02-13T02:16:17.007 INFO:teuthology.orchestra.run.trial011.stdout: Installing : postgresql-server-16.11-1.el10_1.x86_64 175/197 2026-02-13T02:16:17.023 INFO:teuthology.orchestra.run.trial011.stdout: Running scriptlet: postgresql-server-16.11-1.el10_1.x86_64 175/197 2026-02-13T02:16:17.027 INFO:teuthology.orchestra.run.trial011.stdout: Installing : cephfs-top-2:20.3.0-5241.g8f8d3829.el10.noarch 176/197 2026-02-13T02:16:17.033 INFO:teuthology.orchestra.run.trial011.stdout: Installing : rbd-fuse-2:20.3.0-5241.g8f8d3829.el10.x86_64 177/197 2026-02-13T02:16:17.266 INFO:teuthology.orchestra.run.trial011.stdout: Installing : rbd-nbd-2:20.3.0-5241.g8f8d3829.el10.x86_64 178/197 2026-02-13T02:16:17.297 INFO:teuthology.orchestra.run.trial011.stdout: Installing : openssl-devel-1:3.5.1-7.el10_1.x86_64 179/197 2026-02-13T02:16:17.301 INFO:teuthology.orchestra.run.trial011.stdout: Upgrading : openssl-1:3.5.1-7.el10_1.x86_64 180/197 2026-02-13T02:16:17.307 INFO:teuthology.orchestra.run.trial011.stdout: Installing : xfsprogs-devel-6.11.0-2.el10.x86_64 181/197 2026-02-13T02:16:17.308 INFO:teuthology.orchestra.run.trial011.stdout: Installing : libtool-2.4.7-13.el10.x86_64 182/197 2026-02-13T02:16:17.314 INFO:teuthology.orchestra.run.trial011.stdout: Installing : libaio-devel-0.3.111-22.el10.x86_64 183/197 2026-02-13T02:16:17.328 INFO:teuthology.orchestra.run.trial011.stdout: Installing : flex-2.6.4-19.el10.x86_64 184/197 2026-02-13T02:16:17.330 INFO:teuthology.orchestra.run.trial011.stdout: Installing : bison-3.8.2-9.el10.x86_64 185/197 2026-02-13T02:16:17.339 INFO:teuthology.orchestra.run.trial011.stdout: Running scriptlet: util-linux-2.40.2-13.el10.x86_64 186/197 2026-02-13T02:16:17.339 INFO:teuthology.orchestra.run.trial011.stdout: Cleanup : util-linux-2.40.2-13.el10.x86_64 186/197 2026-02-13T02:16:17.355 INFO:teuthology.orchestra.run.trial011.stdout: Running scriptlet: util-linux-2.40.2-13.el10.x86_64 186/197 2026-02-13T02:16:17.358 INFO:teuthology.orchestra.run.trial011.stdout: Cleanup : util-linux-core-2.40.2-13.el10.x86_64 187/197 2026-02-13T02:16:17.360 INFO:teuthology.orchestra.run.trial011.stdout: Cleanup : openssl-1:3.5.1-5.el10_1.x86_64 188/197 2026-02-13T02:16:17.362 INFO:teuthology.orchestra.run.trial011.stdout: Cleanup : libfdisk-2.40.2-13.el10.x86_64 189/197 2026-02-13T02:16:17.363 INFO:teuthology.orchestra.run.trial011.stdout: Cleanup : librbd1-2:18.2.1-4.el10.x86_64 190/197 2026-02-13T02:16:17.364 INFO:teuthology.orchestra.run.trial011.stdout: Cleanup : libmount-2.40.2-13.el10.x86_64 191/197 2026-02-13T02:16:17.366 INFO:teuthology.orchestra.run.trial011.stdout: Cleanup : librados2-2:18.2.1-4.el10.x86_64 192/197 2026-02-13T02:16:17.367 INFO:teuthology.orchestra.run.trial011.stdout: Cleanup : libblkid-2.40.2-13.el10.x86_64 193/197 2026-02-13T02:16:17.368 INFO:teuthology.orchestra.run.trial011.stdout: Cleanup : openssl-fips-provider-1:3.5.1-5.el10_1.x86_64 194/197 2026-02-13T02:16:17.369 INFO:teuthology.orchestra.run.trial011.stdout: Cleanup : openssl-libs-1:3.5.1-5.el10_1.x86_64 195/197 2026-02-13T02:16:17.370 INFO:teuthology.orchestra.run.trial011.stdout: Cleanup : libuuid-2.40.2-13.el10.x86_64 196/197 2026-02-13T02:16:17.371 INFO:teuthology.orchestra.run.trial011.stdout: Cleanup : libsmartcols-2.40.2-13.el10.x86_64 197/197 2026-02-13T02:16:17.378 INFO:teuthology.orchestra.run.trial011.stdout: Running scriptlet: ceph-osd-classic-2:20.3.0-5241.g8f8d3829.el10.x8 197/197 2026-02-13T02:16:17.404 INFO:teuthology.orchestra.run.trial011.stdout: Running scriptlet: ceph-osd-crimson-2:20.3.0-5241.g8f8d3829.el10.x8 197/197 2026-02-13T02:16:18.618 INFO:teuthology.orchestra.run.trial011.stdout: Running scriptlet: libsmartcols-2.40.2-13.el10.x86_64 197/197 2026-02-13T02:16:18.618 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:16:18.618 INFO:teuthology.orchestra.run.trial011.stdout:Upgraded: 2026-02-13T02:16:18.618 INFO:teuthology.orchestra.run.trial011.stdout: libblkid-2.40.2-15.el10_1.x86_64 2026-02-13T02:16:18.618 INFO:teuthology.orchestra.run.trial011.stdout: libfdisk-2.40.2-15.el10_1.x86_64 2026-02-13T02:16:18.618 INFO:teuthology.orchestra.run.trial011.stdout: libmount-2.40.2-15.el10_1.x86_64 2026-02-13T02:16:18.618 INFO:teuthology.orchestra.run.trial011.stdout: librados2-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:18.619 INFO:teuthology.orchestra.run.trial011.stdout: librbd1-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:18.619 INFO:teuthology.orchestra.run.trial011.stdout: libsmartcols-2.40.2-15.el10_1.x86_64 2026-02-13T02:16:18.619 INFO:teuthology.orchestra.run.trial011.stdout: libuuid-2.40.2-15.el10_1.x86_64 2026-02-13T02:16:18.619 INFO:teuthology.orchestra.run.trial011.stdout: openssl-1:3.5.1-7.el10_1.x86_64 2026-02-13T02:16:18.619 INFO:teuthology.orchestra.run.trial011.stdout: openssl-fips-provider-1:3.5.1-7.el10_1.x86_64 2026-02-13T02:16:18.619 INFO:teuthology.orchestra.run.trial011.stdout: openssl-libs-1:3.5.1-7.el10_1.x86_64 2026-02-13T02:16:18.619 INFO:teuthology.orchestra.run.trial011.stdout: util-linux-2.40.2-15.el10_1.x86_64 2026-02-13T02:16:18.619 INFO:teuthology.orchestra.run.trial011.stdout: util-linux-core-2.40.2-15.el10_1.x86_64 2026-02-13T02:16:18.619 INFO:teuthology.orchestra.run.trial011.stdout:Installed: 2026-02-13T02:16:18.619 INFO:teuthology.orchestra.run.trial011.stdout: abseil-cpp-20240722.1-1.el10_0.x86_64 2026-02-13T02:16:18.619 INFO:teuthology.orchestra.run.trial011.stdout: automake-1.16.5-20.el10.noarch 2026-02-13T02:16:18.620 INFO:teuthology.orchestra.run.trial011.stdout: bison-3.8.2-9.el10.x86_64 2026-02-13T02:16:18.620 INFO:teuthology.orchestra.run.trial011.stdout: boost-program-options-1.83.0-5.el10.x86_64 2026-02-13T02:16:18.620 INFO:teuthology.orchestra.run.trial011.stdout: ceph-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:18.620 INFO:teuthology.orchestra.run.trial011.stdout: ceph-base-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:18.620 INFO:teuthology.orchestra.run.trial011.stdout: ceph-common-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:18.620 INFO:teuthology.orchestra.run.trial011.stdout: ceph-fuse-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:18.620 INFO:teuthology.orchestra.run.trial011.stdout: ceph-grafana-dashboards-2:20.3.0-5241.g8f8d3829.el10.noarch 2026-02-13T02:16:18.620 INFO:teuthology.orchestra.run.trial011.stdout: ceph-immutable-object-cache-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:18.620 INFO:teuthology.orchestra.run.trial011.stdout: ceph-mds-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:18.620 INFO:teuthology.orchestra.run.trial011.stdout: ceph-mgr-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:18.620 INFO:teuthology.orchestra.run.trial011.stdout: ceph-mgr-cephadm-2:20.3.0-5241.g8f8d3829.el10.noarch 2026-02-13T02:16:18.620 INFO:teuthology.orchestra.run.trial011.stdout: ceph-mgr-dashboard-2:20.3.0-5241.g8f8d3829.el10.noarch 2026-02-13T02:16:18.621 INFO:teuthology.orchestra.run.trial011.stdout: ceph-mgr-diskprediction-local-2:20.3.0-5241.g8f8d3829.el10.noarch 2026-02-13T02:16:18.621 INFO:teuthology.orchestra.run.trial011.stdout: ceph-mgr-k8sevents-2:20.3.0-5241.g8f8d3829.el10.noarch 2026-02-13T02:16:18.621 INFO:teuthology.orchestra.run.trial011.stdout: ceph-mgr-modules-core-2:20.3.0-5241.g8f8d3829.el10.noarch 2026-02-13T02:16:18.621 INFO:teuthology.orchestra.run.trial011.stdout: ceph-mgr-rook-2:20.3.0-5241.g8f8d3829.el10.noarch 2026-02-13T02:16:18.621 INFO:teuthology.orchestra.run.trial011.stdout: ceph-mon-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:18.621 INFO:teuthology.orchestra.run.trial011.stdout: ceph-osd-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:18.621 INFO:teuthology.orchestra.run.trial011.stdout: ceph-osd-classic-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:18.621 INFO:teuthology.orchestra.run.trial011.stdout: ceph-osd-crimson-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:18.621 INFO:teuthology.orchestra.run.trial011.stdout: ceph-prometheus-alerts-2:20.3.0-5241.g8f8d3829.el10.noarch 2026-02-13T02:16:18.621 INFO:teuthology.orchestra.run.trial011.stdout: ceph-radosgw-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:18.621 INFO:teuthology.orchestra.run.trial011.stdout: ceph-selinux-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:18.622 INFO:teuthology.orchestra.run.trial011.stdout: ceph-test-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:18.622 INFO:teuthology.orchestra.run.trial011.stdout: ceph-volume-2:20.3.0-5241.g8f8d3829.el10.noarch 2026-02-13T02:16:18.622 INFO:teuthology.orchestra.run.trial011.stdout: cephadm-2:20.3.0-5241.g8f8d3829.el10.noarch 2026-02-13T02:16:18.622 INFO:teuthology.orchestra.run.trial011.stdout: cephfs-mirror-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:18.622 INFO:teuthology.orchestra.run.trial011.stdout: cephfs-shell-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:18.622 INFO:teuthology.orchestra.run.trial011.stdout: cephfs-top-2:20.3.0-5241.g8f8d3829.el10.noarch 2026-02-13T02:16:18.622 INFO:teuthology.orchestra.run.trial011.stdout: cmake-filesystem-3.30.5-3.el10_0.x86_64 2026-02-13T02:16:18.622 INFO:teuthology.orchestra.run.trial011.stdout: cryptsetup-2.7.5-2.el10.x86_64 2026-02-13T02:16:18.622 INFO:teuthology.orchestra.run.trial011.stdout: daxctl-libs-80-4.el10.x86_64 2026-02-13T02:16:18.622 INFO:teuthology.orchestra.run.trial011.stdout: elfutils-libelf-devel-0.193-1.el10.rocky.0.1.x86_64 2026-02-13T02:16:18.622 INFO:teuthology.orchestra.run.trial011.stdout: flex-2.6.4-19.el10.x86_64 2026-02-13T02:16:18.623 INFO:teuthology.orchestra.run.trial011.stdout: flexiblas-3.4.2-3.el10.x86_64 2026-02-13T02:16:18.623 INFO:teuthology.orchestra.run.trial011.stdout: flexiblas-netlib-3.4.2-3.el10.x86_64 2026-02-13T02:16:18.623 INFO:teuthology.orchestra.run.trial011.stdout: flexiblas-openblas-openmp-3.4.2-3.el10.x86_64 2026-02-13T02:16:18.623 INFO:teuthology.orchestra.run.trial011.stdout: fuse3-3.16.2-5.el10.x86_64 2026-02-13T02:16:18.623 INFO:teuthology.orchestra.run.trial011.stdout: gperftools-libs-2.15-4.el10_0.x86_64 2026-02-13T02:16:18.623 INFO:teuthology.orchestra.run.trial011.stdout: grpc-data-1.48.4-44.el10_0.noarch 2026-02-13T02:16:18.623 INFO:teuthology.orchestra.run.trial011.stdout: hwloc-libs-2.11.1-3.el10.x86_64 2026-02-13T02:16:18.623 INFO:teuthology.orchestra.run.trial011.stdout: ledmon-libs-1.1.0-2.el10.x86_64 2026-02-13T02:16:18.623 INFO:teuthology.orchestra.run.trial011.stdout: libaio-devel-0.3.111-22.el10.x86_64 2026-02-13T02:16:18.623 INFO:teuthology.orchestra.run.trial011.stdout: libarrow-17.0.0-9.el10_2.x86_64 2026-02-13T02:16:18.623 INFO:teuthology.orchestra.run.trial011.stdout: libarrow-doc-17.0.0-9.el10_2.noarch 2026-02-13T02:16:18.624 INFO:teuthology.orchestra.run.trial011.stdout: libcephfs-daemon-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:18.624 INFO:teuthology.orchestra.run.trial011.stdout: libcephfs-devel-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:18.624 INFO:teuthology.orchestra.run.trial011.stdout: libcephfs-proxy2-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:18.624 INFO:teuthology.orchestra.run.trial011.stdout: libcephfs2-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:18.624 INFO:teuthology.orchestra.run.trial011.stdout: libcephsqlite-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:18.624 INFO:teuthology.orchestra.run.trial011.stdout: libconfig-1.7.3-10.el10.x86_64 2026-02-13T02:16:18.624 INFO:teuthology.orchestra.run.trial011.stdout: libgfortran-14.3.1-2.1.el10.x86_64 2026-02-13T02:16:18.624 INFO:teuthology.orchestra.run.trial011.stdout: libnbd-1.22.2-3.el10_1.x86_64 2026-02-13T02:16:18.624 INFO:teuthology.orchestra.run.trial011.stdout: liboath-2.6.12-1.el10_0.x86_64 2026-02-13T02:16:18.624 INFO:teuthology.orchestra.run.trial011.stdout: liborc2-2.0.7-1.el10_2.x86_64 2026-02-13T02:16:18.625 INFO:teuthology.orchestra.run.trial011.stdout: libpciaccess-0.16-16.el10.x86_64 2026-02-13T02:16:18.625 INFO:teuthology.orchestra.run.trial011.stdout: libpmem-2.1.0-2.el10_0.x86_64 2026-02-13T02:16:18.625 INFO:teuthology.orchestra.run.trial011.stdout: libpmemobj-2.1.0-2.el10_0.x86_64 2026-02-13T02:16:18.625 INFO:teuthology.orchestra.run.trial011.stdout: libquadmath-14.3.1-2.1.el10.x86_64 2026-02-13T02:16:18.625 INFO:teuthology.orchestra.run.trial011.stdout: librabbitmq-0.14.0-3.el10.x86_64 2026-02-13T02:16:18.625 INFO:teuthology.orchestra.run.trial011.stdout: librados-devel-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:18.625 INFO:teuthology.orchestra.run.trial011.stdout: libradosstriper1-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:18.625 INFO:teuthology.orchestra.run.trial011.stdout: librdkafka-2.1.1-7.el10.x86_64 2026-02-13T02:16:18.625 INFO:teuthology.orchestra.run.trial011.stdout: librgw2-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:18.625 INFO:teuthology.orchestra.run.trial011.stdout: libstoragemgmt-1.10.1-4.el10.x86_64 2026-02-13T02:16:18.625 INFO:teuthology.orchestra.run.trial011.stdout: libtool-2.4.7-13.el10.x86_64 2026-02-13T02:16:18.626 INFO:teuthology.orchestra.run.trial011.stdout: libtool-ltdl-2.4.7-13.el10.x86_64 2026-02-13T02:16:18.626 INFO:teuthology.orchestra.run.trial011.stdout: libunwind-1.8.0-4.el10_0.x86_64 2026-02-13T02:16:18.626 INFO:teuthology.orchestra.run.trial011.stdout: libuuid-devel-2.40.2-15.el10_1.x86_64 2026-02-13T02:16:18.626 INFO:teuthology.orchestra.run.trial011.stdout: libxslt-1.1.39-8.el10_0.x86_64 2026-02-13T02:16:18.626 INFO:teuthology.orchestra.run.trial011.stdout: libzstd-devel-1.5.5-9.el10.x86_64 2026-02-13T02:16:18.626 INFO:teuthology.orchestra.run.trial011.stdout: lttng-ust-2.13.7-5.el10.x86_64 2026-02-13T02:16:18.626 INFO:teuthology.orchestra.run.trial011.stdout: lua-5.4.6-7.el10.x86_64 2026-02-13T02:16:18.626 INFO:teuthology.orchestra.run.trial011.stdout: lua-devel-5.4.6-7.el10.x86_64 2026-02-13T02:16:18.626 INFO:teuthology.orchestra.run.trial011.stdout: luarocks-3.9.2-6.el10_0.noarch 2026-02-13T02:16:18.626 INFO:teuthology.orchestra.run.trial011.stdout: mailcap-2.1.54-8.el10.noarch 2026-02-13T02:16:18.626 INFO:teuthology.orchestra.run.trial011.stdout: ndctl-libs-80-4.el10.x86_64 2026-02-13T02:16:18.626 INFO:teuthology.orchestra.run.trial011.stdout: ocl-icd-2.3.2-8.el10.x86_64 2026-02-13T02:16:18.627 INFO:teuthology.orchestra.run.trial011.stdout: openblas-0.3.29-2.el10.x86_64 2026-02-13T02:16:18.627 INFO:teuthology.orchestra.run.trial011.stdout: openblas-openmp-0.3.29-2.el10.x86_64 2026-02-13T02:16:18.627 INFO:teuthology.orchestra.run.trial011.stdout: openssl-devel-1:3.5.1-7.el10_1.x86_64 2026-02-13T02:16:18.627 INFO:teuthology.orchestra.run.trial011.stdout: parquet-libs-17.0.0-9.el10_2.x86_64 2026-02-13T02:16:18.627 INFO:teuthology.orchestra.run.trial011.stdout: pciutils-3.13.0-6.el10.x86_64 2026-02-13T02:16:18.627 INFO:teuthology.orchestra.run.trial011.stdout: perl-Thread-Queue-3.14-511.el10.noarch 2026-02-13T02:16:18.627 INFO:teuthology.orchestra.run.trial011.stdout: perl-threads-1:2.40-511.el10.x86_64 2026-02-13T02:16:18.627 INFO:teuthology.orchestra.run.trial011.stdout: perl-threads-shared-1.69-511.el10.x86_64 2026-02-13T02:16:18.627 INFO:teuthology.orchestra.run.trial011.stdout: postgresql-16.11-1.el10_1.x86_64 2026-02-13T02:16:18.628 INFO:teuthology.orchestra.run.trial011.stdout: postgresql-contrib-16.11-1.el10_1.x86_64 2026-02-13T02:16:18.628 INFO:teuthology.orchestra.run.trial011.stdout: postgresql-private-libs-16.11-1.el10_1.x86_64 2026-02-13T02:16:18.628 INFO:teuthology.orchestra.run.trial011.stdout: postgresql-server-16.11-1.el10_1.x86_64 2026-02-13T02:16:18.628 INFO:teuthology.orchestra.run.trial011.stdout: protobuf-3.19.6-11.el10.x86_64 2026-02-13T02:16:18.628 INFO:teuthology.orchestra.run.trial011.stdout: protobuf-compiler-3.19.6-11.el10.x86_64 2026-02-13T02:16:18.628 INFO:teuthology.orchestra.run.trial011.stdout: python3-asyncssh-2.17.0-1.el10_0.noarch 2026-02-13T02:16:18.628 INFO:teuthology.orchestra.run.trial011.stdout: python3-autocommand-2.2.2-9.el10_0.noarch 2026-02-13T02:16:18.628 INFO:teuthology.orchestra.run.trial011.stdout: python3-bcrypt-4.3.0-3.el10_1.x86_64 2026-02-13T02:16:18.628 INFO:teuthology.orchestra.run.trial011.stdout: python3-cachetools-5.4.0-6.el10_0.noarch 2026-02-13T02:16:18.628 INFO:teuthology.orchestra.run.trial011.stdout: python3-ceph-argparse-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:18.628 INFO:teuthology.orchestra.run.trial011.stdout: python3-ceph-common-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:18.628 INFO:teuthology.orchestra.run.trial011.stdout: python3-cephfs-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:18.628 INFO:teuthology.orchestra.run.trial011.stdout: python3-certifi-2023.05.07-6.el10_0.noarch 2026-02-13T02:16:18.629 INFO:teuthology.orchestra.run.trial011.stdout: python3-cffi-1.16.0-7.el10.x86_64 2026-02-13T02:16:18.629 INFO:teuthology.orchestra.run.trial011.stdout: python3-cheroot-10.0.1-4.el10_0.noarch 2026-02-13T02:16:18.629 INFO:teuthology.orchestra.run.trial011.stdout: python3-cherrypy-18.10.0-4.el10_0.noarch 2026-02-13T02:16:18.629 INFO:teuthology.orchestra.run.trial011.stdout: python3-cmd2-2.5.8-1.el10_2.noarch 2026-02-13T02:16:18.629 INFO:teuthology.orchestra.run.trial011.stdout: python3-colorama-0.4.6-13.el10.noarch 2026-02-13T02:16:18.629 INFO:teuthology.orchestra.run.trial011.stdout: python3-cryptography-43.0.0-4.el10.x86_64 2026-02-13T02:16:18.629 INFO:teuthology.orchestra.run.trial011.stdout: python3-devel-3.12.12-2.el10_1.x86_64 2026-02-13T02:16:18.629 INFO:teuthology.orchestra.run.trial011.stdout: python3-durationpy-0.9-2.el10_0.noarch 2026-02-13T02:16:18.629 INFO:teuthology.orchestra.run.trial011.stdout: python3-google-auth-1:2.40.3-1.el10_1.noarch 2026-02-13T02:16:18.629 INFO:teuthology.orchestra.run.trial011.stdout: python3-grpcio-1.48.4-44.el10_0.x86_64 2026-02-13T02:16:18.629 INFO:teuthology.orchestra.run.trial011.stdout: python3-grpcio-tools-1.48.4-44.el10_0.x86_64 2026-02-13T02:16:18.629 INFO:teuthology.orchestra.run.trial011.stdout: python3-isodate-0.6.1-14.el10_0.noarch 2026-02-13T02:16:18.629 INFO:teuthology.orchestra.run.trial011.stdout: python3-jaraco-collections-5.1.0-1.el10_0.noarch 2026-02-13T02:16:18.630 INFO:teuthology.orchestra.run.trial011.stdout: python3-jaraco-context-6.0.1-4.el10_0.noarch 2026-02-13T02:16:18.630 INFO:teuthology.orchestra.run.trial011.stdout: python3-jaraco-functools-4.0.2-4.el10_0.noarch 2026-02-13T02:16:18.630 INFO:teuthology.orchestra.run.trial011.stdout: python3-jaraco-text-4.0.0-3.el10_0.noarch 2026-02-13T02:16:18.630 INFO:teuthology.orchestra.run.trial011.stdout: python3-jinja2-3.1.6-1.el10_0.noarch 2026-02-13T02:16:18.630 INFO:teuthology.orchestra.run.trial011.stdout: python3-jmespath-1.0.1-8.el10.noarch 2026-02-13T02:16:18.630 INFO:teuthology.orchestra.run.trial011.stdout: python3-kubernetes-1:32.0.1-1.el10_1.noarch 2026-02-13T02:16:18.630 INFO:teuthology.orchestra.run.trial011.stdout: python3-libstoragemgmt-1.10.1-4.el10.x86_64 2026-02-13T02:16:18.630 INFO:teuthology.orchestra.run.trial011.stdout: python3-lxml-5.2.1-4.el10.x86_64 2026-02-13T02:16:18.630 INFO:teuthology.orchestra.run.trial011.stdout: python3-markupsafe-2.1.3-6.el10.x86_64 2026-02-13T02:16:18.630 INFO:teuthology.orchestra.run.trial011.stdout: python3-more-itertools-10.1.0-8.el10_0.noarch 2026-02-13T02:16:18.630 INFO:teuthology.orchestra.run.trial011.stdout: python3-natsort-8.4.0-2.el10_0.noarch 2026-02-13T02:16:18.630 INFO:teuthology.orchestra.run.trial011.stdout: python3-numpy-1:1.26.4-5.el10.x86_64 2026-02-13T02:16:18.630 INFO:teuthology.orchestra.run.trial011.stdout: python3-numpy-f2py-1:1.26.4-5.el10.x86_64 2026-02-13T02:16:18.631 INFO:teuthology.orchestra.run.trial011.stdout: python3-packaging-24.2-2.el10.noarch 2026-02-13T02:16:18.631 INFO:teuthology.orchestra.run.trial011.stdout: python3-ply-3.11-25.el10.noarch 2026-02-13T02:16:18.631 INFO:teuthology.orchestra.run.trial011.stdout: python3-portend-3.2.0-6.el10_0.noarch 2026-02-13T02:16:18.631 INFO:teuthology.orchestra.run.trial011.stdout: python3-prettytable-3.6.0-10.el10.noarch 2026-02-13T02:16:18.631 INFO:teuthology.orchestra.run.trial011.stdout: python3-protobuf-3.19.6-11.el10.x86_64 2026-02-13T02:16:18.631 INFO:teuthology.orchestra.run.trial011.stdout: python3-pyOpenSSL-25.0.0-1.el10_1.noarch 2026-02-13T02:16:18.631 INFO:teuthology.orchestra.run.trial011.stdout: python3-pyasn1-0.6.1-1.el10.noarch 2026-02-13T02:16:18.631 INFO:teuthology.orchestra.run.trial011.stdout: python3-pyasn1-modules-0.6.1-1.el10.noarch 2026-02-13T02:16:18.631 INFO:teuthology.orchestra.run.trial011.stdout: python3-pycparser-2.20-16.el10.noarch 2026-02-13T02:16:18.631 INFO:teuthology.orchestra.run.trial011.stdout: python3-pyperclip-1.8.2-1.el10_0.noarch 2026-02-13T02:16:18.631 INFO:teuthology.orchestra.run.trial011.stdout: python3-rados-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:18.631 INFO:teuthology.orchestra.run.trial011.stdout: python3-rbd-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:18.631 INFO:teuthology.orchestra.run.trial011.stdout: python3-repoze-lru-0.7-23.el10_0.noarch 2026-02-13T02:16:18.632 INFO:teuthology.orchestra.run.trial011.stdout: python3-requests-2.32.4-1.el10_0.noarch 2026-02-13T02:16:18.632 INFO:teuthology.orchestra.run.trial011.stdout: python3-requests-oauthlib-1.3.1-11.el10.noarch 2026-02-13T02:16:18.632 INFO:teuthology.orchestra.run.trial011.stdout: python3-rgw-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:18.632 INFO:teuthology.orchestra.run.trial011.stdout: python3-routes-2.5.1-11.el10_0.noarch 2026-02-13T02:16:18.632 INFO:teuthology.orchestra.run.trial011.stdout: python3-rsa-4.9-7.el10_0.noarch 2026-02-13T02:16:18.632 INFO:teuthology.orchestra.run.trial011.stdout: python3-saml-1.16.0-11.el10.noarch 2026-02-13T02:16:18.632 INFO:teuthology.orchestra.run.trial011.stdout: python3-scipy-1.11.3-17.el10.x86_64 2026-02-13T02:16:18.632 INFO:teuthology.orchestra.run.trial011.stdout: python3-tempora-5.7.0-1.el10_0.noarch 2026-02-13T02:16:18.632 INFO:teuthology.orchestra.run.trial011.stdout: python3-urllib3-1.26.19-2.el10_1.1.noarch 2026-02-13T02:16:18.632 INFO:teuthology.orchestra.run.trial011.stdout: python3-websocket-client-1.8.0-2.el10_0.noarch 2026-02-13T02:16:18.632 INFO:teuthology.orchestra.run.trial011.stdout: python3-xmlsec-1.3.16-1.el10.x86_64 2026-02-13T02:16:18.632 INFO:teuthology.orchestra.run.trial011.stdout: python3-xmltodict-0.13.0-5.el10_0.noarch 2026-02-13T02:16:18.632 INFO:teuthology.orchestra.run.trial011.stdout: python3-zc-lockfile-3.0.post1-11.el10_0.noarch 2026-02-13T02:16:18.633 INFO:teuthology.orchestra.run.trial011.stdout: qatlib-24.09.0-2.el10.x86_64 2026-02-13T02:16:18.633 INFO:teuthology.orchestra.run.trial011.stdout: qatlib-service-24.09.0-2.el10.x86_64 2026-02-13T02:16:18.633 INFO:teuthology.orchestra.run.trial011.stdout: qatzip-libs-1.3.1-1.el10.x86_64 2026-02-13T02:16:18.633 INFO:teuthology.orchestra.run.trial011.stdout: rbd-fuse-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:18.633 INFO:teuthology.orchestra.run.trial011.stdout: rbd-mirror-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:18.633 INFO:teuthology.orchestra.run.trial011.stdout: rbd-nbd-2:20.3.0-5241.g8f8d3829.el10.x86_64 2026-02-13T02:16:18.633 INFO:teuthology.orchestra.run.trial011.stdout: re2-2:20251105-1.el10_2.x86_64 2026-02-13T02:16:18.633 INFO:teuthology.orchestra.run.trial011.stdout: socat-1.7.4.4-8.el10.x86_64 2026-02-13T02:16:18.633 INFO:teuthology.orchestra.run.trial011.stdout: thrift-0.20.0-4.el10_1.x86_64 2026-02-13T02:16:18.633 INFO:teuthology.orchestra.run.trial011.stdout: unzip-6.0-69.el10.x86_64 2026-02-13T02:16:18.633 INFO:teuthology.orchestra.run.trial011.stdout: utf8proc-2.7.0-9.el10.x86_64 2026-02-13T02:16:18.633 INFO:teuthology.orchestra.run.trial011.stdout: uuid-1.6.2-65.el10.x86_64 2026-02-13T02:16:18.633 INFO:teuthology.orchestra.run.trial011.stdout: xfsprogs-devel-6.11.0-2.el10.x86_64 2026-02-13T02:16:18.634 INFO:teuthology.orchestra.run.trial011.stdout: xmlsec1-1:1.2.39-3.el10.x86_64 2026-02-13T02:16:18.634 INFO:teuthology.orchestra.run.trial011.stdout: xmlsec1-openssl-1:1.2.39-3.el10.x86_64 2026-02-13T02:16:18.634 INFO:teuthology.orchestra.run.trial011.stdout: xmlstarlet-1.6.1-27.el10.x86_64 2026-02-13T02:16:18.634 INFO:teuthology.orchestra.run.trial011.stdout: yaml-cpp0.7-0.7.0-1.el10_2.x86_64 2026-02-13T02:16:18.634 INFO:teuthology.orchestra.run.trial011.stdout: zip-3.0-45.el10.x86_64 2026-02-13T02:16:18.634 INFO:teuthology.orchestra.run.trial011.stdout: zlib-ng-compat-devel-2.2.3-2.el10.x86_64 2026-02-13T02:16:18.634 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:16:18.634 INFO:teuthology.orchestra.run.trial011.stdout:Complete! 2026-02-13T02:16:18.702 DEBUG:teuthology.parallel:result is None 2026-02-13T02:16:18.703 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=rocky%2F10%2Fx86_64&sha1=8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-13T02:16:18.866 DEBUG:teuthology.orchestra.run.trial011:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-13T02:16:18.889 INFO:teuthology.orchestra.run.trial011.stdout:20.3.0-5241.g8f8d3829.el10 2026-02-13T02:16:18.890 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5241.g8f8d3829.el10 2026-02-13T02:16:18.890 INFO:teuthology.task.install:The correct ceph version 20.3.0-5241.g8f8d3829 is installed. 2026-02-13T02:16:18.894 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=rocky%2F10%2Fx86_64&sha1=8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-13T02:16:19.052 DEBUG:teuthology.orchestra.run.trial060:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-13T02:16:19.076 INFO:teuthology.orchestra.run.trial060.stdout:20.3.0-5241.g8f8d3829.el10 2026-02-13T02:16:19.077 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5241.g8f8d3829.el10 2026-02-13T02:16:19.077 INFO:teuthology.task.install:The correct ceph version 20.3.0-5241.g8f8d3829 is installed. 2026-02-13T02:16:19.080 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=rocky%2F10%2Fx86_64&sha1=8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-13T02:16:19.236 DEBUG:teuthology.orchestra.run.trial078:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-13T02:16:19.260 INFO:teuthology.orchestra.run.trial078.stdout:20.3.0-5241.g8f8d3829.el10 2026-02-13T02:16:19.261 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5241.g8f8d3829.el10 2026-02-13T02:16:19.261 INFO:teuthology.task.install:The correct ceph version 20.3.0-5241.g8f8d3829 is installed. 2026-02-13T02:16:19.263 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-13T02:16:19.264 DEBUG:teuthology.orchestra.run.trial011:> set -ex 2026-02-13T02:16:19.264 DEBUG:teuthology.orchestra.run.trial011:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-13T02:16:19.293 DEBUG:teuthology.orchestra.run.trial060:> set -ex 2026-02-13T02:16:19.293 DEBUG:teuthology.orchestra.run.trial060:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-13T02:16:19.323 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-13T02:16:19.324 DEBUG:teuthology.orchestra.run.trial078:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-13T02:16:19.353 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-13T02:16:19.353 DEBUG:teuthology.orchestra.run.trial011:> set -ex 2026-02-13T02:16:19.354 DEBUG:teuthology.orchestra.run.trial011:> sudo dd of=/usr/bin/daemon-helper 2026-02-13T02:16:19.379 DEBUG:teuthology.orchestra.run.trial011:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-13T02:16:19.445 DEBUG:teuthology.orchestra.run.trial060:> set -ex 2026-02-13T02:16:19.445 DEBUG:teuthology.orchestra.run.trial060:> sudo dd of=/usr/bin/daemon-helper 2026-02-13T02:16:19.474 DEBUG:teuthology.orchestra.run.trial060:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-13T02:16:19.540 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-13T02:16:19.540 DEBUG:teuthology.orchestra.run.trial078:> sudo dd of=/usr/bin/daemon-helper 2026-02-13T02:16:19.569 DEBUG:teuthology.orchestra.run.trial078:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-13T02:16:19.636 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-13T02:16:19.637 DEBUG:teuthology.orchestra.run.trial011:> set -ex 2026-02-13T02:16:19.637 DEBUG:teuthology.orchestra.run.trial011:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-13T02:16:19.662 DEBUG:teuthology.orchestra.run.trial011:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-13T02:16:19.729 DEBUG:teuthology.orchestra.run.trial060:> set -ex 2026-02-13T02:16:19.729 DEBUG:teuthology.orchestra.run.trial060:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-13T02:16:19.756 DEBUG:teuthology.orchestra.run.trial060:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-13T02:16:19.823 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-13T02:16:19.823 DEBUG:teuthology.orchestra.run.trial078:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-13T02:16:19.851 DEBUG:teuthology.orchestra.run.trial078:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-13T02:16:19.917 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-13T02:16:19.918 DEBUG:teuthology.orchestra.run.trial011:> set -ex 2026-02-13T02:16:19.918 DEBUG:teuthology.orchestra.run.trial011:> sudo dd of=/usr/bin/stdin-killer 2026-02-13T02:16:19.945 DEBUG:teuthology.orchestra.run.trial011:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-13T02:16:20.013 DEBUG:teuthology.orchestra.run.trial060:> set -ex 2026-02-13T02:16:20.013 DEBUG:teuthology.orchestra.run.trial060:> sudo dd of=/usr/bin/stdin-killer 2026-02-13T02:16:20.041 DEBUG:teuthology.orchestra.run.trial060:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-13T02:16:20.108 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-13T02:16:20.108 DEBUG:teuthology.orchestra.run.trial078:> sudo dd of=/usr/bin/stdin-killer 2026-02-13T02:16:20.136 DEBUG:teuthology.orchestra.run.trial078:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-13T02:16:20.202 INFO:teuthology.run_tasks:Running task cephadm... 2026-02-13T02:16:20.334 INFO:tasks.cephadm:Config: {'distro-suffix': 'rockylinux-10', 'roleless': False, 'skip_dashboard': True, 'cephfs': {'ec_profile': ['disabled'], 'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mon warn on pool no app': False}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'client_fscrypt_dummy_encryption': True}, 'global': {'ms die on skipped message': False}, 'mds': {'mds_bal_replicate_threshold': 1, 'mds_export_ephemeral_random_max': 0.2}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'is offline because no MDS', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'BLUESTORE_SLOW_OP_ALERT', 'slow operation indications in BlueStore', 'experiencing slow operations in BlueStore', 'MGR_MODULE_ERROR', 'OSD_DOWN', 'osd.* is down', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'osds down', 'osd.* is down', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'pg .* is stuck inactive', 'pg .* is .*degraded', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': '8f8d38294e4db8750b4b1649f62ce37caa63080f', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2026-02-13T02:16:20.335 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 2026-02-13T02:16:20.337 INFO:tasks.cephadm:Cluster fsid is fc631695-0881-11f1-899c-d404e6e7d460 2026-02-13T02:16:20.337 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2026-02-13T02:16:20.337 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '10.20.193.11', 'mon.b': '10.20.193.60', 'mon.c': '10.20.193.78'} 2026-02-13T02:16:20.338 INFO:tasks.cephadm:First mon is mon.a on trial011 2026-02-13T02:16:20.338 INFO:tasks.cephadm:First mgr is x 2026-02-13T02:16:20.338 INFO:tasks.cephadm:Normalizing hostnames... 2026-02-13T02:16:20.338 DEBUG:teuthology.orchestra.run.trial011:> sudo hostname $(hostname -s) 2026-02-13T02:16:20.366 DEBUG:teuthology.orchestra.run.trial060:> sudo hostname $(hostname -s) 2026-02-13T02:16:20.394 DEBUG:teuthology.orchestra.run.trial078:> sudo hostname $(hostname -s) 2026-02-13T02:16:20.422 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2026-02-13T02:16:20.422 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=rocky%2F10%2Fx86_64&sha1=8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-13T02:16:20.564 INFO:tasks.cephadm:builder_project result: [{'url': 'https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/rocky/10/flavors/default/', 'chacra_url': 'https://2.chacra.ceph.com/repos/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/rocky/10/flavors/default/', 'ref': 'wip-pdonnell-testing-20260210.171210', 'sha1': '8f8d38294e4db8750b4b1649f62ce37caa63080f', 'distro': 'rocky', 'distro_version': '10', 'distro_codename': None, 'modified': '2026-02-10 22:10:04.977645', 'status': 'ready', 'flavor': 'default', 'project': 'ceph', 'archs': ['source', 'x86_64'], 'extra': {'version': '20.3.0-5241-g8f8d3829', 'package_manager_version': '20.3.0-5241.g8f8d3829', 'build_url': 'https://jenkins.ceph.com/job/ceph-dev-pipeline/2911/', 'root_build_cause': '', 'node_name': '10.20.192.19+soko09', 'job_name': 'ceph-dev-pipeline'}}] 2026-02-13T02:16:20.706 INFO:tasks.util.chacra:got chacra host 2.chacra.ceph.com, ref wip-pdonnell-testing-20260210.171210, sha1 8f8d38294e4db8750b4b1649f62ce37caa63080f from https://shaman.ceph.com/api/search/?project=ceph&distros=rocky%2F10%2Fx86_64&flavor=default&sha1=8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-13T02:16:20.707 INFO:tasks.cephadm:Discovered cachra url: https://2.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/rocky/10/x86_64/flavors/default/cephadm 2026-02-13T02:16:20.707 INFO:tasks.cephadm:Downloading cephadm from url: https://2.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/rocky/10/x86_64/flavors/default/cephadm 2026-02-13T02:16:20.707 DEBUG:teuthology.orchestra.run.trial011:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/rocky/10/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2026-02-13T02:16:21.044 INFO:teuthology.orchestra.run.trial011.stdout:-rw-r--r--. 1 ubuntu ubuntu 1406305 Feb 13 02:16 /home/ubuntu/cephtest/cephadm 2026-02-13T02:16:21.045 DEBUG:teuthology.orchestra.run.trial060:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/rocky/10/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2026-02-13T02:16:21.356 INFO:teuthology.orchestra.run.trial060.stdout:-rw-r--r--. 1 ubuntu ubuntu 1406305 Feb 13 02:16 /home/ubuntu/cephtest/cephadm 2026-02-13T02:16:21.356 DEBUG:teuthology.orchestra.run.trial078:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/rocky/10/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2026-02-13T02:16:21.681 INFO:teuthology.orchestra.run.trial078.stdout:-rw-r--r--. 1 ubuntu ubuntu 1406305 Feb 13 02:16 /home/ubuntu/cephtest/cephadm 2026-02-13T02:16:21.682 DEBUG:teuthology.orchestra.run.trial011:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2026-02-13T02:16:21.703 DEBUG:teuthology.orchestra.run.trial060:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2026-02-13T02:16:21.725 DEBUG:teuthology.orchestra.run.trial078:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2026-02-13T02:16:21.767 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 on all hosts... 2026-02-13T02:16:21.767 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 pull 2026-02-13T02:16:21.769 DEBUG:teuthology.orchestra.run.trial060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 pull 2026-02-13T02:16:21.771 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 pull 2026-02-13T02:16:22.003 INFO:teuthology.orchestra.run.trial011.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10... 2026-02-13T02:16:22.006 INFO:teuthology.orchestra.run.trial060.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10... 2026-02-13T02:16:22.022 INFO:teuthology.orchestra.run.trial078.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10... 2026-02-13T02:16:32.666 INFO:teuthology.orchestra.run.trial060.stdout:{ 2026-02-13T02:16:32.666 INFO:teuthology.orchestra.run.trial060.stdout: "ceph_version": "ceph version 20.3.0-5241-g8f8d3829 (8f8d38294e4db8750b4b1649f62ce37caa63080f) tentacle (dev)", 2026-02-13T02:16:32.666 INFO:teuthology.orchestra.run.trial060.stdout: "image_id": "b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da", 2026-02-13T02:16:32.666 INFO:teuthology.orchestra.run.trial060.stdout: "repo_digests": [ 2026-02-13T02:16:32.666 INFO:teuthology.orchestra.run.trial060.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9" 2026-02-13T02:16:32.666 INFO:teuthology.orchestra.run.trial060.stdout: ] 2026-02-13T02:16:32.666 INFO:teuthology.orchestra.run.trial060.stdout:} 2026-02-13T02:16:32.705 INFO:teuthology.orchestra.run.trial078.stdout:{ 2026-02-13T02:16:32.705 INFO:teuthology.orchestra.run.trial078.stdout: "ceph_version": "ceph version 20.3.0-5241-g8f8d3829 (8f8d38294e4db8750b4b1649f62ce37caa63080f) tentacle (dev)", 2026-02-13T02:16:32.705 INFO:teuthology.orchestra.run.trial078.stdout: "image_id": "b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da", 2026-02-13T02:16:32.705 INFO:teuthology.orchestra.run.trial078.stdout: "repo_digests": [ 2026-02-13T02:16:32.706 INFO:teuthology.orchestra.run.trial078.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9" 2026-02-13T02:16:32.706 INFO:teuthology.orchestra.run.trial078.stdout: ] 2026-02-13T02:16:32.706 INFO:teuthology.orchestra.run.trial078.stdout:} 2026-02-13T02:16:32.742 INFO:teuthology.orchestra.run.trial011.stdout:{ 2026-02-13T02:16:32.742 INFO:teuthology.orchestra.run.trial011.stdout: "ceph_version": "ceph version 20.3.0-5241-g8f8d3829 (8f8d38294e4db8750b4b1649f62ce37caa63080f) tentacle (dev)", 2026-02-13T02:16:32.742 INFO:teuthology.orchestra.run.trial011.stdout: "image_id": "b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da", 2026-02-13T02:16:32.743 INFO:teuthology.orchestra.run.trial011.stdout: "repo_digests": [ 2026-02-13T02:16:32.743 INFO:teuthology.orchestra.run.trial011.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9" 2026-02-13T02:16:32.743 INFO:teuthology.orchestra.run.trial011.stdout: ] 2026-02-13T02:16:32.743 INFO:teuthology.orchestra.run.trial011.stdout:} 2026-02-13T02:16:32.758 DEBUG:teuthology.orchestra.run.trial011:> sudo mkdir -p /etc/ceph 2026-02-13T02:16:32.821 DEBUG:teuthology.orchestra.run.trial060:> sudo mkdir -p /etc/ceph 2026-02-13T02:16:32.853 DEBUG:teuthology.orchestra.run.trial078:> sudo mkdir -p /etc/ceph 2026-02-13T02:16:32.886 DEBUG:teuthology.orchestra.run.trial011:> sudo chmod 777 /etc/ceph 2026-02-13T02:16:32.915 DEBUG:teuthology.orchestra.run.trial060:> sudo chmod 777 /etc/ceph 2026-02-13T02:16:32.945 DEBUG:teuthology.orchestra.run.trial078:> sudo chmod 777 /etc/ceph 2026-02-13T02:16:32.971 INFO:tasks.cephadm:Writing seed config... 2026-02-13T02:16:32.972 INFO:tasks.cephadm: override: [client] client_fscrypt_dummy_encryption = True 2026-02-13T02:16:32.972 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2026-02-13T02:16:32.972 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2026-02-13T02:16:32.972 INFO:tasks.cephadm: override: [mds] mds_export_ephemeral_random_max = 0.2 2026-02-13T02:16:32.972 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2026-02-13T02:16:32.972 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2026-02-13T02:16:32.973 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2026-02-13T02:16:32.973 INFO:tasks.cephadm: override: [mon] debug mon = 20 2026-02-13T02:16:32.973 INFO:tasks.cephadm: override: [mon] debug ms = 1 2026-02-13T02:16:32.973 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2026-02-13T02:16:32.973 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2026-02-13T02:16:32.973 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2026-02-13T02:16:32.973 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2026-02-13T02:16:32.973 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2026-02-13T02:16:32.973 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2026-02-13T02:16:32.973 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2026-02-13T02:16:32.973 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2026-02-13T02:16:32.973 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2026-02-13T02:16:32.973 INFO:tasks.cephadm: override: [osd] debug ms = 1 2026-02-13T02:16:32.973 INFO:tasks.cephadm: override: [osd] debug osd = 20 2026-02-13T02:16:32.973 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2026-02-13T02:16:32.973 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2026-02-13T02:16:32.973 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2026-02-13T02:16:32.973 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2026-02-13T02:16:32.973 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2026-02-13T02:16:32.973 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2026-02-13T02:16:32.973 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2026-02-13T02:16:32.973 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2026-02-13T02:16:32.973 DEBUG:teuthology.orchestra.run.trial011:> set -ex 2026-02-13T02:16:32.973 DEBUG:teuthology.orchestra.run.trial011:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2026-02-13T02:16:32.990 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = fc631695-0881-11f1-899c-d404e6e7d460 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd mclock skip benchmark = true osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client_fscrypt_dummy_encryption = True [mds] mds_bal_replicate_threshold = 1 mds_export_ephemeral_random_max = 0.2 2026-02-13T02:16:32.990 DEBUG:teuthology.orchestra.run.trial011:mon.a> sudo journalctl -f -n 0 -u ceph-fc631695-0881-11f1-899c-d404e6e7d460@mon.a.service 2026-02-13T02:16:33.033 DEBUG:teuthology.orchestra.run.trial011:mgr.x> sudo journalctl -f -n 0 -u ceph-fc631695-0881-11f1-899c-d404e6e7d460@mgr.x.service 2026-02-13T02:16:33.075 INFO:tasks.cephadm:Bootstrapping... 2026-02-13T02:16:33.076 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 -v bootstrap --fsid fc631695-0881-11f1-899c-d404e6e7d460 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 10.20.193.11 --skip-dashboard --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2026-02-13T02:16:33.221 INFO:teuthology.orchestra.run.trial011.stdout:-------------------------------------------------------------------------------- 2026-02-13T02:16:33.221 INFO:teuthology.orchestra.run.trial011.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', '-v', 'bootstrap', '--fsid', 'fc631695-0881-11f1-899c-d404e6e7d460', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '10.20.193.11', '--skip-dashboard', '--skip-admin-label'] 2026-02-13T02:16:33.222 INFO:teuthology.orchestra.run.trial011.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2026-02-13T02:16:33.223 INFO:teuthology.orchestra.run.trial011.stdout:Verifying podman|docker is present... 2026-02-13T02:16:33.236 INFO:teuthology.orchestra.run.trial011.stdout:/bin/podman: stdout 5.6.0 2026-02-13T02:16:33.236 INFO:teuthology.orchestra.run.trial011.stdout:Verifying lvm2 is present... 2026-02-13T02:16:33.236 INFO:teuthology.orchestra.run.trial011.stdout:Verifying time synchronization is in place... 2026-02-13T02:16:33.241 INFO:teuthology.orchestra.run.trial011.stdout:Non-zero exit code 4 from systemctl is-enabled chrony.service 2026-02-13T02:16:33.241 INFO:teuthology.orchestra.run.trial011.stdout:systemctl: stdout not-found 2026-02-13T02:16:33.245 INFO:teuthology.orchestra.run.trial011.stdout:Non-zero exit code 4 from systemctl is-active chrony.service 2026-02-13T02:16:33.245 INFO:teuthology.orchestra.run.trial011.stdout:systemctl: stdout inactive 2026-02-13T02:16:33.250 INFO:teuthology.orchestra.run.trial011.stdout:systemctl: stdout enabled 2026-02-13T02:16:33.254 INFO:teuthology.orchestra.run.trial011.stdout:systemctl: stdout active 2026-02-13T02:16:33.254 INFO:teuthology.orchestra.run.trial011.stdout:Unit chronyd.service is enabled and running 2026-02-13T02:16:33.254 INFO:teuthology.orchestra.run.trial011.stdout:Repeating the final host check... 2026-02-13T02:16:33.268 INFO:teuthology.orchestra.run.trial011.stdout:/bin/podman: stdout 5.6.0 2026-02-13T02:16:33.268 INFO:teuthology.orchestra.run.trial011.stdout:podman (/bin/podman) version 5.6.0 is present 2026-02-13T02:16:33.268 INFO:teuthology.orchestra.run.trial011.stdout:systemctl is present 2026-02-13T02:16:33.269 INFO:teuthology.orchestra.run.trial011.stdout:lvcreate is present 2026-02-13T02:16:33.272 INFO:teuthology.orchestra.run.trial011.stdout:Non-zero exit code 4 from systemctl is-enabled chrony.service 2026-02-13T02:16:33.272 INFO:teuthology.orchestra.run.trial011.stdout:systemctl: stdout not-found 2026-02-13T02:16:33.276 INFO:teuthology.orchestra.run.trial011.stdout:Non-zero exit code 4 from systemctl is-active chrony.service 2026-02-13T02:16:33.276 INFO:teuthology.orchestra.run.trial011.stdout:systemctl: stdout inactive 2026-02-13T02:16:33.280 INFO:teuthology.orchestra.run.trial011.stdout:systemctl: stdout enabled 2026-02-13T02:16:33.285 INFO:teuthology.orchestra.run.trial011.stdout:systemctl: stdout active 2026-02-13T02:16:33.285 INFO:teuthology.orchestra.run.trial011.stdout:Unit chronyd.service is enabled and running 2026-02-13T02:16:33.285 INFO:teuthology.orchestra.run.trial011.stdout:Host looks OK 2026-02-13T02:16:33.285 INFO:teuthology.orchestra.run.trial011.stdout:Cluster fsid: fc631695-0881-11f1-899c-d404e6e7d460 2026-02-13T02:16:33.285 INFO:teuthology.orchestra.run.trial011.stdout:Acquiring lock 140064984951904 on /run/cephadm/fc631695-0881-11f1-899c-d404e6e7d460.lock 2026-02-13T02:16:33.285 INFO:teuthology.orchestra.run.trial011.stdout:Lock 140064984951904 acquired on /run/cephadm/fc631695-0881-11f1-899c-d404e6e7d460.lock 2026-02-13T02:16:33.285 INFO:teuthology.orchestra.run.trial011.stdout:Verifying IP 10.20.193.11 port 3300 ... 2026-02-13T02:16:33.285 INFO:teuthology.orchestra.run.trial011.stdout:Verifying IP 10.20.193.11 port 6789 ... 2026-02-13T02:16:33.285 INFO:teuthology.orchestra.run.trial011.stdout:Base mon IP(s) is [10.20.193.11:3300, 10.20.193.11:6789], mon addrv is [v2:10.20.193.11:3300,v1:10.20.193.11:6789] 2026-02-13T02:16:33.287 INFO:teuthology.orchestra.run.trial011.stdout:/sbin/ip: stdout default via 10.20.192.1 dev enp1s0f0np0 proto dhcp src 10.20.193.11 metric 102 2026-02-13T02:16:33.287 INFO:teuthology.orchestra.run.trial011.stdout:/sbin/ip: stdout 10.20.192.0/20 dev enp1s0f0np0 proto kernel scope link src 10.20.193.11 metric 102 2026-02-13T02:16:33.287 INFO:teuthology.orchestra.run.trial011.stdout:/sbin/ip: stdout 169.254.3.0/24 dev enp7s0f4u2u2c2 proto kernel scope link src 169.254.3.1 metric 101 2026-02-13T02:16:33.287 INFO:teuthology.orchestra.run.trial011.stdout:/sbin/ip: stdout fe80::/64 dev enp1s0f0np0 proto kernel metric 256 pref medium 2026-02-13T02:16:33.288 INFO:teuthology.orchestra.run.trial011.stdout:/sbin/ip: stdout fe80::/64 dev enp7s0f4u2u2c2 proto kernel metric 1024 pref medium 2026-02-13T02:16:33.290 INFO:teuthology.orchestra.run.trial011.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2026-02-13T02:16:33.290 INFO:teuthology.orchestra.run.trial011.stdout:/sbin/ip: stdout inet6 ::1/128 scope host noprefixroute 2026-02-13T02:16:33.290 INFO:teuthology.orchestra.run.trial011.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-02-13T02:16:33.290 INFO:teuthology.orchestra.run.trial011.stdout:/sbin/ip: stdout 2: enp7s0f4u2u2c2: mtu 1500 state UNKNOWN qlen 1000 2026-02-13T02:16:33.290 INFO:teuthology.orchestra.run.trial011.stdout:/sbin/ip: stdout inet6 fe80::bc3a:f2ff:feb6:59f/64 scope link noprefixroute 2026-02-13T02:16:33.290 INFO:teuthology.orchestra.run.trial011.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-02-13T02:16:33.290 INFO:teuthology.orchestra.run.trial011.stdout:/sbin/ip: stdout 3: enp1s0f0np0: mtu 1500 state UP qlen 1000 2026-02-13T02:16:33.290 INFO:teuthology.orchestra.run.trial011.stdout:/sbin/ip: stdout inet6 fe80::925a:8ff:fe77:5e5e/64 scope link proto kernel_ll 2026-02-13T02:16:33.290 INFO:teuthology.orchestra.run.trial011.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-02-13T02:16:33.290 INFO:teuthology.orchestra.run.trial011.stdout:Mon IP `10.20.193.11` is in CIDR network `10.20.192.0/20` 2026-02-13T02:16:33.291 INFO:teuthology.orchestra.run.trial011.stdout:Mon IP `10.20.193.11` is in CIDR network `10.20.192.0/20` 2026-02-13T02:16:33.291 INFO:teuthology.orchestra.run.trial011.stdout:Inferred mon public CIDR from local network configuration ['10.20.192.0/20', '10.20.192.0/20'] 2026-02-13T02:16:33.291 INFO:teuthology.orchestra.run.trial011.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2026-02-13T02:16:33.291 INFO:teuthology.orchestra.run.trial011.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10... 2026-02-13T02:16:33.521 INFO:teuthology.orchestra.run.trial011.stdout:/bin/podman: stdout b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da 2026-02-13T02:16:33.521 INFO:teuthology.orchestra.run.trial011.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10... 2026-02-13T02:16:33.521 INFO:teuthology.orchestra.run.trial011.stdout:/bin/podman: stderr Getting image source signatures 2026-02-13T02:16:33.521 INFO:teuthology.orchestra.run.trial011.stdout:/bin/podman: stderr Copying blob sha256:0c53e9fad0324c188a40a9b1e0ca4eb777da2812507ec104055fa6ec400d9a27 2026-02-13T02:16:33.521 INFO:teuthology.orchestra.run.trial011.stdout:/bin/podman: stderr Copying blob sha256:9b7325f35ad40fc8a795fce82955bc486ff370c187eaa160f4df65d0fb22f2a2 2026-02-13T02:16:33.521 INFO:teuthology.orchestra.run.trial011.stdout:/bin/podman: stderr Copying config sha256:b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da 2026-02-13T02:16:33.521 INFO:teuthology.orchestra.run.trial011.stdout:/bin/podman: stderr Writing manifest to image destination 2026-02-13T02:16:33.634 INFO:teuthology.orchestra.run.trial011.stdout:ceph: stdout ceph version 20.3.0-5241-g8f8d3829 (8f8d38294e4db8750b4b1649f62ce37caa63080f) tentacle (dev) 2026-02-13T02:16:33.634 INFO:teuthology.orchestra.run.trial011.stdout:Ceph version: ceph version 20.3.0-5241-g8f8d3829 (8f8d38294e4db8750b4b1649f62ce37caa63080f) tentacle (dev) 2026-02-13T02:16:33.634 INFO:teuthology.orchestra.run.trial011.stdout:Extracting ceph user uid/gid from container image... 2026-02-13T02:16:33.756 INFO:teuthology.orchestra.run.trial011.stdout:stat: stdout 167 167 2026-02-13T02:16:33.756 INFO:teuthology.orchestra.run.trial011.stdout:Creating initial keys... 2026-02-13T02:16:33.853 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph-authtool: stdout AQCBiY5pMpAqMhAAnfLd5ypJFg0rUHkL2f0S1w== 2026-02-13T02:16:33.970 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph-authtool: stdout AQCBiY5pt18tORAAd6RpvPwqb71eSGucq04eXQ== 2026-02-13T02:16:34.060 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph-authtool: stdout AQCCiY5pV7DrAhAAkwci56veLxe+moKnDvwjuw== 2026-02-13T02:16:34.060 INFO:teuthology.orchestra.run.trial011.stdout:Creating initial monmap... 2026-02-13T02:16:34.161 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2026-02-13T02:16:34.162 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = tentacle 2026-02-13T02:16:34.162 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to fc631695-0881-11f1-899c-d404e6e7d460 2026-02-13T02:16:34.162 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2026-02-13T02:16:34.162 INFO:teuthology.orchestra.run.trial011.stdout:monmaptool for a [v2:10.20.193.11:3300,v1:10.20.193.11:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2026-02-13T02:16:34.162 INFO:teuthology.orchestra.run.trial011.stdout:setting min_mon_release = tentacle 2026-02-13T02:16:34.162 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/monmaptool: set fsid to fc631695-0881-11f1-899c-d404e6e7d460 2026-02-13T02:16:34.162 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2026-02-13T02:16:34.162 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:16:34.162 INFO:teuthology.orchestra.run.trial011.stdout:Creating mon... 2026-02-13T02:16:34.257 INFO:teuthology.orchestra.run.trial011.stdout:create mon.a on 2026-02-13T02:16:34.458 INFO:teuthology.orchestra.run.trial011.stdout:systemctl: stderr Removed '/etc/systemd/system/multi-user.target.wants/ceph.target'. 2026-02-13T02:16:34.582 INFO:teuthology.orchestra.run.trial011.stdout:systemctl: stderr Created symlink '/etc/systemd/system/multi-user.target.wants/ceph.target' → '/etc/systemd/system/ceph.target'. 2026-02-13T02:16:34.711 INFO:teuthology.orchestra.run.trial011.stdout:systemctl: stderr Created symlink '/etc/systemd/system/multi-user.target.wants/ceph-fc631695-0881-11f1-899c-d404e6e7d460.target' → '/etc/systemd/system/ceph-fc631695-0881-11f1-899c-d404e6e7d460.target'. 2026-02-13T02:16:34.712 INFO:teuthology.orchestra.run.trial011.stdout:systemctl: stderr Created symlink '/etc/systemd/system/ceph.target.wants/ceph-fc631695-0881-11f1-899c-d404e6e7d460.target' → '/etc/systemd/system/ceph-fc631695-0881-11f1-899c-d404e6e7d460.target'. 2026-02-13T02:16:34.872 INFO:teuthology.orchestra.run.trial011.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-fc631695-0881-11f1-899c-d404e6e7d460@mon.a 2026-02-13T02:16:34.872 INFO:teuthology.orchestra.run.trial011.stdout:systemctl: stderr Failed to reset failed state of unit ceph-fc631695-0881-11f1-899c-d404e6e7d460@mon.a.service: Unit ceph-fc631695-0881-11f1-899c-d404e6e7d460@mon.a.service not loaded. 2026-02-13T02:16:35.019 INFO:teuthology.orchestra.run.trial011.stdout:systemctl: stderr Created symlink '/etc/systemd/system/ceph-fc631695-0881-11f1-899c-d404e6e7d460.target.wants/ceph-fc631695-0881-11f1-899c-d404e6e7d460@mon.a.service' → '/etc/systemd/system/ceph-fc631695-0881-11f1-899c-d404e6e7d460@.service'. 2026-02-13T02:16:35.117 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:35 trial011 systemd[1]: Starting ceph-fc631695-0881-11f1-899c-d404e6e7d460@mon.a.service - Ceph mon.a for fc631695-0881-11f1-899c-d404e6e7d460... 2026-02-13T02:16:35.166 INFO:teuthology.orchestra.run.trial011.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-13T02:16:35.166 INFO:teuthology.orchestra.run.trial011.stdout:systemctl: stdout disabled 2026-02-13T02:16:35.171 INFO:teuthology.orchestra.run.trial011.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-13T02:16:35.172 INFO:teuthology.orchestra.run.trial011.stdout:systemctl: stdout inactive 2026-02-13T02:16:35.172 INFO:teuthology.orchestra.run.trial011.stdout:firewalld.service is not enabled 2026-02-13T02:16:35.172 INFO:teuthology.orchestra.run.trial011.stdout:Not possible to enable service . firewalld.service is not available 2026-02-13T02:16:35.172 INFO:teuthology.orchestra.run.trial011.stdout:Waiting for mon to start... 2026-02-13T02:16:35.172 INFO:teuthology.orchestra.run.trial011.stdout:Waiting for mon... 2026-02-13T02:16:35.334 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout cluster: 2026-02-13T02:16:35.334 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout id: fc631695-0881-11f1-899c-d404e6e7d460 2026-02-13T02:16:35.334 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2026-02-13T02:16:35.334 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout 2026-02-13T02:16:35.334 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout services: 2026-02-13T02:16:35.334 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.138285s) [leader: a] 2026-02-13T02:16:35.334 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2026-02-13T02:16:35.334 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2026-02-13T02:16:35.334 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout 2026-02-13T02:16:35.334 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout data: 2026-02-13T02:16:35.334 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2026-02-13T02:16:35.334 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2026-02-13T02:16:35.334 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2026-02-13T02:16:35.334 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout pgs: 2026-02-13T02:16:35.334 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout 2026-02-13T02:16:35.334 INFO:teuthology.orchestra.run.trial011.stdout:mon is available 2026-02-13T02:16:35.334 INFO:teuthology.orchestra.run.trial011.stdout:Assimilating anything we can from ceph.conf... 2026-02-13T02:16:35.380 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:35 trial011 podman[11513]: 2026-02-13 02:16:35.116543058 +0000 UTC m=+0.015457603 container create 3f9079420c40164733f47a756b46624d5ea505100c5414421407b89993ee5536 (image=quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10, name=ceph-fc631695-0881-11f1-899c-d404e6e7d460-mon-a, vendor=Rocky Enterprise Software Foundation, ceph=True, OSD_FLAVOR=default, summary=Rocky Linux Base image, license=BSD-3-Clause, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.licenses=BSD-3-Clause, version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.title=rockylinux, org.opencontainers.image.authors=Ceph Release Team , name=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, io.buildah.version=1.33.7) 2026-02-13T02:16:35.380 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:35 trial011 podman[11513]: 2026-02-13 02:16:35.152164206 +0000 UTC m=+0.051078751 container init 3f9079420c40164733f47a756b46624d5ea505100c5414421407b89993ee5536 (image=quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10, name=ceph-fc631695-0881-11f1-899c-d404e6e7d460-mon-a, summary=Rocky Linux Base image, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.title=rockylinux, io.buildah.version=1.33.7, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, vendor=Rocky Enterprise Software Foundation, ceph=True, org.opencontainers.image.licenses=BSD-3-Clause, license=BSD-3-Clause, name=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, OSD_FLAVOR=default) 2026-02-13T02:16:35.380 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:35 trial011 podman[11513]: 2026-02-13 02:16:35.153950425 +0000 UTC m=+0.052864970 container start 3f9079420c40164733f47a756b46624d5ea505100c5414421407b89993ee5536 (image=quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10, name=ceph-fc631695-0881-11f1-899c-d404e6e7d460-mon-a, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.title=rockylinux, ceph=True, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, license=BSD-3-Clause, vendor=Rocky Enterprise Software Foundation, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, version=10, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.33.7, org.opencontainers.image.version=10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.documentation=https://docs.ceph.com/, summary=Rocky Linux Base image, name=rockylinux, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10) 2026-02-13T02:16:35.380 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:35 trial011 bash[11513]: 3f9079420c40164733f47a756b46624d5ea505100c5414421407b89993ee5536 2026-02-13T02:16:35.380 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:35 trial011 podman[11513]: 2026-02-13 02:16:35.10966662 +0000 UTC m=+0.008581175 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 2026-02-13T02:16:35.381 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:35 trial011 systemd[1]: Started ceph-fc631695-0881-11f1-899c-d404e6e7d460@mon.a.service - Ceph mon.a for fc631695-0881-11f1-899c-d404e6e7d460. 2026-02-13T02:16:35.381 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:35 trial011 ceph-mon[11539]: mkfs fc631695-0881-11f1-899c-d404e6e7d460 2026-02-13T02:16:35.381 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:35 trial011 ceph-mon[11539]: mon.a is new leader, mons a in quorum (ranks 0) 2026-02-13T02:16:35.499 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout 2026-02-13T02:16:35.499 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout [global] 2026-02-13T02:16:35.499 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout fsid = fc631695-0881-11f1-899c-d404e6e7d460 2026-02-13T02:16:35.499 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2026-02-13T02:16:35.500 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout mon_host = [v2:10.20.193.11:3300,v1:10.20.193.11:6789] 2026-02-13T02:16:35.500 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2026-02-13T02:16:35.500 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2026-02-13T02:16:35.500 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2026-02-13T02:16:35.500 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2026-02-13T02:16:35.500 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout 2026-02-13T02:16:35.500 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout [mgr] 2026-02-13T02:16:35.500 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2026-02-13T02:16:35.500 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout 2026-02-13T02:16:35.500 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout [osd] 2026-02-13T02:16:35.500 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2026-02-13T02:16:35.500 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2026-02-13T02:16:35.501 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2026-02-13T02:16:35.501 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2026-02-13T02:16:35.501 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2026-02-13T02:16:35.501 INFO:teuthology.orchestra.run.trial011.stdout:Generating new minimal ceph.conf... 2026-02-13T02:16:35.655 INFO:teuthology.orchestra.run.trial011.stdout:Restarting the monitor... 2026-02-13T02:16:35.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:35 trial011 systemd[1]: Stopping ceph-fc631695-0881-11f1-899c-d404e6e7d460@mon.a.service - Ceph mon.a for fc631695-0881-11f1-899c-d404e6e7d460... 2026-02-13T02:16:35.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:35 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mon-a[11535]: 2026-02-13T02:16:35.729+0000 7f00ab55d6c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T02:16:35.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:35 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mon-a[11535]: 2026-02-13T02:16:35.729+0000 7f00ab55d6c0 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2026-02-13T02:16:36.203 INFO:teuthology.orchestra.run.trial011.stdout:Setting public_network to 10.20.192.0/20 in global config section 2026-02-13T02:16:36.256 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:35 trial011 podman[11803]: 2026-02-13 02:16:35.993016633 +0000 UTC m=+0.275203099 container died 3f9079420c40164733f47a756b46624d5ea505100c5414421407b89993ee5536 (image=quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10, name=ceph-fc631695-0881-11f1-899c-d404e6e7d460-mon-a, summary=Rocky Linux Base image, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, vendor=Rocky Enterprise Software Foundation, name=rockylinux, ceph=True, license=BSD-3-Clause, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.licenses=BSD-3-Clause, version=10, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, io.buildah.version=1.33.7, org.opencontainers.image.title=rockylinux, org.opencontainers.image.version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f) 2026-02-13T02:16:36.256 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 podman[11803]: 2026-02-13 02:16:36.001619348 +0000 UTC m=+0.283805814 container remove 3f9079420c40164733f47a756b46624d5ea505100c5414421407b89993ee5536 (image=quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10, name=ceph-fc631695-0881-11f1-899c-d404e6e7d460-mon-a, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, license=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, name=rockylinux, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, org.opencontainers.image.title=rockylinux, summary=Rocky Linux Base image, vendor=Rocky Enterprise Software Foundation, version=10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, OSD_FLAVOR=default, io.buildah.version=1.33.7, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-13T02:16:36.257 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 bash[11803]: ceph-fc631695-0881-11f1-899c-d404e6e7d460-mon-a 2026-02-13T02:16:36.257 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 systemd[1]: ceph-fc631695-0881-11f1-899c-d404e6e7d460@mon.a.service: Deactivated successfully. 2026-02-13T02:16:36.257 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 systemd[1]: Stopped ceph-fc631695-0881-11f1-899c-d404e6e7d460@mon.a.service - Ceph mon.a for fc631695-0881-11f1-899c-d404e6e7d460. 2026-02-13T02:16:36.257 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 systemd[1]: Starting ceph-fc631695-0881-11f1-899c-d404e6e7d460@mon.a.service - Ceph mon.a for fc631695-0881-11f1-899c-d404e6e7d460... 2026-02-13T02:16:36.257 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 podman[11929]: 2026-02-13 02:16:36.158788265 +0000 UTC m=+0.014556949 container create bc53aa190b982d53d26771b1bd5ccbe285fdd7f8a98d53a2c069204189e194cc (image=quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10, name=ceph-fc631695-0881-11f1-899c-d404e6e7d460-mon-a, OSD_FLAVOR=default, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.version=10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, license=BSD-3-Clause, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.title=rockylinux, ceph=True, name=rockylinux, org.opencontainers.image.documentation=https://docs.ceph.com/, io.buildah.version=1.33.7, CEPH_REF=wip-pdonnell-testing-20260210.171210, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, summary=Rocky Linux Base image, version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10) 2026-02-13T02:16:36.257 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 podman[11929]: 2026-02-13 02:16:36.195695042 +0000 UTC m=+0.051463726 container init bc53aa190b982d53d26771b1bd5ccbe285fdd7f8a98d53a2c069204189e194cc (image=quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10, name=ceph-fc631695-0881-11f1-899c-d404e6e7d460-mon-a, OSD_FLAVOR=default, org.opencontainers.image.title=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, ceph=True, name=rockylinux, org.opencontainers.image.version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.33.7, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, vendor=Rocky Enterprise Software Foundation, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, license=BSD-3-Clause, org.opencontainers.image.licenses=BSD-3-Clause, summary=Rocky Linux Base image, version=10, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10) 2026-02-13T02:16:36.257 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 podman[11929]: 2026-02-13 02:16:36.19783082 +0000 UTC m=+0.053599494 container start bc53aa190b982d53d26771b1bd5ccbe285fdd7f8a98d53a2c069204189e194cc (image=quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10, name=ceph-fc631695-0881-11f1-899c-d404e6e7d460-mon-a, CEPH_REF=wip-pdonnell-testing-20260210.171210, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, vendor=Rocky Enterprise Software Foundation, license=BSD-3-Clause, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, name=rockylinux, io.buildah.version=1.33.7, OSD_FLAVOR=default, org.opencontainers.image.title=rockylinux, summary=Rocky Linux Base image, version=10, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.version=10, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-13T02:16:36.257 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 bash[11929]: bc53aa190b982d53d26771b1bd5ccbe285fdd7f8a98d53a2c069204189e194cc 2026-02-13T02:16:36.257 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 podman[11929]: 2026-02-13 02:16:36.153003336 +0000 UTC m=+0.008772020 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 2026-02-13T02:16:36.257 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 systemd[1]: Started ceph-fc631695-0881-11f1-899c-d404e6e7d460@mon.a.service - Ceph mon.a for fc631695-0881-11f1-899c-d404e6e7d460. 2026-02-13T02:16:36.257 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: set uid:gid to 167:167 (ceph:ceph) 2026-02-13T02:16:36.258 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: ceph version 20.3.0-5241-g8f8d3829 (8f8d38294e4db8750b4b1649f62ce37caa63080f) tentacle (dev - RelWithDebInfo), process ceph-mon, pid 2 2026-02-13T02:16:36.258 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: pidfile_write: ignore empty --pid-file 2026-02-13T02:16:36.258 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: load: jerasure load: lrc 2026-02-13T02:16:36.258 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: RocksDB version: 7.9.2 2026-02-13T02:16:36.258 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Git sha 0 2026-02-13T02:16:36.258 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Compile date 2026-02-10 21:31:46 2026-02-13T02:16:36.258 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: DB SUMMARY 2026-02-13T02:16:36.258 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: DB Session ID: D30VKH9L77T5JW64KWTK 2026-02-13T02:16:36.258 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: CURRENT file: CURRENT 2026-02-13T02:16:36.258 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: IDENTITY file: IDENTITY 2026-02-13T02:16:36.258 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2026-02-13T02:16:36.258 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2026-02-13T02:16:36.258 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 84725 ; 2026-02-13T02:16:36.259 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.error_if_exists: 0 2026-02-13T02:16:36.259 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.create_if_missing: 0 2026-02-13T02:16:36.259 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.paranoid_checks: 1 2026-02-13T02:16:36.259 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.flush_verify_memtable_count: 1 2026-02-13T02:16:36.259 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2026-02-13T02:16:36.259 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2026-02-13T02:16:36.259 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.env: 0x556f2704c2c0 2026-02-13T02:16:36.259 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.fs: PosixFileSystem 2026-02-13T02:16:36.259 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.info_log: 0x556f6706cd60 2026-02-13T02:16:36.259 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.max_file_opening_threads: 16 2026-02-13T02:16:36.259 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.statistics: (nil) 2026-02-13T02:16:36.259 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.use_fsync: 0 2026-02-13T02:16:36.259 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.max_log_file_size: 0 2026-02-13T02:16:36.260 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.max_manifest_file_size: 1073741824 2026-02-13T02:16:36.260 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.log_file_time_to_roll: 0 2026-02-13T02:16:36.260 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.keep_log_file_num: 1000 2026-02-13T02:16:36.260 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.recycle_log_file_num: 0 2026-02-13T02:16:36.260 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.allow_fallocate: 1 2026-02-13T02:16:36.260 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.allow_mmap_reads: 0 2026-02-13T02:16:36.260 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.allow_mmap_writes: 0 2026-02-13T02:16:36.260 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.use_direct_reads: 0 2026-02-13T02:16:36.260 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2026-02-13T02:16:36.260 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.create_missing_column_families: 0 2026-02-13T02:16:36.260 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.db_log_dir: 2026-02-13T02:16:36.260 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.wal_dir: 2026-02-13T02:16:36.260 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.table_cache_numshardbits: 6 2026-02-13T02:16:36.261 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.WAL_ttl_seconds: 0 2026-02-13T02:16:36.261 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.WAL_size_limit_MB: 0 2026-02-13T02:16:36.261 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2026-02-13T02:16:36.261 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.manifest_preallocation_size: 4194304 2026-02-13T02:16:36.261 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.is_fd_close_on_exec: 1 2026-02-13T02:16:36.261 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.advise_random_on_open: 1 2026-02-13T02:16:36.261 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.db_write_buffer_size: 0 2026-02-13T02:16:36.261 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.write_buffer_manager: 0x556f67063b80 2026-02-13T02:16:36.261 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.access_hint_on_compaction_start: 1 2026-02-13T02:16:36.261 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.random_access_max_buffer_size: 1048576 2026-02-13T02:16:36.261 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.use_adaptive_mutex: 0 2026-02-13T02:16:36.261 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.rate_limiter: (nil) 2026-02-13T02:16:36.262 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2026-02-13T02:16:36.262 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.wal_recovery_mode: 2 2026-02-13T02:16:36.262 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.enable_thread_tracking: 0 2026-02-13T02:16:36.262 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.enable_pipelined_write: 0 2026-02-13T02:16:36.262 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.unordered_write: 0 2026-02-13T02:16:36.262 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.allow_concurrent_memtable_write: 1 2026-02-13T02:16:36.262 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2026-02-13T02:16:36.262 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.write_thread_max_yield_usec: 100 2026-02-13T02:16:36.262 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.write_thread_slow_yield_usec: 3 2026-02-13T02:16:36.262 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.row_cache: None 2026-02-13T02:16:36.262 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.wal_filter: None 2026-02-13T02:16:36.262 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.avoid_flush_during_recovery: 0 2026-02-13T02:16:36.262 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.allow_ingest_behind: 0 2026-02-13T02:16:36.262 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.two_write_queues: 0 2026-02-13T02:16:36.263 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.manual_wal_flush: 0 2026-02-13T02:16:36.263 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.wal_compression: 0 2026-02-13T02:16:36.263 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.atomic_flush: 0 2026-02-13T02:16:36.263 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2026-02-13T02:16:36.263 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.persist_stats_to_disk: 0 2026-02-13T02:16:36.263 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.write_dbid_to_manifest: 0 2026-02-13T02:16:36.263 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.log_readahead_size: 0 2026-02-13T02:16:36.263 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.file_checksum_gen_factory: Unknown 2026-02-13T02:16:36.263 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.best_efforts_recovery: 0 2026-02-13T02:16:36.263 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2026-02-13T02:16:36.263 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2026-02-13T02:16:36.263 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.allow_data_in_errors: 0 2026-02-13T02:16:36.263 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.db_host_id: __hostname__ 2026-02-13T02:16:36.263 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.enforce_single_del_contracts: true 2026-02-13T02:16:36.264 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.max_background_jobs: 2 2026-02-13T02:16:36.264 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.max_background_compactions: -1 2026-02-13T02:16:36.264 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.max_subcompactions: 1 2026-02-13T02:16:36.264 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.avoid_flush_during_shutdown: 0 2026-02-13T02:16:36.264 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2026-02-13T02:16:36.264 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.delayed_write_rate : 16777216 2026-02-13T02:16:36.264 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.max_total_wal_size: 0 2026-02-13T02:16:36.264 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2026-02-13T02:16:36.264 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.stats_dump_period_sec: 600 2026-02-13T02:16:36.264 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.stats_persist_period_sec: 600 2026-02-13T02:16:36.264 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.stats_history_buffer_size: 1048576 2026-02-13T02:16:36.264 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.max_open_files: -1 2026-02-13T02:16:36.264 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.bytes_per_sync: 0 2026-02-13T02:16:36.265 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.wal_bytes_per_sync: 0 2026-02-13T02:16:36.265 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.strict_bytes_per_sync: 0 2026-02-13T02:16:36.265 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.compaction_readahead_size: 0 2026-02-13T02:16:36.265 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.max_background_flushes: -1 2026-02-13T02:16:36.265 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Compression algorithms supported: 2026-02-13T02:16:36.265 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: kZSTD supported: 0 2026-02-13T02:16:36.265 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: kXpressCompression supported: 0 2026-02-13T02:16:36.265 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: kBZip2Compression supported: 0 2026-02-13T02:16:36.265 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: kZSTDNotFinalCompression supported: 0 2026-02-13T02:16:36.265 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: kLZ4Compression supported: 1 2026-02-13T02:16:36.265 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: kZlibCompression supported: 1 2026-02-13T02:16:36.265 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: kLZ4HCCompression supported: 1 2026-02-13T02:16:36.266 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: kSnappyCompression supported: 1 2026-02-13T02:16:36.266 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Fast CRC32 supported: Supported on x86 2026-02-13T02:16:36.266 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: DMutex implementation: pthread_mutex_t 2026-02-13T02:16:36.266 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2026-02-13T02:16:36.266 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2026-02-13T02:16:36.266 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2026-02-13T02:16:36.266 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.merge_operator: 2026-02-13T02:16:36.266 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.compaction_filter: None 2026-02-13T02:16:36.266 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.compaction_filter_factory: None 2026-02-13T02:16:36.266 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.sst_partitioner_factory: None 2026-02-13T02:16:36.266 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.memtable_factory: SkipListFactory 2026-02-13T02:16:36.266 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.table_factory: BlockBasedTable 2026-02-13T02:16:36.266 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x556f671ec360) 2026-02-13T02:16:36.267 INFO:journalctl@ceph.mon.a.trial011.stdout: cache_index_and_filter_blocks: 1 2026-02-13T02:16:36.267 INFO:journalctl@ceph.mon.a.trial011.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2026-02-13T02:16:36.267 INFO:journalctl@ceph.mon.a.trial011.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2026-02-13T02:16:36.267 INFO:journalctl@ceph.mon.a.trial011.stdout: pin_top_level_index_and_filter: 1 2026-02-13T02:16:36.267 INFO:journalctl@ceph.mon.a.trial011.stdout: index_type: 0 2026-02-13T02:16:36.267 INFO:journalctl@ceph.mon.a.trial011.stdout: data_block_index_type: 0 2026-02-13T02:16:36.267 INFO:journalctl@ceph.mon.a.trial011.stdout: index_shortening: 1 2026-02-13T02:16:36.267 INFO:journalctl@ceph.mon.a.trial011.stdout: data_block_hash_table_util_ratio: 0.750000 2026-02-13T02:16:36.267 INFO:journalctl@ceph.mon.a.trial011.stdout: checksum: 4 2026-02-13T02:16:36.267 INFO:journalctl@ceph.mon.a.trial011.stdout: no_block_cache: 0 2026-02-13T02:16:36.267 INFO:journalctl@ceph.mon.a.trial011.stdout: block_cache: 0x556f67065690 2026-02-13T02:16:36.267 INFO:journalctl@ceph.mon.a.trial011.stdout: block_cache_name: BinnedLRUCache 2026-02-13T02:16:36.267 INFO:journalctl@ceph.mon.a.trial011.stdout: block_cache_options: 2026-02-13T02:16:36.267 INFO:journalctl@ceph.mon.a.trial011.stdout: capacity : 536870912 2026-02-13T02:16:36.268 INFO:journalctl@ceph.mon.a.trial011.stdout: num_shard_bits : 4 2026-02-13T02:16:36.268 INFO:journalctl@ceph.mon.a.trial011.stdout: strict_capacity_limit : 0 2026-02-13T02:16:36.268 INFO:journalctl@ceph.mon.a.trial011.stdout: high_pri_pool_ratio: 0.000 2026-02-13T02:16:36.268 INFO:journalctl@ceph.mon.a.trial011.stdout: block_cache_compressed: (nil) 2026-02-13T02:16:36.268 INFO:journalctl@ceph.mon.a.trial011.stdout: persistent_cache: (nil) 2026-02-13T02:16:36.268 INFO:journalctl@ceph.mon.a.trial011.stdout: block_size: 4096 2026-02-13T02:16:36.268 INFO:journalctl@ceph.mon.a.trial011.stdout: block_size_deviation: 10 2026-02-13T02:16:36.268 INFO:journalctl@ceph.mon.a.trial011.stdout: block_restart_interval: 16 2026-02-13T02:16:36.268 INFO:journalctl@ceph.mon.a.trial011.stdout: index_block_restart_interval: 1 2026-02-13T02:16:36.268 INFO:journalctl@ceph.mon.a.trial011.stdout: metadata_block_size: 4096 2026-02-13T02:16:36.268 INFO:journalctl@ceph.mon.a.trial011.stdout: partition_filters: 0 2026-02-13T02:16:36.268 INFO:journalctl@ceph.mon.a.trial011.stdout: use_delta_encoding: 1 2026-02-13T02:16:36.268 INFO:journalctl@ceph.mon.a.trial011.stdout: filter_policy: bloomfilter 2026-02-13T02:16:36.269 INFO:journalctl@ceph.mon.a.trial011.stdout: whole_key_filtering: 1 2026-02-13T02:16:36.269 INFO:journalctl@ceph.mon.a.trial011.stdout: verify_compression: 0 2026-02-13T02:16:36.269 INFO:journalctl@ceph.mon.a.trial011.stdout: read_amp_bytes_per_bit: 0 2026-02-13T02:16:36.269 INFO:journalctl@ceph.mon.a.trial011.stdout: format_version: 5 2026-02-13T02:16:36.269 INFO:journalctl@ceph.mon.a.trial011.stdout: enable_index_compression: 1 2026-02-13T02:16:36.269 INFO:journalctl@ceph.mon.a.trial011.stdout: block_align: 0 2026-02-13T02:16:36.269 INFO:journalctl@ceph.mon.a.trial011.stdout: max_auto_readahead_size: 262144 2026-02-13T02:16:36.269 INFO:journalctl@ceph.mon.a.trial011.stdout: prepopulate_block_cache: 0 2026-02-13T02:16:36.269 INFO:journalctl@ceph.mon.a.trial011.stdout: initial_auto_readahead_size: 8192 2026-02-13T02:16:36.269 INFO:journalctl@ceph.mon.a.trial011.stdout: num_file_reads_for_auto_readahead: 2 2026-02-13T02:16:36.269 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.write_buffer_size: 33554432 2026-02-13T02:16:36.269 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.max_write_buffer_number: 2 2026-02-13T02:16:36.269 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.compression: NoCompression 2026-02-13T02:16:36.270 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.bottommost_compression: Disabled 2026-02-13T02:16:36.270 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.prefix_extractor: nullptr 2026-02-13T02:16:36.270 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2026-02-13T02:16:36.270 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.num_levels: 7 2026-02-13T02:16:36.270 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2026-02-13T02:16:36.270 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2026-02-13T02:16:36.270 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2026-02-13T02:16:36.270 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2026-02-13T02:16:36.270 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.bottommost_compression_opts.level: 32767 2026-02-13T02:16:36.270 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2026-02-13T02:16:36.270 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2026-02-13T02:16:36.270 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2026-02-13T02:16:36.270 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2026-02-13T02:16:36.270 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.bottommost_compression_opts.enabled: false 2026-02-13T02:16:36.271 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2026-02-13T02:16:36.271 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2026-02-13T02:16:36.271 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.compression_opts.window_bits: -14 2026-02-13T02:16:36.271 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.compression_opts.level: 32767 2026-02-13T02:16:36.271 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.compression_opts.strategy: 0 2026-02-13T02:16:36.271 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2026-02-13T02:16:36.271 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2026-02-13T02:16:36.271 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2026-02-13T02:16:36.271 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.compression_opts.parallel_threads: 1 2026-02-13T02:16:36.271 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.compression_opts.enabled: false 2026-02-13T02:16:36.271 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2026-02-13T02:16:36.271 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2026-02-13T02:16:36.271 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2026-02-13T02:16:36.272 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.level0_stop_writes_trigger: 36 2026-02-13T02:16:36.272 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.target_file_size_base: 67108864 2026-02-13T02:16:36.272 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.target_file_size_multiplier: 1 2026-02-13T02:16:36.272 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.max_bytes_for_level_base: 268435456 2026-02-13T02:16:36.272 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2026-02-13T02:16:36.272 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2026-02-13T02:16:36.272 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2026-02-13T02:16:36.272 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2026-02-13T02:16:36.272 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2026-02-13T02:16:36.272 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2026-02-13T02:16:36.272 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2026-02-13T02:16:36.272 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2026-02-13T02:16:36.272 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2026-02-13T02:16:36.273 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2026-02-13T02:16:36.273 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.max_compaction_bytes: 1677721600 2026-02-13T02:16:36.273 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2026-02-13T02:16:36.273 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.arena_block_size: 1048576 2026-02-13T02:16:36.273 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2026-02-13T02:16:36.273 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2026-02-13T02:16:36.273 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.disable_auto_compactions: 0 2026-02-13T02:16:36.273 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2026-02-13T02:16:36.273 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2026-02-13T02:16:36.273 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2026-02-13T02:16:36.273 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2026-02-13T02:16:36.273 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2026-02-13T02:16:36.273 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2026-02-13T02:16:36.274 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2026-02-13T02:16:36.274 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2026-02-13T02:16:36.274 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2026-02-13T02:16:36.274 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2026-02-13T02:16:36.274 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2026-02-13T02:16:36.274 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.inplace_update_support: 0 2026-02-13T02:16:36.274 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.inplace_update_num_locks: 10000 2026-02-13T02:16:36.274 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2026-02-13T02:16:36.274 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.memtable_whole_key_filtering: 0 2026-02-13T02:16:36.274 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.memtable_huge_page_size: 0 2026-02-13T02:16:36.274 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.bloom_locality: 0 2026-02-13T02:16:36.274 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.max_successive_merges: 0 2026-02-13T02:16:36.274 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.optimize_filters_for_hits: 0 2026-02-13T02:16:36.275 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.paranoid_file_checks: 0 2026-02-13T02:16:36.275 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.force_consistency_checks: 1 2026-02-13T02:16:36.275 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.report_bg_io_stats: 0 2026-02-13T02:16:36.275 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.ttl: 2592000 2026-02-13T02:16:36.275 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.periodic_compaction_seconds: 0 2026-02-13T02:16:36.275 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.preclude_last_level_data_seconds: 0 2026-02-13T02:16:36.275 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.preserve_internal_time_seconds: 0 2026-02-13T02:16:36.275 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.enable_blob_files: false 2026-02-13T02:16:36.275 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.min_blob_size: 0 2026-02-13T02:16:36.275 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.blob_file_size: 268435456 2026-02-13T02:16:36.275 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.blob_compression_type: NoCompression 2026-02-13T02:16:36.275 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.enable_blob_garbage_collection: false 2026-02-13T02:16:36.275 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2026-02-13T02:16:36.276 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2026-02-13T02:16:36.276 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.blob_compaction_readahead_size: 0 2026-02-13T02:16:36.276 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.blob_file_starting_level: 0 2026-02-13T02:16:36.276 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2026-02-13T02:16:36.276 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2026-02-13T02:16:36.276 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2026-02-13T02:16:36.276 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 4fc53cc2-e3fe-4ca7-b6ae-ff134dd6e9e0 2026-02-13T02:16:36.276 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: EVENT_LOG_v1 {"time_micros": 1770948996213083, "job": 1, "event": "recovery_started", "wal_files": [9]} 2026-02-13T02:16:36.276 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2026-02-13T02:16:36.276 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: EVENT_LOG_v1 {"time_micros": 1770948996213736, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 81138, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 261, "table_properties": {"data_size": 79243, "index_size": 216, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 645, "raw_key_size": 11741, "raw_average_key_size": 50, "raw_value_size": 72708, "raw_average_value_size": 313, "num_data_blocks": 9, "num_entries": 232, "num_filter_entries": 232, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1770948996, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "4fc53cc2-e3fe-4ca7-b6ae-ff134dd6e9e0", "db_session_id": "D30VKH9L77T5JW64KWTK", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2026-02-13T02:16:36.276 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: EVENT_LOG_v1 {"time_micros": 1770948996213797, "job": 1, "event": "recovery_finished"} 2026-02-13T02:16:36.276 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2026-02-13T02:16:36.277 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2026-02-13T02:16:36.277 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x556f67088e00 2026-02-13T02:16:36.277 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: DB pointer 0x556f67e8e000 2026-02-13T02:16:36.277 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2026-02-13T02:16:36.277 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: rocksdb: [db/db_impl/db_impl.cc:1111] 2026-02-13T02:16:36.277 INFO:journalctl@ceph.mon.a.trial011.stdout: ** DB Stats ** 2026-02-13T02:16:36.277 INFO:journalctl@ceph.mon.a.trial011.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-02-13T02:16:36.277 INFO:journalctl@ceph.mon.a.trial011.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2026-02-13T02:16:36.277 INFO:journalctl@ceph.mon.a.trial011.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-02-13T02:16:36.277 INFO:journalctl@ceph.mon.a.trial011.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2026-02-13T02:16:36.277 INFO:journalctl@ceph.mon.a.trial011.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2026-02-13T02:16:36.277 INFO:journalctl@ceph.mon.a.trial011.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-02-13T02:16:36.278 INFO:journalctl@ceph.mon.a.trial011.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2026-02-13T02:16:36.278 INFO:journalctl@ceph.mon.a.trial011.stdout: 2026-02-13T02:16:36.278 INFO:journalctl@ceph.mon.a.trial011.stdout: ** Compaction Stats [default] ** 2026-02-13T02:16:36.278 INFO:journalctl@ceph.mon.a.trial011.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-02-13T02:16:36.278 INFO:journalctl@ceph.mon.a.trial011.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2026-02-13T02:16:36.278 INFO:journalctl@ceph.mon.a.trial011.stdout: L0 2/0 81.10 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 159.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2026-02-13T02:16:36.278 INFO:journalctl@ceph.mon.a.trial011.stdout: Sum 2/0 81.10 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 159.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2026-02-13T02:16:36.278 INFO:journalctl@ceph.mon.a.trial011.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 159.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2026-02-13T02:16:36.278 INFO:journalctl@ceph.mon.a.trial011.stdout: 2026-02-13T02:16:36.278 INFO:journalctl@ceph.mon.a.trial011.stdout: ** Compaction Stats [default] ** 2026-02-13T02:16:36.278 INFO:journalctl@ceph.mon.a.trial011.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-02-13T02:16:36.278 INFO:journalctl@ceph.mon.a.trial011.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2026-02-13T02:16:36.279 INFO:journalctl@ceph.mon.a.trial011.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 159.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2026-02-13T02:16:36.279 INFO:journalctl@ceph.mon.a.trial011.stdout: 2026-02-13T02:16:36.279 INFO:journalctl@ceph.mon.a.trial011.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2026-02-13T02:16:36.279 INFO:journalctl@ceph.mon.a.trial011.stdout: 2026-02-13T02:16:36.279 INFO:journalctl@ceph.mon.a.trial011.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-02-13T02:16:36.279 INFO:journalctl@ceph.mon.a.trial011.stdout: Flush(GB): cumulative 0.000, interval 0.000 2026-02-13T02:16:36.279 INFO:journalctl@ceph.mon.a.trial011.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2026-02-13T02:16:36.279 INFO:journalctl@ceph.mon.a.trial011.stdout: AddFile(Total Files): cumulative 0, interval 0 2026-02-13T02:16:36.279 INFO:journalctl@ceph.mon.a.trial011.stdout: AddFile(L0 Files): cumulative 0, interval 0 2026-02-13T02:16:36.279 INFO:journalctl@ceph.mon.a.trial011.stdout: AddFile(Keys): cumulative 0, interval 0 2026-02-13T02:16:36.279 INFO:journalctl@ceph.mon.a.trial011.stdout: Cumulative compaction: 0.00 GB write, 28.06 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-02-13T02:16:36.279 INFO:journalctl@ceph.mon.a.trial011.stdout: Interval compaction: 0.00 GB write, 28.06 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-02-13T02:16:36.279 INFO:journalctl@ceph.mon.a.trial011.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2026-02-13T02:16:36.280 INFO:journalctl@ceph.mon.a.trial011.stdout: Block cache BinnedLRUCache@0x556f67065690#2 capacity: 512.00 MB usage: 1.23 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.8e-05 secs_since: 0 2026-02-13T02:16:36.280 INFO:journalctl@ceph.mon.a.trial011.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.83 KB,0.000157952%) IndexBlock(2,0.41 KB,7.7486e-05%) Misc(1,0.00 KB,0%) 2026-02-13T02:16:36.280 INFO:journalctl@ceph.mon.a.trial011.stdout: 2026-02-13T02:16:36.280 INFO:journalctl@ceph.mon.a.trial011.stdout: ** File Read Latency Histogram By Level [default] ** 2026-02-13T02:16:36.280 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: starting mon.a rank 0 at public addrs [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] at bind addrs [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid fc631695-0881-11f1-899c-d404e6e7d460 2026-02-13T02:16:36.280 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: mon.a@-1(???) e1 preinit fsid fc631695-0881-11f1-899c-d404e6e7d460 2026-02-13T02:16:36.280 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: mon.a@-1(???).mds e1 new map 2026-02-13T02:16:36.280 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: mon.a@-1(???).mds e1 print_map 2026-02-13T02:16:36.280 INFO:journalctl@ceph.mon.a.trial011.stdout: e1 2026-02-13T02:16:36.280 INFO:journalctl@ceph.mon.a.trial011.stdout: btime 2026-02-13T02:16:35:175644+0000 2026-02-13T02:16:36.280 INFO:journalctl@ceph.mon.a.trial011.stdout: enable_multiple, ever_enabled_multiple: 1,1 2026-02-13T02:16:36.280 INFO:journalctl@ceph.mon.a.trial011.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2026-02-13T02:16:36.280 INFO:journalctl@ceph.mon.a.trial011.stdout: legacy client fscid: -1 2026-02-13T02:16:36.281 INFO:journalctl@ceph.mon.a.trial011.stdout: 2026-02-13T02:16:36.281 INFO:journalctl@ceph.mon.a.trial011.stdout: No filesystems configured 2026-02-13T02:16:36.281 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2026-02-13T02:16:36.281 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-02-13T02:16:36.281 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-02-13T02:16:36.281 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-02-13T02:16:36.281 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2026-02-13T02:16:36.372 INFO:teuthology.orchestra.run.trial011.stdout:Wrote config to /etc/ceph/ceph.conf 2026-02-13T02:16:36.373 INFO:teuthology.orchestra.run.trial011.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2026-02-13T02:16:36.373 INFO:teuthology.orchestra.run.trial011.stdout:Creating mgr... 2026-02-13T02:16:36.373 INFO:teuthology.orchestra.run.trial011.stdout:Verifying port 0.0.0.0:9283 ... 2026-02-13T02:16:36.373 INFO:teuthology.orchestra.run.trial011.stdout:Verifying port 0.0.0.0:8765 ... 2026-02-13T02:16:36.529 INFO:teuthology.orchestra.run.trial011.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-fc631695-0881-11f1-899c-d404e6e7d460@mgr.x 2026-02-13T02:16:36.530 INFO:teuthology.orchestra.run.trial011.stdout:systemctl: stderr Failed to reset failed state of unit ceph-fc631695-0881-11f1-899c-d404e6e7d460@mgr.x.service: Unit ceph-fc631695-0881-11f1-899c-d404e6e7d460@mgr.x.service not loaded. 2026-02-13T02:16:36.533 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: mon.a is new leader, mons a in quorum (ranks 0) 2026-02-13T02:16:36.534 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: monmap epoch 1 2026-02-13T02:16:36.534 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: fsid fc631695-0881-11f1-899c-d404e6e7d460 2026-02-13T02:16:36.534 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: last_changed 2026-02-13T02:16:34.149794+0000 2026-02-13T02:16:36.534 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: created 2026-02-13T02:16:34.149794+0000 2026-02-13T02:16:36.534 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: min_mon_release 20 (tentacle) 2026-02-13T02:16:36.534 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: election_strategy: 1 2026-02-13T02:16:36.534 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: 0: [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] mon.a 2026-02-13T02:16:36.534 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: fsmap 2026-02-13T02:16:36.534 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: osdmap e1: 0 total, 0 up, 0 in 2026-02-13T02:16:36.534 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:36 trial011 ceph-mon[11956]: mgrmap e1: no daemons active 2026-02-13T02:16:36.652 INFO:teuthology.orchestra.run.trial011.stdout:systemctl: stderr Created symlink '/etc/systemd/system/ceph-fc631695-0881-11f1-899c-d404e6e7d460.target.wants/ceph-fc631695-0881-11f1-899c-d404e6e7d460@mgr.x.service' → '/etc/systemd/system/ceph-fc631695-0881-11f1-899c-d404e6e7d460@.service'. 2026-02-13T02:16:36.794 INFO:journalctl@ceph.mgr.x.trial011.stdout:Feb 13 02:16:36 trial011 podman[12219]: 2026-02-13 02:16:36.773669823 +0000 UTC m=+0.015415655 container create 3e1fbfa14ec33d8e1829d1f8e030a0fc416e4692bd349570c4b61088093e2d33 (image=quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10, name=ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-x, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, vendor=Rocky Enterprise Software Foundation, summary=Rocky Linux Base image, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.title=rockylinux, license=BSD-3-Clause, version=10, OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.version=10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-pdonnell-testing-20260210.171210, io.buildah.version=1.33.7, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, name=rockylinux, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-13T02:16:36.808 INFO:teuthology.orchestra.run.trial011.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-13T02:16:36.808 INFO:teuthology.orchestra.run.trial011.stdout:systemctl: stdout disabled 2026-02-13T02:16:36.814 INFO:teuthology.orchestra.run.trial011.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-13T02:16:36.814 INFO:teuthology.orchestra.run.trial011.stdout:systemctl: stdout inactive 2026-02-13T02:16:36.814 INFO:teuthology.orchestra.run.trial011.stdout:firewalld.service is not enabled 2026-02-13T02:16:36.814 INFO:teuthology.orchestra.run.trial011.stdout:Not possible to enable service . firewalld.service is not available 2026-02-13T02:16:36.820 INFO:teuthology.orchestra.run.trial011.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-13T02:16:36.820 INFO:teuthology.orchestra.run.trial011.stdout:systemctl: stdout disabled 2026-02-13T02:16:36.825 INFO:teuthology.orchestra.run.trial011.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-13T02:16:36.825 INFO:teuthology.orchestra.run.trial011.stdout:systemctl: stdout inactive 2026-02-13T02:16:36.826 INFO:teuthology.orchestra.run.trial011.stdout:firewalld.service is not enabled 2026-02-13T02:16:36.826 INFO:teuthology.orchestra.run.trial011.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2026-02-13T02:16:36.826 INFO:teuthology.orchestra.run.trial011.stdout:Waiting for mgr to start... 2026-02-13T02:16:36.826 INFO:teuthology.orchestra.run.trial011.stdout:Waiting for mgr... 2026-02-13T02:16:37.006 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout 2026-02-13T02:16:37.006 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout { 2026-02-13T02:16:37.006 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "fsid": "fc631695-0881-11f1-899c-d404e6e7d460", 2026-02-13T02:16:37.007 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "health": { 2026-02-13T02:16:37.007 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-02-13T02:16:37.007 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-02-13T02:16:37.007 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-02-13T02:16:37.007 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout }, 2026-02-13T02:16:37.007 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-02-13T02:16:37.007 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-02-13T02:16:37.007 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout 0 2026-02-13T02:16:37.007 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout ], 2026-02-13T02:16:37.007 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-02-13T02:16:37.007 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "a" 2026-02-13T02:16:37.008 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout ], 2026-02-13T02:16:37.008 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "quorum_age": 0, 2026-02-13T02:16:37.008 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "monmap": { 2026-02-13T02:16:37.008 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-13T02:16:37.008 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "tentacle", 2026-02-13T02:16:37.008 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-02-13T02:16:37.008 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout }, 2026-02-13T02:16:37.008 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-02-13T02:16:37.008 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-13T02:16:37.008 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-02-13T02:16:37.008 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-02-13T02:16:37.008 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-02-13T02:16:37.009 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-02-13T02:16:37.009 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-02-13T02:16:37.009 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-02-13T02:16:37.009 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout }, 2026-02-13T02:16:37.009 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-02-13T02:16:37.009 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-02-13T02:16:37.009 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-02-13T02:16:37.009 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-02-13T02:16:37.009 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-02-13T02:16:37.009 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-02-13T02:16:37.009 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-02-13T02:16:37.009 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-02-13T02:16:37.009 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-02-13T02:16:37.010 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout }, 2026-02-13T02:16:37.010 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-02-13T02:16:37.010 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-13T02:16:37.010 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "btime": "2026-02-13T02:16:35:175644+0000", 2026-02-13T02:16:37.010 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-02-13T02:16:37.010 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-02-13T02:16:37.010 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout }, 2026-02-13T02:16:37.010 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-02-13T02:16:37.010 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "available": false, 2026-02-13T02:16:37.010 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-02-13T02:16:37.010 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "modules": [ 2026-02-13T02:16:37.010 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "iostat", 2026-02-13T02:16:37.010 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "nfs" 2026-02-13T02:16:37.011 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout ], 2026-02-13T02:16:37.011 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-13T02:16:37.011 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout }, 2026-02-13T02:16:37.011 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-02-13T02:16:37.011 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-13T02:16:37.011 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "modified": "2026-02-13T02:16:35.175970+0000", 2026-02-13T02:16:37.011 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-13T02:16:37.011 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout }, 2026-02-13T02:16:37.011 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-02-13T02:16:37.011 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout } 2026-02-13T02:16:37.011 INFO:teuthology.orchestra.run.trial011.stdout:mgr not available, waiting (1/15)... 2026-02-13T02:16:37.119 INFO:journalctl@ceph.mgr.x.trial011.stdout:Feb 13 02:16:36 trial011 podman[12219]: 2026-02-13 02:16:36.795165905 +0000 UTC m=+0.036911737 container init 3e1fbfa14ec33d8e1829d1f8e030a0fc416e4692bd349570c4b61088093e2d33 (image=quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10, name=ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-x, org.opencontainers.image.licenses=BSD-3-Clause, io.buildah.version=1.33.7, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, ceph=True, org.opencontainers.image.version=10, org.opencontainers.image.title=rockylinux, version=10, CEPH_REF=wip-pdonnell-testing-20260210.171210, OSD_FLAVOR=default, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, vendor=Rocky Enterprise Software Foundation, name=rockylinux, license=BSD-3-Clause, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, summary=Rocky Linux Base image, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=docker.io/rockylinux/rockylinux:10) 2026-02-13T02:16:37.120 INFO:journalctl@ceph.mgr.x.trial011.stdout:Feb 13 02:16:36 trial011 podman[12219]: 2026-02-13 02:16:36.79690158 +0000 UTC m=+0.038647412 container start 3e1fbfa14ec33d8e1829d1f8e030a0fc416e4692bd349570c4b61088093e2d33 (image=quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10, name=ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-x, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.documentation=https://docs.ceph.com/, name=rockylinux, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, OSD_FLAVOR=default, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_REF=wip-pdonnell-testing-20260210.171210, io.buildah.version=1.33.7, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.title=rockylinux, org.opencontainers.image.authors=Ceph Release Team , license=BSD-3-Clause, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, ceph=True, vendor=Rocky Enterprise Software Foundation, summary=Rocky Linux Base image) 2026-02-13T02:16:37.120 INFO:journalctl@ceph.mgr.x.trial011.stdout:Feb 13 02:16:36 trial011 bash[12219]: 3e1fbfa14ec33d8e1829d1f8e030a0fc416e4692bd349570c4b61088093e2d33 2026-02-13T02:16:37.120 INFO:journalctl@ceph.mgr.x.trial011.stdout:Feb 13 02:16:36 trial011 podman[12219]: 2026-02-13 02:16:36.767181968 +0000 UTC m=+0.008927810 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 2026-02-13T02:16:37.120 INFO:journalctl@ceph.mgr.x.trial011.stdout:Feb 13 02:16:36 trial011 systemd[1]: Started ceph-fc631695-0881-11f1-899c-d404e6e7d460@mgr.x.service - Ceph mgr.x for fc631695-0881-11f1-899c-d404e6e7d460. 2026-02-13T02:16:37.120 INFO:journalctl@ceph.mgr.x.trial011.stdout:Feb 13 02:16:36 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-x[12241]: 2026-02-13T02:16:36.820+0000 7fd6b3ed5fc0 -1 mgr[py] Loading module orchestrator in main interpreter 2026-02-13T02:16:37.120 INFO:journalctl@ceph.mgr.x.trial011.stdout:Feb 13 02:16:36 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-x[12241]: 2026-02-13T02:16:36.915+0000 7fd6b3ed5fc0 -1 mgr[py] Loading module dashboard in main interpreter 2026-02-13T02:16:37.120 INFO:journalctl@ceph.mgr.x.trial011.stdout:Feb 13 02:16:37 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-x[12241]: 2026-02-13T02:16:37.117+0000 7fd6b3ed5fc0 -1 mgr[py] Loading module alerts in main interpreter 2026-02-13T02:16:37.371 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:37 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/2169264588' entity='client.admin' 2026-02-13T02:16:37.371 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:37 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/3306546241' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2026-02-13T02:16:37.372 INFO:journalctl@ceph.mgr.x.trial011.stdout:Feb 13 02:16:37 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-x[12241]: 2026-02-13T02:16:37.119+0000 7fd6b3ed5fc0 -1 mgr[py] Loading module smb in main interpreter 2026-02-13T02:16:37.372 INFO:journalctl@ceph.mgr.x.trial011.stdout:Feb 13 02:16:37 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-x[12241]: 2026-02-13T02:16:37.144+0000 7fd6b3ed5fc0 -1 mgr[py] Loading module snap_schedule in main interpreter 2026-02-13T02:16:37.372 INFO:journalctl@ceph.mgr.x.trial011.stdout:Feb 13 02:16:37 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-x[12241]: 2026-02-13T02:16:37.151+0000 7fd6b3ed5fc0 -1 mgr[py] Loading module stats in main interpreter 2026-02-13T02:16:37.372 INFO:journalctl@ceph.mgr.x.trial011.stdout:Feb 13 02:16:37 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-x[12241]: 2026-02-13T02:16:37.153+0000 7fd6b3ed5fc0 -1 mgr[py] Loading module devicehealth in main interpreter 2026-02-13T02:16:37.372 INFO:journalctl@ceph.mgr.x.trial011.stdout:Feb 13 02:16:37 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-x[12241]: 2026-02-13T02:16:37.157+0000 7fd6b3ed5fc0 -1 mgr[py] Loading module iostat in main interpreter 2026-02-13T02:16:37.372 INFO:journalctl@ceph.mgr.x.trial011.stdout:Feb 13 02:16:37 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-x[12241]: 2026-02-13T02:16:37.158+0000 7fd6b3ed5fc0 -1 mgr[py] Loading module influx in main interpreter 2026-02-13T02:16:37.372 INFO:journalctl@ceph.mgr.x.trial011.stdout:Feb 13 02:16:37 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-x[12241]: 2026-02-13T02:16:37.159+0000 7fd6b3ed5fc0 -1 mgr[py] Loading module telegraf in main interpreter 2026-02-13T02:16:37.372 INFO:journalctl@ceph.mgr.x.trial011.stdout:Feb 13 02:16:37 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-x[12241]: 2026-02-13T02:16:37.162+0000 7fd6b3ed5fc0 -1 mgr[py] Loading module volumes in main interpreter 2026-02-13T02:16:37.373 INFO:journalctl@ceph.mgr.x.trial011.stdout:Feb 13 02:16:37 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-x[12241]: 2026-02-13T02:16:37.190+0000 7fd6b3ed5fc0 -1 mgr[py] Loading module rbd_support in main interpreter 2026-02-13T02:16:37.373 INFO:journalctl@ceph.mgr.x.trial011.stdout:Feb 13 02:16:37 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-x[12241]: 2026-02-13T02:16:37.202+0000 7fd6b3ed5fc0 -1 mgr[py] Loading module mirroring in main interpreter 2026-02-13T02:16:37.373 INFO:journalctl@ceph.mgr.x.trial011.stdout:Feb 13 02:16:37 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-x[12241]: 2026-02-13T02:16:37.212+0000 7fd6b3ed5fc0 -1 mgr[py] Loading module rgw in main interpreter 2026-02-13T02:16:37.373 INFO:journalctl@ceph.mgr.x.trial011.stdout:Feb 13 02:16:37 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-x[12241]: 2026-02-13T02:16:37.215+0000 7fd6b3ed5fc0 -1 mgr[py] Loading module pg_autoscaler in main interpreter 2026-02-13T02:16:37.373 INFO:journalctl@ceph.mgr.x.trial011.stdout:Feb 13 02:16:37 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-x[12241]: 2026-02-13T02:16:37.219+0000 7fd6b3ed5fc0 -1 mgr[py] Loading module mds_autoscaler in main interpreter 2026-02-13T02:16:37.373 INFO:journalctl@ceph.mgr.x.trial011.stdout:Feb 13 02:16:37 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-x[12241]: 2026-02-13T02:16:37.219+0000 7fd6b3ed5fc0 -1 mgr[py] Loading module localpool in main interpreter 2026-02-13T02:16:37.373 INFO:journalctl@ceph.mgr.x.trial011.stdout:Feb 13 02:16:37 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-x[12241]: 2026-02-13T02:16:37.220+0000 7fd6b3ed5fc0 -1 mgr[py] Loading module k8sevents in main interpreter 2026-02-13T02:16:37.373 INFO:journalctl@ceph.mgr.x.trial011.stdout:Feb 13 02:16:37 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-x[12241]: 2026-02-13T02:16:37.353+0000 7fd6b3ed5fc0 -1 mgr[py] Loading module crash in main interpreter 2026-02-13T02:16:37.373 INFO:journalctl@ceph.mgr.x.trial011.stdout:Feb 13 02:16:37 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-x[12241]: 2026-02-13T02:16:37.356+0000 7fd6b3ed5fc0 -1 mgr[py] Loading module prometheus in main interpreter 2026-02-13T02:16:37.373 INFO:journalctl@ceph.mgr.x.trial011.stdout:Feb 13 02:16:37 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-x[12241]: 2026-02-13T02:16:37.364+0000 7fd6b3ed5fc0 -1 mgr[py] Loading module insights in main interpreter 2026-02-13T02:16:37.373 INFO:journalctl@ceph.mgr.x.trial011.stdout:Feb 13 02:16:37 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-x[12241]: 2026-02-13T02:16:37.366+0000 7fd6b3ed5fc0 -1 mgr[py] Loading module test_orchestrator in main interpreter 2026-02-13T02:16:37.373 INFO:journalctl@ceph.mgr.x.trial011.stdout:Feb 13 02:16:37 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-x[12241]: 2026-02-13T02:16:37.367+0000 7fd6b3ed5fc0 -1 mgr[py] Loading module selftest in main interpreter 2026-02-13T02:16:37.374 INFO:journalctl@ceph.mgr.x.trial011.stdout:Feb 13 02:16:37 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-x[12241]: 2026-02-13T02:16:37.369+0000 7fd6b3ed5fc0 -1 mgr[py] Loading module cephadm in main interpreter 2026-02-13T02:16:37.702 INFO:journalctl@ceph.mgr.x.trial011.stdout:Feb 13 02:16:37 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-x[12241]: 2026-02-13T02:16:37.511+0000 7fd6b3ed5fc0 -1 mgr[py] Loading module nfs in main interpreter 2026-02-13T02:16:37.702 INFO:journalctl@ceph.mgr.x.trial011.stdout:Feb 13 02:16:37 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-x[12241]: 2026-02-13T02:16:37.521+0000 7fd6b3ed5fc0 -1 mgr[py] Loading module telemetry in main interpreter 2026-02-13T02:16:37.703 INFO:journalctl@ceph.mgr.x.trial011.stdout:Feb 13 02:16:37 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-x[12241]: 2026-02-13T02:16:37.527+0000 7fd6b3ed5fc0 -1 mgr[py] Loading module progress in main interpreter 2026-02-13T02:16:37.703 INFO:journalctl@ceph.mgr.x.trial011.stdout:Feb 13 02:16:37 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-x[12241]: 2026-02-13T02:16:37.530+0000 7fd6b3ed5fc0 -1 mgr[py] Loading module diskprediction_local in main interpreter 2026-02-13T02:16:37.703 INFO:journalctl@ceph.mgr.x.trial011.stdout:Feb 13 02:16:37 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-x[12241]: 2026-02-13T02:16:37.569+0000 7fd6b3ed5fc0 -1 mgr[py] Loading module rook in main interpreter 2026-02-13T02:16:37.703 INFO:journalctl@ceph.mgr.x.trial011.stdout:Feb 13 02:16:37 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-x[12241]: 2026-02-13T02:16:37.598+0000 7fd6b3ed5fc0 -1 mgr[py] Loading module balancer in main interpreter 2026-02-13T02:16:37.703 INFO:journalctl@ceph.mgr.x.trial011.stdout:Feb 13 02:16:37 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-x[12241]: 2026-02-13T02:16:37.604+0000 7fd6b3ed5fc0 -1 mgr[py] Loading module osd_perf_query in main interpreter 2026-02-13T02:16:37.703 INFO:journalctl@ceph.mgr.x.trial011.stdout:Feb 13 02:16:37 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-x[12241]: 2026-02-13T02:16:37.605+0000 7fd6b3ed5fc0 -1 mgr[py] Loading module status in main interpreter 2026-02-13T02:16:37.703 INFO:journalctl@ceph.mgr.x.trial011.stdout:Feb 13 02:16:37 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-x[12241]: 2026-02-13T02:16:37.607+0000 7fd6b3ed5fc0 -1 mgr[py] Loading module osd_support in main interpreter 2026-02-13T02:16:38.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:38 trial011 ceph-mon[11956]: Activating manager daemon x 2026-02-13T02:16:38.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:38 trial011 ceph-mon[11956]: mgrmap e2: x(active, starting, since 0.00271s) 2026-02-13T02:16:38.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:38 trial011 ceph-mon[11956]: from='mgr.14100 10.20.193.11:0/4107170568' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2026-02-13T02:16:38.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:38 trial011 ceph-mon[11956]: from='mgr.14100 10.20.193.11:0/4107170568' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2026-02-13T02:16:38.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:38 trial011 ceph-mon[11956]: from='mgr.14100 10.20.193.11:0/4107170568' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2026-02-13T02:16:38.703 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:38 trial011 ceph-mon[11956]: from='mgr.14100 10.20.193.11:0/4107170568' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T02:16:38.703 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:38 trial011 ceph-mon[11956]: from='mgr.14100 10.20.193.11:0/4107170568' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2026-02-13T02:16:38.703 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:38 trial011 ceph-mon[11956]: Manager daemon x is now available 2026-02-13T02:16:38.703 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:38 trial011 ceph-mon[11956]: from='mgr.14100 10.20.193.11:0/4107170568' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2026-02-13T02:16:38.703 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:38 trial011 ceph-mon[11956]: from='mgr.14100 10.20.193.11:0/4107170568' entity='mgr.x' 2026-02-13T02:16:38.703 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:38 trial011 ceph-mon[11956]: from='mgr.14100 10.20.193.11:0/4107170568' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2026-02-13T02:16:38.703 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:38 trial011 ceph-mon[11956]: from='mgr.14100 10.20.193.11:0/4107170568' entity='mgr.x' 2026-02-13T02:16:38.703 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:38 trial011 ceph-mon[11956]: from='mgr.14100 10.20.193.11:0/4107170568' entity='mgr.x' 2026-02-13T02:16:39.272 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout 2026-02-13T02:16:39.272 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout { 2026-02-13T02:16:39.272 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "fsid": "fc631695-0881-11f1-899c-d404e6e7d460", 2026-02-13T02:16:39.272 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "health": { 2026-02-13T02:16:39.272 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-02-13T02:16:39.272 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-02-13T02:16:39.272 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-02-13T02:16:39.273 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout }, 2026-02-13T02:16:39.273 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-02-13T02:16:39.273 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-02-13T02:16:39.273 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout 0 2026-02-13T02:16:39.273 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout ], 2026-02-13T02:16:39.273 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-02-13T02:16:39.273 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "a" 2026-02-13T02:16:39.273 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout ], 2026-02-13T02:16:39.273 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2026-02-13T02:16:39.273 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "monmap": { 2026-02-13T02:16:39.273 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-13T02:16:39.273 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "tentacle", 2026-02-13T02:16:39.274 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-02-13T02:16:39.274 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout }, 2026-02-13T02:16:39.274 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-02-13T02:16:39.274 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-13T02:16:39.274 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-02-13T02:16:39.274 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-02-13T02:16:39.274 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-02-13T02:16:39.274 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-02-13T02:16:39.274 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-02-13T02:16:39.274 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-02-13T02:16:39.275 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout }, 2026-02-13T02:16:39.275 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-02-13T02:16:39.275 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-02-13T02:16:39.275 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-02-13T02:16:39.275 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-02-13T02:16:39.275 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-02-13T02:16:39.275 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-02-13T02:16:39.276 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-02-13T02:16:39.276 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-02-13T02:16:39.276 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-02-13T02:16:39.276 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout }, 2026-02-13T02:16:39.276 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-02-13T02:16:39.276 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-13T02:16:39.276 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "btime": "2026-02-13T02:16:35:175644+0000", 2026-02-13T02:16:39.276 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-02-13T02:16:39.276 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-02-13T02:16:39.276 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout }, 2026-02-13T02:16:39.276 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-02-13T02:16:39.276 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "available": true, 2026-02-13T02:16:39.277 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-02-13T02:16:39.277 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "modules": [ 2026-02-13T02:16:39.277 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "iostat", 2026-02-13T02:16:39.277 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "nfs" 2026-02-13T02:16:39.277 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout ], 2026-02-13T02:16:39.277 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-13T02:16:39.277 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout }, 2026-02-13T02:16:39.277 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-02-13T02:16:39.277 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-13T02:16:39.277 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "modified": "2026-02-13T02:16:35.175970+0000", 2026-02-13T02:16:39.277 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-13T02:16:39.277 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout }, 2026-02-13T02:16:39.277 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-02-13T02:16:39.278 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout } 2026-02-13T02:16:39.278 INFO:teuthology.orchestra.run.trial011.stdout:mgr is available 2026-02-13T02:16:39.494 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout 2026-02-13T02:16:39.494 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout [global] 2026-02-13T02:16:39.494 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout fsid = fc631695-0881-11f1-899c-d404e6e7d460 2026-02-13T02:16:39.494 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2026-02-13T02:16:39.494 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout mon_host = [v2:10.20.193.11:3300,v1:10.20.193.11:6789] 2026-02-13T02:16:39.494 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2026-02-13T02:16:39.494 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2026-02-13T02:16:39.494 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2026-02-13T02:16:39.494 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2026-02-13T02:16:39.494 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout 2026-02-13T02:16:39.495 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout [mgr] 2026-02-13T02:16:39.495 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2026-02-13T02:16:39.495 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout 2026-02-13T02:16:39.495 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout [osd] 2026-02-13T02:16:39.495 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2026-02-13T02:16:39.495 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2026-02-13T02:16:39.495 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2026-02-13T02:16:39.495 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2026-02-13T02:16:39.495 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2026-02-13T02:16:39.495 INFO:teuthology.orchestra.run.trial011.stdout:Enabling cephadm module... 2026-02-13T02:16:39.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:39 trial011 ceph-mon[11956]: mgrmap e3: x(active, since 1.00439s) 2026-02-13T02:16:39.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:39 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/1306630471' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2026-02-13T02:16:39.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:39 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/2534019753' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2026-02-13T02:16:40.888 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:40 trial011 ceph-mon[11956]: mgrmap e4: x(active, since 2s) 2026-02-13T02:16:40.888 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:40 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/3250479862' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "cephadm"} : dispatch 2026-02-13T02:16:40.888 INFO:journalctl@ceph.mgr.x.trial011.stdout:Feb 13 02:16:40 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-x[12241]: ignoring --setuser ceph since I am not root 2026-02-13T02:16:40.888 INFO:journalctl@ceph.mgr.x.trial011.stdout:Feb 13 02:16:40 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-x[12241]: ignoring --setgroup ceph since I am not root 2026-02-13T02:16:40.888 INFO:journalctl@ceph.mgr.x.trial011.stdout:Feb 13 02:16:40 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-x[12241]: 2026-02-13T02:16:40.658+0000 7fc2c0b19fc0 -1 mgr[py] Loading module orchestrator in main interpreter 2026-02-13T02:16:40.888 INFO:journalctl@ceph.mgr.x.trial011.stdout:Feb 13 02:16:40 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-x[12241]: 2026-02-13T02:16:40.750+0000 7fc2c0b19fc0 -1 mgr[py] Loading module dashboard in main interpreter 2026-02-13T02:16:40.910 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout { 2026-02-13T02:16:40.910 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "epoch": 5, 2026-02-13T02:16:40.910 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "available": true, 2026-02-13T02:16:40.910 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "active_name": "x", 2026-02-13T02:16:40.910 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "num_standby": 0 2026-02-13T02:16:40.910 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout } 2026-02-13T02:16:40.910 INFO:teuthology.orchestra.run.trial011.stdout:Waiting for the mgr to restart... 2026-02-13T02:16:40.910 INFO:teuthology.orchestra.run.trial011.stdout:Waiting for mgr epoch 5... 2026-02-13T02:16:41.178 INFO:journalctl@ceph.mgr.x.trial011.stdout:Feb 13 02:16:40 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-x[12241]: 2026-02-13T02:16:40.951+0000 7fc2c0b19fc0 -1 mgr[py] Loading module alerts in main interpreter 2026-02-13T02:16:41.178 INFO:journalctl@ceph.mgr.x.trial011.stdout:Feb 13 02:16:40 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-x[12241]: 2026-02-13T02:16:40.952+0000 7fc2c0b19fc0 -1 mgr[py] Loading module smb in main interpreter 2026-02-13T02:16:41.179 INFO:journalctl@ceph.mgr.x.trial011.stdout:Feb 13 02:16:40 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-x[12241]: 2026-02-13T02:16:40.977+0000 7fc2c0b19fc0 -1 mgr[py] Loading module snap_schedule in main interpreter 2026-02-13T02:16:41.179 INFO:journalctl@ceph.mgr.x.trial011.stdout:Feb 13 02:16:40 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-x[12241]: 2026-02-13T02:16:40.984+0000 7fc2c0b19fc0 -1 mgr[py] Loading module stats in main interpreter 2026-02-13T02:16:41.179 INFO:journalctl@ceph.mgr.x.trial011.stdout:Feb 13 02:16:40 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-x[12241]: 2026-02-13T02:16:40.986+0000 7fc2c0b19fc0 -1 mgr[py] Loading module devicehealth in main interpreter 2026-02-13T02:16:41.179 INFO:journalctl@ceph.mgr.x.trial011.stdout:Feb 13 02:16:40 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-x[12241]: 2026-02-13T02:16:40.989+0000 7fc2c0b19fc0 -1 mgr[py] Loading module iostat in main interpreter 2026-02-13T02:16:41.179 INFO:journalctl@ceph.mgr.x.trial011.stdout:Feb 13 02:16:40 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-x[12241]: 2026-02-13T02:16:40.990+0000 7fc2c0b19fc0 -1 mgr[py] Loading module influx in main interpreter 2026-02-13T02:16:41.179 INFO:journalctl@ceph.mgr.x.trial011.stdout:Feb 13 02:16:40 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-x[12241]: 2026-02-13T02:16:40.992+0000 7fc2c0b19fc0 -1 mgr[py] Loading module telegraf in main interpreter 2026-02-13T02:16:41.179 INFO:journalctl@ceph.mgr.x.trial011.stdout:Feb 13 02:16:40 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-x[12241]: 2026-02-13T02:16:40.994+0000 7fc2c0b19fc0 -1 mgr[py] Loading module volumes in main interpreter 2026-02-13T02:16:41.179 INFO:journalctl@ceph.mgr.x.trial011.stdout:Feb 13 02:16:41 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-x[12241]: 2026-02-13T02:16:41.023+0000 7fc2c0b19fc0 -1 mgr[py] Loading module rbd_support in main interpreter 2026-02-13T02:16:41.179 INFO:journalctl@ceph.mgr.x.trial011.stdout:Feb 13 02:16:41 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-x[12241]: 2026-02-13T02:16:41.035+0000 7fc2c0b19fc0 -1 mgr[py] Loading module mirroring in main interpreter 2026-02-13T02:16:41.179 INFO:journalctl@ceph.mgr.x.trial011.stdout:Feb 13 02:16:41 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-x[12241]: 2026-02-13T02:16:41.044+0000 7fc2c0b19fc0 -1 mgr[py] Loading module rgw in main interpreter 2026-02-13T02:16:41.179 INFO:journalctl@ceph.mgr.x.trial011.stdout:Feb 13 02:16:41 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-x[12241]: 2026-02-13T02:16:41.048+0000 7fc2c0b19fc0 -1 mgr[py] Loading module pg_autoscaler in main interpreter 2026-02-13T02:16:41.179 INFO:journalctl@ceph.mgr.x.trial011.stdout:Feb 13 02:16:41 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-x[12241]: 2026-02-13T02:16:41.051+0000 7fc2c0b19fc0 -1 mgr[py] Loading module mds_autoscaler in main interpreter 2026-02-13T02:16:41.180 INFO:journalctl@ceph.mgr.x.trial011.stdout:Feb 13 02:16:41 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-x[12241]: 2026-02-13T02:16:41.052+0000 7fc2c0b19fc0 -1 mgr[py] Loading module localpool in main interpreter 2026-02-13T02:16:41.180 INFO:journalctl@ceph.mgr.x.trial011.stdout:Feb 13 02:16:41 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-x[12241]: 2026-02-13T02:16:41.053+0000 7fc2c0b19fc0 -1 mgr[py] Loading module k8sevents in main interpreter 2026-02-13T02:16:41.180 INFO:journalctl@ceph.mgr.x.trial011.stdout:Feb 13 02:16:41 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-x[12241]: 2026-02-13T02:16:41.176+0000 7fc2c0b19fc0 -1 mgr[py] Loading module crash in main interpreter 2026-02-13T02:16:41.452 INFO:journalctl@ceph.mgr.x.trial011.stdout:Feb 13 02:16:41 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-x[12241]: 2026-02-13T02:16:41.179+0000 7fc2c0b19fc0 -1 mgr[py] Loading module prometheus in main interpreter 2026-02-13T02:16:41.452 INFO:journalctl@ceph.mgr.x.trial011.stdout:Feb 13 02:16:41 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-x[12241]: 2026-02-13T02:16:41.186+0000 7fc2c0b19fc0 -1 mgr[py] Loading module insights in main interpreter 2026-02-13T02:16:41.452 INFO:journalctl@ceph.mgr.x.trial011.stdout:Feb 13 02:16:41 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-x[12241]: 2026-02-13T02:16:41.188+0000 7fc2c0b19fc0 -1 mgr[py] Loading module test_orchestrator in main interpreter 2026-02-13T02:16:41.453 INFO:journalctl@ceph.mgr.x.trial011.stdout:Feb 13 02:16:41 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-x[12241]: 2026-02-13T02:16:41.190+0000 7fc2c0b19fc0 -1 mgr[py] Loading module selftest in main interpreter 2026-02-13T02:16:41.453 INFO:journalctl@ceph.mgr.x.trial011.stdout:Feb 13 02:16:41 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-x[12241]: 2026-02-13T02:16:41.192+0000 7fc2c0b19fc0 -1 mgr[py] Loading module cephadm in main interpreter 2026-02-13T02:16:41.453 INFO:journalctl@ceph.mgr.x.trial011.stdout:Feb 13 02:16:41 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-x[12241]: 2026-02-13T02:16:41.330+0000 7fc2c0b19fc0 -1 mgr[py] Loading module nfs in main interpreter 2026-02-13T02:16:41.453 INFO:journalctl@ceph.mgr.x.trial011.stdout:Feb 13 02:16:41 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-x[12241]: 2026-02-13T02:16:41.340+0000 7fc2c0b19fc0 -1 mgr[py] Loading module telemetry in main interpreter 2026-02-13T02:16:41.453 INFO:journalctl@ceph.mgr.x.trial011.stdout:Feb 13 02:16:41 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-x[12241]: 2026-02-13T02:16:41.346+0000 7fc2c0b19fc0 -1 mgr[py] Loading module progress in main interpreter 2026-02-13T02:16:41.453 INFO:journalctl@ceph.mgr.x.trial011.stdout:Feb 13 02:16:41 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-x[12241]: 2026-02-13T02:16:41.349+0000 7fc2c0b19fc0 -1 mgr[py] Loading module diskprediction_local in main interpreter 2026-02-13T02:16:41.453 INFO:journalctl@ceph.mgr.x.trial011.stdout:Feb 13 02:16:41 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-x[12241]: 2026-02-13T02:16:41.386+0000 7fc2c0b19fc0 -1 mgr[py] Loading module rook in main interpreter 2026-02-13T02:16:41.453 INFO:journalctl@ceph.mgr.x.trial011.stdout:Feb 13 02:16:41 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-x[12241]: 2026-02-13T02:16:41.415+0000 7fc2c0b19fc0 -1 mgr[py] Loading module balancer in main interpreter 2026-02-13T02:16:41.453 INFO:journalctl@ceph.mgr.x.trial011.stdout:Feb 13 02:16:41 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-x[12241]: 2026-02-13T02:16:41.421+0000 7fc2c0b19fc0 -1 mgr[py] Loading module osd_perf_query in main interpreter 2026-02-13T02:16:41.453 INFO:journalctl@ceph.mgr.x.trial011.stdout:Feb 13 02:16:41 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-x[12241]: 2026-02-13T02:16:41.422+0000 7fc2c0b19fc0 -1 mgr[py] Loading module status in main interpreter 2026-02-13T02:16:41.453 INFO:journalctl@ceph.mgr.x.trial011.stdout:Feb 13 02:16:41 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-x[12241]: 2026-02-13T02:16:41.424+0000 7fc2c0b19fc0 -1 mgr[py] Loading module osd_support in main interpreter 2026-02-13T02:16:41.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:41 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/3250479862' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2026-02-13T02:16:41.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:41 trial011 ceph-mon[11956]: mgrmap e5: x(active, since 3s) 2026-02-13T02:16:41.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:41 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/3196549074' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2026-02-13T02:16:41.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:41 trial011 ceph-mon[11956]: Active manager daemon x restarted 2026-02-13T02:16:41.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:41 trial011 ceph-mon[11956]: Activating manager daemon x 2026-02-13T02:16:41.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:41 trial011 ceph-mon[11956]: osdmap e2: 0 total, 0 up, 0 in 2026-02-13T02:16:41.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:41 trial011 ceph-mon[11956]: mgrmap e6: x(active, starting, since 0.00273482s) 2026-02-13T02:16:41.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:41 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T02:16:41.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:41 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2026-02-13T02:16:41.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:41 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2026-02-13T02:16:41.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:41 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2026-02-13T02:16:41.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:41 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2026-02-13T02:16:41.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:41 trial011 ceph-mon[11956]: Manager daemon x is now available 2026-02-13T02:16:42.456 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout { 2026-02-13T02:16:42.456 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2026-02-13T02:16:42.456 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout "initialized": true 2026-02-13T02:16:42.457 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout } 2026-02-13T02:16:42.457 INFO:teuthology.orchestra.run.trial011.stdout:mgr epoch 5 is available 2026-02-13T02:16:42.457 INFO:teuthology.orchestra.run.trial011.stdout:Verifying orchestrator module is enabled... 2026-02-13T02:16:43.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:42 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:16:43.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:42 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:16:43.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:42 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:16:43.203 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:42 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:16:43.203 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:42 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:16:43.203 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:42 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:16:43.203 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:42 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:16:43.203 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:42 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:16:43.203 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:42 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:16:43.203 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:42 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:16:43.203 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:42 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2026-02-13T02:16:43.203 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:42 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2026-02-13T02:16:43.203 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:42 trial011 ceph-mon[11956]: mgrmap e7: x(active, since 1.00358s) 2026-02-13T02:16:43.203 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:42 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/3997030555' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "orchestrator"} : dispatch 2026-02-13T02:16:43.204 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:42 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:16:43.455 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stderr module 'orchestrator' is already enabled (always-on) 2026-02-13T02:16:43.456 INFO:teuthology.orchestra.run.trial011.stdout:Setting orchestrator backend to cephadm... 2026-02-13T02:16:43.924 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout value unchanged 2026-02-13T02:16:43.924 INFO:teuthology.orchestra.run.trial011.stdout:Generating ssh key... 2026-02-13T02:16:44.202 INFO:journalctl@ceph.mgr.x.trial011.stdout:Feb 13 02:16:44 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-x[12241]: Generating public/private ed25519 key pair. 2026-02-13T02:16:44.202 INFO:journalctl@ceph.mgr.x.trial011.stdout:Feb 13 02:16:44 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-x[12241]: Your identification has been saved in /tmp/tmponj31ojj/key 2026-02-13T02:16:44.202 INFO:journalctl@ceph.mgr.x.trial011.stdout:Feb 13 02:16:44 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-x[12241]: Your public key has been saved in /tmp/tmponj31ojj/key.pub 2026-02-13T02:16:44.202 INFO:journalctl@ceph.mgr.x.trial011.stdout:Feb 13 02:16:44 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-x[12241]: The key fingerprint is: 2026-02-13T02:16:44.203 INFO:journalctl@ceph.mgr.x.trial011.stdout:Feb 13 02:16:44 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-x[12241]: SHA256:HzAcXx4emXGWg+BoOs37RlqfYi/9DmjQWjdGWG9w/pQ ceph-fc631695-0881-11f1-899c-d404e6e7d460 2026-02-13T02:16:44.203 INFO:journalctl@ceph.mgr.x.trial011.stdout:Feb 13 02:16:44 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-x[12241]: The key's randomart image is: 2026-02-13T02:16:44.203 INFO:journalctl@ceph.mgr.x.trial011.stdout:Feb 13 02:16:44 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-x[12241]: +--[ED25519 256]--+ 2026-02-13T02:16:44.203 INFO:journalctl@ceph.mgr.x.trial011.stdout:Feb 13 02:16:44 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-x[12241]: | . ..B=+. | 2026-02-13T02:16:44.203 INFO:journalctl@ceph.mgr.x.trial011.stdout:Feb 13 02:16:44 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-x[12241]: | . = *+Xo .| 2026-02-13T02:16:44.203 INFO:journalctl@ceph.mgr.x.trial011.stdout:Feb 13 02:16:44 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-x[12241]: | * + + +E.| 2026-02-13T02:16:44.203 INFO:journalctl@ceph.mgr.x.trial011.stdout:Feb 13 02:16:44 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-x[12241]: | = + . . o | 2026-02-13T02:16:44.203 INFO:journalctl@ceph.mgr.x.trial011.stdout:Feb 13 02:16:44 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-x[12241]: | o S + + .| 2026-02-13T02:16:44.203 INFO:journalctl@ceph.mgr.x.trial011.stdout:Feb 13 02:16:44 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-x[12241]: | . *o= . | 2026-02-13T02:16:44.203 INFO:journalctl@ceph.mgr.x.trial011.stdout:Feb 13 02:16:44 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-x[12241]: | o++o.. | 2026-02-13T02:16:44.203 INFO:journalctl@ceph.mgr.x.trial011.stdout:Feb 13 02:16:44 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-x[12241]: | .o= +. | 2026-02-13T02:16:44.203 INFO:journalctl@ceph.mgr.x.trial011.stdout:Feb 13 02:16:44 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-x[12241]: | o.+.oo | 2026-02-13T02:16:44.204 INFO:journalctl@ceph.mgr.x.trial011.stdout:Feb 13 02:16:44 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-x[12241]: +----[SHA256]-----+ 2026-02-13T02:16:44.523 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIIT2GFPrKfHNmTPsCs8EqgiefZ4RfEPMXaApolCOoCGq ceph-fc631695-0881-11f1-899c-d404e6e7d460 2026-02-13T02:16:44.524 INFO:teuthology.orchestra.run.trial011.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2026-02-13T02:16:44.524 INFO:teuthology.orchestra.run.trial011.stdout:Adding key to root@localhost authorized_keys... 2026-02-13T02:16:44.524 INFO:teuthology.orchestra.run.trial011.stdout:Adding host trial011... 2026-02-13T02:16:44.545 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:44 trial011 ceph-mon[11956]: Optimize plan auto_2026-02-13_02:16:41, mode upmap, max misplaced 0.050000 2026-02-13T02:16:44.545 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:44 trial011 ceph-mon[11956]: No pools available 2026-02-13T02:16:44.545 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:44 trial011 ceph-mon[11956]: Found migration_current of "None". Setting to last migration. 2026-02-13T02:16:44.545 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:44 trial011 ceph-mon[11956]: from='client.14120 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2026-02-13T02:16:44.545 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:44 trial011 ceph-mon[11956]: from='client.14120 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2026-02-13T02:16:44.545 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:44 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/3997030555' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "orchestrator"}]': finished 2026-02-13T02:16:44.545 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:44 trial011 ceph-mon[11956]: mgrmap e8: x(active, since 2s) 2026-02-13T02:16:44.545 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:44 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:16:44.545 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:44 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:16:44.545 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:44 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:16:44.545 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:44 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:16:45.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:45 trial011 ceph-mon[11956]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:16:45.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:45 trial011 ceph-mon[11956]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:16:45.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:45 trial011 ceph-mon[11956]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:16:45.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:45 trial011 ceph-mon[11956]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:16:46.494 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout Added host 'trial011' with addr '10.20.193.11' 2026-02-13T02:16:46.494 INFO:teuthology.orchestra.run.trial011.stdout:Deploying unmanaged mon service... 2026-02-13T02:16:46.701 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:46 trial011 ceph-mon[11956]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial011", "addr": "10.20.193.11", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:16:46.739 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2026-02-13T02:16:46.739 INFO:teuthology.orchestra.run.trial011.stdout:Deploying unmanaged mgr service... 2026-02-13T02:16:46.990 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2026-02-13T02:16:47.229 INFO:teuthology.orchestra.run.trial011.stdout:Saving cluster configuration to /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/config directory 2026-02-13T02:16:47.490 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:47 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:16:47.490 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:47 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:16:47.490 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:47 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:16:47.490 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:47 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:16:47.491 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:47 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:16:47.491 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:47 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:16:47.491 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:47 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/1100861591' entity='client.admin' 2026-02-13T02:16:47.515 INFO:teuthology.orchestra.run.trial011.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2026-02-13T02:16:47.515 INFO:teuthology.orchestra.run.trial011.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2026-02-13T02:16:47.515 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:16:47.515 INFO:teuthology.orchestra.run.trial011.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2026-02-13T02:16:47.515 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:16:47.516 INFO:teuthology.orchestra.run.trial011.stdout:Or, if you are only running a single cluster on this host: 2026-02-13T02:16:47.516 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:16:47.516 INFO:teuthology.orchestra.run.trial011.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2026-02-13T02:16:47.516 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:16:47.516 INFO:teuthology.orchestra.run.trial011.stdout:Please consider enabling telemetry to help improve Ceph: 2026-02-13T02:16:47.516 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:16:47.516 INFO:teuthology.orchestra.run.trial011.stdout: ceph telemetry on 2026-02-13T02:16:47.516 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:16:47.516 INFO:teuthology.orchestra.run.trial011.stdout:For more information see: 2026-02-13T02:16:47.516 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:16:47.516 INFO:teuthology.orchestra.run.trial011.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2026-02-13T02:16:47.517 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:16:47.517 INFO:teuthology.orchestra.run.trial011.stdout:Bootstrap complete. 2026-02-13T02:16:47.521 INFO:teuthology.orchestra.run.trial011.stdout:systemctl: stdout static 2026-02-13T02:16:47.526 INFO:teuthology.orchestra.run.trial011.stdout:Non-zero exit code 3 from systemctl is-active logrotate 2026-02-13T02:16:47.526 INFO:teuthology.orchestra.run.trial011.stdout:systemctl: stdout inactive 2026-02-13T02:16:47.526 INFO:teuthology.orchestra.run.trial011.stdout:Enabling the logrotate.timer service to perform daily log rotation. 2026-02-13T02:16:47.693 INFO:tasks.cephadm:Fetching config... 2026-02-13T02:16:47.694 DEBUG:teuthology.orchestra.run.trial011:> set -ex 2026-02-13T02:16:47.694 DEBUG:teuthology.orchestra.run.trial011:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2026-02-13T02:16:47.711 INFO:tasks.cephadm:Fetching client.admin keyring... 2026-02-13T02:16:47.712 DEBUG:teuthology.orchestra.run.trial011:> set -ex 2026-02-13T02:16:47.712 DEBUG:teuthology.orchestra.run.trial011:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2026-02-13T02:16:47.770 INFO:tasks.cephadm:Fetching mon keyring... 2026-02-13T02:16:47.770 DEBUG:teuthology.orchestra.run.trial011:> set -ex 2026-02-13T02:16:47.770 DEBUG:teuthology.orchestra.run.trial011:> sudo dd if=/var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/keyring of=/dev/stdout 2026-02-13T02:16:47.838 INFO:tasks.cephadm:Fetching pub ssh key... 2026-02-13T02:16:47.839 DEBUG:teuthology.orchestra.run.trial011:> set -ex 2026-02-13T02:16:47.839 DEBUG:teuthology.orchestra.run.trial011:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2026-02-13T02:16:47.895 INFO:tasks.cephadm:Installing pub ssh key for root users... 2026-02-13T02:16:47.896 DEBUG:teuthology.orchestra.run.trial011:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIIT2GFPrKfHNmTPsCs8EqgiefZ4RfEPMXaApolCOoCGq ceph-fc631695-0881-11f1-899c-d404e6e7d460' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2026-02-13T02:16:47.973 INFO:teuthology.orchestra.run.trial011.stdout:ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIIT2GFPrKfHNmTPsCs8EqgiefZ4RfEPMXaApolCOoCGq ceph-fc631695-0881-11f1-899c-d404e6e7d460 2026-02-13T02:16:47.984 DEBUG:teuthology.orchestra.run.trial060:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIIT2GFPrKfHNmTPsCs8EqgiefZ4RfEPMXaApolCOoCGq ceph-fc631695-0881-11f1-899c-d404e6e7d460' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2026-02-13T02:16:48.024 INFO:teuthology.orchestra.run.trial060.stdout:ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIIT2GFPrKfHNmTPsCs8EqgiefZ4RfEPMXaApolCOoCGq ceph-fc631695-0881-11f1-899c-d404e6e7d460 2026-02-13T02:16:48.035 DEBUG:teuthology.orchestra.run.trial078:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIIT2GFPrKfHNmTPsCs8EqgiefZ4RfEPMXaApolCOoCGq ceph-fc631695-0881-11f1-899c-d404e6e7d460' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2026-02-13T02:16:48.079 INFO:teuthology.orchestra.run.trial078.stdout:ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIIT2GFPrKfHNmTPsCs8EqgiefZ4RfEPMXaApolCOoCGq ceph-fc631695-0881-11f1-899c-d404e6e7d460 2026-02-13T02:16:48.090 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2026-02-13T02:16:48.231 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:16:48.484 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2026-02-13T02:16:48.484 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph orch client-keyring set client.admin '*' --mode 0755 2026-02-13T02:16:48.607 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:16:48.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:48 trial011 ceph-mon[11956]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:16:48.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:48 trial011 ceph-mon[11956]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:16:48.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:48 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/146698902' entity='client.admin' 2026-02-13T02:16:48.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:48 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:16:48.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:48 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:16:48.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:48 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/529415578' entity='client.admin' 2026-02-13T02:16:48.864 INFO:tasks.cephadm:Writing (initial) conf and keyring to trial060 2026-02-13T02:16:48.864 DEBUG:teuthology.orchestra.run.trial060:> set -ex 2026-02-13T02:16:48.864 DEBUG:teuthology.orchestra.run.trial060:> dd of=/etc/ceph/ceph.conf 2026-02-13T02:16:48.883 DEBUG:teuthology.orchestra.run.trial060:> set -ex 2026-02-13T02:16:48.883 DEBUG:teuthology.orchestra.run.trial060:> dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-13T02:16:48.941 INFO:tasks.cephadm:Adding host trial060 to orchestrator... 2026-02-13T02:16:48.941 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph orch host add trial060 2026-02-13T02:16:49.064 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:16:49.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:49 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:16:49.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:49 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:16:49.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:49 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:16:49.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:49 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:16:49.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:49 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial011", "name": "osd_memory_target"} : dispatch 2026-02-13T02:16:49.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:49 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:16:49.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:49 trial011 ceph-mon[11956]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:16:49.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:49 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:16:49.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:49 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:16:49.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:49 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:16:49.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:49 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:16:49.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:49 trial011 ceph-mon[11956]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial060", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:16:49.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:49 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:16:49.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:49 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:16:49.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:49 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:16:51.233 INFO:teuthology.orchestra.run.trial011.stdout:Added host 'trial060' with addr '10.20.193.60' 2026-02-13T02:16:51.275 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph orch host ls --format=json 2026-02-13T02:16:51.398 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:16:51.621 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:16:51.621 INFO:teuthology.orchestra.run.trial011.stdout:[{"addr": "10.20.193.11", "hostname": "trial011", "labels": [], "status": ""}, {"addr": "10.20.193.60", "hostname": "trial060", "labels": [], "status": ""}] 2026-02-13T02:16:51.658 INFO:tasks.cephadm:Writing (initial) conf and keyring to trial078 2026-02-13T02:16:51.658 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-13T02:16:51.658 DEBUG:teuthology.orchestra.run.trial078:> dd of=/etc/ceph/ceph.conf 2026-02-13T02:16:51.678 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-13T02:16:51.679 DEBUG:teuthology.orchestra.run.trial078:> dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-13T02:16:51.736 INFO:tasks.cephadm:Adding host trial078 to orchestrator... 2026-02-13T02:16:51.736 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph orch host add trial078 2026-02-13T02:16:51.860 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:16:52.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:52 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:16:52.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:52 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:16:52.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:52 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:16:52.703 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:52 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:16:52.703 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:52 trial011 ceph-mon[11956]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T02:16:53.792 INFO:teuthology.orchestra.run.trial011.stdout:Added host 'trial078' with addr '10.20.193.78' 2026-02-13T02:16:53.793 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:53 trial011 ceph-mon[11956]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial078", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:16:53.793 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:53 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:16:53.793 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:53 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:16:53.793 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:53 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:16:53.793 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:53 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:16:53.793 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:53 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:16:53.794 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:53 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial060", "name": "osd_memory_target"} : dispatch 2026-02-13T02:16:53.794 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:53 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:16:53.794 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:53 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:16:53.836 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph orch host ls --format=json 2026-02-13T02:16:53.963 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:16:54.180 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:16:54.180 INFO:teuthology.orchestra.run.trial011.stdout:[{"addr": "10.20.193.11", "hostname": "trial011", "labels": [], "status": ""}, {"addr": "10.20.193.60", "hostname": "trial060", "labels": [], "status": ""}, {"addr": "10.20.193.78", "hostname": "trial078", "labels": [], "status": ""}] 2026-02-13T02:16:54.218 INFO:tasks.cephadm:Setting crush tunables to default 2026-02-13T02:16:54.219 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph osd crush tunables default 2026-02-13T02:16:54.339 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:16:55.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:54 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:16:55.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:54 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:16:55.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:54 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:16:55.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:54 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:16:55.203 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:54 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:16:55.203 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:54 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:16:55.203 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:54 trial011 ceph-mon[11956]: from='client.14158 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T02:16:55.203 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:54 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:16:55.203 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:54 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/3134820464' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2026-02-13T02:16:55.314 INFO:teuthology.orchestra.run.trial011.stderr:adjusted tunables profile to default 2026-02-13T02:16:55.356 INFO:tasks.cephadm:Adding mon.a on trial011 2026-02-13T02:16:55.356 INFO:tasks.cephadm:Adding mon.b on trial060 2026-02-13T02:16:55.356 INFO:tasks.cephadm:Adding mon.c on trial078 2026-02-13T02:16:55.356 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph orch apply mon '3;trial011:10.20.193.11=a;trial060:10.20.193.60=b;trial078:10.20.193.78=c' 2026-02-13T02:16:55.482 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-13T02:16:55.482 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-13T02:16:55.704 INFO:teuthology.orchestra.run.trial078.stdout:Scheduled mon update... 2026-02-13T02:16:55.747 DEBUG:teuthology.orchestra.run.trial060:mon.b> sudo journalctl -f -n 0 -u ceph-fc631695-0881-11f1-899c-d404e6e7d460@mon.b.service 2026-02-13T02:16:55.751 DEBUG:teuthology.orchestra.run.trial078:mon.c> sudo journalctl -f -n 0 -u ceph-fc631695-0881-11f1-899c-d404e6e7d460@mon.c.service 2026-02-13T02:16:55.753 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2026-02-13T02:16:55.754 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph mon dump -f json 2026-02-13T02:16:55.918 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-13T02:16:55.918 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-13T02:16:56.169 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:16:56.170 INFO:teuthology.orchestra.run.trial078.stdout:{"epoch":1,"fsid":"fc631695-0881-11f1-899c-d404e6e7d460","modified":"2026-02-13T02:16:34.149794Z","created":"2026-02-13T02:16:34.149794Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:3300","nonce":0},{"type":"v1","addr":"10.20.193.11:6789","nonce":0}]},"addr":"10.20.193.11:6789/0","public_addr":"10.20.193.11:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T02:16:34:149809+0000","crush_location":[]}],"quorum":[0]} 2026-02-13T02:16:56.170 INFO:teuthology.orchestra.run.trial078.stderr:dumped monmap epoch 1 2026-02-13T02:16:56.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:56 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:16:56.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:56 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/3134820464' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2026-02-13T02:16:56.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:56 trial011 ceph-mon[11956]: osdmap e3: 0 total, 0 up, 0 in 2026-02-13T02:16:56.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:56 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:16:56.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:56 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:16:56.453 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:56 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:16:56.453 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:56 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:16:56.453 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:56 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:16:56.453 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:56 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial078", "name": "osd_memory_target"} : dispatch 2026-02-13T02:16:56.453 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:56 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:16:56.453 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:56 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:16:57.212 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2026-02-13T02:16:57.212 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph mon dump -f json 2026-02-13T02:16:57.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:57 trial011 ceph-mon[11956]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;trial011:10.20.193.11=a;trial060:10.20.193.60=b;trial078:10.20.193.78=c", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:16:57.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:57 trial011 ceph-mon[11956]: from='client.? 10.20.193.78:0/4260161526' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-13T02:16:57.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:57 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:16:57.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:57 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:16:57.453 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:57 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:16:57.453 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:57 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T02:16:57.453 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:16:57 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:16:57.482 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.c/config 2026-02-13T02:16:57.595 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:16:57 trial078 ceph-mon[14969]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2026-02-13T02:17:02.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:02 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T02:17:02.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:02 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T02:17:02.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:02 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T02:17:02.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:02 trial011 ceph-mon[11956]: mon.a calling monitor election 2026-02-13T02:17:02.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:02 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T02:17:02.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:02 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T02:17:02.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:02 trial011 ceph-mon[11956]: mon.c calling monitor election 2026-02-13T02:17:02.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:02 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T02:17:02.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:02 trial011 ceph-mon[11956]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T02:17:02.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:02 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T02:17:02.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:02 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T02:17:02.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:02 trial011 ceph-mon[11956]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2026-02-13T02:17:02.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:02 trial011 ceph-mon[11956]: monmap epoch 2 2026-02-13T02:17:02.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:02 trial011 ceph-mon[11956]: fsid fc631695-0881-11f1-899c-d404e6e7d460 2026-02-13T02:17:02.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:02 trial011 ceph-mon[11956]: last_changed 2026-02-13T02:16:57.544986+0000 2026-02-13T02:17:02.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:02 trial011 ceph-mon[11956]: created 2026-02-13T02:16:34.149794+0000 2026-02-13T02:17:02.954 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:02 trial011 ceph-mon[11956]: min_mon_release 20 (tentacle) 2026-02-13T02:17:02.954 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:02 trial011 ceph-mon[11956]: election_strategy: 1 2026-02-13T02:17:02.954 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:02 trial011 ceph-mon[11956]: 0: [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] mon.a 2026-02-13T02:17:02.954 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:02 trial011 ceph-mon[11956]: 1: [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] mon.c 2026-02-13T02:17:02.954 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:02 trial011 ceph-mon[11956]: fsmap 2026-02-13T02:17:02.954 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:02 trial011 ceph-mon[11956]: osdmap e3: 0 total, 0 up, 0 in 2026-02-13T02:17:02.954 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:02 trial011 ceph-mon[11956]: mgrmap e8: x(active, since 21s) 2026-02-13T02:17:02.954 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:02 trial011 ceph-mon[11956]: overall HEALTH_OK 2026-02-13T02:17:02.954 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:02 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:02.954 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:02 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:02.954 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:02 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:02.954 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:02 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T02:17:02.955 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:02 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:03.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:02 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T02:17:03.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:02 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T02:17:03.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:02 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T02:17:03.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:02 trial078 ceph-mon[14969]: mon.a calling monitor election 2026-02-13T02:17:03.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:02 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T02:17:03.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:02 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T02:17:03.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:02 trial078 ceph-mon[14969]: mon.c calling monitor election 2026-02-13T02:17:03.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:02 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T02:17:03.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:02 trial078 ceph-mon[14969]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T02:17:03.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:02 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T02:17:03.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:02 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T02:17:03.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:02 trial078 ceph-mon[14969]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2026-02-13T02:17:03.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:02 trial078 ceph-mon[14969]: monmap epoch 2 2026-02-13T02:17:03.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:02 trial078 ceph-mon[14969]: fsid fc631695-0881-11f1-899c-d404e6e7d460 2026-02-13T02:17:03.043 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:02 trial078 ceph-mon[14969]: last_changed 2026-02-13T02:16:57.544986+0000 2026-02-13T02:17:03.043 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:02 trial078 ceph-mon[14969]: created 2026-02-13T02:16:34.149794+0000 2026-02-13T02:17:03.043 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:02 trial078 ceph-mon[14969]: min_mon_release 20 (tentacle) 2026-02-13T02:17:03.043 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:02 trial078 ceph-mon[14969]: election_strategy: 1 2026-02-13T02:17:03.043 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:02 trial078 ceph-mon[14969]: 0: [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] mon.a 2026-02-13T02:17:03.043 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:02 trial078 ceph-mon[14969]: 1: [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] mon.c 2026-02-13T02:17:03.043 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:02 trial078 ceph-mon[14969]: fsmap 2026-02-13T02:17:03.043 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:02 trial078 ceph-mon[14969]: osdmap e3: 0 total, 0 up, 0 in 2026-02-13T02:17:03.043 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:02 trial078 ceph-mon[14969]: mgrmap e8: x(active, since 21s) 2026-02-13T02:17:03.043 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:02 trial078 ceph-mon[14969]: overall HEALTH_OK 2026-02-13T02:17:03.043 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:02 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:03.043 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:02 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:03.043 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:02 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:03.044 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:02 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T02:17:03.044 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:02 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:03.724 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:17:03.724 INFO:teuthology.orchestra.run.trial078.stdout:{"epoch":2,"fsid":"fc631695-0881-11f1-899c-d404e6e7d460","modified":"2026-02-13T02:16:57.544986Z","created":"2026-02-13T02:16:34.149794Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:3300","nonce":0},{"type":"v1","addr":"10.20.193.11:6789","nonce":0}]},"addr":"10.20.193.11:6789/0","public_addr":"10.20.193.11:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T02:16:34:149809+0000","crush_location":[]},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:3300","nonce":0},{"type":"v1","addr":"10.20.193.78:6789","nonce":0}]},"addr":"10.20.193.78:6789/0","public_addr":"10.20.193.78:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T02:16:57:544985+0000","crush_location":[]}],"quorum":[0,1]} 2026-02-13T02:17:03.725 INFO:teuthology.orchestra.run.trial078.stderr:dumped monmap epoch 2 2026-02-13T02:17:03.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:03 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T02:17:04.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:03 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T02:17:04.250 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:04 trial060 ceph-mon[14797]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2026-02-13T02:17:04.763 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2026-02-13T02:17:04.763 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph mon dump -f json 2026-02-13T02:17:04.891 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.c/config 2026-02-13T02:17:09.415 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:09 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T02:17:09.415 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:09 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T02:17:09.415 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:09 trial078 ceph-mon[14969]: mon.a calling monitor election 2026-02-13T02:17:09.415 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:09 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T02:17:09.415 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:09 trial078 ceph-mon[14969]: mon.c calling monitor election 2026-02-13T02:17:09.415 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:09 trial078 ceph-mon[14969]: mon.b calling monitor election 2026-02-13T02:17:09.415 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:09 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T02:17:09.415 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:09 trial078 ceph-mon[14969]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T02:17:09.415 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:09 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T02:17:09.416 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:09 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T02:17:09.416 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:09 trial078 ceph-mon[14969]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T02:17:09.416 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:09 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T02:17:09.416 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:09 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T02:17:09.416 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:09 trial078 ceph-mon[14969]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2026-02-13T02:17:09.416 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:09 trial078 ceph-mon[14969]: monmap epoch 3 2026-02-13T02:17:09.416 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:09 trial078 ceph-mon[14969]: fsid fc631695-0881-11f1-899c-d404e6e7d460 2026-02-13T02:17:09.416 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:09 trial078 ceph-mon[14969]: last_changed 2026-02-13T02:17:04.086871+0000 2026-02-13T02:17:09.416 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:09 trial078 ceph-mon[14969]: created 2026-02-13T02:16:34.149794+0000 2026-02-13T02:17:09.416 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:09 trial078 ceph-mon[14969]: min_mon_release 20 (tentacle) 2026-02-13T02:17:09.416 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:09 trial078 ceph-mon[14969]: election_strategy: 1 2026-02-13T02:17:09.416 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:09 trial078 ceph-mon[14969]: 0: [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] mon.a 2026-02-13T02:17:09.417 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:09 trial078 ceph-mon[14969]: 1: [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] mon.c 2026-02-13T02:17:09.417 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:09 trial078 ceph-mon[14969]: 2: [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] mon.b 2026-02-13T02:17:09.417 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:09 trial078 ceph-mon[14969]: fsmap 2026-02-13T02:17:09.417 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:09 trial078 ceph-mon[14969]: osdmap e3: 0 total, 0 up, 0 in 2026-02-13T02:17:09.417 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:09 trial078 ceph-mon[14969]: mgrmap e8: x(active, since 27s) 2026-02-13T02:17:09.417 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:09 trial078 ceph-mon[14969]: overall HEALTH_OK 2026-02-13T02:17:09.417 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:09 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:09.417 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:09 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:09.417 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:09 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:09.417 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:09 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:09.418 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:09 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T02:17:09.418 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:09 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T02:17:09.418 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:09 trial060 ceph-mon[14797]: mon.a calling monitor election 2026-02-13T02:17:09.418 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:09 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T02:17:09.418 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:09 trial060 ceph-mon[14797]: mon.c calling monitor election 2026-02-13T02:17:09.418 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:09 trial060 ceph-mon[14797]: mon.b calling monitor election 2026-02-13T02:17:09.418 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:09 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T02:17:09.419 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:09 trial060 ceph-mon[14797]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T02:17:09.419 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:09 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T02:17:09.419 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:09 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T02:17:09.419 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:09 trial060 ceph-mon[14797]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T02:17:09.419 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:09 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T02:17:09.419 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:09 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T02:17:09.419 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:09 trial060 ceph-mon[14797]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2026-02-13T02:17:09.419 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:09 trial060 ceph-mon[14797]: monmap epoch 3 2026-02-13T02:17:09.419 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:09 trial060 ceph-mon[14797]: fsid fc631695-0881-11f1-899c-d404e6e7d460 2026-02-13T02:17:09.419 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:09 trial060 ceph-mon[14797]: last_changed 2026-02-13T02:17:04.086871+0000 2026-02-13T02:17:09.419 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:09 trial060 ceph-mon[14797]: created 2026-02-13T02:16:34.149794+0000 2026-02-13T02:17:09.419 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:09 trial060 ceph-mon[14797]: min_mon_release 20 (tentacle) 2026-02-13T02:17:09.420 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:09 trial060 ceph-mon[14797]: election_strategy: 1 2026-02-13T02:17:09.420 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:09 trial060 ceph-mon[14797]: 0: [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] mon.a 2026-02-13T02:17:09.420 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:09 trial060 ceph-mon[14797]: 1: [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] mon.c 2026-02-13T02:17:09.420 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:09 trial060 ceph-mon[14797]: 2: [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] mon.b 2026-02-13T02:17:09.420 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:09 trial060 ceph-mon[14797]: fsmap 2026-02-13T02:17:09.420 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:09 trial060 ceph-mon[14797]: osdmap e3: 0 total, 0 up, 0 in 2026-02-13T02:17:09.420 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:09 trial060 ceph-mon[14797]: mgrmap e8: x(active, since 27s) 2026-02-13T02:17:09.420 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:09 trial060 ceph-mon[14797]: overall HEALTH_OK 2026-02-13T02:17:09.420 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:09 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:09.420 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:09 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:09.420 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:09 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:09.420 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:09 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:09.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:09 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T02:17:09.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:09 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T02:17:09.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:09 trial011 ceph-mon[11956]: mon.a calling monitor election 2026-02-13T02:17:09.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:09 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T02:17:09.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:09 trial011 ceph-mon[11956]: mon.c calling monitor election 2026-02-13T02:17:09.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:09 trial011 ceph-mon[11956]: mon.b calling monitor election 2026-02-13T02:17:09.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:09 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T02:17:09.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:09 trial011 ceph-mon[11956]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T02:17:09.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:09 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T02:17:09.453 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:09 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T02:17:09.453 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:09 trial011 ceph-mon[11956]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T02:17:09.453 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:09 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T02:17:09.453 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:09 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T02:17:09.453 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:09 trial011 ceph-mon[11956]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2026-02-13T02:17:09.453 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:09 trial011 ceph-mon[11956]: monmap epoch 3 2026-02-13T02:17:09.453 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:09 trial011 ceph-mon[11956]: fsid fc631695-0881-11f1-899c-d404e6e7d460 2026-02-13T02:17:09.453 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:09 trial011 ceph-mon[11956]: last_changed 2026-02-13T02:17:04.086871+0000 2026-02-13T02:17:09.453 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:09 trial011 ceph-mon[11956]: created 2026-02-13T02:16:34.149794+0000 2026-02-13T02:17:09.453 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:09 trial011 ceph-mon[11956]: min_mon_release 20 (tentacle) 2026-02-13T02:17:09.453 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:09 trial011 ceph-mon[11956]: election_strategy: 1 2026-02-13T02:17:09.453 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:09 trial011 ceph-mon[11956]: 0: [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] mon.a 2026-02-13T02:17:09.453 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:09 trial011 ceph-mon[11956]: 1: [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] mon.c 2026-02-13T02:17:09.454 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:09 trial011 ceph-mon[11956]: 2: [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] mon.b 2026-02-13T02:17:09.454 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:09 trial011 ceph-mon[11956]: fsmap 2026-02-13T02:17:09.454 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:09 trial011 ceph-mon[11956]: osdmap e3: 0 total, 0 up, 0 in 2026-02-13T02:17:09.454 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:09 trial011 ceph-mon[11956]: mgrmap e8: x(active, since 27s) 2026-02-13T02:17:09.454 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:09 trial011 ceph-mon[11956]: overall HEALTH_OK 2026-02-13T02:17:09.454 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:09 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:09.454 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:09 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:09.454 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:09 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:09.454 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:09 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:09.544 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:17:09.544 INFO:teuthology.orchestra.run.trial078.stdout:{"epoch":3,"fsid":"fc631695-0881-11f1-899c-d404e6e7d460","modified":"2026-02-13T02:17:04.086871Z","created":"2026-02-13T02:16:34.149794Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:3300","nonce":0},{"type":"v1","addr":"10.20.193.11:6789","nonce":0}]},"addr":"10.20.193.11:6789/0","public_addr":"10.20.193.11:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T02:16:34:149809+0000","crush_location":[]},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:3300","nonce":0},{"type":"v1","addr":"10.20.193.78:6789","nonce":0}]},"addr":"10.20.193.78:6789/0","public_addr":"10.20.193.78:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T02:16:57:544985+0000","crush_location":[]},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:3300","nonce":0},{"type":"v1","addr":"10.20.193.60:6789","nonce":0}]},"addr":"10.20.193.60:6789/0","public_addr":"10.20.193.60:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T02:17:04:086870+0000","crush_location":[]}],"quorum":[0,1,2]} 2026-02-13T02:17:09.544 INFO:teuthology.orchestra.run.trial078.stderr:dumped monmap epoch 3 2026-02-13T02:17:09.584 INFO:tasks.cephadm:Generating final ceph.conf file... 2026-02-13T02:17:09.584 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph config generate-minimal-conf 2026-02-13T02:17:09.707 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:17:09.930 INFO:teuthology.orchestra.run.trial011.stdout:# minimal ceph.conf for fc631695-0881-11f1-899c-d404e6e7d460 2026-02-13T02:17:09.930 INFO:teuthology.orchestra.run.trial011.stdout:[global] 2026-02-13T02:17:09.930 INFO:teuthology.orchestra.run.trial011.stdout: fsid = fc631695-0881-11f1-899c-d404e6e7d460 2026-02-13T02:17:09.930 INFO:teuthology.orchestra.run.trial011.stdout: mon_host = [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] 2026-02-13T02:17:09.971 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2026-02-13T02:17:09.971 DEBUG:teuthology.orchestra.run.trial011:> set -ex 2026-02-13T02:17:09.971 DEBUG:teuthology.orchestra.run.trial011:> sudo dd of=/etc/ceph/ceph.conf 2026-02-13T02:17:10.001 DEBUG:teuthology.orchestra.run.trial011:> set -ex 2026-02-13T02:17:10.001 DEBUG:teuthology.orchestra.run.trial011:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-13T02:17:10.069 DEBUG:teuthology.orchestra.run.trial060:> set -ex 2026-02-13T02:17:10.069 DEBUG:teuthology.orchestra.run.trial060:> sudo dd of=/etc/ceph/ceph.conf 2026-02-13T02:17:10.098 DEBUG:teuthology.orchestra.run.trial060:> set -ex 2026-02-13T02:17:10.098 DEBUG:teuthology.orchestra.run.trial060:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-13T02:17:10.165 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-13T02:17:10.165 DEBUG:teuthology.orchestra.run.trial078:> sudo dd of=/etc/ceph/ceph.conf 2026-02-13T02:17:10.195 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-13T02:17:10.195 DEBUG:teuthology.orchestra.run.trial078:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-13T02:17:10.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:10 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:17:10.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:10 trial011 ceph-mon[11956]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T02:17:10.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:10 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:10.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:10 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:10.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:10 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:10.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:10 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:10.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:10 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:10.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:10 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:17:10.203 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:10 trial011 ceph-mon[11956]: from='client.? 10.20.193.78:0/815709876' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-13T02:17:10.203 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:10 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:10.203 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:10 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:10.203 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:10 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:10.203 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:10 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:10.203 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:10 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:10.203 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:10 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:10.203 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:10 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:10.203 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:10 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T02:17:10.203 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:10 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-13T02:17:10.203 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:10 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:10.203 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:10 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/308966258' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:10.204 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:10 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:10.204 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:10 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:10.204 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:10 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T02:17:10.204 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:10 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-13T02:17:10.204 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:10 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:10.204 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:10 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T02:17:10.262 INFO:tasks.cephadm:Adding mgr.x on trial011 2026-02-13T02:17:10.262 INFO:tasks.cephadm:Adding mgr.y on trial060 2026-02-13T02:17:10.262 INFO:tasks.cephadm:Adding mgr.z on trial078 2026-02-13T02:17:10.262 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph orch apply mgr '3;trial011=x;trial060=y;trial078=z' 2026-02-13T02:17:10.424 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.c/config 2026-02-13T02:17:10.428 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:10 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:17:10.428 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:10 trial078 ceph-mon[14969]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T02:17:10.428 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:10 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:10.428 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:10 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:10.428 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:10 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:10.428 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:10 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:10.428 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:10 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:10.428 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:10 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:17:10.428 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:10 trial078 ceph-mon[14969]: from='client.? 10.20.193.78:0/815709876' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-13T02:17:10.429 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:10 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:10.429 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:10 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:10.429 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:10 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:10.429 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:10 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:10.429 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:10 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:10.429 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:10 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:10.429 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:10 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:10.429 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:10 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T02:17:10.429 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:10 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-13T02:17:10.429 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:10 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:10.429 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:10 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/308966258' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:10.429 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:10 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:10.429 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:10 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:10.429 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:10 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T02:17:10.429 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:10 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-13T02:17:10.429 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:10 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:10.429 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:10 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T02:17:10.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:10 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:17:10.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:10 trial060 ceph-mon[14797]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T02:17:10.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:10 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:10.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:10 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:10.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:10 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:10.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:10 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:10.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:10 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:10.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:10 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:17:10.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:10 trial060 ceph-mon[14797]: from='client.? 10.20.193.78:0/815709876' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-13T02:17:10.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:10 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:10.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:10 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:10.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:10 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:10.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:10 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:10.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:10 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:10.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:10 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:10.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:10 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:10.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:10 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T02:17:10.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:10 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-13T02:17:10.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:10 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:10.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:10 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/308966258' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:10.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:10 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:10.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:10 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:10.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:10 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T02:17:10.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:10 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-13T02:17:10.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:10 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:10.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:10 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T02:17:10.645 INFO:teuthology.orchestra.run.trial078.stdout:Scheduled mgr update... 2026-02-13T02:17:10.686 DEBUG:teuthology.orchestra.run.trial060:mgr.y> sudo journalctl -f -n 0 -u ceph-fc631695-0881-11f1-899c-d404e6e7d460@mgr.y.service 2026-02-13T02:17:10.688 DEBUG:teuthology.orchestra.run.trial078:mgr.z> sudo journalctl -f -n 0 -u ceph-fc631695-0881-11f1-899c-d404e6e7d460@mgr.z.service 2026-02-13T02:17:10.690 INFO:tasks.cephadm:setting config [client] client_mount_timeout = 600 2026-02-13T02:17:10.690 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph config set client client_mount_timeout 600 2026-02-13T02:17:10.691 INFO:tasks.cephadm:setting config [client] debug_client = 20 2026-02-13T02:17:10.692 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph config set client debug_client 20 2026-02-13T02:17:10.734 INFO:tasks.cephadm:setting config [client] debug_ms = 1 2026-02-13T02:17:10.734 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph config set client debug_ms 1 2026-02-13T02:17:10.777 INFO:tasks.cephadm:setting config [client] rados_mon_op_timeout = 900 2026-02-13T02:17:10.777 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph config set client rados_mon_op_timeout 900 2026-02-13T02:17:10.811 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:17:10.812 INFO:tasks.cephadm:setting config [client] rados_osd_op_timeout = 900 2026-02-13T02:17:10.812 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph config set client rados_osd_op_timeout 900 2026-02-13T02:17:10.855 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:17:10.898 INFO:tasks.cephadm:setting config [mds] debug_mds = 20 2026-02-13T02:17:10.898 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph config set mds debug_mds 20 2026-02-13T02:17:10.901 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:17:10.902 INFO:tasks.cephadm:setting config [mds] debug_mds_balancer = 20 2026-02-13T02:17:10.902 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph config set mds debug_mds_balancer 20 2026-02-13T02:17:10.935 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:17:10.936 INFO:tasks.cephadm:setting config [mds] debug_ms = 2 2026-02-13T02:17:10.937 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph config set mds debug_ms 2 2026-02-13T02:17:10.980 INFO:tasks.cephadm:setting config [mds] mds_bal_fragment_size_max = 10000 2026-02-13T02:17:10.980 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph config set mds mds_bal_fragment_size_max 10000 2026-02-13T02:17:11.023 INFO:tasks.cephadm:setting config [mds] mds_bal_merge_size = 5 2026-02-13T02:17:11.023 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph config set mds mds_bal_merge_size 5 2026-02-13T02:17:11.029 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:17:11.030 INFO:tasks.cephadm:setting config [mds] mds_bal_split_bits = 3 2026-02-13T02:17:11.030 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph config set mds mds_bal_split_bits 3 2026-02-13T02:17:11.031 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:17:11.067 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:17:11.068 INFO:tasks.cephadm:setting config [mds] mds_bal_split_size = 100 2026-02-13T02:17:11.068 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph config set mds mds_bal_split_size 100 2026-02-13T02:17:11.110 INFO:tasks.cephadm:setting config [mds] mds_debug_frag = True 2026-02-13T02:17:11.110 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph config set mds mds_debug_frag True 2026-02-13T02:17:11.121 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:17:11.122 INFO:tasks.cephadm:setting config [mds] mds_debug_scatterstat = True 2026-02-13T02:17:11.122 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph config set mds mds_debug_scatterstat True 2026-02-13T02:17:11.143 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.139+0000 7f5e034e16c0 1 -- 10.20.193.11:0/4097541672 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f5dd803f8f0 msgr2=0x7f5dd805fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:11.143 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.139+0000 7f5e034e16c0 1 --2- 10.20.193.11:0/4097541672 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f5dd803f8f0 0x7f5dd805fda0 secure :-1 s=READY pgs=47 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5df0005980 tx=0x7f5df0005910 comp rx=0 tx=0).stop 2026-02-13T02:17:11.143 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.139+0000 7f5e034e16c0 1 -- 10.20.193.11:0/4097541672 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f5dfc10eed0 msgr2=0x7f5dfc0f8770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:11.143 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.139+0000 7f5e034e16c0 1 --2- 10.20.193.11:0/4097541672 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f5dfc10eed0 0x7f5dfc0f8770 secure :-1 s=READY pgs=88 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5dec00b710 tx=0x7f5dec00bbe0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.143 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.139+0000 7f5e034e16c0 1 -- 10.20.193.11:0/4097541672 shutdown_connections 2026-02-13T02:17:11.143 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.139+0000 7f5e034e16c0 1 --2- 10.20.193.11:0/4097541672 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f5dd803f8f0 0x7f5dd805fda0 unknown :-1 s=CLOSED pgs=47 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.143 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.139+0000 7f5e034e16c0 1 --2- 10.20.193.11:0/4097541672 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f5dfc110a00 0x7f5dfc0f8fd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.143 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.139+0000 7f5e034e16c0 1 --2- 10.20.193.11:0/4097541672 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f5dfc110050 0x7f5dfc171390 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.143 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.139+0000 7f5e034e16c0 1 --2- 10.20.193.11:0/4097541672 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f5dfc10eed0 0x7f5dfc0f8770 unknown :-1 s=CLOSED pgs=88 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.143 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.139+0000 7f5e034e16c0 1 -- 10.20.193.11:0/4097541672 >> 10.20.193.11:0/4097541672 conn(0x7f5dfc0ec5f0 msgr2=0x7f5dfc0eed00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:17:11.143 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.140+0000 7f5e034e16c0 1 -- 10.20.193.11:0/4097541672 shutdown_connections 2026-02-13T02:17:11.143 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.140+0000 7f5e034e16c0 1 -- 10.20.193.11:0/4097541672 wait complete. 2026-02-13T02:17:11.144 INFO:tasks.cephadm:setting config [mds] mds_op_complaint_time = 180 2026-02-13T02:17:11.144 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph config set mds mds_op_complaint_time 180 2026-02-13T02:17:11.159 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.157+0000 7f0c8ef506c0 1 -- 10.20.193.11:0/3874639930 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f0c881723e0 con 0x7f0c8810cc50 2026-02-13T02:17:11.161 INFO:tasks.cephadm:setting config [mds] mds_verify_scatter = True 2026-02-13T02:17:11.161 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph config set mds mds_verify_scatter True 2026-02-13T02:17:11.162 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.160+0000 7f0c7dffb6c0 1 -- 10.20.193.11:0/3874639930 <== mon.0 v2:10.20.193.11:3300/0 9 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v12)=0 v12) ==== 123+0+0 (secure 0 0 0) 0x7f0c78030030 con 0x7f0c8810cc50 2026-02-13T02:17:11.164 INFO:tasks.cephadm:setting config [mds] osd_op_complaint_time = 180 2026-02-13T02:17:11.164 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph config set mds osd_op_complaint_time 180 2026-02-13T02:17:11.164 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.160+0000 7f0c7dffb6c0 1 -- 10.20.193.11:0/3874639930 <== mon.0 v2:10.20.193.11:3300/0 10 ==== config(27 keys) ==== 1119+0+0 (secure 0 0 0) 0x7f0c78030030 con 0x7f0c8810cc50 2026-02-13T02:17:11.166 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.163+0000 7fa9e73596c0 1 -- 10.20.193.11:0/2295127432 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fa9e0110a00 msgr2=0x7fa9e0171390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:11.166 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.163+0000 7fa9e73596c0 1 --2- 10.20.193.11:0/2295127432 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fa9e0110a00 0x7fa9e0171390 secure :-1 s=READY pgs=91 gs=3 cs=0 l=1 c_cookie=9901761470685414420 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa9dc006fd0 tx=0x7fa9dc02fd20 comp rx=0 tx=0).stop 2026-02-13T02:17:11.166 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.163+0000 7fa9e73596c0 1 -- 10.20.193.11:0/2295127432 shutdown_connections 2026-02-13T02:17:11.166 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.163+0000 7fa9e73596c0 1 --2- 10.20.193.11:0/2295127432 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fa9e0110050 0x7fa9e01104c0 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.166 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.163+0000 7fa9e73596c0 1 --2- 10.20.193.11:0/2295127432 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fa9e0110a00 0x7fa9e0171390 unknown :-1 s=CLOSED pgs=91 gs=3 cs=0 l=1 c_cookie=9901761470685414420 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.166 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.163+0000 7fa9e73596c0 1 --2- 10.20.193.11:0/2295127432 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa9e010eed0 0x7fa9e010f2c0 unknown :-1 s=CLOSED pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.166 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.163+0000 7fa9e73596c0 1 -- 10.20.193.11:0/2295127432 >> 10.20.193.11:0/2295127432 conn(0x7fa9e00ec5f0 msgr2=0x7fa9e010ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:17:11.166 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.163+0000 7fa9e73596c0 1 -- 10.20.193.11:0/2295127432 shutdown_connections 2026-02-13T02:17:11.167 INFO:tasks.cephadm:setting config [mds] rados_mon_op_timeout = 900 2026-02-13T02:17:11.167 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph config set mds rados_mon_op_timeout 900 2026-02-13T02:17:11.168 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.163+0000 7f0c8ef506c0 1 -- 10.20.193.11:0/3874639930 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f0c6403f8f0 msgr2=0x7f0c6405fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:11.168 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.163+0000 7f0c8ef506c0 1 --2- 10.20.193.11:0/3874639930 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f0c6403f8f0 0x7f0c6405fda0 secure :-1 s=READY pgs=48 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0c70005980 tx=0x7f0c70005910 comp rx=0 tx=0).stop 2026-02-13T02:17:11.168 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.164+0000 7f0c8ef506c0 1 -- 10.20.193.11:0/3874639930 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f0c8810cc50 msgr2=0x7f0c880f6520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:11.168 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.164+0000 7f0c8ef506c0 1 --2- 10.20.193.11:0/3874639930 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f0c8810cc50 0x7f0c880f6520 secure :-1 s=READY pgs=90 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0c780092b0 tx=0x7f0c780028e0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.168 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.164+0000 7f0c8ef506c0 1 -- 10.20.193.11:0/3874639930 shutdown_connections 2026-02-13T02:17:11.168 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.164+0000 7f0c8ef506c0 1 --2- 10.20.193.11:0/3874639930 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f0c6403f8f0 0x7f0c6405fda0 unknown :-1 s=CLOSED pgs=48 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.168 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.164+0000 7f0c8ef506c0 1 --2- 10.20.193.11:0/3874639930 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f0c8810ddd0 0x7f0c8816f110 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.168 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.164+0000 7f0c8ef506c0 1 --2- 10.20.193.11:0/3874639930 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f0c8810e780 0x7f0c880f6d80 unknown :-1 s=CLOSED pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.168 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.164+0000 7f0c8ef506c0 1 --2- 10.20.193.11:0/3874639930 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f0c8810cc50 0x7f0c880f6520 unknown :-1 s=CLOSED pgs=90 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.168 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.164+0000 7f0c8ef506c0 1 -- 10.20.193.11:0/3874639930 >> 10.20.193.11:0/3874639930 conn(0x7f0c880ea370 msgr2=0x7f0c880eca80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:17:11.168 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.164+0000 7f0c8ef506c0 1 -- 10.20.193.11:0/3874639930 shutdown_connections 2026-02-13T02:17:11.168 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.164+0000 7f0c8ef506c0 1 -- 10.20.193.11:0/3874639930 wait complete. 2026-02-13T02:17:11.168 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.164+0000 7f3cb68eb6c0 1 -- 10.20.193.11:0/4202011845 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f3cb0110a00 msgr2=0x7f3cb0171390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:11.169 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.164+0000 7f3cb68eb6c0 1 --2- 10.20.193.11:0/4202011845 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f3cb0110a00 0x7f3cb0171390 secure :-1 s=READY pgs=92 gs=2 cs=0 l=1 c_cookie=3233725295079507217 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3ca400aa40 tx=0x7f3ca402fde0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.169 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.164+0000 7f3cb68eb6c0 1 -- 10.20.193.11:0/4202011845 shutdown_connections 2026-02-13T02:17:11.169 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.164+0000 7f3cb68eb6c0 1 --2- 10.20.193.11:0/4202011845 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f3cb0110a00 0x7f3cb0171390 unknown :-1 s=CLOSED pgs=92 gs=2 cs=0 l=1 c_cookie=3233725295079507217 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.169 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.164+0000 7f3cb68eb6c0 1 --2- 10.20.193.11:0/4202011845 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f3cb0110050 0x7f3cb01104c0 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.169 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.164+0000 7f3cb68eb6c0 1 --2- 10.20.193.11:0/4202011845 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f3cb010eed0 0x7f3cb010f2c0 unknown :-1 s=CLOSED pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.169 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.164+0000 7f3cb68eb6c0 1 -- 10.20.193.11:0/4202011845 >> 10.20.193.11:0/4202011845 conn(0x7f3cb00ec5f0 msgr2=0x7f3cb010ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:17:11.169 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.164+0000 7f3cb68eb6c0 1 -- 10.20.193.11:0/4202011845 shutdown_connections 2026-02-13T02:17:11.169 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.164+0000 7f3cb68eb6c0 1 -- 10.20.193.11:0/4202011845 wait complete. 2026-02-13T02:17:11.169 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.163+0000 7fa9e73596c0 1 -- 10.20.193.11:0/2295127432 wait complete. 2026-02-13T02:17:11.169 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.164+0000 7fa9e73596c0 1 Processor -- start 2026-02-13T02:17:11.169 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.164+0000 7fa9e73596c0 1 -- start start 2026-02-13T02:17:11.170 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.165+0000 7f3cb68eb6c0 1 Processor -- start 2026-02-13T02:17:11.170 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.165+0000 7f3cb68eb6c0 1 -- start start 2026-02-13T02:17:11.170 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.165+0000 7f3cb68eb6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f3cb010eed0 0x7f3cb00f6620 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:11.170 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.165+0000 7f3cb68eb6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f3cb0110050 0x7f3cb0171390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:11.170 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.165+0000 7f3cb68eb6c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f3cb0110a00 0x7f3cb00f6e80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:11.170 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.165+0000 7f3cb68eb6c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb00f7ab0 con 0x7f3cb0110050 2026-02-13T02:17:11.170 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.165+0000 7f3cb68eb6c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb00f7c20 con 0x7f3cb0110a00 2026-02-13T02:17:11.170 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.165+0000 7f3cb68eb6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb00f7de0 con 0x7f3cb010eed0 2026-02-13T02:17:11.170 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.165+0000 7f3cb4e5d6c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f3cb0110a00 0x7f3cb00f6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:11.170 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.165+0000 7f3cb4e5d6c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f3cb0110a00 0x7f3cb00f6e80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.60:3300/0 says I am v2:10.20.193.11:45392/0 (socket says 10.20.193.11:45392) 2026-02-13T02:17:11.171 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.165+0000 7f3caffff6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f3cb010eed0 0x7f3cb00f6620 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:11.171 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.165+0000 7f3cb4e5d6c0 1 -- 10.20.193.11:0/971774583 learned_addr learned my addr 10.20.193.11:0/971774583 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:17:11.171 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.165+0000 7f3caffff6c0 1 -- 10.20.193.11:0/971774583 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f3cb010eed0 msgr2=0x7f3cb00f6620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 11 2026-02-13T02:17:11.171 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.165+0000 7f3caffff6c0 1 -- 10.20.193.11:0/971774583 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f3cb010eed0 msgr2=0x7f3cb00f6620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T02:17:11.171 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.165+0000 7f3caffff6c0 1 --2- 10.20.193.11:0/971774583 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f3cb010eed0 0x7f3cb00f6620 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-13T02:17:11.171 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.165+0000 7f3caffff6c0 1 --2- 10.20.193.11:0/971774583 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f3cb010eed0 0x7f3cb00f6620 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-13T02:17:11.171 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.165+0000 7f3cb4e5d6c0 1 -- 10.20.193.11:0/971774583 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f3cb0110a00 msgr2=0x7f3cb00f6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 10 2026-02-13T02:17:11.171 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.165+0000 7f3cb4e5d6c0 1 -- 10.20.193.11:0/971774583 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f3cb0110a00 msgr2=0x7f3cb00f6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T02:17:11.171 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.165+0000 7f3cb4e5d6c0 1 --2- 10.20.193.11:0/971774583 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f3cb0110a00 0x7f3cb00f6e80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-13T02:17:11.171 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.165+0000 7f3cb4e5d6c0 1 --2- 10.20.193.11:0/971774583 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f3cb0110a00 0x7f3cb00f6e80 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-13T02:17:11.171 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.165+0000 7fa9e73596c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fa9e010eed0 0x7fa9e00fca60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:11.171 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.165+0000 7fa9e73596c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fa9e0110050 0x7fa9e0171390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:11.171 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.165+0000 7fa9e73596c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa9e0110a00 0x7fa9e00fd2c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:11.171 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.165+0000 7fa9e73596c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7fa9e00fdef0 con 0x7fa9e010eed0 2026-02-13T02:17:11.171 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.165+0000 7fa9e73596c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa9e00fe060 con 0x7fa9e0110050 2026-02-13T02:17:11.171 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.165+0000 7fa9e73596c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa9e00fe220 con 0x7fa9e0110a00 2026-02-13T02:17:11.171 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.165+0000 7f3caf7fe6c0 1 --2- 10.20.193.11:0/971774583 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f3cb0110050 0x7f3cb0171390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:11.172 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.165+0000 7fa9e48c96c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fa9e0110050 0x7fa9e0171390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:11.172 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.165+0000 7fa9e48c96c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fa9e0110050 0x7fa9e0171390 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.60:3300/0 says I am v2:10.20.193.11:45394/0 (socket says 10.20.193.11:45394) 2026-02-13T02:17:11.172 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.166+0000 7f3caf7fe6c0 1 -- 10.20.193.11:0/971774583 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f3cb010eed0 msgr2=0x7f3cb00f6620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T02:17:11.172 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.166+0000 7f3caf7fe6c0 1 --2- 10.20.193.11:0/971774583 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f3cb010eed0 0x7f3cb00f6620 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.172 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.165+0000 7fa9e48c96c0 1 -- 10.20.193.11:0/336177196 learned_addr learned my addr 10.20.193.11:0/336177196 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:17:11.172 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.166+0000 7f3caf7fe6c0 1 -- 10.20.193.11:0/971774583 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f3cb0110a00 msgr2=0x7f3cb00f6e80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T02:17:11.172 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.166+0000 7f3caf7fe6c0 1 --2- 10.20.193.11:0/971774583 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f3cb0110a00 0x7f3cb00f6e80 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.172 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.166+0000 7f3caf7fe6c0 1 -- 10.20.193.11:0/971774583 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ca400a660 con 0x7f3cb0110050 2026-02-13T02:17:11.173 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.165+0000 7fa9e50ca6c0 1 --2- 10.20.193.11:0/336177196 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fa9e010eed0 0x7fa9e00fca60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:11.173 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.165+0000 7fa9e48c96c0 1 -- 10.20.193.11:0/336177196 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fa9e0110050 msgr2=0x7fa9e0171390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 9 2026-02-13T02:17:11.173 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.165+0000 7fa9e48c96c0 1 -- 10.20.193.11:0/336177196 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fa9e0110050 msgr2=0x7fa9e0171390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T02:17:11.173 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.165+0000 7fa9e48c96c0 1 --2- 10.20.193.11:0/336177196 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fa9e0110050 0x7fa9e0171390 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-13T02:17:11.173 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.165+0000 7fa9e48c96c0 1 --2- 10.20.193.11:0/336177196 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fa9e0110050 0x7fa9e0171390 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-13T02:17:11.173 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.165+0000 7fa9e58cb6c0 1 --2- 10.20.193.11:0/336177196 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa9e0110a00 0x7fa9e00fd2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:11.173 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.166+0000 7f3caf7fe6c0 1 --2- 10.20.193.11:0/971774583 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f3cb0110050 0x7f3cb0171390 secure :-1 s=READY pgs=94 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3ca000b6c0 tx=0x7f3ca000bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:17:11.173 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.166+0000 7fa9e58cb6c0 1 -- 10.20.193.11:0/336177196 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa9e0110a00 msgr2=0x7fa9e00fd2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 10 2026-02-13T02:17:11.173 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.166+0000 7fa9e58cb6c0 1 -- 10.20.193.11:0/336177196 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa9e0110a00 msgr2=0x7fa9e00fd2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T02:17:11.173 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.166+0000 7fa9e58cb6c0 1 --2- 10.20.193.11:0/336177196 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa9e0110a00 0x7fa9e00fd2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-13T02:17:11.174 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.166+0000 7fa9e58cb6c0 1 --2- 10.20.193.11:0/336177196 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa9e0110a00 0x7fa9e00fd2c0 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-13T02:17:11.174 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.166+0000 7fa9e50ca6c0 1 -- 10.20.193.11:0/336177196 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa9e0110a00 msgr2=0x7fa9e00fd2c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T02:17:11.174 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.166+0000 7fa9e50ca6c0 1 --2- 10.20.193.11:0/336177196 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa9e0110a00 0x7fa9e00fd2c0 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.174 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.166+0000 7fa9e50ca6c0 1 -- 10.20.193.11:0/336177196 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fa9e0110050 msgr2=0x7fa9e0171390 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T02:17:11.174 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.166+0000 7fa9e50ca6c0 1 --2- 10.20.193.11:0/336177196 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fa9e0110050 0x7fa9e0171390 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.174 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.167+0000 7f3cad7fa6c0 1 -- 10.20.193.11:0/971774583 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3ca0004250 con 0x7f3cb0110050 2026-02-13T02:17:11.174 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.167+0000 7f3cad7fa6c0 1 -- 10.20.193.11:0/971774583 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(27 keys) ==== 1119+0+0 (secure 0 0 0) 0x7f3ca0004d20 con 0x7f3cb0110050 2026-02-13T02:17:11.174 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.166+0000 7fa9e50ca6c0 1 -- 10.20.193.11:0/336177196 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9dc00a5b0 con 0x7fa9e010eed0 2026-02-13T02:17:11.174 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.167+0000 7f3cb68eb6c0 1 -- 10.20.193.11:0/971774583 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cb00f80c0 con 0x7f3cb0110050 2026-02-13T02:17:11.174 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.166+0000 7fa9e50ca6c0 1 --2- 10.20.193.11:0/336177196 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fa9e010eed0 0x7fa9e00fca60 secure :-1 s=READY pgs=93 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa9d000b6c0 tx=0x7fa9d000bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:17:11.174 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.166+0000 7fa9ce7fc6c0 1 -- 10.20.193.11:0/336177196 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa9d0004250 con 0x7fa9e010eed0 2026-02-13T02:17:11.174 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.166+0000 7fa9ce7fc6c0 1 -- 10.20.193.11:0/336177196 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(27 keys) ==== 1119+0+0 (secure 0 0 0) 0x7fa9d0004d20 con 0x7fa9e010eed0 2026-02-13T02:17:11.175 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.166+0000 7fa9ce7fc6c0 1 -- 10.20.193.11:0/336177196 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa9d0002930 con 0x7fa9e010eed0 2026-02-13T02:17:11.175 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.166+0000 7fa9e73596c0 1 -- 10.20.193.11:0/336177196 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9e00fe500 con 0x7fa9e010eed0 2026-02-13T02:17:11.175 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.166+0000 7fa9e73596c0 1 -- 10.20.193.11:0/336177196 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9e00fe990 con 0x7fa9e010eed0 2026-02-13T02:17:11.175 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.167+0000 7f3cb68eb6c0 1 -- 10.20.193.11:0/971774583 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cb00f85a0 con 0x7f3cb0110050 2026-02-13T02:17:11.175 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.167+0000 7f3cad7fa6c0 1 -- 10.20.193.11:0/971774583 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3ca0002930 con 0x7f3cb0110050 2026-02-13T02:17:11.175 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.167+0000 7f3cad7fa6c0 1 -- 10.20.193.11:0/971774583 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (secure 0 0 0) 0x7f3ca00056c0 con 0x7f3cb0110050 2026-02-13T02:17:11.175 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.167+0000 7f3cb68eb6c0 1 -- 10.20.193.11:0/971774583 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cb0064280 con 0x7f3cb0110050 2026-02-13T02:17:11.175 INFO:tasks.cephadm:setting config [mds] rados_osd_op_timeout = 900 2026-02-13T02:17:11.175 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph config set mds rados_osd_op_timeout 900 2026-02-13T02:17:11.176 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.168+0000 7f3cad7fa6c0 1 --2- 10.20.193.11:0/971774583 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f3c8803f940 0x7f3c8805fdf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:11.176 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.168+0000 7f3cad7fa6c0 1 -- 10.20.193.11:0/971774583 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 935+0+0 (secure 0 0 0) 0x7f3ca0051100 con 0x7f3cb0110050 2026-02-13T02:17:11.176 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.168+0000 7f3caffff6c0 1 --2- 10.20.193.11:0/971774583 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f3c8803f940 0x7f3c8805fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:11.176 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.169+0000 7f3caffff6c0 1 --2- 10.20.193.11:0/971774583 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f3c8803f940 0x7f3c8805fdf0 secure :-1 s=READY pgs=51 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3c9c005980 tx=0x7f3c9c005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:17:11.176 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.168+0000 7fa9ce7fc6c0 1 -- 10.20.193.11:0/336177196 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (secure 0 0 0) 0x7fa9d0002ac0 con 0x7fa9e010eed0 2026-02-13T02:17:11.176 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.168+0000 7fa9ce7fc6c0 1 --2- 10.20.193.11:0/336177196 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fa9bc03f8f0 0x7fa9bc05fda0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:11.176 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.168+0000 7fa9ce7fc6c0 1 -- 10.20.193.11:0/336177196 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 935+0+0 (secure 0 0 0) 0x7fa9d00511a0 con 0x7fa9e010eed0 2026-02-13T02:17:11.176 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.168+0000 7fa9e73596c0 1 -- 10.20.193.11:0/336177196 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9e01752f0 con 0x7fa9e010eed0 2026-02-13T02:17:11.177 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.168+0000 7fa9e48c96c0 1 --2- 10.20.193.11:0/336177196 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fa9bc03f8f0 0x7fa9bc05fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:11.177 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.169+0000 7fa9e48c96c0 1 --2- 10.20.193.11:0/336177196 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fa9bc03f8f0 0x7fa9bc05fda0 secure :-1 s=READY pgs=50 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa9d4005b40 tx=0x7fa9d40072a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:17:11.177 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:17:11.177 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.170+0000 7f3cad7fa6c0 1 -- 10.20.193.11:0/971774583 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f3ca00043b0 con 0x7f3cb0110050 2026-02-13T02:17:11.177 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.172+0000 7fa9ce7fc6c0 1 -- 10.20.193.11:0/336177196 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fa9d000fda0 con 0x7fa9e010eed0 2026-02-13T02:17:11.179 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:17:11.181 INFO:tasks.cephadm:setting config [mgr] client_mount_timeout = 30 2026-02-13T02:17:11.181 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph config set mgr client_mount_timeout 30 2026-02-13T02:17:11.208 INFO:tasks.cephadm:setting config [mgr] debug_client = 20 2026-02-13T02:17:11.209 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph config set mgr debug_client 20 2026-02-13T02:17:11.215 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:17:11.217 INFO:tasks.cephadm:setting config [mgr] debug_mgr = 20 2026-02-13T02:17:11.217 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph config set mgr debug_mgr 20 2026-02-13T02:17:11.218 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.215+0000 7f2bc10446c0 1 -- 10.20.193.11:0/2223118265 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f2bbc10c770 msgr2=0x7f2bbc10cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:11.218 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.215+0000 7f2bc10446c0 1 --2- 10.20.193.11:0/2223118265 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f2bbc10c770 0x7f2bbc10cc10 secure :-1 s=READY pgs=95 gs=1 cs=0 l=1 c_cookie=9396796156830637406 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2bb00098a0 tx=0x7f2bb002ec40 comp rx=0 tx=0).stop 2026-02-13T02:17:11.218 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.215+0000 7f2bc10446c0 1 -- 10.20.193.11:0/2223118265 shutdown_connections 2026-02-13T02:17:11.218 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.215+0000 7f2bc10446c0 1 --2- 10.20.193.11:0/2223118265 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f2bbc060d80 0x7f2bbc0611f0 unknown :-1 s=CLOSED pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.218 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.215+0000 7f2bc10446c0 1 --2- 10.20.193.11:0/2223118265 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f2bbc10c770 0x7f2bbc10cc10 unknown :-1 s=CLOSED pgs=95 gs=1 cs=0 l=1 c_cookie=9396796156830637406 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.218 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.215+0000 7f2bc10446c0 1 --2- 10.20.193.11:0/2223118265 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f2bbc0621c0 0x7f2bbc060840 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.218 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.215+0000 7f2bc10446c0 1 -- 10.20.193.11:0/2223118265 >> 10.20.193.11:0/2223118265 conn(0x7f2bbc0ea370 msgr2=0x7f2bbc10a780 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:17:11.218 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.215+0000 7f2bc10446c0 1 -- 10.20.193.11:0/2223118265 shutdown_connections 2026-02-13T02:17:11.220 INFO:tasks.cephadm:setting config [mgr] debug_ms = 1 2026-02-13T02:17:11.220 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph config set mgr debug_ms 1 2026-02-13T02:17:11.221 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.215+0000 7f2bc10446c0 1 -- 10.20.193.11:0/2223118265 wait complete. 2026-02-13T02:17:11.221 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.215+0000 7f2bc10446c0 1 Processor -- start 2026-02-13T02:17:11.221 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.215+0000 7f2bc10446c0 1 -- start start 2026-02-13T02:17:11.221 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.216+0000 7f2bc10446c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f2bbc060d80 0x7f2bbc0fe7c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:11.221 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.216+0000 7f2bc10446c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f2bbc0621c0 0x7f2bbc0fee10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:11.221 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.216+0000 7f2bc10446c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f2bbc10c770 0x7f2bbc0ff9b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:11.221 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.216+0000 7f2bc10446c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f2bbc100140 con 0x7f2bbc10c770 2026-02-13T02:17:11.221 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.216+0000 7f2bc10446c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f2bbc1002b0 con 0x7f2bbc060d80 2026-02-13T02:17:11.221 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.216+0000 7f2bbad766c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f2bbc060d80 0x7f2bbc0fe7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:11.221 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.216+0000 7f2bbad766c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f2bbc060d80 0x7f2bbc0fe7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.60:3300/0 says I am v2:10.20.193.11:45406/0 (socket says 10.20.193.11:45406) 2026-02-13T02:17:11.221 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.216+0000 7f2bba5756c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f2bbc0621c0 0x7f2bbc0fee10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:11.221 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.216+0000 7f2bba5756c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f2bbc0621c0 0x7f2bbc0fee10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.78:3300/0 says I am v2:10.20.193.11:48456/0 (socket says 10.20.193.11:48456) 2026-02-13T02:17:11.221 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.216+0000 7f2bba5756c0 1 -- 10.20.193.11:0/1318020250 learned_addr learned my addr 10.20.193.11:0/1318020250 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:17:11.221 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.216+0000 7f2bc10446c0 1 -- 10.20.193.11:0/1318020250 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f2bbc100470 con 0x7f2bbc0621c0 2026-02-13T02:17:11.221 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.217+0000 7f2bbad766c0 1 -- 10.20.193.11:0/1318020250 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f2bbc060d80 msgr2=0x7f2bbc0fe7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 9 2026-02-13T02:17:11.221 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.217+0000 7f2bbad766c0 1 -- 10.20.193.11:0/1318020250 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f2bbc060d80 msgr2=0x7f2bbc0fe7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T02:17:11.221 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.217+0000 7f2bbb5776c0 1 --2- 10.20.193.11:0/1318020250 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f2bbc10c770 0x7f2bbc0ff9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:11.221 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.217+0000 7f2bbad766c0 1 --2- 10.20.193.11:0/1318020250 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f2bbc060d80 0x7f2bbc0fe7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-13T02:17:11.221 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.217+0000 7f2bbad766c0 1 --2- 10.20.193.11:0/1318020250 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f2bbc060d80 0x7f2bbc0fe7c0 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-13T02:17:11.221 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.217+0000 7f2bba5756c0 1 -- 10.20.193.11:0/1318020250 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f2bbc0621c0 msgr2=0x7f2bbc0fee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 10 2026-02-13T02:17:11.222 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.217+0000 7f2bba5756c0 1 -- 10.20.193.11:0/1318020250 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f2bbc0621c0 msgr2=0x7f2bbc0fee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T02:17:11.222 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.217+0000 7f2bba5756c0 1 --2- 10.20.193.11:0/1318020250 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f2bbc0621c0 0x7f2bbc0fee10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-13T02:17:11.222 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.217+0000 7f2bba5756c0 1 --2- 10.20.193.11:0/1318020250 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f2bbc0621c0 0x7f2bbc0fee10 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-13T02:17:11.222 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.217+0000 7f2bbb5776c0 1 -- 10.20.193.11:0/1318020250 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f2bbc0621c0 msgr2=0x7f2bbc0fee10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T02:17:11.222 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.217+0000 7f2bbb5776c0 1 --2- 10.20.193.11:0/1318020250 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f2bbc0621c0 0x7f2bbc0fee10 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.222 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.217+0000 7f2bbb5776c0 1 -- 10.20.193.11:0/1318020250 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f2bbc060d80 msgr2=0x7f2bbc0fe7c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T02:17:11.222 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.217+0000 7f2bbb5776c0 1 --2- 10.20.193.11:0/1318020250 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f2bbc060d80 0x7f2bbc0fe7c0 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.222 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.217+0000 7f2bbb5776c0 1 -- 10.20.193.11:0/1318020250 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bb00094c0 con 0x7f2bbc10c770 2026-02-13T02:17:11.222 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.217+0000 7f2bbb5776c0 1 --2- 10.20.193.11:0/1318020250 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f2bbc10c770 0x7f2bbc0ff9b0 secure :-1 s=READY pgs=96 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2bb00098a0 tx=0x7f2bb00028e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:17:11.222 INFO:tasks.cephadm:setting config [mgr] mon_warn_on_pool_no_app = False 2026-02-13T02:17:11.222 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph config set mgr mon_warn_on_pool_no_app False 2026-02-13T02:17:11.223 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.219+0000 7f2b9bfff6c0 1 -- 10.20.193.11:0/1318020250 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2bb00045f0 con 0x7f2bbc10c770 2026-02-13T02:17:11.223 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.219+0000 7f2bc10446c0 1 -- 10.20.193.11:0/1318020250 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bbc1006f0 con 0x7f2bbc10c770 2026-02-13T02:17:11.223 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.219+0000 7f2b9bfff6c0 1 -- 10.20.193.11:0/1318020250 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(27 keys) ==== 1119+0+0 (secure 0 0 0) 0x7f2bb0002e80 con 0x7f2bbc10c770 2026-02-13T02:17:11.223 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.219+0000 7f2b9bfff6c0 1 -- 10.20.193.11:0/1318020250 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2bb00045f0 con 0x7f2bbc10c770 2026-02-13T02:17:11.223 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.219+0000 7f2bc10446c0 1 -- 10.20.193.11:0/1318020250 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bbc100bd0 con 0x7f2bbc10c770 2026-02-13T02:17:11.223 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.220+0000 7f2b9bfff6c0 1 -- 10.20.193.11:0/1318020250 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (secure 0 0 0) 0x7f2bb00071c0 con 0x7f2bbc10c770 2026-02-13T02:17:11.223 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.220+0000 7f2bc10446c0 1 -- 10.20.193.11:0/1318020250 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bbc179820 con 0x7f2bbc10c770 2026-02-13T02:17:11.227 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.220+0000 7f2b9bfff6c0 1 --2- 10.20.193.11:0/1318020250 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f2b9003f950 0x7f2b9005fe00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:11.227 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.221+0000 7f2b9bfff6c0 1 -- 10.20.193.11:0/1318020250 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 935+0+0 (secure 0 0 0) 0x7f2bb0033030 con 0x7f2bbc10c770 2026-02-13T02:17:11.227 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.221+0000 7f2bbad766c0 1 --2- 10.20.193.11:0/1318020250 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f2b9003f950 0x7f2b9005fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:11.227 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.221+0000 7f2bbad766c0 1 --2- 10.20.193.11:0/1318020250 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f2b9003f950 0x7f2b9005fe00 secure :-1 s=READY pgs=52 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2bac006c20 tx=0x7f2bac0069f0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:17:11.228 INFO:tasks.cephadm:setting config [mon] mon_op_complaint_time = 120 2026-02-13T02:17:11.228 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph config set mon mon_op_complaint_time 120 2026-02-13T02:17:11.229 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.224+0000 7f2b9bfff6c0 1 -- 10.20.193.11:0/1318020250 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f2bb0031740 con 0x7f2bbc10c770 2026-02-13T02:17:11.236 INFO:tasks.cephadm:setting config [osd] osd_op_complaint_time = 180 2026-02-13T02:17:11.237 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph config set osd osd_op_complaint_time 180 2026-02-13T02:17:11.276 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.271+0000 7f7bb26e86c0 1 -- 10.20.193.11:0/3216192663 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f7bac110050 msgr2=0x7f7bac1104c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:11.276 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.271+0000 7f7bb26e86c0 1 --2- 10.20.193.11:0/3216192663 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f7bac110050 0x7f7bac1104c0 secure :-1 s=READY pgs=97 gs=1 cs=0 l=1 c_cookie=9615464460603043833 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7b9c009970 tx=0x7f7b9c02ed20 comp rx=0 tx=0).stop 2026-02-13T02:17:11.276 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.271+0000 7f7bb26e86c0 1 -- 10.20.193.11:0/3216192663 shutdown_connections 2026-02-13T02:17:11.276 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.271+0000 7f7bb26e86c0 1 --2- 10.20.193.11:0/3216192663 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f7bac110a00 0x7f7bac171390 unknown :-1 s=CLOSED pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.276 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.271+0000 7f7bb26e86c0 1 --2- 10.20.193.11:0/3216192663 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f7bac110050 0x7f7bac1104c0 unknown :-1 s=CLOSED pgs=97 gs=1 cs=0 l=1 c_cookie=9615464460603043833 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.277 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.271+0000 7f7bb26e86c0 1 --2- 10.20.193.11:0/3216192663 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f7bac10eed0 0x7f7bac10f2c0 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.277 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.271+0000 7f7bb26e86c0 1 -- 10.20.193.11:0/3216192663 >> 10.20.193.11:0/3216192663 conn(0x7f7bac0ec5f0 msgr2=0x7f7bac10ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:17:11.277 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.271+0000 7f7bb26e86c0 1 -- 10.20.193.11:0/3216192663 shutdown_connections 2026-02-13T02:17:11.277 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.271+0000 7f7bb26e86c0 1 -- 10.20.193.11:0/3216192663 wait complete. 2026-02-13T02:17:11.277 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.272+0000 7f7bb26e86c0 1 Processor -- start 2026-02-13T02:17:11.277 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.272+0000 7f7bb26e86c0 1 -- start start 2026-02-13T02:17:11.277 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.272+0000 7f7bb26e86c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f7bac10eed0 0x7f7bac0f8580 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:11.277 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.272+0000 7f7bb26e86c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f7bac110050 0x7f7bac171390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:11.277 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.272+0000 7f7bb26e86c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f7bac110a00 0x7f7bac0f8de0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:11.278 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.272+0000 7f7bb26e86c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f7bac0f9a10 con 0x7f7bac10eed0 2026-02-13T02:17:11.278 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.272+0000 7f7bb26e86c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f7bac0f9b80 con 0x7f7bac110050 2026-02-13T02:17:11.278 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.272+0000 7f7bb26e86c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f7bac0f9d40 con 0x7f7bac110a00 2026-02-13T02:17:11.278 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.272+0000 7f7babfff6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f7bac10eed0 0x7f7bac0f8580 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:11.278 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.272+0000 7f7babfff6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f7bac10eed0 0x7f7bac0f8580 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:34260/0 (socket says 10.20.193.11:34260) 2026-02-13T02:17:11.278 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.272+0000 7f7babfff6c0 1 -- 10.20.193.11:0/1838688982 learned_addr learned my addr 10.20.193.11:0/1838688982 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:17:11.278 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.272+0000 7f7bab7fe6c0 1 --2- 10.20.193.11:0/1838688982 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f7bac110050 0x7f7bac171390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:11.278 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.273+0000 7f7bab7fe6c0 1 -- 10.20.193.11:0/1838688982 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f7bac110050 msgr2=0x7f7bac171390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 10 2026-02-13T02:17:11.278 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.273+0000 7f7bab7fe6c0 1 -- 10.20.193.11:0/1838688982 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f7bac110050 msgr2=0x7f7bac171390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T02:17:11.278 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.273+0000 7f7bab7fe6c0 1 --2- 10.20.193.11:0/1838688982 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f7bac110050 0x7f7bac171390 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-13T02:17:11.279 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.273+0000 7f7babfff6c0 1 -- 10.20.193.11:0/1838688982 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f7bac110a00 msgr2=0x7f7bac0f8de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:11.279 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.273+0000 7f7babfff6c0 1 --2- 10.20.193.11:0/1838688982 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f7bac110a00 0x7f7bac0f8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.279 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.273+0000 7f7bab7fe6c0 1 --2- 10.20.193.11:0/1838688982 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f7bac110050 0x7f7bac171390 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-13T02:17:11.279 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.273+0000 7f7babfff6c0 1 -- 10.20.193.11:0/1838688982 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f7bac110050 msgr2=0x7f7bac171390 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T02:17:11.279 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.273+0000 7f7babfff6c0 1 --2- 10.20.193.11:0/1838688982 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f7bac110050 0x7f7bac171390 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.279 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.273+0000 7f7babfff6c0 1 -- 10.20.193.11:0/1838688982 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b9c009590 con 0x7f7bac10eed0 2026-02-13T02:17:11.280 DEBUG:tasks.cephadm:set 26 configs 2026-02-13T02:17:11.280 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'fc631695-0881-11f1-899c-d404e6e7d460', '--', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='trial011') 2026-02-13T02:17:11.281 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'fc631695-0881-11f1-899c-d404e6e7d460', '--', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='trial011') 2026-02-13T02:17:11.281 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'fc631695-0881-11f1-899c-d404e6e7d460', '--', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='trial011') 2026-02-13T02:17:11.281 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'fc631695-0881-11f1-899c-d404e6e7d460', '--', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='trial011') 2026-02-13T02:17:11.281 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'fc631695-0881-11f1-899c-d404e6e7d460', '--', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='trial011') 2026-02-13T02:17:11.283 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.273+0000 7f7babfff6c0 1 --2- 10.20.193.11:0/1838688982 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f7bac10eed0 0x7f7bac0f8580 secure :-1 s=READY pgs=98 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7b98005dc0 tx=0x7f7b9800bbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:17:11.283 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.273+0000 7f7ba97fa6c0 1 -- 10.20.193.11:0/1838688982 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7b98004250 con 0x7f7bac10eed0 2026-02-13T02:17:11.283 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.273+0000 7f7bb26e86c0 1 -- 10.20.193.11:0/1838688982 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bac0fa020 con 0x7f7bac10eed0 2026-02-13T02:17:11.283 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.273+0000 7f7bb26e86c0 1 -- 10.20.193.11:0/1838688982 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bac0fa550 con 0x7f7bac10eed0 2026-02-13T02:17:11.283 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.273+0000 7f7ba97fa6c0 1 -- 10.20.193.11:0/1838688982 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(27 keys) ==== 1119+0+0 (secure 0 0 0) 0x7f7b9800be30 con 0x7f7bac10eed0 2026-02-13T02:17:11.283 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.273+0000 7f7ba97fa6c0 1 -- 10.20.193.11:0/1838688982 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7b980052a0 con 0x7f7bac10eed0 2026-02-13T02:17:11.283 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.274+0000 7f7bb26e86c0 1 -- 10.20.193.11:0/1838688982 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bac1752f0 con 0x7f7bac10eed0 2026-02-13T02:17:11.283 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.274+0000 7f7ba97fa6c0 1 -- 10.20.193.11:0/1838688982 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (secure 0 0 0) 0x7f7b98005430 con 0x7f7bac10eed0 2026-02-13T02:17:11.284 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.275+0000 7f7ba97fa6c0 1 --2- 10.20.193.11:0/1838688982 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f7b8003f8f0 0x7f7b8005fda0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:11.284 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.275+0000 7f7ba97fa6c0 1 -- 10.20.193.11:0/1838688982 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 935+0+0 (secure 0 0 0) 0x7f7b98051300 con 0x7f7bac10eed0 2026-02-13T02:17:11.284 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.275+0000 7f7bab7fe6c0 1 --2- 10.20.193.11:0/1838688982 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f7b8003f8f0 0x7f7b8005fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:11.284 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.275+0000 7f7bab7fe6c0 1 --2- 10.20.193.11:0/1838688982 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f7b8003f8f0 0x7f7b8005fda0 secure :-1 s=READY pgs=53 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7b9c0098c0 tx=0x7f7b9c0023a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:17:11.284 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.278+0000 7f7ba97fa6c0 1 -- 10.20.193.11:0/1838688982 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f7b98008040 con 0x7f7bac10eed0 2026-02-13T02:17:11.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:11 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:11.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:11 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:11.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:11 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T02:17:11.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:11 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-13T02:17:11.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:11 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:11.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:11 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:11.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:11 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:11.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:11 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:17:11.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:11 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:11.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:11 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:17:11.293 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:11 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:11.293 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:11 trial078 ceph-mon[14969]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;trial011=x;trial060=y;trial078=z", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:17:11.293 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:11 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:11.293 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:11 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:17:11.293 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:11 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:11.293 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:11 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:17:11.293 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:11 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:11.293 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:11 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-13T02:17:11.293 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:11 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-02-13T02:17:11.293 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:11 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-13T02:17:11.293 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:11 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:11.294 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:11 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/415538471' entity='client.admin' 2026-02-13T02:17:11.294 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:11 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/681035491' entity='client.admin' 2026-02-13T02:17:11.294 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:11 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/4097541672' entity='client.admin' 2026-02-13T02:17:11.294 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:11 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/3874639930' entity='client.admin' 2026-02-13T02:17:11.294 INFO:journalctl@ceph.mgr.z.trial078.stdout:Feb 13 02:17:11 trial078 systemd[1]: Starting ceph-fc631695-0881-11f1-899c-d404e6e7d460@mgr.z.service - Ceph mgr.z for fc631695-0881-11f1-899c-d404e6e7d460... 2026-02-13T02:17:11.295 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:17:11.300 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:17:11.320 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.317+0000 7f3cb68eb6c0 1 -- 10.20.193.11:0/971774583 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f3cb010f2c0 con 0x7f3cb0110050 2026-02-13T02:17:11.325 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.321+0000 7f3cad7fa6c0 1 -- 10.20.193.11:0/971774583 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v13)=0 v13) ==== 123+0+0 (secure 0 0 0) 0x7f3ca00043b0 con 0x7f3cb0110050 2026-02-13T02:17:11.327 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.324+0000 7f3cad7fa6c0 1 -- 10.20.193.11:0/971774583 <== mon.0 v2:10.20.193.11:3300/0 8 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3ca0050ad0 con 0x7f3cb0110050 2026-02-13T02:17:11.327 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.323+0000 7f2b9bfff6c0 1 -- 10.20.193.11:0/1318020250 <== mon.0 v2:10.20.193.11:3300/0 7 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2bb0074ce0 con 0x7f2bbc10c770 2026-02-13T02:17:11.328 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.323+0000 7fa9ce7fc6c0 1 -- 10.20.193.11:0/336177196 <== mon.0 v2:10.20.193.11:3300/0 7 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa9d0010e90 con 0x7fa9e010eed0 2026-02-13T02:17:11.328 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.325+0000 7f7ba97fa6c0 1 -- 10.20.193.11:0/1838688982 <== mon.0 v2:10.20.193.11:3300/0 7 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f7b98050cd0 con 0x7f7bac10eed0 2026-02-13T02:17:11.329 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.326+0000 7f3cb68eb6c0 1 -- 10.20.193.11:0/971774583 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f3c8803f940 msgr2=0x7f3c8805fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:11.329 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.326+0000 7f3cb68eb6c0 1 --2- 10.20.193.11:0/971774583 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f3c8803f940 0x7f3c8805fdf0 secure :-1 s=READY pgs=51 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3c9c005980 tx=0x7f3c9c005910 comp rx=0 tx=0).stop 2026-02-13T02:17:11.329 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.326+0000 7f3cb68eb6c0 1 -- 10.20.193.11:0/971774583 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f3cb0110050 msgr2=0x7f3cb0171390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:11.330 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.326+0000 7f3cb68eb6c0 1 --2- 10.20.193.11:0/971774583 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f3cb0110050 0x7f3cb0171390 secure :-1 s=READY pgs=94 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3ca000b6c0 tx=0x7f3ca000bb90 comp rx=0 tx=0).stop 2026-02-13T02:17:11.330 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.327+0000 7f3cb68eb6c0 1 -- 10.20.193.11:0/971774583 shutdown_connections 2026-02-13T02:17:11.330 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.327+0000 7f3cb68eb6c0 1 --2- 10.20.193.11:0/971774583 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f3c8803f940 0x7f3c8805fdf0 unknown :-1 s=CLOSED pgs=51 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.330 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.327+0000 7f3cb68eb6c0 1 --2- 10.20.193.11:0/971774583 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f3cb0110a00 0x7f3cb00f6e80 unknown :-1 s=CLOSED pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.330 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.327+0000 7f3cb68eb6c0 1 --2- 10.20.193.11:0/971774583 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f3cb0110050 0x7f3cb0171390 unknown :-1 s=CLOSED pgs=94 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.330 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.327+0000 7f3cb68eb6c0 1 --2- 10.20.193.11:0/971774583 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f3cb010eed0 0x7f3cb00f6620 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.330 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.327+0000 7f3cb68eb6c0 1 -- 10.20.193.11:0/971774583 >> 10.20.193.11:0/971774583 conn(0x7f3cb00ec5f0 msgr2=0x7f3cb00ecbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:17:11.330 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.327+0000 7f3cb68eb6c0 1 -- 10.20.193.11:0/971774583 shutdown_connections 2026-02-13T02:17:11.331 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.328+0000 7f3cb68eb6c0 1 -- 10.20.193.11:0/971774583 wait complete. 2026-02-13T02:17:11.338 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.336+0000 7fa9e73596c0 1 -- 10.20.193.11:0/336177196 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7fa9e0174ad0 con 0x7fa9e010eed0 2026-02-13T02:17:11.342 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:17:11.344 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.341+0000 7fa9ce7fc6c0 1 -- 10.20.193.11:0/336177196 <== mon.0 v2:10.20.193.11:3300/0 8 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v14)=0 v14) ==== 108+0+0 (secure 0 0 0) 0x7fa9d000f550 con 0x7fa9e010eed0 2026-02-13T02:17:11.346 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.343+0000 7fd263aa76c0 1 -- 10.20.193.11:0/4088126005 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fd25c10e780 msgr2=0x7fd25c16f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:11.346 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.343+0000 7fd263aa76c0 1 --2- 10.20.193.11:0/4088126005 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fd25c10e780 0x7fd25c16f110 secure :-1 s=READY pgs=99 gs=3 cs=0 l=1 c_cookie=4319588250988602964 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd258006fd0 tx=0x7fd25802ffd0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.346 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.343+0000 7fd263aa76c0 1 -- 10.20.193.11:0/4088126005 shutdown_connections 2026-02-13T02:17:11.347 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.343+0000 7fd263aa76c0 1 --2- 10.20.193.11:0/4088126005 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fd25c10e780 0x7fd25c16f110 unknown :-1 s=CLOSED pgs=99 gs=3 cs=0 l=1 c_cookie=4319588250988602964 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.347 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.343+0000 7fd263aa76c0 1 --2- 10.20.193.11:0/4088126005 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd25c10ddd0 0x7fd25c10e240 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.347 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.343+0000 7fd263aa76c0 1 --2- 10.20.193.11:0/4088126005 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fd25c10cc50 0x7fd25c10d040 unknown :-1 s=CLOSED pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.347 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.343+0000 7fd263aa76c0 1 -- 10.20.193.11:0/4088126005 >> 10.20.193.11:0/4088126005 conn(0x7fd25c0ea370 msgr2=0x7fd25c10a780 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:17:11.347 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.344+0000 7fd263aa76c0 1 -- 10.20.193.11:0/4088126005 shutdown_connections 2026-02-13T02:17:11.348 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.344+0000 7fd263aa76c0 1 -- 10.20.193.11:0/4088126005 wait complete. 2026-02-13T02:17:11.348 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.344+0000 7fd263aa76c0 1 Processor -- start 2026-02-13T02:17:11.348 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.345+0000 7fd263aa76c0 1 -- start start 2026-02-13T02:17:11.348 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.345+0000 7fd263aa76c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd25c10cc50 0x7fd25c116f60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:11.350 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.345+0000 7fd263aa76c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fd25c10ddd0 0x7fd25c1175b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:11.350 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.345+0000 7fd263aa76c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fd25c10e780 0x7fd25c1181a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:11.350 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.345+0000 7fd2618186c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd25c10cc50 0x7fd25c116f60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:11.350 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.346+0000 7fd263aa76c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7fd25c118930 con 0x7fd25c10ddd0 2026-02-13T02:17:11.350 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.346+0000 7fd2610176c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fd25c10ddd0 0x7fd25c1175b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:11.350 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.346+0000 7fd263aa76c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd25c118aa0 con 0x7fd25c10e780 2026-02-13T02:17:11.350 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.346+0000 7fd263aa76c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fd25c118c60 con 0x7fd25c10cc50 2026-02-13T02:17:11.351 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.346+0000 7fd2620196c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fd25c10e780 0x7fd25c1181a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:11.351 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.346+0000 7fd2620196c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fd25c10e780 0x7fd25c1181a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.60:3300/0 says I am v2:10.20.193.11:45428/0 (socket says 10.20.193.11:45428) 2026-02-13T02:17:11.351 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.346+0000 7fd2620196c0 1 -- 10.20.193.11:0/2441853076 learned_addr learned my addr 10.20.193.11:0/2441853076 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:17:11.351 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.346+0000 7fd2618186c0 1 -- 10.20.193.11:0/2441853076 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd25c10cc50 msgr2=0x7fd25c116f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 9 2026-02-13T02:17:11.351 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.346+0000 7fd2618186c0 1 -- 10.20.193.11:0/2441853076 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd25c10cc50 msgr2=0x7fd25c116f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T02:17:11.351 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.346+0000 7fd2618186c0 1 --2- 10.20.193.11:0/2441853076 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd25c10cc50 0x7fd25c116f60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-13T02:17:11.351 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.346+0000 7fd2618186c0 1 --2- 10.20.193.11:0/2441853076 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd25c10cc50 0x7fd25c116f60 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-13T02:17:11.351 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.346+0000 7fd2620196c0 1 -- 10.20.193.11:0/2441853076 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fd25c10e780 msgr2=0x7fd25c1181a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 11 2026-02-13T02:17:11.351 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.346+0000 7fd2620196c0 1 -- 10.20.193.11:0/2441853076 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fd25c10e780 msgr2=0x7fd25c1181a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T02:17:11.352 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.346+0000 7fd2620196c0 1 --2- 10.20.193.11:0/2441853076 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fd25c10e780 0x7fd25c1181a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-13T02:17:11.352 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.346+0000 7fd2620196c0 1 --2- 10.20.193.11:0/2441853076 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fd25c10e780 0x7fd25c1181a0 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-13T02:17:11.352 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.346+0000 7fd2610176c0 1 -- 10.20.193.11:0/2441853076 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd25c10cc50 msgr2=0x7fd25c116f60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T02:17:11.352 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.346+0000 7fd2610176c0 1 --2- 10.20.193.11:0/2441853076 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd25c10cc50 0x7fd25c116f60 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.352 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.346+0000 7fd2610176c0 1 -- 10.20.193.11:0/2441853076 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fd25c10e780 msgr2=0x7fd25c1181a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T02:17:11.352 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.346+0000 7fd2610176c0 1 --2- 10.20.193.11:0/2441853076 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fd25c10e780 0x7fd25c1181a0 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.352 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.346+0000 7fd2610176c0 1 -- 10.20.193.11:0/2441853076 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd25800a5b0 con 0x7fd25c10ddd0 2026-02-13T02:17:11.352 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.346+0000 7fd2610176c0 1 --2- 10.20.193.11:0/2441853076 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fd25c10ddd0 0x7fd25c1175b0 secure :-1 s=READY pgs=100 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd250004750 tx=0x7fd25000bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:17:11.352 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.347+0000 7fd24affd6c0 1 -- 10.20.193.11:0/2441853076 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd250004250 con 0x7fd25c10ddd0 2026-02-13T02:17:11.352 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.347+0000 7fd263aa76c0 1 -- 10.20.193.11:0/2441853076 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd25c118f40 con 0x7fd25c10ddd0 2026-02-13T02:17:11.353 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.347+0000 7fd263aa76c0 1 -- 10.20.193.11:0/2441853076 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd25c1594f0 con 0x7fd25c10ddd0 2026-02-13T02:17:11.353 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.347+0000 7fd24affd6c0 1 -- 10.20.193.11:0/2441853076 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd2500043b0 con 0x7fd25c10ddd0 2026-02-13T02:17:11.353 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.347+0000 7fd24affd6c0 1 -- 10.20.193.11:0/2441853076 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd250011070 con 0x7fd25c10ddd0 2026-02-13T02:17:11.353 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.346+0000 7fa9e73596c0 1 -- 10.20.193.11:0/336177196 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fa9bc03f8f0 msgr2=0x7fa9bc05fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:11.354 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.346+0000 7fa9e73596c0 1 --2- 10.20.193.11:0/336177196 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fa9bc03f8f0 0x7fa9bc05fda0 secure :-1 s=READY pgs=50 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa9d4005b40 tx=0x7fa9d40072a0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.354 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.346+0000 7fa9e73596c0 1 -- 10.20.193.11:0/336177196 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fa9e010eed0 msgr2=0x7fa9e00fca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:11.354 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.346+0000 7fa9e73596c0 1 --2- 10.20.193.11:0/336177196 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fa9e010eed0 0x7fa9e00fca60 secure :-1 s=READY pgs=93 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa9d000b6c0 tx=0x7fa9d000bb90 comp rx=0 tx=0).stop 2026-02-13T02:17:11.354 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.346+0000 7fa9e73596c0 1 -- 10.20.193.11:0/336177196 shutdown_connections 2026-02-13T02:17:11.354 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.346+0000 7fa9e73596c0 1 --2- 10.20.193.11:0/336177196 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fa9bc03f8f0 0x7fa9bc05fda0 unknown :-1 s=CLOSED pgs=50 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.354 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.346+0000 7fa9e73596c0 1 --2- 10.20.193.11:0/336177196 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fa9e0110050 0x7fa9e0171390 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.354 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.346+0000 7fa9e73596c0 1 --2- 10.20.193.11:0/336177196 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa9e0110a00 0x7fa9e00fd2c0 unknown :-1 s=CLOSED pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.354 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.346+0000 7fa9e73596c0 1 --2- 10.20.193.11:0/336177196 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fa9e010eed0 0x7fa9e00fca60 unknown :-1 s=CLOSED pgs=93 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.354 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.346+0000 7fa9e73596c0 1 -- 10.20.193.11:0/336177196 >> 10.20.193.11:0/336177196 conn(0x7fa9e00ec5f0 msgr2=0x7fa9e00eeb30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:17:11.354 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.346+0000 7fa9e73596c0 1 -- 10.20.193.11:0/336177196 shutdown_connections 2026-02-13T02:17:11.355 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.346+0000 7fa9e73596c0 1 -- 10.20.193.11:0/336177196 wait complete. 2026-02-13T02:17:11.355 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.348+0000 7fd263aa76c0 1 -- 10.20.193.11:0/2441853076 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd25c170fa0 con 0x7fd25c10ddd0 2026-02-13T02:17:11.355 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:17:11.356 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.348+0000 7fd24affd6c0 1 -- 10.20.193.11:0/2441853076 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (secure 0 0 0) 0x7fd2500111d0 con 0x7fd25c10ddd0 2026-02-13T02:17:11.357 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.349+0000 7fd24affd6c0 1 --2- 10.20.193.11:0/2441853076 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fd23803f8f0 0x7fd23805fda0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:11.357 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.349+0000 7fd24affd6c0 1 -- 10.20.193.11:0/2441853076 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 935+0+0 (secure 0 0 0) 0x7fd250051230 con 0x7fd25c10ddd0 2026-02-13T02:17:11.357 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.349+0000 7fd2618186c0 1 --2- 10.20.193.11:0/2441853076 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fd23803f8f0 0x7fd23805fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:11.357 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.349+0000 7fd2618186c0 1 --2- 10.20.193.11:0/2441853076 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fd23803f8f0 0x7fd23805fda0 secure :-1 s=READY pgs=54 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd24c005980 tx=0x7fd24c005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:17:11.357 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.352+0000 7fd24affd6c0 1 -- 10.20.193.11:0/2441853076 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fd250014030 con 0x7fd25c10ddd0 2026-02-13T02:17:11.360 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.353+0000 7feff66206c0 1 -- 10.20.193.11:0/1188069091 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7feff0063e50 msgr2=0x7feff00642c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:11.360 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.353+0000 7feff66206c0 1 --2- 10.20.193.11:0/1188069091 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7feff0063e50 0x7feff00642c0 secure :-1 s=READY pgs=101 gs=1 cs=0 l=1 c_cookie=16686693663746850544 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fefe00098a0 tx=0x7fefe002ec60 comp rx=0 tx=0).stop 2026-02-13T02:17:11.360 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.353+0000 7feff66206c0 1 -- 10.20.193.11:0/1188069091 shutdown_connections 2026-02-13T02:17:11.360 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.353+0000 7feff66206c0 1 --2- 10.20.193.11:0/1188069091 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7feff0064800 0x7feff0065160 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.360 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.353+0000 7feff66206c0 1 --2- 10.20.193.11:0/1188069091 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7feff0063e50 0x7feff00642c0 unknown :-1 s=CLOSED pgs=101 gs=1 cs=0 l=1 c_cookie=16686693663746850544 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.360 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.353+0000 7feff66206c0 1 --2- 10.20.193.11:0/1188069091 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7feff0062cd0 0x7feff00630c0 unknown :-1 s=CLOSED pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.361 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.353+0000 7feff66206c0 1 -- 10.20.193.11:0/1188069091 >> 10.20.193.11:0/1188069091 conn(0x7feff00ec5f0 msgr2=0x7feff010ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:17:11.361 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.353+0000 7feff66206c0 1 -- 10.20.193.11:0/1188069091 shutdown_connections 2026-02-13T02:17:11.361 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.353+0000 7feff66206c0 1 -- 10.20.193.11:0/1188069091 wait complete. 2026-02-13T02:17:11.361 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.354+0000 7feff66206c0 1 Processor -- start 2026-02-13T02:17:11.361 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.354+0000 7feff66206c0 1 -- start start 2026-02-13T02:17:11.361 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.355+0000 7feff66206c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7feff0062cd0 0x7feff00f7f90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:11.361 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.355+0000 7feff66206c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7feff0063e50 0x7feff00f85e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:11.361 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.355+0000 7feff66206c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7feff0064800 0x7feff00f91d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:11.361 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.355+0000 7fefeffff6c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7feff0062cd0 0x7feff00f7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:11.362 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.355+0000 7fefeffff6c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7feff0062cd0 0x7feff00f7f90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.60:3300/0 says I am v2:10.20.193.11:45446/0 (socket says 10.20.193.11:45446) 2026-02-13T02:17:11.362 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.355+0000 7feff66206c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7feff00f9960 con 0x7feff0064800 2026-02-13T02:17:11.362 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.355+0000 7feff66206c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7feff00f9ad0 con 0x7feff0062cd0 2026-02-13T02:17:11.362 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.355+0000 7feff66206c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7feff00f9c90 con 0x7feff0063e50 2026-02-13T02:17:11.362 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.355+0000 7fefeffff6c0 1 -- 10.20.193.11:0/3209558962 learned_addr learned my addr 10.20.193.11:0/3209558962 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:17:11.362 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.355+0000 7fefef7fe6c0 1 --2- 10.20.193.11:0/3209558962 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7feff0063e50 0x7feff00f85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:11.362 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.355+0000 7fefeffff6c0 1 -- 10.20.193.11:0/3209558962 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7feff0062cd0 msgr2=0x7feff00f7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 9 2026-02-13T02:17:11.362 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.355+0000 7fefeffff6c0 1 -- 10.20.193.11:0/3209558962 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7feff0062cd0 msgr2=0x7feff00f7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T02:17:11.362 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.355+0000 7fefeffff6c0 1 --2- 10.20.193.11:0/3209558962 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7feff0062cd0 0x7feff00f7f90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-13T02:17:11.363 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.355+0000 7fefeffff6c0 1 --2- 10.20.193.11:0/3209558962 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7feff0062cd0 0x7feff00f7f90 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-13T02:17:11.363 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.355+0000 7feff4b926c0 1 --2- 10.20.193.11:0/3209558962 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7feff0064800 0x7feff00f91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:11.363 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.356+0000 7feff4b926c0 1 -- 10.20.193.11:0/3209558962 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7feff0063e50 msgr2=0x7feff00f85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:11.363 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.356+0000 7feff4b926c0 1 --2- 10.20.193.11:0/3209558962 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7feff0063e50 0x7feff00f85e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.363 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.356+0000 7feff4b926c0 1 -- 10.20.193.11:0/3209558962 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7feff0062cd0 msgr2=0x7feff00f7f90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T02:17:11.363 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.356+0000 7feff4b926c0 1 --2- 10.20.193.11:0/3209558962 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7feff0062cd0 0x7feff00f7f90 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.363 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.356+0000 7feff4b926c0 1 -- 10.20.193.11:0/3209558962 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefe00094c0 con 0x7feff0064800 2026-02-13T02:17:11.363 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.356+0000 7fefef7fe6c0 1 --2- 10.20.193.11:0/3209558962 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7feff0063e50 0x7feff00f85e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:17:11.364 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:17:11.365 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.357+0000 7feff4b926c0 1 --2- 10.20.193.11:0/3209558962 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7feff0064800 0x7feff00f91d0 secure :-1 s=READY pgs=104 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fefe4006090 tx=0x7fefe4006560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:17:11.365 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.357+0000 7fefed7fa6c0 1 -- 10.20.193.11:0/3209558962 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fefe4003c40 con 0x7feff0064800 2026-02-13T02:17:11.365 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.357+0000 7fefed7fa6c0 1 -- 10.20.193.11:0/3209558962 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fefe4006820 con 0x7feff0064800 2026-02-13T02:17:11.365 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.357+0000 7fefed7fa6c0 1 -- 10.20.193.11:0/3209558962 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fefe400de40 con 0x7feff0064800 2026-02-13T02:17:11.365 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.357+0000 7feff66206c0 1 -- 10.20.193.11:0/3209558962 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feff00f9f70 con 0x7feff0064800 2026-02-13T02:17:11.365 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.357+0000 7feff66206c0 1 -- 10.20.193.11:0/3209558962 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feff00fa4b0 con 0x7feff0064800 2026-02-13T02:17:11.366 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.359+0000 7fefed7fa6c0 1 -- 10.20.193.11:0/3209558962 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (secure 0 0 0) 0x7fefe4012070 con 0x7feff0064800 2026-02-13T02:17:11.366 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.359+0000 7feff66206c0 1 -- 10.20.193.11:0/3209558962 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feff0179930 con 0x7feff0064800 2026-02-13T02:17:11.366 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.359+0000 7fefed7fa6c0 1 --2- 10.20.193.11:0/3209558962 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fefc803f8f0 0x7fefc805fda0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:11.366 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.359+0000 7fefed7fa6c0 1 -- 10.20.193.11:0/3209558962 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 935+0+0 (secure 0 0 0) 0x7fefe4052300 con 0x7feff0064800 2026-02-13T02:17:11.366 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.359+0000 7fefeffff6c0 1 --2- 10.20.193.11:0/3209558962 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fefc803f8f0 0x7fefc805fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:11.366 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.360+0000 7fefeffff6c0 1 --2- 10.20.193.11:0/3209558962 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fefc803f8f0 0x7fefc805fda0 secure :-1 s=READY pgs=55 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fefdc005b40 tx=0x7fefdc0072a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:17:11.367 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:17:11.367 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.363+0000 7fefed7fa6c0 1 -- 10.20.193.11:0/3209558962 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fefe4012350 con 0x7feff0064800 2026-02-13T02:17:11.369 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:17:11.402 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.399+0000 7f2bc10446c0 1 -- 10.20.193.11:0/1318020250 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7f2bbc1105a0 con 0x7f2bbc10c770 2026-02-13T02:17:11.405 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.402+0000 7f2b9bfff6c0 1 -- 10.20.193.11:0/1318020250 <== mon.0 v2:10.20.193.11:3300/0 8 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v15)=0 v15) ==== 117+0+0 (secure 0 0 0) 0x7f2bb0030880 con 0x7f2bbc10c770 2026-02-13T02:17:11.409 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.405+0000 7f85904416c0 1 -- 10.20.193.11:0/2861199005 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f8588110a00 msgr2=0x7f8588171390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:11.409 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.405+0000 7f85904416c0 1 --2- 10.20.193.11:0/2861199005 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f8588110a00 0x7f8588171390 secure :-1 s=READY pgs=105 gs=2 cs=0 l=1 c_cookie=14980141733532299680 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8584006fd0 tx=0x7f858402fd20 comp rx=0 tx=0).stop 2026-02-13T02:17:11.409 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.406+0000 7f85904416c0 1 -- 10.20.193.11:0/2861199005 shutdown_connections 2026-02-13T02:17:11.409 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.406+0000 7f85904416c0 1 --2- 10.20.193.11:0/2861199005 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f8588110a00 0x7f8588171390 unknown :-1 s=CLOSED pgs=105 gs=2 cs=0 l=1 c_cookie=14980141733532299680 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.409 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.406+0000 7f85904416c0 1 --2- 10.20.193.11:0/2861199005 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f8588110050 0x7f85881104c0 unknown :-1 s=CLOSED pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.410 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.406+0000 7f85904416c0 1 --2- 10.20.193.11:0/2861199005 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f858810eed0 0x7f858810f2c0 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.410 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.406+0000 7f85904416c0 1 -- 10.20.193.11:0/2861199005 >> 10.20.193.11:0/2861199005 conn(0x7f85880ec5f0 msgr2=0x7f858810ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:17:11.410 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.406+0000 7f85904416c0 1 -- 10.20.193.11:0/2861199005 shutdown_connections 2026-02-13T02:17:11.410 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.406+0000 7f85904416c0 1 -- 10.20.193.11:0/2861199005 wait complete. 2026-02-13T02:17:11.411 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.406+0000 7f2bc10446c0 1 -- 10.20.193.11:0/1318020250 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f2b9003f950 msgr2=0x7f2b9005fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:11.411 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.407+0000 7f2bc10446c0 1 --2- 10.20.193.11:0/1318020250 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f2b9003f950 0x7f2b9005fe00 secure :-1 s=READY pgs=52 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2bac006c20 tx=0x7f2bac0069f0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.411 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.407+0000 7f2bc10446c0 1 -- 10.20.193.11:0/1318020250 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f2bbc10c770 msgr2=0x7f2bbc0ff9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:11.411 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.407+0000 7f2bc10446c0 1 --2- 10.20.193.11:0/1318020250 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f2bbc10c770 0x7f2bbc0ff9b0 secure :-1 s=READY pgs=96 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2bb00098a0 tx=0x7f2bb00028e0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.411 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.407+0000 7f2bc10446c0 1 -- 10.20.193.11:0/1318020250 shutdown_connections 2026-02-13T02:17:11.413 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.407+0000 7f85904416c0 1 Processor -- start 2026-02-13T02:17:11.413 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.407+0000 7f85904416c0 1 -- start start 2026-02-13T02:17:11.413 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.407+0000 7f85904416c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f858810eed0 0x7f8588062c60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:11.413 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.407+0000 7f85904416c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f8588110050 0x7f8588171390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:11.413 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.407+0000 7f85904416c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f8588110a00 0x7f85880634c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:11.413 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.407+0000 7f85904416c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f85880640f0 con 0x7f8588110050 2026-02-13T02:17:11.413 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.407+0000 7f85904416c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f8588064260 con 0x7f8588110a00 2026-02-13T02:17:11.414 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.407+0000 7f85904416c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f8588064420 con 0x7f858810eed0 2026-02-13T02:17:11.414 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.407+0000 7f858e9b36c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f8588110a00 0x7f85880634c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:11.414 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.407+0000 7f858e9b36c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f8588110a00 0x7f85880634c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.60:3300/0 says I am v2:10.20.193.11:45466/0 (socket says 10.20.193.11:45466) 2026-02-13T02:17:11.414 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.407+0000 7f858e9b36c0 1 -- 10.20.193.11:0/2179077860 learned_addr learned my addr 10.20.193.11:0/2179077860 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:17:11.414 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.407+0000 7f858e9b36c0 1 -- 10.20.193.11:0/2179077860 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f8588110a00 msgr2=0x7f85880634c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 11 2026-02-13T02:17:11.414 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.407+0000 7f858e9b36c0 1 -- 10.20.193.11:0/2179077860 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f8588110a00 msgr2=0x7f85880634c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T02:17:11.414 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.407+0000 7f858e9b36c0 1 --2- 10.20.193.11:0/2179077860 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f8588110a00 0x7f85880634c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-13T02:17:11.414 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.407+0000 7f858e9b36c0 1 --2- 10.20.193.11:0/2179077860 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f8588110a00 0x7f85880634c0 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-13T02:17:11.414 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.407+0000 7f858e1b26c0 1 --2- 10.20.193.11:0/2179077860 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f858810eed0 0x7f8588062c60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:11.414 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.408+0000 7f858e1b26c0 1 -- 10.20.193.11:0/2179077860 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f858810eed0 msgr2=0x7f8588062c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 9 2026-02-13T02:17:11.415 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.408+0000 7f858e1b26c0 1 -- 10.20.193.11:0/2179077860 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f858810eed0 msgr2=0x7f8588062c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T02:17:11.415 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.408+0000 7f858e1b26c0 1 --2- 10.20.193.11:0/2179077860 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f858810eed0 0x7f8588062c60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-13T02:17:11.415 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.408+0000 7f858e1b26c0 1 --2- 10.20.193.11:0/2179077860 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f858810eed0 0x7f8588062c60 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-13T02:17:11.415 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.407+0000 7f2bc10446c0 1 --2- 10.20.193.11:0/1318020250 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f2b9003f950 0x7f2b9005fe00 unknown :-1 s=CLOSED pgs=52 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.415 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.407+0000 7f2bc10446c0 1 --2- 10.20.193.11:0/1318020250 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f2bbc10c770 0x7f2bbc0ff9b0 unknown :-1 s=CLOSED pgs=96 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.416 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.407+0000 7f2bc10446c0 1 --2- 10.20.193.11:0/1318020250 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f2bbc0621c0 0x7f2bbc0fee10 unknown :-1 s=CLOSED pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.416 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.407+0000 7f2bc10446c0 1 --2- 10.20.193.11:0/1318020250 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f2bbc060d80 0x7f2bbc0fe7c0 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.416 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.407+0000 7f2bc10446c0 1 -- 10.20.193.11:0/1318020250 >> 10.20.193.11:0/1318020250 conn(0x7f2bbc0ea370 msgr2=0x7f2bbc0561d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:17:11.416 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.407+0000 7f2bc10446c0 1 -- 10.20.193.11:0/1318020250 shutdown_connections 2026-02-13T02:17:11.416 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.407+0000 7f2bc10446c0 1 -- 10.20.193.11:0/1318020250 wait complete. 2026-02-13T02:17:11.416 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.408+0000 7f858d9b16c0 1 --2- 10.20.193.11:0/2179077860 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f8588110050 0x7f8588171390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:11.416 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.408+0000 7f858d9b16c0 1 -- 10.20.193.11:0/2179077860 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f858810eed0 msgr2=0x7f8588062c60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T02:17:11.417 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.408+0000 7f858d9b16c0 1 --2- 10.20.193.11:0/2179077860 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f858810eed0 0x7f8588062c60 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.417 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.408+0000 7f858d9b16c0 1 -- 10.20.193.11:0/2179077860 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f8588110a00 msgr2=0x7f85880634c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T02:17:11.417 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.408+0000 7f858d9b16c0 1 --2- 10.20.193.11:0/2179077860 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f8588110a00 0x7f85880634c0 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.417 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.408+0000 7f858d9b16c0 1 -- 10.20.193.11:0/2179077860 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f858400a5b0 con 0x7f8588110050 2026-02-13T02:17:11.417 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:17:11.419 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.408+0000 7f858d9b16c0 1 --2- 10.20.193.11:0/2179077860 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f8588110050 0x7f8588171390 secure :-1 s=READY pgs=106 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f857c00b6c0 tx=0x7f857c00bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:17:11.419 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.408+0000 7f856f7fe6c0 1 -- 10.20.193.11:0/2179077860 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f857c004250 con 0x7f8588110050 2026-02-13T02:17:11.419 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.409+0000 7f85904416c0 1 -- 10.20.193.11:0/2179077860 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8588064700 con 0x7f8588110050 2026-02-13T02:17:11.419 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.409+0000 7f856f7fe6c0 1 -- 10.20.193.11:0/2179077860 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f857c0043b0 con 0x7f8588110050 2026-02-13T02:17:11.419 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.409+0000 7f85904416c0 1 -- 10.20.193.11:0/2179077860 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8588064c30 con 0x7f8588110050 2026-02-13T02:17:11.420 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.409+0000 7f856f7fe6c0 1 -- 10.20.193.11:0/2179077860 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f857c00dca0 con 0x7f8588110050 2026-02-13T02:17:11.420 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.409+0000 7f856f7fe6c0 1 -- 10.20.193.11:0/2179077860 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (secure 0 0 0) 0x7f857c004860 con 0x7f8588110050 2026-02-13T02:17:11.420 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.409+0000 7f85904416c0 1 -- 10.20.193.11:0/2179077860 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8588175430 con 0x7f8588110050 2026-02-13T02:17:11.420 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.409+0000 7f856f7fe6c0 1 --2- 10.20.193.11:0/2179077860 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f855803f8f0 0x7f855805fda0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:11.420 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.410+0000 7f856f7fe6c0 1 -- 10.20.193.11:0/2179077860 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 935+0+0 (secure 0 0 0) 0x7f857c052350 con 0x7f8588110050 2026-02-13T02:17:11.420 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.410+0000 7f858e1b26c0 1 --2- 10.20.193.11:0/2179077860 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f855803f8f0 0x7f855805fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:11.420 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.410+0000 7f858e1b26c0 1 --2- 10.20.193.11:0/2179077860 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f855803f8f0 0x7f855805fda0 secure :-1 s=READY pgs=56 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8578004750 tx=0x7f8578005ac0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:17:11.420 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.412+0000 7f856f7fe6c0 1 -- 10.20.193.11:0/2179077860 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f857c00de00 con 0x7f8588110050 2026-02-13T02:17:11.437 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.434+0000 7f7bb26e86c0 1 -- 10.20.193.11:0/1838688982 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f7bac174c40 con 0x7f7bac10eed0 2026-02-13T02:17:11.440 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.437+0000 7f7ba97fa6c0 1 -- 10.20.193.11:0/1838688982 <== mon.0 v2:10.20.193.11:3300/0 8 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v16)=0 v16) ==== 106+0+0 (secure 0 0 0) 0x7f7b9800f040 con 0x7f7bac10eed0 2026-02-13T02:17:11.443 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.440+0000 7f7bb26e86c0 1 -- 10.20.193.11:0/1838688982 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f7b8003f8f0 msgr2=0x7f7b8005fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:11.443 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.440+0000 7f7bb26e86c0 1 --2- 10.20.193.11:0/1838688982 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f7b8003f8f0 0x7f7b8005fda0 secure :-1 s=READY pgs=53 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7b9c0098c0 tx=0x7f7b9c0023a0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.443 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.440+0000 7f7bb26e86c0 1 -- 10.20.193.11:0/1838688982 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f7bac10eed0 msgr2=0x7f7bac0f8580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:11.443 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.440+0000 7f7bb26e86c0 1 --2- 10.20.193.11:0/1838688982 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f7bac10eed0 0x7f7bac0f8580 secure :-1 s=READY pgs=98 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7b98005dc0 tx=0x7f7b9800bbd0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.444 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.440+0000 7f7bb26e86c0 1 -- 10.20.193.11:0/1838688982 shutdown_connections 2026-02-13T02:17:11.444 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.440+0000 7f7bb26e86c0 1 --2- 10.20.193.11:0/1838688982 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f7b8003f8f0 0x7f7b8005fda0 unknown :-1 s=CLOSED pgs=53 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.444 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.440+0000 7f7bb26e86c0 1 --2- 10.20.193.11:0/1838688982 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f7bac110050 0x7f7bac171390 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.444 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.440+0000 7f7bb26e86c0 1 --2- 10.20.193.11:0/1838688982 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f7bac110a00 0x7f7bac0f8de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.444 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.440+0000 7f7bb26e86c0 1 --2- 10.20.193.11:0/1838688982 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f7bac10eed0 0x7f7bac0f8580 unknown :-1 s=CLOSED pgs=98 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.444 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.440+0000 7f7bb26e86c0 1 -- 10.20.193.11:0/1838688982 >> 10.20.193.11:0/1838688982 conn(0x7f7bac0ec5f0 msgr2=0x7f7bac0eec10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:17:11.444 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.440+0000 7f7bb26e86c0 1 -- 10.20.193.11:0/1838688982 shutdown_connections 2026-02-13T02:17:11.444 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.440+0000 7f7bb26e86c0 1 -- 10.20.193.11:0/1838688982 wait complete. 2026-02-13T02:17:11.458 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:17:11.464 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:11 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:11.464 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:11 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:11.464 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:11 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T02:17:11.464 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:11 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-13T02:17:11.464 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:11 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:11.465 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:11 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:11.465 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:11 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:11.465 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:11 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:17:11.465 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:11 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:11.465 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:11 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:17:11.465 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:11 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:11.465 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:11 trial011 ceph-mon[11956]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;trial011=x;trial060=y;trial078=z", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:17:11.465 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:11 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:11.465 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:11 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:17:11.465 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:11 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:11.465 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:11 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:17:11.465 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:11 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:11.466 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:11 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-13T02:17:11.466 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:11 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-02-13T02:17:11.466 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:11 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-13T02:17:11.466 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:11 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:11.466 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:11 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/415538471' entity='client.admin' 2026-02-13T02:17:11.466 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:11 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/681035491' entity='client.admin' 2026-02-13T02:17:11.466 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:11 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/4097541672' entity='client.admin' 2026-02-13T02:17:11.466 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:11 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/3874639930' entity='client.admin' 2026-02-13T02:17:11.472 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.469+0000 7ff88902f6c0 1 -- 10.20.193.11:0/3670019766 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7ff88410c4e0 msgr2=0x7ff88410ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:11.472 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.469+0000 7ff88902f6c0 1 --2- 10.20.193.11:0/3670019766 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7ff88410c4e0 0x7ff88410ce40 secure :-1 s=READY pgs=107 gs=3 cs=0 l=1 c_cookie=12464105553633172319 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff874006fd0 tx=0x7ff87402fd20 comp rx=0 tx=0).stop 2026-02-13T02:17:11.475 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.469+0000 7ff88902f6c0 1 -- 10.20.193.11:0/3670019766 shutdown_connections 2026-02-13T02:17:11.475 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.469+0000 7ff88902f6c0 1 --2- 10.20.193.11:0/3670019766 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7ff88410bb30 0x7ff88410bfa0 unknown :-1 s=CLOSED pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.475 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.470+0000 7ff88902f6c0 1 --2- 10.20.193.11:0/3670019766 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7ff88410c4e0 0x7ff88410ce40 unknown :-1 s=CLOSED pgs=107 gs=3 cs=0 l=1 c_cookie=12464105553633172319 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.475 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.470+0000 7ff88902f6c0 1 --2- 10.20.193.11:0/3670019766 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff88410ab90 0x7ff88410af80 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.475 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.470+0000 7ff88902f6c0 1 -- 10.20.193.11:0/3670019766 >> 10.20.193.11:0/3670019766 conn(0x7ff8840e8510 msgr2=0x7ff884108940 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:17:11.475 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.470+0000 7ff88902f6c0 1 -- 10.20.193.11:0/3670019766 shutdown_connections 2026-02-13T02:17:11.475 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.470+0000 7ff88902f6c0 1 -- 10.20.193.11:0/3670019766 wait complete. 2026-02-13T02:17:11.475 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.470+0000 7ff88902f6c0 1 Processor -- start 2026-02-13T02:17:11.475 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.470+0000 7ff88902f6c0 1 -- start start 2026-02-13T02:17:11.476 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.470+0000 7ff88902f6c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7ff88410ab90 0x7ff8840f3e80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:11.476 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.470+0000 7ff88902f6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7ff88410bb30 0x7ff8840f44d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:11.476 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.470+0000 7ff88902f6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff88410c4e0 0x7ff8840f50c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:11.476 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.470+0000 7ff88902f6c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7ff8840f5850 con 0x7ff88410bb30 2026-02-13T02:17:11.476 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.470+0000 7ff8825756c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7ff88410bb30 0x7ff8840f44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:11.476 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.470+0000 7ff882d766c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7ff88410ab90 0x7ff8840f3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:11.476 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.470+0000 7ff88902f6c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff8840f59c0 con 0x7ff88410ab90 2026-02-13T02:17:11.476 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.470+0000 7ff88902f6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7ff8840f5b80 con 0x7ff88410c4e0 2026-02-13T02:17:11.476 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.470+0000 7ff8825756c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7ff88410bb30 0x7ff8840f44d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:34322/0 (socket says 10.20.193.11:34322) 2026-02-13T02:17:11.476 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.470+0000 7ff8825756c0 1 -- 10.20.193.11:0/1419240367 learned_addr learned my addr 10.20.193.11:0/1419240367 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:17:11.476 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.471+0000 7ff882d766c0 1 -- 10.20.193.11:0/1419240367 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7ff88410ab90 msgr2=0x7ff8840f3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 9 2026-02-13T02:17:11.476 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.471+0000 7ff882d766c0 1 -- 10.20.193.11:0/1419240367 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7ff88410ab90 msgr2=0x7ff8840f3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T02:17:11.477 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.471+0000 7ff882d766c0 1 --2- 10.20.193.11:0/1419240367 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7ff88410ab90 0x7ff8840f3e80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-13T02:17:11.477 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.471+0000 7ff882d766c0 1 --2- 10.20.193.11:0/1419240367 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7ff88410ab90 0x7ff8840f3e80 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-13T02:17:11.477 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.471+0000 7ff8835776c0 1 --2- 10.20.193.11:0/1419240367 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff88410c4e0 0x7ff8840f50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:11.477 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.471+0000 7ff8825756c0 1 -- 10.20.193.11:0/1419240367 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff88410c4e0 msgr2=0x7ff8840f50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:11.477 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.471+0000 7ff8835776c0 1 -- 10.20.193.11:0/1419240367 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff88410c4e0 msgr2=0x7ff8840f50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 11 2026-02-13T02:17:11.477 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.471+0000 7ff8835776c0 1 -- 10.20.193.11:0/1419240367 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff88410c4e0 msgr2=0x7ff8840f50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T02:17:11.477 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.471+0000 7ff8835776c0 1 --2- 10.20.193.11:0/1419240367 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff88410c4e0 0x7ff8840f50c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-13T02:17:11.477 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.471+0000 7ff8835776c0 1 --2- 10.20.193.11:0/1419240367 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff88410c4e0 0x7ff8840f50c0 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-13T02:17:11.477 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.471+0000 7ff8825756c0 1 --2- 10.20.193.11:0/1419240367 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff88410c4e0 0x7ff8840f50c0 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.477 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.471+0000 7ff8825756c0 1 -- 10.20.193.11:0/1419240367 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7ff88410ab90 msgr2=0x7ff8840f3e80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T02:17:11.477 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.471+0000 7ff8825756c0 1 --2- 10.20.193.11:0/1419240367 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7ff88410ab90 0x7ff8840f3e80 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.477 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.471+0000 7ff8825756c0 1 -- 10.20.193.11:0/1419240367 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff87400a5b0 con 0x7ff88410bb30 2026-02-13T02:17:11.478 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.471+0000 7ff8825756c0 1 --2- 10.20.193.11:0/1419240367 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7ff88410bb30 0x7ff8840f44d0 secure :-1 s=READY pgs=108 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff86c005dc0 tx=0x7ff86c00bbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:17:11.478 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.471+0000 7ff863fff6c0 1 -- 10.20.193.11:0/1419240367 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff86c004250 con 0x7ff88410bb30 2026-02-13T02:17:11.478 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.471+0000 7ff863fff6c0 1 -- 10.20.193.11:0/1419240367 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff86c00be30 con 0x7ff88410bb30 2026-02-13T02:17:11.478 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.471+0000 7ff863fff6c0 1 -- 10.20.193.11:0/1419240367 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff86c0052a0 con 0x7ff88410bb30 2026-02-13T02:17:11.478 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.471+0000 7ff88902f6c0 1 -- 10.20.193.11:0/1419240367 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8840f5e60 con 0x7ff88410bb30 2026-02-13T02:17:11.478 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.471+0000 7ff88902f6c0 1 -- 10.20.193.11:0/1419240367 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8840f63f0 con 0x7ff88410bb30 2026-02-13T02:17:11.478 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.472+0000 7ff88902f6c0 1 -- 10.20.193.11:0/1419240367 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff884175420 con 0x7ff88410bb30 2026-02-13T02:17:11.479 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.472+0000 7ff863fff6c0 1 -- 10.20.193.11:0/1419240367 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (secure 0 0 0) 0x7ff86c004780 con 0x7ff88410bb30 2026-02-13T02:17:11.479 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.472+0000 7ff863fff6c0 1 --2- 10.20.193.11:0/1419240367 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7ff85803f8f0 0x7ff85805fda0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:11.479 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.473+0000 7ff863fff6c0 1 -- 10.20.193.11:0/1419240367 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 935+0+0 (secure 0 0 0) 0x7ff86c051270 con 0x7ff88410bb30 2026-02-13T02:17:11.479 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.473+0000 7ff882d766c0 1 --2- 10.20.193.11:0/1419240367 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7ff85803f8f0 0x7ff85805fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:11.479 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.473+0000 7ff882d766c0 1 --2- 10.20.193.11:0/1419240367 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7ff85803f8f0 0x7ff85805fda0 secure :-1 s=READY pgs=57 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff878004750 tx=0x7ff878005ac0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:17:11.480 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.474+0000 7fd263aa76c0 1 -- 10.20.193.11:0/2441853076 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command([{prefix=config set, name=mds_bal_fragment_size_max}] v 0) -- 0x7fd25c062490 con 0x7fd25c10ddd0 2026-02-13T02:17:11.480 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.475+0000 7ff863fff6c0 1 -- 10.20.193.11:0/1419240367 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7ff86c013260 con 0x7ff88410bb30 2026-02-13T02:17:11.480 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:17:11.482 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.476+0000 7f0a4febc6c0 1 -- 10.20.193.11:0/1164653228 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f0a480600a0 msgr2=0x7f0a4810b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:11.482 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.476+0000 7f0a4febc6c0 1 --2- 10.20.193.11:0/1164653228 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f0a480600a0 0x7f0a4810b5f0 secure :-1 s=READY pgs=109 gs=1 cs=0 l=1 c_cookie=5755810872085064948 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0a38009970 tx=0x7f0a3802ed20 comp rx=0 tx=0).stop 2026-02-13T02:17:11.482 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.476+0000 7f0a4febc6c0 1 -- 10.20.193.11:0/1164653228 shutdown_connections 2026-02-13T02:17:11.483 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.476+0000 7f0a4febc6c0 1 --2- 10.20.193.11:0/1164653228 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f0a4810bb30 0x7f0a4810bfa0 unknown :-1 s=CLOSED pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.483 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.476+0000 7f0a4febc6c0 1 --2- 10.20.193.11:0/1164653228 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f0a4810c690 0x7f0a4810cb30 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.483 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.476+0000 7f0a4febc6c0 1 --2- 10.20.193.11:0/1164653228 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f0a480600a0 0x7f0a4810b5f0 unknown :-1 s=CLOSED pgs=109 gs=1 cs=0 l=1 c_cookie=5755810872085064948 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.483 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.476+0000 7f0a4febc6c0 1 -- 10.20.193.11:0/1164653228 >> 10.20.193.11:0/1164653228 conn(0x7f0a480e9230 msgr2=0x7f0a48109640 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:17:11.483 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.476+0000 7f0a4febc6c0 1 -- 10.20.193.11:0/1164653228 shutdown_connections 2026-02-13T02:17:11.483 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.476+0000 7f0a4febc6c0 1 -- 10.20.193.11:0/1164653228 wait complete. 2026-02-13T02:17:11.483 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.476+0000 7f0a4febc6c0 1 Processor -- start 2026-02-13T02:17:11.483 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.476+0000 7f0a4febc6c0 1 -- start start 2026-02-13T02:17:11.483 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.476+0000 7f0a4febc6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f0a480600a0 0x7f0a480f4930 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:11.484 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.476+0000 7f0a4febc6c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f0a4810bb30 0x7f0a480f4f80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:11.484 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.476+0000 7f0a4febc6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f0a4810c690 0x7f0a480f5b70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:11.484 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.476+0000 7f0a4febc6c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f0a480f6300 con 0x7f0a4810c690 2026-02-13T02:17:11.484 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.476+0000 7f0a4febc6c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f0a480f6470 con 0x7f0a4810bb30 2026-02-13T02:17:11.484 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.476+0000 7f0a4febc6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f0a480f6630 con 0x7f0a480600a0 2026-02-13T02:17:11.484 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.477+0000 7f0a4e42e6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f0a4810c690 0x7f0a480f5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:11.484 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.477+0000 7f0a4e42e6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f0a4810c690 0x7f0a480f5b70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:34340/0 (socket says 10.20.193.11:34340) 2026-02-13T02:17:11.484 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.477+0000 7f0a4e42e6c0 1 -- 10.20.193.11:0/2265151936 learned_addr learned my addr 10.20.193.11:0/2265151936 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:17:11.484 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.477+0000 7f0a4dc2d6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f0a480600a0 0x7f0a480f4930 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:11.484 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.477+0000 7f0a4d42c6c0 1 --2- 10.20.193.11:0/2265151936 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f0a4810bb30 0x7f0a480f4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:11.484 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.477+0000 7f0a4dc2d6c0 1 -- 10.20.193.11:0/2265151936 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f0a480600a0 msgr2=0x7f0a480f4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 9 2026-02-13T02:17:11.484 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.477+0000 7f0a4dc2d6c0 1 -- 10.20.193.11:0/2265151936 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f0a480600a0 msgr2=0x7f0a480f4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T02:17:11.485 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.477+0000 7f0a4dc2d6c0 1 --2- 10.20.193.11:0/2265151936 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f0a480600a0 0x7f0a480f4930 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-13T02:17:11.485 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.477+0000 7f0a4dc2d6c0 1 --2- 10.20.193.11:0/2265151936 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f0a480600a0 0x7f0a480f4930 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-13T02:17:11.485 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.477+0000 7f0a4e42e6c0 1 -- 10.20.193.11:0/2265151936 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f0a480600a0 msgr2=0x7f0a480f4930 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T02:17:11.485 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.477+0000 7f0a4e42e6c0 1 --2- 10.20.193.11:0/2265151936 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f0a480600a0 0x7f0a480f4930 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.485 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.477+0000 7f0a4e42e6c0 1 -- 10.20.193.11:0/2265151936 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f0a4810bb30 msgr2=0x7f0a480f4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:11.485 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.477+0000 7f0a4e42e6c0 1 --2- 10.20.193.11:0/2265151936 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f0a4810bb30 0x7f0a480f4f80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.485 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.477+0000 7f0a4e42e6c0 1 -- 10.20.193.11:0/2265151936 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a38009590 con 0x7f0a4810c690 2026-02-13T02:17:11.485 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.477+0000 7f0a4e42e6c0 1 --2- 10.20.193.11:0/2265151936 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f0a4810c690 0x7f0a480f5b70 secure :-1 s=READY pgs=110 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0a44006ea0 tx=0x7f0a440068a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:17:11.486 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.477+0000 7fd24affd6c0 1 -- 10.20.193.11:0/2441853076 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_fragment_size_max}]=0 v17)=0 v17) ==== 127+0+0 (secure 0 0 0) 0x7fd25000e040 con 0x7fd25c10ddd0 2026-02-13T02:17:11.487 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.477+0000 7f0a36ffd6c0 1 -- 10.20.193.11:0/2265151936 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0a44003a30 con 0x7f0a4810c690 2026-02-13T02:17:11.487 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.478+0000 7f0a4febc6c0 1 -- 10.20.193.11:0/2265151936 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a480f6910 con 0x7f0a4810c690 2026-02-13T02:17:11.487 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.478+0000 7f0a4febc6c0 1 -- 10.20.193.11:0/2265151936 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a480f6e50 con 0x7f0a4810c690 2026-02-13T02:17:11.487 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.478+0000 7f0a36ffd6c0 1 -- 10.20.193.11:0/2265151936 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0a44005510 con 0x7f0a4810c690 2026-02-13T02:17:11.487 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.478+0000 7f0a36ffd6c0 1 -- 10.20.193.11:0/2265151936 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0a440122f0 con 0x7f0a4810c690 2026-02-13T02:17:11.487 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.478+0000 7f0a4febc6c0 1 -- 10.20.193.11:0/2265151936 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a48110ea0 con 0x7f0a4810c690 2026-02-13T02:17:11.487 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.478+0000 7f0a36ffd6c0 1 -- 10.20.193.11:0/2265151936 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (secure 0 0 0) 0x7f0a44012480 con 0x7f0a4810c690 2026-02-13T02:17:11.487 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.479+0000 7f0a36ffd6c0 1 --2- 10.20.193.11:0/2265151936 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f0a2403f8f0 0x7f0a2405fda0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:11.487 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.479+0000 7f0a36ffd6c0 1 -- 10.20.193.11:0/2265151936 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 935+0+0 (secure 0 0 0) 0x7f0a44052380 con 0x7f0a4810c690 2026-02-13T02:17:11.487 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.480+0000 7f0a4dc2d6c0 1 --2- 10.20.193.11:0/2265151936 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f0a2403f8f0 0x7f0a2405fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:11.488 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.481+0000 7f0a4dc2d6c0 1 --2- 10.20.193.11:0/2265151936 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f0a2403f8f0 0x7f0a2405fda0 secure :-1 s=READY pgs=58 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0a380023e0 tx=0x7f0a38005f40 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:17:11.488 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.481+0000 7fd263aa76c0 1 -- 10.20.193.11:0/2441853076 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fd23803f8f0 msgr2=0x7fd23805fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:11.488 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.481+0000 7fd263aa76c0 1 --2- 10.20.193.11:0/2441853076 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fd23803f8f0 0x7fd23805fda0 secure :-1 s=READY pgs=54 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd24c005980 tx=0x7fd24c005910 comp rx=0 tx=0).stop 2026-02-13T02:17:11.488 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.481+0000 7fd263aa76c0 1 -- 10.20.193.11:0/2441853076 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fd25c10ddd0 msgr2=0x7fd25c1175b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:11.489 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.481+0000 7fd263aa76c0 1 --2- 10.20.193.11:0/2441853076 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fd25c10ddd0 0x7fd25c1175b0 secure :-1 s=READY pgs=100 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd250004750 tx=0x7fd25000bed0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.489 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.481+0000 7fd263aa76c0 1 -- 10.20.193.11:0/2441853076 shutdown_connections 2026-02-13T02:17:11.489 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.481+0000 7fd263aa76c0 1 --2- 10.20.193.11:0/2441853076 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fd23803f8f0 0x7fd23805fda0 unknown :-1 s=CLOSED pgs=54 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.489 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.481+0000 7fd263aa76c0 1 --2- 10.20.193.11:0/2441853076 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fd25c10e780 0x7fd25c1181a0 unknown :-1 s=CLOSED pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.489 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.481+0000 7fd263aa76c0 1 --2- 10.20.193.11:0/2441853076 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fd25c10ddd0 0x7fd25c1175b0 unknown :-1 s=CLOSED pgs=100 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.489 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.481+0000 7fd263aa76c0 1 --2- 10.20.193.11:0/2441853076 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd25c10cc50 0x7fd25c116f60 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.489 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.481+0000 7fd263aa76c0 1 -- 10.20.193.11:0/2441853076 >> 10.20.193.11:0/2441853076 conn(0x7fd25c0ea370 msgr2=0x7fd25c10a750 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:17:11.489 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.481+0000 7fd263aa76c0 1 -- 10.20.193.11:0/2441853076 shutdown_connections 2026-02-13T02:17:11.489 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.481+0000 7fd263aa76c0 1 -- 10.20.193.11:0/2441853076 wait complete. 2026-02-13T02:17:11.490 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.481+0000 7f0a36ffd6c0 1 -- 10.20.193.11:0/2265151936 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f0a440173f0 con 0x7f0a4810c690 2026-02-13T02:17:11.492 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:17:11.493 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.491+0000 7feff66206c0 1 -- 10.20.193.11:0/3209558962 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7feff01792a0 con 0x7feff0064800 2026-02-13T02:17:11.498 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.495+0000 7fefed7fa6c0 1 -- 10.20.193.11:0/3209558962 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v18)=0 v18) ==== 116+0+0 (secure 0 0 0) 0x7fefe4012350 con 0x7feff0064800 2026-02-13T02:17:11.503 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.499+0000 7feff66206c0 1 -- 10.20.193.11:0/3209558962 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fefc803f8f0 msgr2=0x7fefc805fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:11.503 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.499+0000 7feff66206c0 1 --2- 10.20.193.11:0/3209558962 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fefc803f8f0 0x7fefc805fda0 secure :-1 s=READY pgs=55 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fefdc005b40 tx=0x7fefdc0072a0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.503 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.499+0000 7feff66206c0 1 -- 10.20.193.11:0/3209558962 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7feff0064800 msgr2=0x7feff00f91d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:11.503 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.499+0000 7feff66206c0 1 --2- 10.20.193.11:0/3209558962 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7feff0064800 0x7feff00f91d0 secure :-1 s=READY pgs=104 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fefe4006090 tx=0x7fefe4006560 comp rx=0 tx=0).stop 2026-02-13T02:17:11.503 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.499+0000 7feff66206c0 1 -- 10.20.193.11:0/3209558962 shutdown_connections 2026-02-13T02:17:11.503 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.499+0000 7feff66206c0 1 --2- 10.20.193.11:0/3209558962 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fefc803f8f0 0x7fefc805fda0 unknown :-1 s=CLOSED pgs=55 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.504 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.500+0000 7feff66206c0 1 --2- 10.20.193.11:0/3209558962 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7feff0064800 0x7feff00f91d0 unknown :-1 s=CLOSED pgs=104 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.504 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.500+0000 7feff66206c0 1 --2- 10.20.193.11:0/3209558962 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7feff0063e50 0x7feff00f85e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.504 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.500+0000 7feff66206c0 1 --2- 10.20.193.11:0/3209558962 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7feff0062cd0 0x7feff00f7f90 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.504 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.500+0000 7feff66206c0 1 -- 10.20.193.11:0/3209558962 >> 10.20.193.11:0/3209558962 conn(0x7feff00ec5f0 msgr2=0x7feff00ee2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:17:11.504 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.500+0000 7feff66206c0 1 -- 10.20.193.11:0/3209558962 shutdown_connections 2026-02-13T02:17:11.504 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.500+0000 7feff66206c0 1 -- 10.20.193.11:0/3209558962 wait complete. 2026-02-13T02:17:11.509 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'fc631695-0881-11f1-899c-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='trial011') 2026-02-13T02:17:11.510 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'fc631695-0881-11f1-899c-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='trial011') 2026-02-13T02:17:11.516 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'fc631695-0881-11f1-899c-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='trial011') 2026-02-13T02:17:11.530 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.527+0000 7f85904416c0 1 -- 10.20.193.11:0/2179077860 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) -- 0x7f8588174ca0 con 0x7f8588110050 2026-02-13T02:17:11.533 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.531+0000 7f856f7fe6c0 1 -- 10.20.193.11:0/2179077860 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v19)=0 v19) ==== 116+0+0 (secure 0 0 0) 0x7f857c011e60 con 0x7f8588110050 2026-02-13T02:17:11.538 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:17:11.539 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.535+0000 7f85904416c0 1 -- 10.20.193.11:0/2179077860 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f855803f8f0 msgr2=0x7f855805fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:11.539 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.536+0000 7f85904416c0 1 --2- 10.20.193.11:0/2179077860 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f855803f8f0 0x7f855805fda0 secure :-1 s=READY pgs=56 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8578004750 tx=0x7f8578005ac0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.539 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.536+0000 7f85904416c0 1 -- 10.20.193.11:0/2179077860 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f8588110050 msgr2=0x7f8588171390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:11.539 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.536+0000 7f85904416c0 1 --2- 10.20.193.11:0/2179077860 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f8588110050 0x7f8588171390 secure :-1 s=READY pgs=106 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f857c00b6c0 tx=0x7f857c00bb90 comp rx=0 tx=0).stop 2026-02-13T02:17:11.539 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.536+0000 7f85904416c0 1 -- 10.20.193.11:0/2179077860 shutdown_connections 2026-02-13T02:17:11.540 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.536+0000 7f85904416c0 1 --2- 10.20.193.11:0/2179077860 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f855803f8f0 0x7f855805fda0 unknown :-1 s=CLOSED pgs=56 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.540 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.536+0000 7f85904416c0 1 --2- 10.20.193.11:0/2179077860 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f8588110a00 0x7f85880634c0 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.540 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.536+0000 7f85904416c0 1 --2- 10.20.193.11:0/2179077860 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f8588110050 0x7f8588171390 unknown :-1 s=CLOSED pgs=106 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.540 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.536+0000 7f85904416c0 1 --2- 10.20.193.11:0/2179077860 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f858810eed0 0x7f8588062c60 unknown :-1 s=CLOSED pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.540 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.536+0000 7f85904416c0 1 -- 10.20.193.11:0/2179077860 >> 10.20.193.11:0/2179077860 conn(0x7f85880ec5f0 msgr2=0x7f85880ee580 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:17:11.540 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.536+0000 7f85904416c0 1 -- 10.20.193.11:0/2179077860 shutdown_connections 2026-02-13T02:17:11.540 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.536+0000 7f85904416c0 1 -- 10.20.193.11:0/2179077860 wait complete. 2026-02-13T02:17:11.552 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:17:11.561 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'fc631695-0881-11f1-899c-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_fragment_size_max', '10000'], check_status=True, hostname='trial011') 2026-02-13T02:17:11.562 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'fc631695-0881-11f1-899c-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_merge_size', '5'], check_status=True, hostname='trial011') 2026-02-13T02:17:11.567 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.563+0000 7f898df256c0 1 -- 10.20.193.11:0/146732561 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f8988110a00 msgr2=0x7f8988171390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:11.567 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.563+0000 7f898df256c0 1 --2- 10.20.193.11:0/146732561 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f8988110a00 0x7f8988171390 secure :-1 s=READY pgs=111 gs=1 cs=0 l=1 c_cookie=14584868376277969054 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f897c00aa40 tx=0x7f897c02fde0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.567 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.564+0000 7f898df256c0 1 -- 10.20.193.11:0/146732561 shutdown_connections 2026-02-13T02:17:11.567 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.564+0000 7f898df256c0 1 --2- 10.20.193.11:0/146732561 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f8988110a00 0x7f8988171390 unknown :-1 s=CLOSED pgs=111 gs=1 cs=0 l=1 c_cookie=14584868376277969054 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.567 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.564+0000 7f898df256c0 1 --2- 10.20.193.11:0/146732561 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f8988110050 0x7f89881104c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.567 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.564+0000 7f898df256c0 1 --2- 10.20.193.11:0/146732561 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f898810eed0 0x7f898810f2c0 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.567 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.564+0000 7f898df256c0 1 -- 10.20.193.11:0/146732561 >> 10.20.193.11:0/146732561 conn(0x7f89880ec5f0 msgr2=0x7f898810ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:17:11.567 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.564+0000 7f898df256c0 1 -- 10.20.193.11:0/146732561 shutdown_connections 2026-02-13T02:17:11.569 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.564+0000 7f898df256c0 1 -- 10.20.193.11:0/146732561 wait complete. 2026-02-13T02:17:11.569 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.564+0000 7f898df256c0 1 Processor -- start 2026-02-13T02:17:11.569 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.564+0000 7f898df256c0 1 -- start start 2026-02-13T02:17:11.569 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.565+0000 7f898df256c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f898810eed0 0x7f89880f8ee0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:11.570 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.565+0000 7f898df256c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f8988110050 0x7f8988171370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:11.570 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.565+0000 7f898df256c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f8988110a00 0x7f89880f9720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:11.570 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.565+0000 7f898df256c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f89880fa370 con 0x7f8988110050 2026-02-13T02:17:11.570 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.565+0000 7f898df256c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f89880fa4e0 con 0x7f898810eed0 2026-02-13T02:17:11.570 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.565+0000 7f898df256c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f89880fa6a0 con 0x7f8988110a00 2026-02-13T02:17:11.570 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.565+0000 7f8987fff6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f8988110a00 0x7f89880f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:11.570 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.565+0000 7f89877fe6c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f898810eed0 0x7f89880f8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:11.570 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.565+0000 7f8986ffd6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f8988110050 0x7f8988171370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:11.570 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.565+0000 7f89877fe6c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f898810eed0 0x7f89880f8ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.60:3300/0 says I am v2:10.20.193.11:45514/0 (socket says 10.20.193.11:45514) 2026-02-13T02:17:11.570 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.565+0000 7f89877fe6c0 1 -- 10.20.193.11:0/3215374523 learned_addr learned my addr 10.20.193.11:0/3215374523 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:17:11.570 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.565+0000 7f89877fe6c0 1 -- 10.20.193.11:0/3215374523 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f898810eed0 msgr2=0x7f89880f8ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 10 2026-02-13T02:17:11.571 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.565+0000 7f89877fe6c0 1 -- 10.20.193.11:0/3215374523 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f898810eed0 msgr2=0x7f89880f8ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T02:17:11.571 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.565+0000 7f89877fe6c0 1 --2- 10.20.193.11:0/3215374523 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f898810eed0 0x7f89880f8ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-13T02:17:11.571 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.565+0000 7f89877fe6c0 1 --2- 10.20.193.11:0/3215374523 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f898810eed0 0x7f89880f8ee0 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-13T02:17:11.571 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.565+0000 7f8987fff6c0 1 -- 10.20.193.11:0/3215374523 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f8988110a00 msgr2=0x7f89880f9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 9 2026-02-13T02:17:11.571 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.565+0000 7f8987fff6c0 1 -- 10.20.193.11:0/3215374523 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f8988110a00 msgr2=0x7f89880f9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T02:17:11.571 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.565+0000 7f8987fff6c0 1 --2- 10.20.193.11:0/3215374523 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f8988110a00 0x7f89880f9720 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-13T02:17:11.571 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.565+0000 7f8987fff6c0 1 --2- 10.20.193.11:0/3215374523 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f8988110a00 0x7f89880f9720 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-13T02:17:11.571 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.565+0000 7f8986ffd6c0 1 -- 10.20.193.11:0/3215374523 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f8988110a00 msgr2=0x7f89880f9720 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T02:17:11.571 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.565+0000 7f8986ffd6c0 1 --2- 10.20.193.11:0/3215374523 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f8988110a00 0x7f89880f9720 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.571 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.565+0000 7f8986ffd6c0 1 -- 10.20.193.11:0/3215374523 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f898810eed0 msgr2=0x7f89880f8ee0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T02:17:11.571 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.565+0000 7f8986ffd6c0 1 --2- 10.20.193.11:0/3215374523 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f898810eed0 0x7f89880f8ee0 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.571 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.565+0000 7f8986ffd6c0 1 -- 10.20.193.11:0/3215374523 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f897c00a660 con 0x7f8988110050 2026-02-13T02:17:11.572 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.565+0000 7f8986ffd6c0 1 --2- 10.20.193.11:0/3215374523 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f8988110050 0x7f8988171370 secure :-1 s=READY pgs=112 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f897800b640 tx=0x7f897800bb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:17:11.572 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.565+0000 7f8984ff96c0 1 -- 10.20.193.11:0/3215374523 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f89780044a0 con 0x7f8988110050 2026-02-13T02:17:11.572 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.565+0000 7f898df256c0 1 -- 10.20.193.11:0/3215374523 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89880fa920 con 0x7f8988110050 2026-02-13T02:17:11.572 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.565+0000 7f898df256c0 1 -- 10.20.193.11:0/3215374523 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89880fae50 con 0x7f8988110050 2026-02-13T02:17:11.572 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.565+0000 7f8984ff96c0 1 -- 10.20.193.11:0/3215374523 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f8978009030 con 0x7f8988110050 2026-02-13T02:17:11.572 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.565+0000 7f8984ff96c0 1 -- 10.20.193.11:0/3215374523 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f89780044a0 con 0x7f8988110050 2026-02-13T02:17:11.572 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.566+0000 7f8984ff96c0 1 -- 10.20.193.11:0/3215374523 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (secure 0 0 0) 0x7f89780071c0 con 0x7f8988110050 2026-02-13T02:17:11.572 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.566+0000 7f898df256c0 1 -- 10.20.193.11:0/3215374523 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89881753c0 con 0x7f8988110050 2026-02-13T02:17:11.572 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.567+0000 7f8984ff96c0 1 --2- 10.20.193.11:0/3215374523 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f895c03f950 0x7f895c05fe00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:11.573 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.567+0000 7f8984ff96c0 1 -- 10.20.193.11:0/3215374523 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 935+0+0 (secure 0 0 0) 0x7f89780632d0 con 0x7f8988110050 2026-02-13T02:17:11.573 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.567+0000 7f89877fe6c0 1 --2- 10.20.193.11:0/3215374523 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f895c03f950 0x7f895c05fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:11.573 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.567+0000 7f89877fe6c0 1 --2- 10.20.193.11:0/3215374523 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f895c03f950 0x7f895c05fe00 secure :-1 s=READY pgs=59 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8974007240 tx=0x7f8974007620 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:17:11.573 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.569+0000 7f8984ff96c0 1 -- 10.20.193.11:0/3215374523 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f89780253f0 con 0x7f8988110050 2026-02-13T02:17:11.574 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'fc631695-0881-11f1-899c-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_bits', '3'], check_status=True, hostname='trial011') 2026-02-13T02:17:11.583 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.580+0000 7f6cb2fec6c0 1 -- 10.20.193.11:0/3478491303 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f6cac10eed0 msgr2=0x7f6cac10f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:11.583 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.580+0000 7f6cb2fec6c0 1 --2- 10.20.193.11:0/3478491303 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f6cac10eed0 0x7f6cac10f2c0 secure :-1 s=READY pgs=113 gs=1 cs=0 l=1 c_cookie=9675574153641454867 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c9c009970 tx=0x7f6c9c02ed20 comp rx=0 tx=0).stop 2026-02-13T02:17:11.583 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.580+0000 7f6cb2fec6c0 1 -- 10.20.193.11:0/3478491303 shutdown_connections 2026-02-13T02:17:11.583 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.580+0000 7f6cb2fec6c0 1 --2- 10.20.193.11:0/3478491303 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f6cac110050 0x7f6cac1104c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.583 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.580+0000 7f6cb2fec6c0 1 --2- 10.20.193.11:0/3478491303 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6cac110a00 0x7f6cac171390 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.583 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.580+0000 7f6cb2fec6c0 1 --2- 10.20.193.11:0/3478491303 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f6cac10eed0 0x7f6cac10f2c0 unknown :-1 s=CLOSED pgs=113 gs=1 cs=0 l=1 c_cookie=9675574153641454867 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.583 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.580+0000 7f6cb2fec6c0 1 -- 10.20.193.11:0/3478491303 >> 10.20.193.11:0/3478491303 conn(0x7f6cac0ec5f0 msgr2=0x7f6cac10ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:17:11.584 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.580+0000 7f6cb2fec6c0 1 -- 10.20.193.11:0/3478491303 shutdown_connections 2026-02-13T02:17:11.584 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.580+0000 7f6cb2fec6c0 1 -- 10.20.193.11:0/3478491303 wait complete. 2026-02-13T02:17:11.584 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.580+0000 7f19157106c0 1 -- 10.20.193.11:0/2965610133 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f1910110a00 msgr2=0x7f1910171390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:11.584 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.580+0000 7f19157106c0 1 --2- 10.20.193.11:0/2965610133 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f1910110a00 0x7f1910171390 secure :-1 s=READY pgs=114 gs=1 cs=0 l=1 c_cookie=5954300316699674023 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f190000aa40 tx=0x7f190002fde0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.584 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.580+0000 7f19157106c0 1 -- 10.20.193.11:0/2965610133 shutdown_connections 2026-02-13T02:17:11.584 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.580+0000 7f19157106c0 1 --2- 10.20.193.11:0/2965610133 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f1910110a00 0x7f1910171390 unknown :-1 s=CLOSED pgs=114 gs=1 cs=0 l=1 c_cookie=5954300316699674023 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.585 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.580+0000 7f19157106c0 1 --2- 10.20.193.11:0/2965610133 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1910110050 0x7f19101104c0 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.585 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.580+0000 7f19157106c0 1 --2- 10.20.193.11:0/2965610133 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f191010eed0 0x7f191010f2c0 unknown :-1 s=CLOSED pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.585 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.580+0000 7f19157106c0 1 -- 10.20.193.11:0/2965610133 >> 10.20.193.11:0/2965610133 conn(0x7f19100ec5f0 msgr2=0x7f191010ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:17:11.585 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.580+0000 7f19157106c0 1 -- 10.20.193.11:0/2965610133 shutdown_connections 2026-02-13T02:17:11.585 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.580+0000 7f19157106c0 1 -- 10.20.193.11:0/2965610133 wait complete. 2026-02-13T02:17:11.585 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.580+0000 7f6cb2fec6c0 1 Processor -- start 2026-02-13T02:17:11.586 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.581+0000 7f6cb2fec6c0 1 -- start start 2026-02-13T02:17:11.586 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.581+0000 7f6cb2fec6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f6cac10eed0 0x7f6cac062c60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:11.586 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.581+0000 7f19157106c0 1 Processor -- start 2026-02-13T02:17:11.586 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.581+0000 7f19157106c0 1 -- start start 2026-02-13T02:17:11.587 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.581+0000 7f6cb2fec6c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f6cac110050 0x7f6cac171390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:11.587 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.581+0000 7f6cb2fec6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6cac110a00 0x7f6cac0634c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:11.587 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.581+0000 7f6cb2fec6c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f6cac0640f0 con 0x7f6cac10eed0 2026-02-13T02:17:11.587 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.581+0000 7f6cb2fec6c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6cac064260 con 0x7f6cac110050 2026-02-13T02:17:11.587 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.581+0000 7f6cb2fec6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f6cac064420 con 0x7f6cac110a00 2026-02-13T02:17:11.587 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.581+0000 7f6cb0d616c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f6cac10eed0 0x7f6cac062c60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:11.587 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.581+0000 7f6cb0d616c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f6cac10eed0 0x7f6cac062c60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:34392/0 (socket says 10.20.193.11:34392) 2026-02-13T02:17:11.587 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.581+0000 7f6cb0d616c0 1 -- 10.20.193.11:0/1050377170 learned_addr learned my addr 10.20.193.11:0/1050377170 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:17:11.588 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.581+0000 7f19157106c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f191010eed0 0x7f19100fc970 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:11.588 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.581+0000 7f19157106c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1910110050 0x7f1910171390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:11.588 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.581+0000 7f19157106c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f1910110a00 0x7f19100fd1d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:11.588 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.581+0000 7f19157106c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f19100fde00 con 0x7f191010eed0 2026-02-13T02:17:11.588 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.581+0000 7f19157106c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f19100fdf70 con 0x7f1910110a00 2026-02-13T02:17:11.588 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.581+0000 7f19157106c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f19100fe130 con 0x7f1910110050 2026-02-13T02:17:11.588 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.581+0000 7f190effd6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f191010eed0 0x7f19100fc970 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:11.589 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.581+0000 7f6ca3fff6c0 1 --2- 10.20.193.11:0/1050377170 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f6cac110050 0x7f6cac171390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:11.589 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.581+0000 7f6ca3fff6c0 1 -- 10.20.193.11:0/1050377170 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f6cac110050 msgr2=0x7f6cac171390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 10 2026-02-13T02:17:11.589 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.581+0000 7f190effd6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f191010eed0 0x7f19100fc970 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:34404/0 (socket says 10.20.193.11:34404) 2026-02-13T02:17:11.589 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.581+0000 7f190effd6c0 1 -- 10.20.193.11:0/2207396411 learned_addr learned my addr 10.20.193.11:0/2207396411 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:17:11.589 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.581+0000 7f190e7fc6c0 1 --2- 10.20.193.11:0/2207396411 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1910110050 0x7f1910171390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:11.590 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.581+0000 7f6ca3fff6c0 1 -- 10.20.193.11:0/1050377170 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f6cac110050 msgr2=0x7f6cac171390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T02:17:11.590 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.581+0000 7f6ca3fff6c0 1 --2- 10.20.193.11:0/1050377170 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f6cac110050 0x7f6cac171390 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-13T02:17:11.590 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.581+0000 7f6ca3fff6c0 1 --2- 10.20.193.11:0/1050377170 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f6cac110050 0x7f6cac171390 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-13T02:17:11.590 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.581+0000 7f6cb0d616c0 1 -- 10.20.193.11:0/1050377170 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6cac110a00 msgr2=0x7f6cac0634c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:11.591 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.581+0000 7f190e7fc6c0 1 -- 10.20.193.11:0/2207396411 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1910110050 msgr2=0x7f1910171390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 9 2026-02-13T02:17:11.591 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.581+0000 7f190e7fc6c0 1 -- 10.20.193.11:0/2207396411 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1910110050 msgr2=0x7f1910171390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T02:17:11.591 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.581+0000 7f190e7fc6c0 1 --2- 10.20.193.11:0/2207396411 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1910110050 0x7f1910171390 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-13T02:17:11.591 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.581+0000 7f190e7fc6c0 1 --2- 10.20.193.11:0/2207396411 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1910110050 0x7f1910171390 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-13T02:17:11.591 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.581+0000 7f190effd6c0 1 -- 10.20.193.11:0/2207396411 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1910110050 msgr2=0x7f1910171390 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T02:17:11.591 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.581+0000 7f190effd6c0 1 --2- 10.20.193.11:0/2207396411 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1910110050 0x7f1910171390 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.591 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.581+0000 7f190effd6c0 1 -- 10.20.193.11:0/2207396411 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f1910110a00 msgr2=0x7f19100fd1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:11.591 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.581+0000 7f190effd6c0 1 --2- 10.20.193.11:0/2207396411 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f1910110a00 0x7f19100fd1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.591 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.581+0000 7f190effd6c0 1 -- 10.20.193.11:0/2207396411 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f190000a660 con 0x7f191010eed0 2026-02-13T02:17:11.592 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.582+0000 7f190effd6c0 1 --2- 10.20.193.11:0/2207396411 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f191010eed0 0x7f19100fc970 secure :-1 s=READY pgs=115 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1904005dc0 tx=0x7f190400bbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:17:11.592 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.581+0000 7f6cb15626c0 1 --2- 10.20.193.11:0/1050377170 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6cac110a00 0x7f6cac0634c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:11.592 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.581+0000 7f6cb0d616c0 1 --2- 10.20.193.11:0/1050377170 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6cac110a00 0x7f6cac0634c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.592 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.581+0000 7f6cb0d616c0 1 -- 10.20.193.11:0/1050377170 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f6cac110050 msgr2=0x7f6cac171390 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T02:17:11.592 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.581+0000 7f6cb0d616c0 1 --2- 10.20.193.11:0/1050377170 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f6cac110050 0x7f6cac171390 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.593 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.581+0000 7f6cb0d616c0 1 -- 10.20.193.11:0/1050377170 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c9c009590 con 0x7f6cac10eed0 2026-02-13T02:17:11.593 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.581+0000 7f6cb15626c0 1 --2- 10.20.193.11:0/1050377170 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6cac110a00 0x7f6cac0634c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:17:11.593 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.582+0000 7f6cb0d616c0 1 --2- 10.20.193.11:0/1050377170 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f6cac10eed0 0x7f6cac062c60 secure :-1 s=READY pgs=116 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c9c009290 tx=0x7f6c9c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:17:11.593 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.582+0000 7f18effff6c0 1 -- 10.20.193.11:0/2207396411 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1904004250 con 0x7f191010eed0 2026-02-13T02:17:11.594 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.582+0000 7f18effff6c0 1 -- 10.20.193.11:0/2207396411 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f190400be30 con 0x7f191010eed0 2026-02-13T02:17:11.594 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.582+0000 7f19157106c0 1 -- 10.20.193.11:0/2207396411 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19100fe410 con 0x7f191010eed0 2026-02-13T02:17:11.594 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.582+0000 7f18effff6c0 1 -- 10.20.193.11:0/2207396411 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f19040052a0 con 0x7f191010eed0 2026-02-13T02:17:11.594 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.582+0000 7f19157106c0 1 -- 10.20.193.11:0/2207396411 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19100fe940 con 0x7f191010eed0 2026-02-13T02:17:11.594 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.582+0000 7f6ca1ffb6c0 1 -- 10.20.193.11:0/1050377170 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6c9c002c20 con 0x7f6cac10eed0 2026-02-13T02:17:11.595 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.582+0000 7f6ca1ffb6c0 1 -- 10.20.193.11:0/1050377170 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6c9c002d80 con 0x7f6cac10eed0 2026-02-13T02:17:11.595 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.582+0000 7f6cb2fec6c0 1 -- 10.20.193.11:0/1050377170 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cac0646a0 con 0x7f6cac10eed0 2026-02-13T02:17:11.595 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.582+0000 7f6ca1ffb6c0 1 -- 10.20.193.11:0/1050377170 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6c9c037410 con 0x7f6cac10eed0 2026-02-13T02:17:11.595 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.582+0000 7f19157106c0 1 -- 10.20.193.11:0/2207396411 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1910175430 con 0x7f191010eed0 2026-02-13T02:17:11.595 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.582+0000 7f6cb2fec6c0 1 -- 10.20.193.11:0/1050377170 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cac064b70 con 0x7f6cac10eed0 2026-02-13T02:17:11.596 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.583+0000 7f18effff6c0 1 -- 10.20.193.11:0/2207396411 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (secure 0 0 0) 0x7f1904004780 con 0x7f191010eed0 2026-02-13T02:17:11.596 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.583+0000 7f18effff6c0 1 --2- 10.20.193.11:0/2207396411 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f18e403f8f0 0x7f18e405fda0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:11.596 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.583+0000 7f18effff6c0 1 -- 10.20.193.11:0/2207396411 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 935+0+0 (secure 0 0 0) 0x7f19040512e0 con 0x7f191010eed0 2026-02-13T02:17:11.596 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.583+0000 7f190e7fc6c0 1 --2- 10.20.193.11:0/2207396411 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f18e403f8f0 0x7f18e405fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:11.597 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.583+0000 7f6ca1ffb6c0 1 -- 10.20.193.11:0/1050377170 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (secure 0 0 0) 0x7f6c9c0375e0 con 0x7f6cac10eed0 2026-02-13T02:17:11.597 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.583+0000 7f6cb2fec6c0 1 -- 10.20.193.11:0/1050377170 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cac175410 con 0x7f6cac10eed0 2026-02-13T02:17:11.597 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.583+0000 7f190e7fc6c0 1 --2- 10.20.193.11:0/2207396411 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f18e403f8f0 0x7f18e405fda0 secure :-1 s=READY pgs=60 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f18f8005980 tx=0x7f18f8005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:17:11.598 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.583+0000 7f6ca1ffb6c0 1 --2- 10.20.193.11:0/1050377170 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f6c8803f8f0 0x7f6c8805fda0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:11.598 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.583+0000 7f6ca1ffb6c0 1 -- 10.20.193.11:0/1050377170 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 935+0+0 (secure 0 0 0) 0x7f6c9c0767a0 con 0x7f6cac10eed0 2026-02-13T02:17:11.598 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.584+0000 7f6ca3fff6c0 1 --2- 10.20.193.11:0/1050377170 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f6c8803f8f0 0x7f6c8805fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:11.598 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.584+0000 7f6ca3fff6c0 1 --2- 10.20.193.11:0/1050377170 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f6c8803f8f0 0x7f6c8805fda0 secure :-1 s=READY pgs=61 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c94005980 tx=0x7f6c94005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:17:11.599 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:11 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:11.599 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:11 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:11.599 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:11 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T02:17:11.599 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:11 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-13T02:17:11.599 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:11 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:11.599 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:11 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:11.599 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:11 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:11.599 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:11 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:17:11.600 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:11 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:11.600 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:11 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:17:11.600 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:11 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:11.600 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:11 trial060 ceph-mon[14797]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;trial011=x;trial060=y;trial078=z", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:17:11.600 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:11 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:11.600 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:11 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:17:11.600 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:11 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:11.600 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:11 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:17:11.600 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:11 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:11.600 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:11 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-13T02:17:11.600 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:11 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-02-13T02:17:11.600 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:11 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-13T02:17:11.601 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:11 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:11.601 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:11 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/415538471' entity='client.admin' 2026-02-13T02:17:11.601 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:11 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/681035491' entity='client.admin' 2026-02-13T02:17:11.601 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:11 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/4097541672' entity='client.admin' 2026-02-13T02:17:11.601 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:11 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/3874639930' entity='client.admin' 2026-02-13T02:17:11.601 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.585+0000 7f18effff6c0 1 -- 10.20.193.11:0/2207396411 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f190400e890 con 0x7f191010eed0 2026-02-13T02:17:11.601 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.587+0000 7f6ca1ffb6c0 1 -- 10.20.193.11:0/1050377170 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f6c9c039770 con 0x7f6cac10eed0 2026-02-13T02:17:11.602 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'fc631695-0881-11f1-899c-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_size', '100'], check_status=True, hostname='trial011') 2026-02-13T02:17:11.603 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:17:11.603 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:17:11.604 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.593+0000 7ff88902f6c0 1 -- 10.20.193.11:0/1419240367 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7ff884174d10 con 0x7ff88410bb30 2026-02-13T02:17:11.604 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.597+0000 7ff863fff6c0 1 -- 10.20.193.11:0/1419240367 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v20)=0 v20) ==== 115+0+0 (secure 0 0 0) 0x7ff86c00e8d0 con 0x7ff88410bb30 2026-02-13T02:17:11.605 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.598+0000 7f349a0376c0 1 -- 10.20.193.11:0/4167731291 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f349410fea0 msgr2=0x7f3494110310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:11.605 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.598+0000 7f349a0376c0 1 --2- 10.20.193.11:0/4167731291 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f349410fea0 0x7f3494110310 secure :-1 s=READY pgs=117 gs=1 cs=0 l=1 c_cookie=5397283998531913425 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f34880098a0 tx=0x7f348802ec40 comp rx=0 tx=0).stop 2026-02-13T02:17:11.606 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.599+0000 7f349a0376c0 1 -- 10.20.193.11:0/4167731291 shutdown_connections 2026-02-13T02:17:11.606 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.599+0000 7f349a0376c0 1 --2- 10.20.193.11:0/4167731291 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f3494110850 0x7f34941711e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.606 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.599+0000 7f349a0376c0 1 --2- 10.20.193.11:0/4167731291 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f349410fea0 0x7f3494110310 unknown :-1 s=CLOSED pgs=117 gs=1 cs=0 l=1 c_cookie=5397283998531913425 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.606 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.599+0000 7f349a0376c0 1 --2- 10.20.193.11:0/4167731291 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f349410ed20 0x7f349410f110 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.606 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.599+0000 7f349a0376c0 1 -- 10.20.193.11:0/4167731291 >> 10.20.193.11:0/4167731291 conn(0x7f34940ec440 msgr2=0x7f349410c850 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:17:11.606 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.599+0000 7f349a0376c0 1 -- 10.20.193.11:0/4167731291 shutdown_connections 2026-02-13T02:17:11.606 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.599+0000 7f349a0376c0 1 -- 10.20.193.11:0/4167731291 wait complete. 2026-02-13T02:17:11.606 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.599+0000 7f349a0376c0 1 Processor -- start 2026-02-13T02:17:11.606 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.599+0000 7f349a0376c0 1 -- start start 2026-02-13T02:17:11.606 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.599+0000 7f349a0376c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f349410ed20 0x7f34940ee5f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:11.606 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.599+0000 7f349a0376c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f349410fea0 0x7f34941711e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:11.606 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.599+0000 7f349a0376c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f3494110850 0x7f34940eee50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:11.607 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.599+0000 7f349a0376c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f34940efa80 con 0x7f3494110850 2026-02-13T02:17:11.607 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.599+0000 7f349a0376c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f34940efbf0 con 0x7f349410fea0 2026-02-13T02:17:11.607 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.599+0000 7f349a0376c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f34940efdb0 con 0x7f349410ed20 2026-02-13T02:17:11.607 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.599+0000 7f349b2c06c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f3494110850 0x7f34940eee50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:11.607 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.599+0000 7f349b2c06c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f3494110850 0x7f34940eee50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:34416/0 (socket says 10.20.193.11:34416) 2026-02-13T02:17:11.607 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.600+0000 7f349b2c06c0 1 -- 10.20.193.11:0/4041610032 learned_addr learned my addr 10.20.193.11:0/4041610032 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:17:11.607 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.600+0000 7f34988346c0 1 --2- 10.20.193.11:0/4041610032 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f349410fea0 0x7f34941711e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:11.607 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.600+0000 7f34990356c0 1 --2- 10.20.193.11:0/4041610032 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f349410ed20 0x7f34940ee5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:11.607 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.600+0000 7f34988346c0 1 -- 10.20.193.11:0/4041610032 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f349410fea0 msgr2=0x7f34941711e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 11 2026-02-13T02:17:11.607 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.600+0000 7f349b2c06c0 1 -- 10.20.193.11:0/4041610032 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f349410ed20 msgr2=0x7f34940ee5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:11.607 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.600+0000 7f349b2c06c0 1 --2- 10.20.193.11:0/4041610032 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f349410ed20 0x7f34940ee5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.607 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.600+0000 7f349b2c06c0 1 -- 10.20.193.11:0/4041610032 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f349410fea0 msgr2=0x7f34941711e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:11.607 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.600+0000 7f34988346c0 1 -- 10.20.193.11:0/4041610032 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f349410fea0 msgr2=0x7f34941711e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T02:17:11.607 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.600+0000 7f34988346c0 1 --2- 10.20.193.11:0/4041610032 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f349410fea0 0x7f34941711e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-13T02:17:11.608 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.600+0000 7f34988346c0 1 --2- 10.20.193.11:0/4041610032 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f349410fea0 0x7f34941711e0 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-13T02:17:11.608 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.600+0000 7f349b2c06c0 1 --2- 10.20.193.11:0/4041610032 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f349410fea0 0x7f34941711e0 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.608 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.600+0000 7f349b2c06c0 1 -- 10.20.193.11:0/4041610032 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34880094c0 con 0x7f3494110850 2026-02-13T02:17:11.608 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.600+0000 7f349b2c06c0 1 --2- 10.20.193.11:0/4041610032 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f3494110850 0x7f34940eee50 secure :-1 s=READY pgs=118 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f349000c6c0 tx=0x7f349000cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:17:11.608 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.600+0000 7f34827fc6c0 1 -- 10.20.193.11:0/4041610032 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3490003a30 con 0x7f3494110850 2026-02-13T02:17:11.608 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.600+0000 7f349a0376c0 1 -- 10.20.193.11:0/4041610032 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34940f0090 con 0x7f3494110850 2026-02-13T02:17:11.608 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.600+0000 7f349a0376c0 1 -- 10.20.193.11:0/4041610032 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34940f05f0 con 0x7f3494110850 2026-02-13T02:17:11.608 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.600+0000 7f34827fc6c0 1 -- 10.20.193.11:0/4041610032 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3490003b90 con 0x7f3494110850 2026-02-13T02:17:11.608 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.600+0000 7f34827fc6c0 1 -- 10.20.193.11:0/4041610032 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3490010590 con 0x7f3494110850 2026-02-13T02:17:11.608 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.601+0000 7ff88902f6c0 1 -- 10.20.193.11:0/1419240367 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7ff85803f8f0 msgr2=0x7ff85805fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:11.609 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.601+0000 7ff88902f6c0 1 --2- 10.20.193.11:0/1419240367 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7ff85803f8f0 0x7ff85805fda0 secure :-1 s=READY pgs=57 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff878004750 tx=0x7ff878005ac0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.609 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.601+0000 7ff88902f6c0 1 -- 10.20.193.11:0/1419240367 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7ff88410bb30 msgr2=0x7ff8840f44d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:11.609 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.601+0000 7ff88902f6c0 1 --2- 10.20.193.11:0/1419240367 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7ff88410bb30 0x7ff8840f44d0 secure :-1 s=READY pgs=108 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff86c005dc0 tx=0x7ff86c00bbd0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.609 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.601+0000 7f349a0376c0 1 -- 10.20.193.11:0/4041610032 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34941752e0 con 0x7f3494110850 2026-02-13T02:17:11.609 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.601+0000 7ff88902f6c0 1 -- 10.20.193.11:0/1419240367 shutdown_connections 2026-02-13T02:17:11.609 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.601+0000 7ff88902f6c0 1 --2- 10.20.193.11:0/1419240367 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7ff85803f8f0 0x7ff85805fda0 unknown :-1 s=CLOSED pgs=57 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.610 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.601+0000 7ff88902f6c0 1 --2- 10.20.193.11:0/1419240367 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff88410c4e0 0x7ff8840f50c0 unknown :-1 s=CLOSED pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.610 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.601+0000 7ff88902f6c0 1 --2- 10.20.193.11:0/1419240367 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7ff88410bb30 0x7ff8840f44d0 unknown :-1 s=CLOSED pgs=108 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.610 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.601+0000 7ff88902f6c0 1 --2- 10.20.193.11:0/1419240367 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7ff88410ab90 0x7ff8840f3e80 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.610 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.601+0000 7ff88902f6c0 1 -- 10.20.193.11:0/1419240367 >> 10.20.193.11:0/1419240367 conn(0x7ff8840e8510 msgr2=0x7ff8840ea1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:17:11.610 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.601+0000 7ff88902f6c0 1 -- 10.20.193.11:0/1419240367 shutdown_connections 2026-02-13T02:17:11.610 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.601+0000 7f34827fc6c0 1 -- 10.20.193.11:0/4041610032 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (secure 0 0 0) 0x7f3490003d00 con 0x7f3494110850 2026-02-13T02:17:11.610 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.601+0000 7ff88902f6c0 1 -- 10.20.193.11:0/1419240367 wait complete. 2026-02-13T02:17:11.611 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.602+0000 7f34827fc6c0 1 --2- 10.20.193.11:0/4041610032 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f347003f8f0 0x7f347005fda0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:11.611 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.602+0000 7f34827fc6c0 1 -- 10.20.193.11:0/4041610032 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 935+0+0 (secure 0 0 0) 0x7f3490052160 con 0x7f3494110850 2026-02-13T02:17:11.611 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.602+0000 7f34990356c0 1 --2- 10.20.193.11:0/4041610032 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f347003f8f0 0x7f347005fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:11.611 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.602+0000 7f34990356c0 1 --2- 10.20.193.11:0/4041610032 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f347003f8f0 0x7f347005fda0 secure :-1 s=READY pgs=62 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3484004750 tx=0x7f3484005ac0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:17:11.612 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.601+0000 7f381eae36c0 1 -- 10.20.193.11:0/1460314326 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f381810b320 msgr2=0x7f381810b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:11.612 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.601+0000 7f381eae36c0 1 --2- 10.20.193.11:0/1460314326 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f381810b320 0x7f381810b7c0 secure :-1 s=READY pgs=119 gs=1 cs=0 l=1 c_cookie=12119941684953168787 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3814006fd0 tx=0x7f381402fd20 comp rx=0 tx=0).stop 2026-02-13T02:17:11.612 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.601+0000 7f381eae36c0 1 -- 10.20.193.11:0/1460314326 shutdown_connections 2026-02-13T02:17:11.612 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.601+0000 7f381eae36c0 1 --2- 10.20.193.11:0/1460314326 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f381810db50 0x7f381810ad90 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.612 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.601+0000 7f381eae36c0 1 --2- 10.20.193.11:0/1460314326 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f381810b320 0x7f381810b7c0 unknown :-1 s=CLOSED pgs=119 gs=1 cs=0 l=1 c_cookie=12119941684953168787 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.612 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.601+0000 7f381eae36c0 1 --2- 10.20.193.11:0/1460314326 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f381810d220 0x7f381810d610 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.612 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.601+0000 7f381eae36c0 1 -- 10.20.193.11:0/1460314326 >> 10.20.193.11:0/1460314326 conn(0x7f38180e8970 msgr2=0x7f3818108da0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:17:11.612 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.601+0000 7f381eae36c0 1 -- 10.20.193.11:0/1460314326 shutdown_connections 2026-02-13T02:17:11.612 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.601+0000 7f381eae36c0 1 -- 10.20.193.11:0/1460314326 wait complete. 2026-02-13T02:17:11.612 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.602+0000 7f381eae36c0 1 Processor -- start 2026-02-13T02:17:11.612 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.602+0000 7f381eae36c0 1 -- start start 2026-02-13T02:17:11.612 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.602+0000 7f381eae36c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f381810b320 0x7f38180f4330 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:11.612 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.602+0000 7f381eae36c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f381810d220 0x7f38180f4980 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:11.613 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.602+0000 7f381eae36c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f381810db50 0x7f38180f5570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:11.613 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.602+0000 7f381eae36c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f38180f5d00 con 0x7f381810db50 2026-02-13T02:17:11.613 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.602+0000 7f381eae36c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f38180f5e70 con 0x7f381810b320 2026-02-13T02:17:11.613 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.602+0000 7f381eae36c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f38180f6030 con 0x7f381810d220 2026-02-13T02:17:11.613 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.602+0000 7f381d0556c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f381810db50 0x7f38180f5570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:11.613 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.602+0000 7f381d0556c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f381810db50 0x7f38180f5570 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:34432/0 (socket says 10.20.193.11:34432) 2026-02-13T02:17:11.613 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.602+0000 7f381d0556c0 1 -- 10.20.193.11:0/2201656460 learned_addr learned my addr 10.20.193.11:0/2201656460 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:17:11.613 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.602+0000 7f380ffff6c0 1 --2- 10.20.193.11:0/2201656460 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f381810d220 0x7f38180f4980 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:11.613 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.602+0000 7f381c8546c0 1 --2- 10.20.193.11:0/2201656460 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f381810b320 0x7f38180f4330 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:11.613 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.602+0000 7f381d0556c0 1 -- 10.20.193.11:0/2201656460 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f381810d220 msgr2=0x7f38180f4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:11.613 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.602+0000 7f381d0556c0 1 --2- 10.20.193.11:0/2201656460 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f381810d220 0x7f38180f4980 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.613 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.602+0000 7f381d0556c0 1 -- 10.20.193.11:0/2201656460 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f381810b320 msgr2=0x7f38180f4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:11.613 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.602+0000 7f381d0556c0 1 --2- 10.20.193.11:0/2201656460 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f381810b320 0x7f38180f4330 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.613 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.602+0000 7f381d0556c0 1 -- 10.20.193.11:0/2201656460 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f381400a5b0 con 0x7f381810db50 2026-02-13T02:17:11.613 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.602+0000 7f381c8546c0 1 --2- 10.20.193.11:0/2201656460 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f381810b320 0x7f38180f4330 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:17:11.613 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.602+0000 7f381d0556c0 1 --2- 10.20.193.11:0/2201656460 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f381810db50 0x7f38180f5570 secure :-1 s=READY pgs=120 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3814006fa0 tx=0x7f38140307b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:17:11.614 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.605+0000 7f380dffb6c0 1 -- 10.20.193.11:0/2201656460 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3814003c40 con 0x7f381810db50 2026-02-13T02:17:11.614 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.605+0000 7f34827fc6c0 1 -- 10.20.193.11:0/4041610032 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f349000dd70 con 0x7f3494110850 2026-02-13T02:17:11.614 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.605+0000 7f381eae36c0 1 -- 10.20.193.11:0/2201656460 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38180f62b0 con 0x7f381810db50 2026-02-13T02:17:11.614 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.605+0000 7f0a4febc6c0 1 -- 10.20.193.11:0/2265151936 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) -- 0x7f0a480ed780 con 0x7f0a4810c690 2026-02-13T02:17:11.615 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.606+0000 7f381eae36c0 1 -- 10.20.193.11:0/2201656460 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38180f6790 con 0x7f381810db50 2026-02-13T02:17:11.615 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.606+0000 7f380dffb6c0 1 -- 10.20.193.11:0/2201656460 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f38140308e0 con 0x7f381810db50 2026-02-13T02:17:11.615 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.606+0000 7f380dffb6c0 1 -- 10.20.193.11:0/2201656460 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f38140364f0 con 0x7f381810db50 2026-02-13T02:17:11.615 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.606+0000 7f381eae36c0 1 -- 10.20.193.11:0/2201656460 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3818175420 con 0x7f381810db50 2026-02-13T02:17:11.615 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.607+0000 7f380dffb6c0 1 -- 10.20.193.11:0/2201656460 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (secure 0 0 0) 0x7f3814008af0 con 0x7f381810db50 2026-02-13T02:17:11.615 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.607+0000 7f380dffb6c0 1 --2- 10.20.193.11:0/2201656460 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f37f403f940 0x7f37f405fdf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:11.615 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.607+0000 7f380dffb6c0 1 -- 10.20.193.11:0/2201656460 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 935+0+0 (secure 0 0 0) 0x7f3814076710 con 0x7f381810db50 2026-02-13T02:17:11.615 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.608+0000 7f381c8546c0 1 --2- 10.20.193.11:0/2201656460 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f37f403f940 0x7f37f405fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:11.615 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.608+0000 7f381c8546c0 1 --2- 10.20.193.11:0/2201656460 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f37f403f940 0x7f37f405fdf0 secure :-1 s=READY pgs=63 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3808004750 tx=0x7f3808005f10 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:17:11.616 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.609+0000 7f0a36ffd6c0 1 -- 10.20.193.11:0/2265151936 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v21)=0 v21) ==== 118+0+0 (secure 0 0 0) 0x7f0a4400b040 con 0x7f0a4810c690 2026-02-13T02:17:11.616 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.611+0000 7f380dffb6c0 1 -- 10.20.193.11:0/2201656460 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f381403a630 con 0x7f381810db50 2026-02-13T02:17:11.616 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.612+0000 7f0a4febc6c0 1 -- 10.20.193.11:0/2265151936 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f0a2403f8f0 msgr2=0x7f0a2405fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:11.616 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.612+0000 7f0a4febc6c0 1 --2- 10.20.193.11:0/2265151936 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f0a2403f8f0 0x7f0a2405fda0 secure :-1 s=READY pgs=58 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0a380023e0 tx=0x7f0a38005f40 comp rx=0 tx=0).stop 2026-02-13T02:17:11.616 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.612+0000 7f0a4febc6c0 1 -- 10.20.193.11:0/2265151936 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f0a4810c690 msgr2=0x7f0a480f5b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:11.617 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.612+0000 7f0a4febc6c0 1 --2- 10.20.193.11:0/2265151936 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f0a4810c690 0x7f0a480f5b70 secure :-1 s=READY pgs=110 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0a44006ea0 tx=0x7f0a440068a0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.617 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.612+0000 7f0a4febc6c0 1 -- 10.20.193.11:0/2265151936 shutdown_connections 2026-02-13T02:17:11.617 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.612+0000 7f0a4febc6c0 1 --2- 10.20.193.11:0/2265151936 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f0a2403f8f0 0x7f0a2405fda0 unknown :-1 s=CLOSED pgs=58 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.617 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.612+0000 7f0a4febc6c0 1 --2- 10.20.193.11:0/2265151936 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f0a4810bb30 0x7f0a480f4f80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.617 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.612+0000 7f0a4febc6c0 1 --2- 10.20.193.11:0/2265151936 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f0a4810c690 0x7f0a480f5b70 unknown :-1 s=CLOSED pgs=110 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.617 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.612+0000 7f0a4febc6c0 1 --2- 10.20.193.11:0/2265151936 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f0a480600a0 0x7f0a480f4930 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.617 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.612+0000 7f0a4febc6c0 1 -- 10.20.193.11:0/2265151936 >> 10.20.193.11:0/2265151936 conn(0x7f0a480e9230 msgr2=0x7f0a480eaee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:17:11.617 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.612+0000 7f0a4febc6c0 1 -- 10.20.193.11:0/2265151936 shutdown_connections 2026-02-13T02:17:11.617 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.612+0000 7f0a4febc6c0 1 -- 10.20.193.11:0/2265151936 wait complete. 2026-02-13T02:17:11.620 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.617+0000 7f277ef8d6c0 1 -- 10.20.193.11:0/4032631146 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f2778110050 msgr2=0x7f27781104c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:11.620 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.617+0000 7f277ef8d6c0 1 --2- 10.20.193.11:0/4032631146 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f2778110050 0x7f27781104c0 secure :-1 s=READY pgs=121 gs=3 cs=0 l=1 c_cookie=189937580262632917 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f27600098a0 tx=0x7f276002ec50 comp rx=0 tx=0).stop 2026-02-13T02:17:11.621 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.618+0000 7f277ef8d6c0 1 -- 10.20.193.11:0/4032631146 shutdown_connections 2026-02-13T02:17:11.621 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.618+0000 7f277ef8d6c0 1 --2- 10.20.193.11:0/4032631146 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f2778110a00 0x7f2778171390 unknown :-1 s=CLOSED pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.621 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.618+0000 7f277ef8d6c0 1 --2- 10.20.193.11:0/4032631146 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f2778110050 0x7f27781104c0 unknown :-1 s=CLOSED pgs=121 gs=3 cs=0 l=1 c_cookie=189937580262632917 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.621 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.618+0000 7f277ef8d6c0 1 --2- 10.20.193.11:0/4032631146 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f277810eed0 0x7f277810f2c0 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.621 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.618+0000 7f277ef8d6c0 1 -- 10.20.193.11:0/4032631146 >> 10.20.193.11:0/4032631146 conn(0x7f27780ec5f0 msgr2=0x7f277810ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:17:11.621 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.618+0000 7f277ef8d6c0 1 -- 10.20.193.11:0/4032631146 shutdown_connections 2026-02-13T02:17:11.621 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.618+0000 7f277ef8d6c0 1 -- 10.20.193.11:0/4032631146 wait complete. 2026-02-13T02:17:11.622 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.619+0000 7f277ef8d6c0 1 Processor -- start 2026-02-13T02:17:11.622 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.619+0000 7f277ef8d6c0 1 -- start start 2026-02-13T02:17:11.622 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.619+0000 7f277ef8d6c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f277810eed0 0x7f27780f8f30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:11.623 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.620+0000 7f277ef8d6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f2778110050 0x7f2778171390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:11.623 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.620+0000 7f277ef8d6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f2778110a00 0x7f27780f9790 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:11.623 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.620+0000 7f277ef8d6c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f27780fa3c0 con 0x7f2778110050 2026-02-13T02:17:11.623 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.620+0000 7f277ef8d6c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f27780fa530 con 0x7f277810eed0 2026-02-13T02:17:11.623 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.620+0000 7f277ef8d6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f27780fa6f0 con 0x7f2778110a00 2026-02-13T02:17:11.623 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.620+0000 7f276ffff6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f2778110050 0x7f2778171390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:11.623 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.620+0000 7f277ccfe6c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f277810eed0 0x7f27780f8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:11.623 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.620+0000 7f276ffff6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f2778110050 0x7f2778171390 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:34450/0 (socket says 10.20.193.11:34450) 2026-02-13T02:17:11.624 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.620+0000 7f276ffff6c0 1 -- 10.20.193.11:0/2266448957 learned_addr learned my addr 10.20.193.11:0/2266448957 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:17:11.624 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.620+0000 7f277d4ff6c0 1 --2- 10.20.193.11:0/2266448957 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f2778110a00 0x7f27780f9790 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:11.624 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.620+0000 7f276ffff6c0 1 -- 10.20.193.11:0/2266448957 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f2778110a00 msgr2=0x7f27780f9790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:11.624 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.620+0000 7f276ffff6c0 1 --2- 10.20.193.11:0/2266448957 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f2778110a00 0x7f27780f9790 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.624 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.620+0000 7f276ffff6c0 1 -- 10.20.193.11:0/2266448957 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f277810eed0 msgr2=0x7f27780f8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:11.624 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.620+0000 7f276ffff6c0 1 --2- 10.20.193.11:0/2266448957 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f277810eed0 0x7f27780f8f30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.624 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.620+0000 7f276ffff6c0 1 -- 10.20.193.11:0/2266448957 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27600094c0 con 0x7f2778110050 2026-02-13T02:17:11.624 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.620+0000 7f276ffff6c0 1 --2- 10.20.193.11:0/2266448957 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f2778110050 0x7f2778171390 secure :-1 s=READY pgs=122 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2760004510 tx=0x7f2760004540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:17:11.624 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.620+0000 7f276dffb6c0 1 -- 10.20.193.11:0/2266448957 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2760002c20 con 0x7f2778110050 2026-02-13T02:17:11.624 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.620+0000 7f277ef8d6c0 1 -- 10.20.193.11:0/2266448957 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27780fa970 con 0x7f2778110050 2026-02-13T02:17:11.624 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.620+0000 7f277ef8d6c0 1 -- 10.20.193.11:0/2266448957 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27780fae40 con 0x7f2778110050 2026-02-13T02:17:11.624 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.620+0000 7f276dffb6c0 1 -- 10.20.193.11:0/2266448957 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f27600076a0 con 0x7f2778110050 2026-02-13T02:17:11.624 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.620+0000 7f276dffb6c0 1 -- 10.20.193.11:0/2266448957 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2760002c20 con 0x7f2778110050 2026-02-13T02:17:11.625 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.621+0000 7f277ef8d6c0 1 -- 10.20.193.11:0/2266448957 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27781753e0 con 0x7f2778110050 2026-02-13T02:17:11.625 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.621+0000 7f276dffb6c0 1 -- 10.20.193.11:0/2266448957 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (secure 0 0 0) 0x7f2760031500 con 0x7f2778110050 2026-02-13T02:17:11.625 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.622+0000 7f276dffb6c0 1 --2- 10.20.193.11:0/2266448957 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f275403f950 0x7f275405fe00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:11.625 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.622+0000 7f276dffb6c0 1 -- 10.20.193.11:0/2266448957 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 935+0+0 (secure 0 0 0) 0x7f27600753e0 con 0x7f2778110050 2026-02-13T02:17:11.625 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.622+0000 7f277ccfe6c0 1 --2- 10.20.193.11:0/2266448957 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f275403f950 0x7f275405fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:11.625 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.622+0000 7f277ccfe6c0 1 --2- 10.20.193.11:0/2266448957 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f275403f950 0x7f275405fe00 secure :-1 s=READY pgs=64 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2768004750 tx=0x7f2768005ac0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:17:11.627 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.624+0000 7f276dffb6c0 1 -- 10.20.193.11:0/2266448957 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f2760036070 con 0x7f2778110050 2026-02-13T02:17:11.628 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.625+0000 7f32582ac6c0 1 -- 10.20.193.11:0/1971096776 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f32501146f0 msgr2=0x7f3250114b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:11.628 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.625+0000 7f32582ac6c0 1 --2- 10.20.193.11:0/1971096776 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f32501146f0 0x7f3250114b60 secure :-1 s=READY pgs=123 gs=1 cs=0 l=1 c_cookie=2846719511772166898 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3244009970 tx=0x7f324402eda0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.628 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.625+0000 7f32582ac6c0 1 -- 10.20.193.11:0/1971096776 shutdown_connections 2026-02-13T02:17:11.628 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.625+0000 7f32582ac6c0 1 --2- 10.20.193.11:0/1971096776 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f3250115120 0x7f32501155c0 unknown :-1 s=CLOSED pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.628 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.625+0000 7f32582ac6c0 1 --2- 10.20.193.11:0/1971096776 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f32501146f0 0x7f3250114b60 unknown :-1 s=CLOSED pgs=123 gs=1 cs=0 l=1 c_cookie=2846719511772166898 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.628 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.625+0000 7f32582ac6c0 1 --2- 10.20.193.11:0/1971096776 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f3250113dc0 0x7f32501141b0 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.628 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.625+0000 7f32582ac6c0 1 -- 10.20.193.11:0/1971096776 >> 10.20.193.11:0/1971096776 conn(0x7f325005bd20 msgr2=0x7f325005c140 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:17:11.628 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.625+0000 7f32582ac6c0 1 -- 10.20.193.11:0/1971096776 shutdown_connections 2026-02-13T02:17:11.628 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.625+0000 7f32582ac6c0 1 -- 10.20.193.11:0/1971096776 wait complete. 2026-02-13T02:17:11.630 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.626+0000 7f32582ac6c0 1 Processor -- start 2026-02-13T02:17:11.630 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.626+0000 7f32582ac6c0 1 -- start start 2026-02-13T02:17:11.631 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.626+0000 7f32582ac6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f3250113dc0 0x7f32500fdc00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:11.631 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.626+0000 7f32582ac6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f32501146f0 0x7f32500fe250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:11.631 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.626+0000 7f32582ac6c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f3250115120 0x7f32500fedf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:11.631 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.626+0000 7f32582ac6c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f32500ff580 con 0x7f32501146f0 2026-02-13T02:17:11.631 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.626+0000 7f32582ac6c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f32500ff6f0 con 0x7f3250115120 2026-02-13T02:17:11.631 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.626+0000 7f32582ac6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f32500ff8b0 con 0x7f3250113dc0 2026-02-13T02:17:11.631 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.626+0000 7f32558206c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f32501146f0 0x7f32500fe250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:11.631 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.626+0000 7f32568226c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f3250115120 0x7f32500fedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:11.631 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.626+0000 7f32568226c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f3250115120 0x7f32500fedf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.60:3300/0 says I am v2:10.20.193.11:45620/0 (socket says 10.20.193.11:45620) 2026-02-13T02:17:11.631 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.626+0000 7f32568226c0 1 -- 10.20.193.11:0/2615278576 learned_addr learned my addr 10.20.193.11:0/2615278576 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:17:11.631 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.626+0000 7f32560216c0 1 --2- 10.20.193.11:0/2615278576 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f3250113dc0 0x7f32500fdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:11.631 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.626+0000 7f32568226c0 1 -- 10.20.193.11:0/2615278576 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f3250115120 msgr2=0x7f32500fedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 9 2026-02-13T02:17:11.631 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.626+0000 7f32568226c0 1 -- 10.20.193.11:0/2615278576 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f3250115120 msgr2=0x7f32500fedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T02:17:11.631 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.626+0000 7f32568226c0 1 --2- 10.20.193.11:0/2615278576 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f3250115120 0x7f32500fedf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-13T02:17:11.632 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.626+0000 7f32568226c0 1 --2- 10.20.193.11:0/2615278576 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f3250115120 0x7f32500fedf0 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-13T02:17:11.632 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.626+0000 7f32560216c0 1 -- 10.20.193.11:0/2615278576 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f3250113dc0 msgr2=0x7f32500fdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 11 2026-02-13T02:17:11.632 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.626+0000 7f32560216c0 1 -- 10.20.193.11:0/2615278576 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f3250113dc0 msgr2=0x7f32500fdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T02:17:11.632 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.626+0000 7f32560216c0 1 --2- 10.20.193.11:0/2615278576 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f3250113dc0 0x7f32500fdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-13T02:17:11.632 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.626+0000 7f32560216c0 1 --2- 10.20.193.11:0/2615278576 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f3250113dc0 0x7f32500fdc00 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-13T02:17:11.632 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.626+0000 7f32558206c0 1 -- 10.20.193.11:0/2615278576 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f3250113dc0 msgr2=0x7f32500fdc00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T02:17:11.632 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.626+0000 7f32558206c0 1 --2- 10.20.193.11:0/2615278576 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f3250113dc0 0x7f32500fdc00 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.632 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.626+0000 7f32558206c0 1 -- 10.20.193.11:0/2615278576 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f3250115120 msgr2=0x7f32500fedf0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T02:17:11.632 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.626+0000 7f32558206c0 1 --2- 10.20.193.11:0/2615278576 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f3250115120 0x7f32500fedf0 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.632 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.626+0000 7f32558206c0 1 -- 10.20.193.11:0/2615278576 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3244009590 con 0x7f32501146f0 2026-02-13T02:17:11.632 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.626+0000 7f32558206c0 1 --2- 10.20.193.11:0/2615278576 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f32501146f0 0x7f32500fe250 secure :-1 s=READY pgs=124 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f32440091b0 tx=0x7f32440045b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:17:11.632 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.627+0000 7f32377fe6c0 1 -- 10.20.193.11:0/2615278576 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f32440028d0 con 0x7f32501146f0 2026-02-13T02:17:11.632 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.627+0000 7f32377fe6c0 1 -- 10.20.193.11:0/2615278576 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f324402fe30 con 0x7f32501146f0 2026-02-13T02:17:11.632 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.627+0000 7f32377fe6c0 1 -- 10.20.193.11:0/2615278576 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3244007350 con 0x7f32501146f0 2026-02-13T02:17:11.632 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.627+0000 7f32582ac6c0 1 -- 10.20.193.11:0/2615278576 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32500ffb30 con 0x7f32501146f0 2026-02-13T02:17:11.633 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.627+0000 7f32582ac6c0 1 -- 10.20.193.11:0/2615278576 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3250100010 con 0x7f32501146f0 2026-02-13T02:17:11.633 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.628+0000 7f32582ac6c0 1 -- 10.20.193.11:0/2615278576 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3250119980 con 0x7f32501146f0 2026-02-13T02:17:11.633 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.628+0000 7f32377fe6c0 1 -- 10.20.193.11:0/2615278576 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (secure 0 0 0) 0x7f32440312a0 con 0x7f32501146f0 2026-02-13T02:17:11.633 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.628+0000 7f32377fe6c0 1 --2- 10.20.193.11:0/2615278576 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f322c03f940 0x7f322c05fdf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:11.634 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.629+0000 7f32377fe6c0 1 -- 10.20.193.11:0/2615278576 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 935+0+0 (secure 0 0 0) 0x7f32440756f0 con 0x7f32501146f0 2026-02-13T02:17:11.634 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.629+0000 7f32560216c0 1 --2- 10.20.193.11:0/2615278576 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f322c03f940 0x7f322c05fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:11.634 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.629+0000 7f32560216c0 1 --2- 10.20.193.11:0/2615278576 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f322c03f940 0x7f322c05fdf0 secure :-1 s=READY pgs=65 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3240005980 tx=0x7f3240005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:17:11.635 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.632+0000 7f32377fe6c0 1 -- 10.20.193.11:0/2615278576 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f3244031030 con 0x7f32501146f0 2026-02-13T02:17:11.640 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.637+0000 7f08259a86c0 1 -- 10.20.193.11:0/2936288647 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f082010cc50 msgr2=0x7f082010d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:11.640 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.637+0000 7f08259a86c0 1 --2- 10.20.193.11:0/2936288647 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f082010cc50 0x7f082010d040 secure :-1 s=READY pgs=125 gs=1 cs=0 l=1 c_cookie=3536146941164230232 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0814009970 tx=0x7f081402ed20 comp rx=0 tx=0).stop 2026-02-13T02:17:11.640 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.637+0000 7f08259a86c0 1 -- 10.20.193.11:0/2936288647 shutdown_connections 2026-02-13T02:17:11.640 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.637+0000 7f08259a86c0 1 --2- 10.20.193.11:0/2936288647 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f082010e780 0x7f082016f110 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.640 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.637+0000 7f08259a86c0 1 --2- 10.20.193.11:0/2936288647 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f082010ddd0 0x7f082010e240 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.640 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.637+0000 7f08259a86c0 1 --2- 10.20.193.11:0/2936288647 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f082010cc50 0x7f082010d040 unknown :-1 s=CLOSED pgs=125 gs=1 cs=0 l=1 c_cookie=3536146941164230232 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.641 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.637+0000 7f08259a86c0 1 -- 10.20.193.11:0/2936288647 >> 10.20.193.11:0/2936288647 conn(0x7f08200ea370 msgr2=0x7f082010a780 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:17:11.641 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.637+0000 7f08259a86c0 1 -- 10.20.193.11:0/2936288647 shutdown_connections 2026-02-13T02:17:11.642 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.637+0000 7f08259a86c0 1 -- 10.20.193.11:0/2936288647 wait complete. 2026-02-13T02:17:11.642 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.638+0000 7f08259a86c0 1 Processor -- start 2026-02-13T02:17:11.642 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.638+0000 7f08259a86c0 1 -- start start 2026-02-13T02:17:11.642 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.639+0000 7f08259a86c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f082010cc50 0x7f082017d430 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:11.642 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.639+0000 7f08259a86c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f082010ddd0 0x7f082014f160 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:11.642 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.639+0000 7f08259a86c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f082010e780 0x7f082014f8b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:11.642 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.639+0000 7f08259a86c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f0820150040 con 0x7f082010ddd0 2026-02-13T02:17:11.643 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.639+0000 7f08259a86c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f08201501b0 con 0x7f082010cc50 2026-02-13T02:17:11.643 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.639+0000 7f08259a86c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f0820150370 con 0x7f082010e780 2026-02-13T02:17:11.643 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.639+0000 7f081e7fc6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f082010ddd0 0x7f082014f160 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:11.643 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.639+0000 7f081e7fc6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f082010ddd0 0x7f082014f160 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:34490/0 (socket says 10.20.193.11:34490) 2026-02-13T02:17:11.643 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.639+0000 7f081e7fc6c0 1 -- 10.20.193.11:0/233226243 learned_addr learned my addr 10.20.193.11:0/233226243 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:17:11.643 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.639+0000 7f081f7fe6c0 1 --2- 10.20.193.11:0/233226243 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f082010e780 0x7f082014f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:11.643 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.639+0000 7f081effd6c0 1 --2- 10.20.193.11:0/233226243 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f082010cc50 0x7f082017d430 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:11.643 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.639+0000 7f081effd6c0 1 -- 10.20.193.11:0/233226243 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f082010cc50 msgr2=0x7f082017d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 9 2026-02-13T02:17:11.643 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.639+0000 7f081effd6c0 1 -- 10.20.193.11:0/233226243 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f082010cc50 msgr2=0x7f082017d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T02:17:11.643 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.639+0000 7f081effd6c0 1 --2- 10.20.193.11:0/233226243 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f082010cc50 0x7f082017d430 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-13T02:17:11.643 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.639+0000 7f081effd6c0 1 --2- 10.20.193.11:0/233226243 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f082010cc50 0x7f082017d430 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-13T02:17:11.643 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.639+0000 7f081f7fe6c0 1 -- 10.20.193.11:0/233226243 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f082010e780 msgr2=0x7f082014f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 11 2026-02-13T02:17:11.644 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.639+0000 7f081e7fc6c0 1 -- 10.20.193.11:0/233226243 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f082010e780 msgr2=0x7f082014f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:11.644 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.639+0000 7f081f7fe6c0 1 -- 10.20.193.11:0/233226243 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f082010e780 msgr2=0x7f082014f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T02:17:11.644 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.639+0000 7f081f7fe6c0 1 --2- 10.20.193.11:0/233226243 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f082010e780 0x7f082014f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-13T02:17:11.644 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.639+0000 7f081f7fe6c0 1 --2- 10.20.193.11:0/233226243 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f082010e780 0x7f082014f8b0 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-13T02:17:11.644 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.639+0000 7f081e7fc6c0 1 --2- 10.20.193.11:0/233226243 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f082010e780 0x7f082014f8b0 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.644 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.639+0000 7f081e7fc6c0 1 -- 10.20.193.11:0/233226243 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f082010cc50 msgr2=0x7f082017d430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T02:17:11.644 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.639+0000 7f081e7fc6c0 1 --2- 10.20.193.11:0/233226243 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f082010cc50 0x7f082017d430 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.644 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.639+0000 7f081e7fc6c0 1 -- 10.20.193.11:0/233226243 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0814009590 con 0x7f082010ddd0 2026-02-13T02:17:11.644 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.639+0000 7f081e7fc6c0 1 --2- 10.20.193.11:0/233226243 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f082010ddd0 0x7f082014f160 secure :-1 s=READY pgs=126 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f080800b710 tx=0x7f080800bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:17:11.645 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.640+0000 7f08249a26c0 1 -- 10.20.193.11:0/233226243 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0808004250 con 0x7f082010ddd0 2026-02-13T02:17:11.645 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.640+0000 7f08249a26c0 1 -- 10.20.193.11:0/233226243 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0808002da0 con 0x7f082010ddd0 2026-02-13T02:17:11.646 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.640+0000 7f08249a26c0 1 -- 10.20.193.11:0/233226243 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f080800ce40 con 0x7f082010ddd0 2026-02-13T02:17:11.646 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.640+0000 7f08259a86c0 1 -- 10.20.193.11:0/233226243 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0820150650 con 0x7f082010ddd0 2026-02-13T02:17:11.646 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.640+0000 7f08259a86c0 1 -- 10.20.193.11:0/233226243 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0820150ae0 con 0x7f082010ddd0 2026-02-13T02:17:11.646 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.640+0000 7f08259a86c0 1 -- 10.20.193.11:0/233226243 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0820170f30 con 0x7f082010ddd0 2026-02-13T02:17:11.646 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.641+0000 7f08249a26c0 1 -- 10.20.193.11:0/233226243 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (secure 0 0 0) 0x7f080800c410 con 0x7f082010ddd0 2026-02-13T02:17:11.646 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.641+0000 7f08249a26c0 1 --2- 10.20.193.11:0/233226243 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f07f403f8f0 0x7f07f405fda0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:11.646 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.641+0000 7f08249a26c0 1 -- 10.20.193.11:0/233226243 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 935+0+0 (secure 0 0 0) 0x7f08080513d0 con 0x7f082010ddd0 2026-02-13T02:17:11.646 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.641+0000 7f081effd6c0 1 --2- 10.20.193.11:0/233226243 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f07f403f8f0 0x7f07f405fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:11.646 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.641+0000 7f081effd6c0 1 --2- 10.20.193.11:0/233226243 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f07f403f8f0 0x7f07f405fda0 secure :-1 s=READY pgs=66 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f08140023e0 tx=0x7f0814005c00 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:17:11.647 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.643+0000 7f08249a26c0 1 -- 10.20.193.11:0/233226243 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f0808011230 con 0x7f082010ddd0 2026-02-13T02:17:11.661 INFO:journalctl@ceph.mgr.z.trial078.stdout:Feb 13 02:17:11 trial078 podman[16353]: 2026-02-13 02:17:11.307009898 +0000 UTC m=+0.015797382 container create bd26c0e9fb00f317bd4c38a83f8c03c67b1c7773b92bc4021bc52e56466f714c (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-z, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, summary=Rocky Linux Base image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, name=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.licenses=BSD-3-Clause, license=BSD-3-Clause, org.opencontainers.image.title=rockylinux, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, version=10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.authors=Ceph Release Team , ceph=True, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, io.buildah.version=1.33.7, org.opencontainers.image.version=10, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-13T02:17:11.661 INFO:journalctl@ceph.mgr.z.trial078.stdout:Feb 13 02:17:11 trial078 podman[16353]: 2026-02-13 02:17:11.336345687 +0000 UTC m=+0.045133181 container init bd26c0e9fb00f317bd4c38a83f8c03c67b1c7773b92bc4021bc52e56466f714c (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-z, OSD_FLAVOR=default, name=rockylinux, summary=Rocky Linux Base image, ceph=True, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.authors=Ceph Release Team , license=BSD-3-Clause, org.opencontainers.image.title=rockylinux, version=10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.version=10, org.opencontainers.image.documentation=https://docs.ceph.com/, vendor=Rocky Enterprise Software Foundation, io.buildah.version=1.33.7, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-13T02:17:11.662 INFO:journalctl@ceph.mgr.z.trial078.stdout:Feb 13 02:17:11 trial078 podman[16353]: 2026-02-13 02:17:11.337911598 +0000 UTC m=+0.046699092 container start bd26c0e9fb00f317bd4c38a83f8c03c67b1c7773b92bc4021bc52e56466f714c (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-z, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, io.buildah.version=1.33.7, summary=Rocky Linux Base image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.version=10, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.authors=Ceph Release Team , ceph=True, version=10, org.opencontainers.image.documentation=https://docs.ceph.com/, license=BSD-3-Clause, OSD_FLAVOR=default, name=rockylinux, org.opencontainers.image.title=rockylinux, vendor=Rocky Enterprise Software Foundation) 2026-02-13T02:17:11.662 INFO:journalctl@ceph.mgr.z.trial078.stdout:Feb 13 02:17:11 trial078 bash[16353]: bd26c0e9fb00f317bd4c38a83f8c03c67b1c7773b92bc4021bc52e56466f714c 2026-02-13T02:17:11.662 INFO:journalctl@ceph.mgr.z.trial078.stdout:Feb 13 02:17:11 trial078 podman[16353]: 2026-02-13 02:17:11.29995145 +0000 UTC m=+0.008738944 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T02:17:11.662 INFO:journalctl@ceph.mgr.z.trial078.stdout:Feb 13 02:17:11 trial078 systemd[1]: Started ceph-fc631695-0881-11f1-899c-d404e6e7d460@mgr.z.service - Ceph mgr.z for fc631695-0881-11f1-899c-d404e6e7d460. 2026-02-13T02:17:11.662 INFO:journalctl@ceph.mgr.z.trial078.stdout:Feb 13 02:17:11 trial078 ceph-mgr[16379]: -- 10.20.193.78:0/2951799365 <== mon.0 v2:10.20.193.11:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564c40dfba00 con 0x564c40eaf400 2026-02-13T02:17:11.662 INFO:journalctl@ceph.mgr.z.trial078.stdout:Feb 13 02:17:11 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-z[16372]: 2026-02-13T02:17:11.363+0000 7f0e76c7bfc0 -1 mgr[py] Loading module orchestrator in main interpreter 2026-02-13T02:17:11.662 INFO:journalctl@ceph.mgr.z.trial078.stdout:Feb 13 02:17:11 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-z[16372]: 2026-02-13T02:17:11.455+0000 7f0e76c7bfc0 -1 mgr[py] Loading module dashboard in main interpreter 2026-02-13T02:17:11.662 INFO:journalctl@ceph.mgr.z.trial078.stdout:Feb 13 02:17:11 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-z[16372]: 2026-02-13T02:17:11.658+0000 7f0e76c7bfc0 -1 mgr[py] Loading module alerts in main interpreter 2026-02-13T02:17:11.670 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'fc631695-0881-11f1-899c-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='trial011') 2026-02-13T02:17:11.678 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'fc631695-0881-11f1-899c-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='trial011') 2026-02-13T02:17:11.694 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.691+0000 7f898df256c0 1 -- 10.20.193.11:0/3215374523 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7f89880f1db0 con 0x7f8988110050 2026-02-13T02:17:11.696 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.694+0000 7f8984ff96c0 1 -- 10.20.193.11:0/3215374523 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v22)=0 v22) ==== 122+0+0 (secure 0 0 0) 0x7f8978022030 con 0x7f8988110050 2026-02-13T02:17:11.698 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.695+0000 7f7bd20586c0 1 -- 10.20.193.11:0/3568543670 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f7bcc110a00 msgr2=0x7f7bcc171390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:11.698 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.695+0000 7f7bd20586c0 1 --2- 10.20.193.11:0/3568543670 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f7bcc110a00 0x7f7bcc171390 secure :-1 s=READY pgs=127 gs=1 cs=0 l=1 c_cookie=1557255931319992388 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7bc000aa40 tx=0x7f7bc002fde0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.698 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.695+0000 7f7bd20586c0 1 -- 10.20.193.11:0/3568543670 shutdown_connections 2026-02-13T02:17:11.698 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.695+0000 7f7bd20586c0 1 --2- 10.20.193.11:0/3568543670 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f7bcc110050 0x7f7bcc1104c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.698 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.695+0000 7f7bd20586c0 1 --2- 10.20.193.11:0/3568543670 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f7bcc110a00 0x7f7bcc171390 unknown :-1 s=CLOSED pgs=127 gs=1 cs=0 l=1 c_cookie=1557255931319992388 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.698 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.695+0000 7f7bd20586c0 1 --2- 10.20.193.11:0/3568543670 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f7bcc10eed0 0x7f7bcc10f2c0 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.698 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.695+0000 7f7bd20586c0 1 -- 10.20.193.11:0/3568543670 >> 10.20.193.11:0/3568543670 conn(0x7f7bcc0ec5f0 msgr2=0x7f7bcc10ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:17:11.698 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.695+0000 7f7bd20586c0 1 -- 10.20.193.11:0/3568543670 shutdown_connections 2026-02-13T02:17:11.698 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.695+0000 7f7bd20586c0 1 -- 10.20.193.11:0/3568543670 wait complete. 2026-02-13T02:17:11.699 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.695+0000 7f7bd20586c0 1 Processor -- start 2026-02-13T02:17:11.700 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.695+0000 7f63d48186c0 1 -- 10.20.193.11:0/1175143972 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f63cc113560 msgr2=0x7f63cc1139d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:11.700 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.695+0000 7f63d48186c0 1 --2- 10.20.193.11:0/1175143972 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f63cc113560 0x7f63cc1139d0 secure :-1 s=READY pgs=128 gs=1 cs=0 l=1 c_cookie=3493951035475714870 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f63b80098a0 tx=0x7f63b802ec40 comp rx=0 tx=0).stop 2026-02-13T02:17:11.700 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.695+0000 7f63d48186c0 1 -- 10.20.193.11:0/1175143972 shutdown_connections 2026-02-13T02:17:11.700 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.695+0000 7f63d48186c0 1 --2- 10.20.193.11:0/1175143972 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f63cc113f10 0x7f63cc175870 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.700 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.695+0000 7f63d48186c0 1 --2- 10.20.193.11:0/1175143972 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f63cc113560 0x7f63cc1139d0 unknown :-1 s=CLOSED pgs=128 gs=1 cs=0 l=1 c_cookie=3493951035475714870 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.700 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.695+0000 7f63d48186c0 1 --2- 10.20.193.11:0/1175143972 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f63cc1147f0 0x7f63cc114be0 unknown :-1 s=CLOSED pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.700 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.695+0000 7f63d48186c0 1 -- 10.20.193.11:0/1175143972 >> 10.20.193.11:0/1175143972 conn(0x7f63cc064300 msgr2=0x7f63cc064700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:17:11.700 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.695+0000 7f63d48186c0 1 -- 10.20.193.11:0/1175143972 shutdown_connections 2026-02-13T02:17:11.700 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.695+0000 7f63d48186c0 1 -- 10.20.193.11:0/1175143972 wait complete. 2026-02-13T02:17:11.701 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.695+0000 7f7bd20586c0 1 -- start start 2026-02-13T02:17:11.702 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.695+0000 7f7bd20586c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f7bcc10eed0 0x7f7bcc0f8ec0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:11.702 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.695+0000 7f7bd20586c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f7bcc110050 0x7f7bcc171370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:11.702 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.695+0000 7f7bd20586c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f7bcc110a00 0x7f7bcc0f9700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:11.702 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.695+0000 7f7bd20586c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f7bcc0fa350 con 0x7f7bcc110a00 2026-02-13T02:17:11.702 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.695+0000 7f7bd20586c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f7bcc0fa4c0 con 0x7f7bcc10eed0 2026-02-13T02:17:11.702 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.695+0000 7f7bd20586c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f7bcc0fa680 con 0x7f7bcc110050 2026-02-13T02:17:11.702 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.696+0000 7f7bcb7fe6c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f7bcc10eed0 0x7f7bcc0f8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:11.702 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.696+0000 7f7bcaffd6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f7bcc110050 0x7f7bcc171370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:11.702 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.696+0000 7f7bcb7fe6c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f7bcc10eed0 0x7f7bcc0f8ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.60:3300/0 says I am v2:10.20.193.11:45670/0 (socket says 10.20.193.11:45670) 2026-02-13T02:17:11.702 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.696+0000 7f7bcb7fe6c0 1 -- 10.20.193.11:0/3253384130 learned_addr learned my addr 10.20.193.11:0/3253384130 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:17:11.702 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.696+0000 7f7bcbfff6c0 1 --2- 10.20.193.11:0/3253384130 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f7bcc110a00 0x7f7bcc0f9700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:11.703 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.696+0000 7f7bcb7fe6c0 1 -- 10.20.193.11:0/3253384130 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f7bcc10eed0 msgr2=0x7f7bcc0f8ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 9 2026-02-13T02:17:11.703 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.696+0000 7f7bcb7fe6c0 1 -- 10.20.193.11:0/3253384130 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f7bcc10eed0 msgr2=0x7f7bcc0f8ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T02:17:11.703 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.696+0000 7f7bcb7fe6c0 1 --2- 10.20.193.11:0/3253384130 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f7bcc10eed0 0x7f7bcc0f8ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-13T02:17:11.703 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.696+0000 7f7bcb7fe6c0 1 --2- 10.20.193.11:0/3253384130 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f7bcc10eed0 0x7f7bcc0f8ec0 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-13T02:17:11.703 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.696+0000 7f7bcaffd6c0 1 -- 10.20.193.11:0/3253384130 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f7bcc110050 msgr2=0x7f7bcc171370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 10 2026-02-13T02:17:11.703 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.696+0000 7f7bcaffd6c0 1 -- 10.20.193.11:0/3253384130 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f7bcc110050 msgr2=0x7f7bcc171370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T02:17:11.703 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.696+0000 7f7bcaffd6c0 1 --2- 10.20.193.11:0/3253384130 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f7bcc110050 0x7f7bcc171370 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-13T02:17:11.703 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.696+0000 7f63d48186c0 1 Processor -- start 2026-02-13T02:17:11.704 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.696+0000 7f7bcaffd6c0 1 --2- 10.20.193.11:0/3253384130 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f7bcc110050 0x7f7bcc171370 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-13T02:17:11.704 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.696+0000 7f63d48186c0 1 -- start start 2026-02-13T02:17:11.704 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.696+0000 7f63d48186c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f63cc113560 0x7f63cc0fe920 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:11.704 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.696+0000 7f63d48186c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f63cc113f10 0x7f63cc175870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:11.705 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.696+0000 7f63d48186c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f63cc1147f0 0x7f63cc0ff180 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:11.705 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.696+0000 7f63d48186c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f63cc0ffdb0 con 0x7f63cc113f10 2026-02-13T02:17:11.705 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.696+0000 7f63d48186c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f63cc0fff20 con 0x7f63cc1147f0 2026-02-13T02:17:11.705 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.696+0000 7f63d48186c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f63cc1000e0 con 0x7f63cc113560 2026-02-13T02:17:11.705 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.696+0000 7f7bcbfff6c0 1 -- 10.20.193.11:0/3253384130 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f7bcc110050 msgr2=0x7f7bcc171370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T02:17:11.705 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.696+0000 7f7bcbfff6c0 1 --2- 10.20.193.11:0/3253384130 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f7bcc110050 0x7f7bcc171370 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.705 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.696+0000 7f7bcbfff6c0 1 -- 10.20.193.11:0/3253384130 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f7bcc10eed0 msgr2=0x7f7bcc0f8ec0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T02:17:11.705 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.696+0000 7f7bcbfff6c0 1 --2- 10.20.193.11:0/3253384130 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f7bcc10eed0 0x7f7bcc0f8ec0 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.706 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.696+0000 7f7bcbfff6c0 1 -- 10.20.193.11:0/3253384130 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bc000a660 con 0x7f7bcc110a00 2026-02-13T02:17:11.706 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.696+0000 7f63d1d8c6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f63cc113f10 0x7f63cc175870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:11.706 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.696+0000 7f63d1d8c6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f63cc113f10 0x7f63cc175870 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:34538/0 (socket says 10.20.193.11:34538) 2026-02-13T02:17:11.706 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.696+0000 7f63d1d8c6c0 1 -- 10.20.193.11:0/2313699882 learned_addr learned my addr 10.20.193.11:0/2313699882 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:17:11.706 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.696+0000 7f63d2d8e6c0 1 --2- 10.20.193.11:0/2313699882 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f63cc1147f0 0x7f63cc0ff180 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:11.706 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.696+0000 7f63d258d6c0 1 --2- 10.20.193.11:0/2313699882 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f63cc113560 0x7f63cc0fe920 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:11.707 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.696+0000 7f7bcbfff6c0 1 --2- 10.20.193.11:0/3253384130 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f7bcc110a00 0x7f7bcc0f9700 secure :-1 s=READY pgs=129 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7bc00302f0 tx=0x7f7bc0030ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:17:11.707 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.696+0000 7f63d1d8c6c0 1 -- 10.20.193.11:0/2313699882 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f63cc113560 msgr2=0x7f63cc0fe920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:11.707 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.696+0000 7f63d1d8c6c0 1 --2- 10.20.193.11:0/2313699882 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f63cc113560 0x7f63cc0fe920 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.707 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.696+0000 7f63d1d8c6c0 1 -- 10.20.193.11:0/2313699882 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f63cc1147f0 msgr2=0x7f63cc0ff180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:11.708 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.696+0000 7f63d1d8c6c0 1 --2- 10.20.193.11:0/2313699882 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f63cc1147f0 0x7f63cc0ff180 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.708 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.696+0000 7f63d1d8c6c0 1 -- 10.20.193.11:0/2313699882 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63b80094c0 con 0x7f63cc113f10 2026-02-13T02:17:11.708 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.696+0000 7f7bc8ff96c0 1 -- 10.20.193.11:0/3253384130 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7bc0003a30 con 0x7f7bcc110a00 2026-02-13T02:17:11.708 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.696+0000 7f7bc8ff96c0 1 -- 10.20.193.11:0/3253384130 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f7bc0003b90 con 0x7f7bcc110a00 2026-02-13T02:17:11.708 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.696+0000 7f7bd20586c0 1 -- 10.20.193.11:0/3253384130 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bcc0fa8a0 con 0x7f7bcc110a00 2026-02-13T02:17:11.708 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.696+0000 7f7bc8ff96c0 1 -- 10.20.193.11:0/3253384130 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7bc0038410 con 0x7f7bcc110a00 2026-02-13T02:17:11.708 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.696+0000 7f7bd20586c0 1 -- 10.20.193.11:0/3253384130 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bcc0fad20 con 0x7f7bcc110a00 2026-02-13T02:17:11.709 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.696+0000 7f63d1d8c6c0 1 --2- 10.20.193.11:0/2313699882 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f63cc113f10 0x7f63cc175870 secure :-1 s=READY pgs=130 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f63b80023c0 tx=0x7f63b80028e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:17:11.709 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.697+0000 7f63b77fe6c0 1 -- 10.20.193.11:0/2313699882 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f63b8002e30 con 0x7f63cc113f10 2026-02-13T02:17:11.709 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.697+0000 7f63b77fe6c0 1 -- 10.20.193.11:0/2313699882 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f63b802f720 con 0x7f63cc113f10 2026-02-13T02:17:11.709 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.697+0000 7f63d48186c0 1 -- 10.20.193.11:0/2313699882 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63cc100360 con 0x7f63cc113f10 2026-02-13T02:17:11.709 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.697+0000 7f63b77fe6c0 1 -- 10.20.193.11:0/2313699882 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f63b8031330 con 0x7f63cc113f10 2026-02-13T02:17:11.710 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.697+0000 7f7bd20586c0 1 -- 10.20.193.11:0/3253384130 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bcc0faf40 con 0x7f7bcc110a00 2026-02-13T02:17:11.710 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.697+0000 7f7bc8ff96c0 1 -- 10.20.193.11:0/3253384130 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (secure 0 0 0) 0x7f7bc00385a0 con 0x7f7bcc110a00 2026-02-13T02:17:11.711 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.697+0000 7f63d48186c0 1 -- 10.20.193.11:0/2313699882 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63cc100830 con 0x7f63cc113f10 2026-02-13T02:17:11.711 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.697+0000 7f63b77fe6c0 1 -- 10.20.193.11:0/2313699882 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (secure 0 0 0) 0x7f63b8031500 con 0x7f63cc113f10 2026-02-13T02:17:11.711 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.698+0000 7f63d48186c0 1 -- 10.20.193.11:0/2313699882 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63cc179960 con 0x7f63cc113f10 2026-02-13T02:17:11.711 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.698+0000 7f7bc8ff96c0 1 --2- 10.20.193.11:0/3253384130 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f7ba403f8f0 0x7f7ba405fda0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:11.711 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.698+0000 7f7bc8ff96c0 1 -- 10.20.193.11:0/3253384130 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 935+0+0 (secure 0 0 0) 0x7f7bc0076750 con 0x7f7bcc110a00 2026-02-13T02:17:11.712 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.698+0000 7f7bcb7fe6c0 1 --2- 10.20.193.11:0/3253384130 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f7ba403f8f0 0x7f7ba405fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:11.712 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.698+0000 7f63b77fe6c0 1 --2- 10.20.193.11:0/2313699882 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f63a803f8f0 0x7f63a805fda0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:11.712 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.698+0000 7f63b77fe6c0 1 -- 10.20.193.11:0/2313699882 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 935+0+0 (secure 0 0 0) 0x7f63b80759d0 con 0x7f63cc113f10 2026-02-13T02:17:11.712 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.698+0000 7f7bcb7fe6c0 1 --2- 10.20.193.11:0/3253384130 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f7ba403f8f0 0x7f7ba405fda0 secure :-1 s=READY pgs=67 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7bb8007240 tx=0x7f7bb8007620 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:17:11.713 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.698+0000 7f63d258d6c0 1 --2- 10.20.193.11:0/2313699882 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f63a803f8f0 0x7f63a805fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:11.713 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.698+0000 7f898df256c0 1 -- 10.20.193.11:0/3215374523 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f895c03f950 msgr2=0x7f895c05fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:11.713 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.698+0000 7f898df256c0 1 --2- 10.20.193.11:0/3215374523 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f895c03f950 0x7f895c05fe00 secure :-1 s=READY pgs=59 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8974007240 tx=0x7f8974007620 comp rx=0 tx=0).stop 2026-02-13T02:17:11.713 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.698+0000 7f898df256c0 1 -- 10.20.193.11:0/3215374523 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f8988110050 msgr2=0x7f8988171370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:11.713 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.698+0000 7f898df256c0 1 --2- 10.20.193.11:0/3215374523 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f8988110050 0x7f8988171370 secure :-1 s=READY pgs=112 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f897800b640 tx=0x7f897800bb10 comp rx=0 tx=0).stop 2026-02-13T02:17:11.714 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.698+0000 7f63d258d6c0 1 --2- 10.20.193.11:0/2313699882 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f63a803f8f0 0x7f63a805fda0 secure :-1 s=READY pgs=68 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f63c4005980 tx=0x7f63c4005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:17:11.714 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.698+0000 7f898df256c0 1 -- 10.20.193.11:0/3215374523 shutdown_connections 2026-02-13T02:17:11.715 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.698+0000 7f898df256c0 1 --2- 10.20.193.11:0/3215374523 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f895c03f950 0x7f895c05fe00 unknown :-1 s=CLOSED pgs=59 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.715 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.698+0000 7f898df256c0 1 --2- 10.20.193.11:0/3215374523 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f8988110a00 0x7f89880f9720 unknown :-1 s=CLOSED pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.715 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.698+0000 7f898df256c0 1 --2- 10.20.193.11:0/3215374523 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f8988110050 0x7f8988171370 unknown :-1 s=CLOSED pgs=112 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.715 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.698+0000 7f898df256c0 1 --2- 10.20.193.11:0/3215374523 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f898810eed0 0x7f89880f8ee0 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.715 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.698+0000 7f898df256c0 1 -- 10.20.193.11:0/3215374523 >> 10.20.193.11:0/3215374523 conn(0x7f89880ec5f0 msgr2=0x7f89880ef4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:17:11.715 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.698+0000 7f898df256c0 1 -- 10.20.193.11:0/3215374523 shutdown_connections 2026-02-13T02:17:11.715 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.699+0000 7f898df256c0 1 -- 10.20.193.11:0/3215374523 wait complete. 2026-02-13T02:17:11.715 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.700+0000 7f7bc8ff96c0 1 -- 10.20.193.11:0/3253384130 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f7bc0038880 con 0x7f7bcc110a00 2026-02-13T02:17:11.716 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.701+0000 7f63b77fe6c0 1 -- 10.20.193.11:0/2313699882 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f63b80317e0 con 0x7f63cc113f10 2026-02-13T02:17:11.719 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.702+0000 7fd99d6686c0 1 -- 10.20.193.11:0/3351150854 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fd998062160 msgr2=0x7fd9980607e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:11.719 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.702+0000 7fd99d6686c0 1 --2- 10.20.193.11:0/3351150854 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fd998062160 0x7fd9980607e0 secure :-1 s=READY pgs=131 gs=1 cs=0 l=1 c_cookie=10267428581380185317 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd98c009970 tx=0x7fd98c02ed20 comp rx=0 tx=0).stop 2026-02-13T02:17:11.719 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.702+0000 7fd99d6686c0 1 -- 10.20.193.11:0/3351150854 shutdown_connections 2026-02-13T02:17:11.719 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.702+0000 7fd99d6686c0 1 --2- 10.20.193.11:0/3351150854 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fd998060d20 0x7fd998061190 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.719 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.702+0000 7fd99d6686c0 1 --2- 10.20.193.11:0/3351150854 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd998150d00 0x7fd9981710e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.719 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.702+0000 7fd99d6686c0 1 --2- 10.20.193.11:0/3351150854 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fd998062160 0x7fd9980607e0 unknown :-1 s=CLOSED pgs=131 gs=1 cs=0 l=1 c_cookie=10267428581380185317 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.719 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.702+0000 7fd99d6686c0 1 -- 10.20.193.11:0/3351150854 >> 10.20.193.11:0/3351150854 conn(0x7fd9980ea370 msgr2=0x7fd99810a780 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:17:11.719 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.702+0000 7fd99d6686c0 1 -- 10.20.193.11:0/3351150854 shutdown_connections 2026-02-13T02:17:11.720 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.702+0000 7fd99d6686c0 1 -- 10.20.193.11:0/3351150854 wait complete. 2026-02-13T02:17:11.720 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.703+0000 7fd99d6686c0 1 Processor -- start 2026-02-13T02:17:11.720 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.703+0000 7fd99d6686c0 1 -- start start 2026-02-13T02:17:11.720 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.703+0000 7fd99d6686c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fd998060d20 0x7fd99815c550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:11.720 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.703+0000 7fd99d6686c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd998062160 0x7fd99815cba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:11.720 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.703+0000 7fd99d6686c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fd998150d00 0x7fd99815d790 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:11.720 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.703+0000 7fd99d6686c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7fd99815df20 con 0x7fd998060d20 2026-02-13T02:17:11.720 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.703+0000 7fd99d6686c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd99815e090 con 0x7fd998150d00 2026-02-13T02:17:11.720 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.703+0000 7fd99d6686c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fd99815e250 con 0x7fd998062160 2026-02-13T02:17:11.720 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.703+0000 7fd996ffd6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fd998060d20 0x7fd99815c550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:11.720 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.703+0000 7fd9967fc6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd998062160 0x7fd99815cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:11.720 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.703+0000 7fd9967fc6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd998062160 0x7fd99815cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.78:3300/0 says I am v2:10.20.193.11:48778/0 (socket says 10.20.193.11:48778) 2026-02-13T02:17:11.720 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.703+0000 7fd9967fc6c0 1 -- 10.20.193.11:0/916440633 learned_addr learned my addr 10.20.193.11:0/916440633 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:17:11.721 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.703+0000 7fd9967fc6c0 1 -- 10.20.193.11:0/916440633 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd998062160 msgr2=0x7fd99815cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 10 2026-02-13T02:17:11.721 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.703+0000 7fd9967fc6c0 1 -- 10.20.193.11:0/916440633 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd998062160 msgr2=0x7fd99815cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T02:17:11.721 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.703+0000 7fd9967fc6c0 1 --2- 10.20.193.11:0/916440633 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd998062160 0x7fd99815cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-13T02:17:11.721 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.703+0000 7fd9967fc6c0 1 --2- 10.20.193.11:0/916440633 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd998062160 0x7fd99815cba0 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-13T02:17:11.721 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.703+0000 7fd9977fe6c0 1 --2- 10.20.193.11:0/916440633 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fd998150d00 0x7fd99815d790 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:11.721 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.704+0000 7fd9977fe6c0 1 -- 10.20.193.11:0/916440633 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fd998150d00 msgr2=0x7fd99815d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 11 2026-02-13T02:17:11.721 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.704+0000 7fd9977fe6c0 1 -- 10.20.193.11:0/916440633 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fd998150d00 msgr2=0x7fd99815d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T02:17:11.721 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.704+0000 7fd9977fe6c0 1 --2- 10.20.193.11:0/916440633 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fd998150d00 0x7fd99815d790 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-13T02:17:11.721 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.704+0000 7fd9977fe6c0 1 --2- 10.20.193.11:0/916440633 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fd998150d00 0x7fd99815d790 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-13T02:17:11.721 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.704+0000 7fd996ffd6c0 1 -- 10.20.193.11:0/916440633 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd998062160 msgr2=0x7fd99815cba0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T02:17:11.721 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.704+0000 7fd996ffd6c0 1 --2- 10.20.193.11:0/916440633 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd998062160 0x7fd99815cba0 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.721 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.704+0000 7fd996ffd6c0 1 -- 10.20.193.11:0/916440633 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fd998150d00 msgr2=0x7fd99815d790 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T02:17:11.721 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.704+0000 7fd996ffd6c0 1 --2- 10.20.193.11:0/916440633 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fd998150d00 0x7fd99815d790 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.721 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.704+0000 7fd996ffd6c0 1 -- 10.20.193.11:0/916440633 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd98c009590 con 0x7fd998060d20 2026-02-13T02:17:11.721 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.704+0000 7fd996ffd6c0 1 --2- 10.20.193.11:0/916440633 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fd998060d20 0x7fd99815c550 secure :-1 s=READY pgs=132 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd98c006010 tx=0x7fd98c0045f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:17:11.722 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.704+0000 7fd977fff6c0 1 -- 10.20.193.11:0/916440633 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd98c002ba0 con 0x7fd998060d20 2026-02-13T02:17:11.722 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.704+0000 7fd977fff6c0 1 -- 10.20.193.11:0/916440633 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd98c002d00 con 0x7fd998060d20 2026-02-13T02:17:11.722 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.704+0000 7fd99d6686c0 1 -- 10.20.193.11:0/916440633 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd99815e4d0 con 0x7fd998060d20 2026-02-13T02:17:11.722 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.704+0000 7fd977fff6c0 1 -- 10.20.193.11:0/916440633 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd98c031340 con 0x7fd998060d20 2026-02-13T02:17:11.722 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.704+0000 7fd99d6686c0 1 -- 10.20.193.11:0/916440633 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd99815ea00 con 0x7fd998060d20 2026-02-13T02:17:11.722 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.705+0000 7fd99d6686c0 1 -- 10.20.193.11:0/916440633 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9981753f0 con 0x7fd998060d20 2026-02-13T02:17:11.722 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.705+0000 7fd977fff6c0 1 -- 10.20.193.11:0/916440633 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (secure 0 0 0) 0x7fd98c0314a0 con 0x7fd998060d20 2026-02-13T02:17:11.722 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.705+0000 7fd977fff6c0 1 --2- 10.20.193.11:0/916440633 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fd96c03f8f0 0x7fd96c05fda0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:11.722 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.705+0000 7fd977fff6c0 1 -- 10.20.193.11:0/916440633 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 935+0+0 (secure 0 0 0) 0x7fd98c075560 con 0x7fd998060d20 2026-02-13T02:17:11.722 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.706+0000 7fd9967fc6c0 1 --2- 10.20.193.11:0/916440633 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fd96c03f8f0 0x7fd96c05fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:11.722 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.706+0000 7fd9967fc6c0 1 --2- 10.20.193.11:0/916440633 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fd96c03f8f0 0x7fd96c05fda0 secure :-1 s=READY pgs=69 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd980009260 tx=0x7fd980009050 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:17:11.722 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.707+0000 7fd977fff6c0 1 -- 10.20.193.11:0/916440633 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fd98c007920 con 0x7fd998060d20 2026-02-13T02:17:11.723 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.713+0000 7f19157106c0 1 -- 10.20.193.11:0/2207396411 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f1910174ad0 con 0x7f191010eed0 2026-02-13T02:17:11.723 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.716+0000 7f18effff6c0 1 -- 10.20.193.11:0/2207396411 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v23)=0 v23) ==== 120+0+0 (secure 0 0 0) 0x7f190400e890 con 0x7f191010eed0 2026-02-13T02:17:11.723 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.717+0000 7f6cb2fec6c0 1 -- 10.20.193.11:0/1050377170 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7f6cac174d60 con 0x7f6cac10eed0 2026-02-13T02:17:11.723 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.719+0000 7f349a0376c0 1 -- 10.20.193.11:0/4041610032 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f3494174bb0 con 0x7f3494110850 2026-02-13T02:17:11.724 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.719+0000 7f19157106c0 1 -- 10.20.193.11:0/2207396411 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f18e403f8f0 msgr2=0x7f18e405fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:11.724 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.719+0000 7f19157106c0 1 --2- 10.20.193.11:0/2207396411 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f18e403f8f0 0x7f18e405fda0 secure :-1 s=READY pgs=60 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f18f8005980 tx=0x7f18f8005910 comp rx=0 tx=0).stop 2026-02-13T02:17:11.724 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.719+0000 7f19157106c0 1 -- 10.20.193.11:0/2207396411 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f191010eed0 msgr2=0x7f19100fc970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:11.724 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.719+0000 7f19157106c0 1 --2- 10.20.193.11:0/2207396411 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f191010eed0 0x7f19100fc970 secure :-1 s=READY pgs=115 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1904005dc0 tx=0x7f190400bbd0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.724 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.719+0000 7f19157106c0 1 -- 10.20.193.11:0/2207396411 shutdown_connections 2026-02-13T02:17:11.724 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.719+0000 7f19157106c0 1 --2- 10.20.193.11:0/2207396411 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f18e403f8f0 0x7f18e405fda0 unknown :-1 s=CLOSED pgs=60 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.724 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.719+0000 7f19157106c0 1 --2- 10.20.193.11:0/2207396411 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f1910110a00 0x7f19100fd1d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.724 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.719+0000 7f19157106c0 1 --2- 10.20.193.11:0/2207396411 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1910110050 0x7f1910171390 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.724 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.719+0000 7f19157106c0 1 --2- 10.20.193.11:0/2207396411 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f191010eed0 0x7f19100fc970 unknown :-1 s=CLOSED pgs=115 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.724 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.719+0000 7f19157106c0 1 -- 10.20.193.11:0/2207396411 >> 10.20.193.11:0/2207396411 conn(0x7f19100ec5f0 msgr2=0x7f1910062b10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:17:11.725 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.719+0000 7f19157106c0 1 -- 10.20.193.11:0/2207396411 shutdown_connections 2026-02-13T02:17:11.725 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.719+0000 7f19157106c0 1 -- 10.20.193.11:0/2207396411 wait complete. 2026-02-13T02:17:11.725 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.720+0000 7f6ca1ffb6c0 1 -- 10.20.193.11:0/1050377170 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v24)=0 v24) ==== 119+0+0 (secure 0 0 0) 0x7f6c9c0358d0 con 0x7f6cac10eed0 2026-02-13T02:17:11.725 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.722+0000 7f6cb2fec6c0 1 -- 10.20.193.11:0/1050377170 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f6c8803f8f0 msgr2=0x7f6c8805fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:11.726 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.722+0000 7f6cb2fec6c0 1 --2- 10.20.193.11:0/1050377170 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f6c8803f8f0 0x7f6c8805fda0 secure :-1 s=READY pgs=61 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c94005980 tx=0x7f6c94005910 comp rx=0 tx=0).stop 2026-02-13T02:17:11.726 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.722+0000 7f6cb2fec6c0 1 -- 10.20.193.11:0/1050377170 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f6cac10eed0 msgr2=0x7f6cac062c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:11.726 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.722+0000 7f6cb2fec6c0 1 --2- 10.20.193.11:0/1050377170 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f6cac10eed0 0x7f6cac062c60 secure :-1 s=READY pgs=116 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c9c009290 tx=0x7f6c9c004730 comp rx=0 tx=0).stop 2026-02-13T02:17:11.726 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.723+0000 7f6cb2fec6c0 1 -- 10.20.193.11:0/1050377170 shutdown_connections 2026-02-13T02:17:11.726 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.723+0000 7f6cb2fec6c0 1 --2- 10.20.193.11:0/1050377170 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f6c8803f8f0 0x7f6c8805fda0 unknown :-1 s=CLOSED pgs=61 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.726 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.723+0000 7f6cb2fec6c0 1 --2- 10.20.193.11:0/1050377170 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f6cac110050 0x7f6cac171390 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.726 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.723+0000 7f6cb2fec6c0 1 --2- 10.20.193.11:0/1050377170 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6cac110a00 0x7f6cac0634c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.726 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.723+0000 7f6cb2fec6c0 1 --2- 10.20.193.11:0/1050377170 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f6cac10eed0 0x7f6cac062c60 unknown :-1 s=CLOSED pgs=116 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.726 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.723+0000 7f6cb2fec6c0 1 -- 10.20.193.11:0/1050377170 >> 10.20.193.11:0/1050377170 conn(0x7f6cac0ec5f0 msgr2=0x7f6cac0ee660 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:17:11.726 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.723+0000 7f6cb2fec6c0 1 -- 10.20.193.11:0/1050377170 shutdown_connections 2026-02-13T02:17:11.726 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.723+0000 7f6cb2fec6c0 1 -- 10.20.193.11:0/1050377170 wait complete. 2026-02-13T02:17:11.728 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.725+0000 7f34827fc6c0 1 -- 10.20.193.11:0/4041610032 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v25)=0 v25) ==== 121+0+0 (secure 0 0 0) 0x7f349000db90 con 0x7f3494110850 2026-02-13T02:17:11.731 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.728+0000 7f349a0376c0 1 -- 10.20.193.11:0/4041610032 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f347003f8f0 msgr2=0x7f347005fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:11.731 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.728+0000 7f349a0376c0 1 --2- 10.20.193.11:0/4041610032 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f347003f8f0 0x7f347005fda0 secure :-1 s=READY pgs=62 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3484004750 tx=0x7f3484005ac0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.731 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.728+0000 7f349a0376c0 1 -- 10.20.193.11:0/4041610032 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f3494110850 msgr2=0x7f34940eee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:11.731 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.728+0000 7f349a0376c0 1 --2- 10.20.193.11:0/4041610032 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f3494110850 0x7f34940eee50 secure :-1 s=READY pgs=118 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f349000c6c0 tx=0x7f349000cb90 comp rx=0 tx=0).stop 2026-02-13T02:17:11.732 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.729+0000 7f349a0376c0 1 -- 10.20.193.11:0/4041610032 shutdown_connections 2026-02-13T02:17:11.732 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.729+0000 7f349a0376c0 1 --2- 10.20.193.11:0/4041610032 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f347003f8f0 0x7f347005fda0 unknown :-1 s=CLOSED pgs=62 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.732 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.729+0000 7f349a0376c0 1 --2- 10.20.193.11:0/4041610032 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f349410fea0 0x7f34941711e0 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.732 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.729+0000 7f349a0376c0 1 --2- 10.20.193.11:0/4041610032 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f3494110850 0x7f34940eee50 unknown :-1 s=CLOSED pgs=118 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.732 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.729+0000 7f349a0376c0 1 --2- 10.20.193.11:0/4041610032 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f349410ed20 0x7f34940ee5f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.732 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.729+0000 7f349a0376c0 1 -- 10.20.193.11:0/4041610032 >> 10.20.193.11:0/4041610032 conn(0x7f34940ec440 msgr2=0x7f3494063340 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:17:11.732 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.729+0000 7f349a0376c0 1 -- 10.20.193.11:0/4041610032 shutdown_connections 2026-02-13T02:17:11.732 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.729+0000 7f349a0376c0 1 -- 10.20.193.11:0/4041610032 wait complete. 2026-02-13T02:17:11.737 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.735+0000 7f381eae36c0 1 -- 10.20.193.11:0/2201656460 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f38180ecec0 con 0x7f381810db50 2026-02-13T02:17:11.741 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.738+0000 7f380dffb6c0 1 -- 10.20.193.11:0/2201656460 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v26)=0 v26) ==== 120+0+0 (secure 0 0 0) 0x7f381403a630 con 0x7f381810db50 2026-02-13T02:17:11.745 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.742+0000 7f381eae36c0 1 -- 10.20.193.11:0/2201656460 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f37f403f940 msgr2=0x7f37f405fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:11.745 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.742+0000 7f381eae36c0 1 --2- 10.20.193.11:0/2201656460 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f37f403f940 0x7f37f405fdf0 secure :-1 s=READY pgs=63 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3808004750 tx=0x7f3808005f10 comp rx=0 tx=0).stop 2026-02-13T02:17:11.745 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.742+0000 7f381eae36c0 1 -- 10.20.193.11:0/2201656460 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f381810db50 msgr2=0x7f38180f5570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:11.745 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.742+0000 7f381eae36c0 1 --2- 10.20.193.11:0/2201656460 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f381810db50 0x7f38180f5570 secure :-1 s=READY pgs=120 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3814006fa0 tx=0x7f38140307b0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.746 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.743+0000 7f381eae36c0 1 -- 10.20.193.11:0/2201656460 shutdown_connections 2026-02-13T02:17:11.746 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.743+0000 7f381eae36c0 1 --2- 10.20.193.11:0/2201656460 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f37f403f940 0x7f37f405fdf0 unknown :-1 s=CLOSED pgs=63 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.746 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.743+0000 7f381eae36c0 1 --2- 10.20.193.11:0/2201656460 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f381810db50 0x7f38180f5570 unknown :-1 s=CLOSED pgs=120 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.747 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.743+0000 7f381eae36c0 1 --2- 10.20.193.11:0/2201656460 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f381810d220 0x7f38180f4980 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.747 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.743+0000 7f381eae36c0 1 --2- 10.20.193.11:0/2201656460 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f381810b320 0x7f38180f4330 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.747 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.743+0000 7f381eae36c0 1 -- 10.20.193.11:0/2201656460 >> 10.20.193.11:0/2201656460 conn(0x7f38180e8970 msgr2=0x7f38180ea620 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:17:11.747 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.743+0000 7f381eae36c0 1 -- 10.20.193.11:0/2201656460 shutdown_connections 2026-02-13T02:17:11.747 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.743+0000 7f381eae36c0 1 -- 10.20.193.11:0/2201656460 wait complete. 2026-02-13T02:17:11.751 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.749+0000 7f277ef8d6c0 1 -- 10.20.193.11:0/2266448957 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7f277810f2c0 con 0x7f2778110050 2026-02-13T02:17:11.753 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.749+0000 7f6ea5fb86c0 1 -- 10.20.193.11:0/544671178 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f6ea010ddb0 msgr2=0x7f6ea010e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:11.754 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.749+0000 7f6ea5fb86c0 1 --2- 10.20.193.11:0/544671178 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f6ea010ddb0 0x7f6ea010e220 secure :-1 s=READY pgs=133 gs=1 cs=0 l=1 c_cookie=11390748545137873812 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6e84009970 tx=0x7f6e8402ed20 comp rx=0 tx=0).stop 2026-02-13T02:17:11.754 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.749+0000 7f6ea5fb86c0 1 -- 10.20.193.11:0/544671178 shutdown_connections 2026-02-13T02:17:11.754 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.749+0000 7f6ea5fb86c0 1 --2- 10.20.193.11:0/544671178 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f6ea010e760 0x7f6ea016f0f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.754 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.749+0000 7f6ea5fb86c0 1 --2- 10.20.193.11:0/544671178 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f6ea010ddb0 0x7f6ea010e220 unknown :-1 s=CLOSED pgs=133 gs=1 cs=0 l=1 c_cookie=11390748545137873812 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.754 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.749+0000 7f6ea5fb86c0 1 --2- 10.20.193.11:0/544671178 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6ea010cc30 0x7f6ea010d020 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.754 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.749+0000 7f6ea5fb86c0 1 -- 10.20.193.11:0/544671178 >> 10.20.193.11:0/544671178 conn(0x7f6ea00ea330 msgr2=0x7f6ea010a760 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:17:11.754 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.749+0000 7f6ea5fb86c0 1 -- 10.20.193.11:0/544671178 shutdown_connections 2026-02-13T02:17:11.754 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.749+0000 7f6ea5fb86c0 1 -- 10.20.193.11:0/544671178 wait complete. 2026-02-13T02:17:11.754 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.749+0000 7f6ea5fb86c0 1 Processor -- start 2026-02-13T02:17:11.754 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.749+0000 7f6ea5fb86c0 1 -- start start 2026-02-13T02:17:11.755 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.750+0000 7f6ea5fb86c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f6ea010cc30 0x7f6ea00f2c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:11.755 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.750+0000 7f6ea5fb86c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6ea010ddb0 0x7f6ea016f0f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:11.755 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.750+0000 7f6ea5fb86c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f6ea010e760 0x7f6ea00f34f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:11.755 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.750+0000 7f6ea5fb86c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f6ea00f4090 con 0x7f6ea010e760 2026-02-13T02:17:11.755 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.750+0000 7f6ea5fb86c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6ea00f4200 con 0x7f6ea010cc30 2026-02-13T02:17:11.755 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.750+0000 7f6ea5fb86c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f6ea00f43c0 con 0x7f6ea010ddb0 2026-02-13T02:17:11.755 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.750+0000 7f6e9ffff6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f6ea010e760 0x7f6ea00f34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:11.755 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.750+0000 7f6e9f7fe6c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f6ea010cc30 0x7f6ea00f2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:11.755 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.750+0000 7f6e9effd6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6ea010ddb0 0x7f6ea016f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:11.755 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.750+0000 7f6e9f7fe6c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f6ea010cc30 0x7f6ea00f2c90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.60:3300/0 says I am v2:10.20.193.11:45724/0 (socket says 10.20.193.11:45724) 2026-02-13T02:17:11.755 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.750+0000 7f6e9f7fe6c0 1 -- 10.20.193.11:0/2978527764 learned_addr learned my addr 10.20.193.11:0/2978527764 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:17:11.755 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.750+0000 7f6e9f7fe6c0 1 -- 10.20.193.11:0/2978527764 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f6ea010cc30 msgr2=0x7f6ea00f2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 9 2026-02-13T02:17:11.756 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.750+0000 7f6e9f7fe6c0 1 -- 10.20.193.11:0/2978527764 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f6ea010cc30 msgr2=0x7f6ea00f2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T02:17:11.756 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.750+0000 7f6e9f7fe6c0 1 --2- 10.20.193.11:0/2978527764 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f6ea010cc30 0x7f6ea00f2c90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-13T02:17:11.756 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.750+0000 7f6e9effd6c0 1 -- 10.20.193.11:0/2978527764 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6ea010ddb0 msgr2=0x7f6ea016f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 11 2026-02-13T02:17:11.756 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.750+0000 7f6e9f7fe6c0 1 --2- 10.20.193.11:0/2978527764 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f6ea010cc30 0x7f6ea00f2c90 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-13T02:17:11.756 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.750+0000 7f6e9effd6c0 1 -- 10.20.193.11:0/2978527764 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6ea010ddb0 msgr2=0x7f6ea016f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T02:17:11.756 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.750+0000 7f6e9effd6c0 1 --2- 10.20.193.11:0/2978527764 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6ea010ddb0 0x7f6ea016f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-13T02:17:11.756 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.750+0000 7f6e9effd6c0 1 --2- 10.20.193.11:0/2978527764 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6ea010ddb0 0x7f6ea016f0f0 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-13T02:17:11.756 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.750+0000 7f6e9ffff6c0 1 -- 10.20.193.11:0/2978527764 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6ea010ddb0 msgr2=0x7f6ea016f0f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T02:17:11.756 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.750+0000 7f6e9ffff6c0 1 --2- 10.20.193.11:0/2978527764 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6ea010ddb0 0x7f6ea016f0f0 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.756 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.750+0000 7f6e9ffff6c0 1 -- 10.20.193.11:0/2978527764 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f6ea010cc30 msgr2=0x7f6ea00f2c90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T02:17:11.756 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.750+0000 7f6e9ffff6c0 1 --2- 10.20.193.11:0/2978527764 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f6ea010cc30 0x7f6ea00f2c90 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.756 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.750+0000 7f6e9ffff6c0 1 -- 10.20.193.11:0/2978527764 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e84009590 con 0x7f6ea010e760 2026-02-13T02:17:11.757 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.750+0000 7f6e9ffff6c0 1 --2- 10.20.193.11:0/2978527764 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f6ea010e760 0x7f6ea00f34f0 secure :-1 s=READY pgs=134 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6e94006090 tx=0x7f6e94006560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:17:11.758 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'fc631695-0881-11f1-899c-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='trial011') 2026-02-13T02:17:11.758 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.752+0000 7f276dffb6c0 1 -- 10.20.193.11:0/2266448957 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v27)=0 v27) ==== 125+0+0 (secure 0 0 0) 0x7f2760036070 con 0x7f2778110050 2026-02-13T02:17:11.759 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.753+0000 7f6e9cff96c0 1 -- 10.20.193.11:0/2978527764 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6e94003a30 con 0x7f6ea010e760 2026-02-13T02:17:11.759 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.753+0000 7f6e9cff96c0 1 -- 10.20.193.11:0/2978527764 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6e94005510 con 0x7f6ea010e760 2026-02-13T02:17:11.759 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.753+0000 7f6e9cff96c0 1 -- 10.20.193.11:0/2978527764 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6e94012070 con 0x7f6ea010e760 2026-02-13T02:17:11.759 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.753+0000 7f6ea5fb86c0 1 -- 10.20.193.11:0/2978527764 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ea00f46a0 con 0x7f6ea010e760 2026-02-13T02:17:11.759 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.753+0000 7f6ea5fb86c0 1 -- 10.20.193.11:0/2978527764 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ea00f4b30 con 0x7f6ea010e760 2026-02-13T02:17:11.760 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.754+0000 7f6e9cff96c0 1 -- 10.20.193.11:0/2978527764 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (secure 0 0 0) 0x7f6e94012200 con 0x7f6ea010e760 2026-02-13T02:17:11.760 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.754+0000 7f6ea5fb86c0 1 -- 10.20.193.11:0/2978527764 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ea0173120 con 0x7f6ea010e760 2026-02-13T02:17:11.760 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.754+0000 7f6e9cff96c0 1 --2- 10.20.193.11:0/2978527764 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f6e7803f8f0 0x7f6e7805fda0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:11.760 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.754+0000 7f6e9cff96c0 1 -- 10.20.193.11:0/2978527764 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 935+0+0 (secure 0 0 0) 0x7f6e940522e0 con 0x7f6ea010e760 2026-02-13T02:17:11.760 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.754+0000 7f6e9f7fe6c0 1 --2- 10.20.193.11:0/2978527764 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f6e7803f8f0 0x7f6e7805fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:11.760 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.755+0000 7f6e9f7fe6c0 1 --2- 10.20.193.11:0/2978527764 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f6e7803f8f0 0x7f6e7805fda0 secure :-1 s=READY pgs=70 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6e8c005f90 tx=0x7f6e8c004420 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:17:11.761 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.755+0000 7f277ef8d6c0 1 -- 10.20.193.11:0/2266448957 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f275403f950 msgr2=0x7f275405fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:11.761 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.755+0000 7f277ef8d6c0 1 --2- 10.20.193.11:0/2266448957 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f275403f950 0x7f275405fe00 secure :-1 s=READY pgs=64 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2768004750 tx=0x7f2768005ac0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.761 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.756+0000 7f277ef8d6c0 1 -- 10.20.193.11:0/2266448957 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f2778110050 msgr2=0x7f2778171390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:11.761 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.756+0000 7f277ef8d6c0 1 --2- 10.20.193.11:0/2266448957 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f2778110050 0x7f2778171390 secure :-1 s=READY pgs=122 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2760004510 tx=0x7f2760004540 comp rx=0 tx=0).stop 2026-02-13T02:17:11.761 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.756+0000 7f277ef8d6c0 1 -- 10.20.193.11:0/2266448957 shutdown_connections 2026-02-13T02:17:11.761 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.756+0000 7f277ef8d6c0 1 --2- 10.20.193.11:0/2266448957 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f275403f950 0x7f275405fe00 unknown :-1 s=CLOSED pgs=64 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.761 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.756+0000 7f277ef8d6c0 1 --2- 10.20.193.11:0/2266448957 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f2778110a00 0x7f27780f9790 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.761 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.756+0000 7f277ef8d6c0 1 --2- 10.20.193.11:0/2266448957 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f2778110050 0x7f2778171390 unknown :-1 s=CLOSED pgs=122 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.761 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.756+0000 7f277ef8d6c0 1 --2- 10.20.193.11:0/2266448957 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f277810eed0 0x7f27780f8f30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.762 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.756+0000 7f277ef8d6c0 1 -- 10.20.193.11:0/2266448957 >> 10.20.193.11:0/2266448957 conn(0x7f27780ec5f0 msgr2=0x7f27780ef540 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:17:11.762 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.756+0000 7f277ef8d6c0 1 -- 10.20.193.11:0/2266448957 shutdown_connections 2026-02-13T02:17:11.762 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.756+0000 7f277ef8d6c0 1 -- 10.20.193.11:0/2266448957 wait complete. 2026-02-13T02:17:11.762 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.757+0000 7f6e9cff96c0 1 -- 10.20.193.11:0/2978527764 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f6e9400e040 con 0x7f6ea010e760 2026-02-13T02:17:11.765 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.762+0000 7f32582ac6c0 1 -- 10.20.193.11:0/2615278576 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f32501141b0 con 0x7f32501146f0 2026-02-13T02:17:11.768 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.765+0000 7f32377fe6c0 1 -- 10.20.193.11:0/2615278576 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v28)=0 v28) ==== 121+0+0 (secure 0 0 0) 0x7f3244030c30 con 0x7f32501146f0 2026-02-13T02:17:11.770 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.767+0000 7f08259a86c0 1 -- 10.20.193.11:0/233226243 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command([{prefix=config set, name=client_mount_timeout}] v 0) -- 0x7f082010e240 con 0x7f082010ddd0 2026-02-13T02:17:11.772 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.769+0000 7f32582ac6c0 1 -- 10.20.193.11:0/2615278576 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f322c03f940 msgr2=0x7f322c05fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:11.772 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.769+0000 7f32582ac6c0 1 --2- 10.20.193.11:0/2615278576 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f322c03f940 0x7f322c05fdf0 secure :-1 s=READY pgs=65 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3240005980 tx=0x7f3240005910 comp rx=0 tx=0).stop 2026-02-13T02:17:11.772 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.769+0000 7f32582ac6c0 1 -- 10.20.193.11:0/2615278576 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f32501146f0 msgr2=0x7f32500fe250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:11.772 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.769+0000 7f32582ac6c0 1 --2- 10.20.193.11:0/2615278576 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f32501146f0 0x7f32500fe250 secure :-1 s=READY pgs=124 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f32440091b0 tx=0x7f32440045b0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.773 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.769+0000 7f32582ac6c0 1 -- 10.20.193.11:0/2615278576 shutdown_connections 2026-02-13T02:17:11.773 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.769+0000 7f32582ac6c0 1 --2- 10.20.193.11:0/2615278576 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f322c03f940 0x7f322c05fdf0 unknown :-1 s=CLOSED pgs=65 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.773 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.769+0000 7f32582ac6c0 1 --2- 10.20.193.11:0/2615278576 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f3250115120 0x7f32500fedf0 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.773 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.769+0000 7f32582ac6c0 1 --2- 10.20.193.11:0/2615278576 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f32501146f0 0x7f32500fe250 unknown :-1 s=CLOSED pgs=124 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.773 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.769+0000 7f32582ac6c0 1 --2- 10.20.193.11:0/2615278576 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f3250113dc0 0x7f32500fdc00 unknown :-1 s=CLOSED pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.773 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.769+0000 7f32582ac6c0 1 -- 10.20.193.11:0/2615278576 >> 10.20.193.11:0/2615278576 conn(0x7f325005bd20 msgr2=0x7f325005c910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:17:11.773 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.769+0000 7f32582ac6c0 1 -- 10.20.193.11:0/2615278576 shutdown_connections 2026-02-13T02:17:11.774 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.769+0000 7f32582ac6c0 1 -- 10.20.193.11:0/2615278576 wait complete. 2026-02-13T02:17:11.774 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.770+0000 7f08249a26c0 1 -- 10.20.193.11:0/233226243 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{prefix=config set, name=client_mount_timeout}]=0 v29)=0 v29) ==== 119+0+0 (secure 0 0 0) 0x7f0808010870 con 0x7f082010ddd0 2026-02-13T02:17:11.776 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.771+0000 7f1de2a816c0 1 -- 10.20.193.11:0/2761270515 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f1ddc10bb10 msgr2=0x7f1ddc10bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:11.776 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.771+0000 7f1de2a816c0 1 --2- 10.20.193.11:0/2761270515 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f1ddc10bb10 0x7f1ddc10bf00 secure :-1 s=READY pgs=135 gs=1 cs=0 l=1 c_cookie=16251430371251989641 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1dc80098a0 tx=0x7f1dc802ec40 comp rx=0 tx=0).stop 2026-02-13T02:17:11.776 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.771+0000 7f1de2a816c0 1 -- 10.20.193.11:0/2761270515 shutdown_connections 2026-02-13T02:17:11.776 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.771+0000 7f1de2a816c0 1 --2- 10.20.193.11:0/2761270515 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f1ddc10cc90 0x7f1ddc10d100 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.776 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.771+0000 7f1de2a816c0 1 --2- 10.20.193.11:0/2761270515 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1ddc10d640 0x7f1ddc16dfd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.776 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.771+0000 7f1de2a816c0 1 --2- 10.20.193.11:0/2761270515 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f1ddc10bb10 0x7f1ddc10bf00 unknown :-1 s=CLOSED pgs=135 gs=1 cs=0 l=1 c_cookie=16251430371251989641 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.777 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.771+0000 7f1de2a816c0 1 -- 10.20.193.11:0/2761270515 >> 10.20.193.11:0/2761270515 conn(0x7f1ddc0e9230 msgr2=0x7f1ddc109640 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:17:11.777 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.772+0000 7f1de2a816c0 1 -- 10.20.193.11:0/2761270515 shutdown_connections 2026-02-13T02:17:11.777 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.772+0000 7f1de2a816c0 1 -- 10.20.193.11:0/2761270515 wait complete. 2026-02-13T02:17:11.777 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.772+0000 7f1de2a816c0 1 Processor -- start 2026-02-13T02:17:11.777 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.772+0000 7f1de2a816c0 1 -- start start 2026-02-13T02:17:11.777 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.772+0000 7f1de2a816c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1ddc10bb10 0x7f1ddc114fa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:11.777 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.772+0000 7f1de2a816c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f1ddc10cc90 0x7f1ddc1155f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:11.777 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.772+0000 7f1de2a816c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f1ddc10d640 0x7f1ddc1161e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:11.777 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.772+0000 7f1de2a816c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f1ddc116970 con 0x7f1ddc10d640 2026-02-13T02:17:11.777 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.772+0000 7f1de2a816c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f1ddc116ae0 con 0x7f1ddc10cc90 2026-02-13T02:17:11.777 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.772+0000 7f1de2a816c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f1ddc116ca0 con 0x7f1ddc10bb10 2026-02-13T02:17:11.777 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.772+0000 7f1de0ff36c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f1ddc10d640 0x7f1ddc1161e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:11.778 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.772+0000 7f1de0ff36c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f1ddc10d640 0x7f1ddc1161e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:34594/0 (socket says 10.20.193.11:34594) 2026-02-13T02:17:11.778 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.772+0000 7f1de0ff36c0 1 -- 10.20.193.11:0/1284554092 learned_addr learned my addr 10.20.193.11:0/1284554092 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:17:11.778 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.772+0000 7f1ddb7fe6c0 1 --2- 10.20.193.11:0/1284554092 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f1ddc10cc90 0x7f1ddc1155f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:11.778 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.772+0000 7f1ddbfff6c0 1 --2- 10.20.193.11:0/1284554092 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1ddc10bb10 0x7f1ddc114fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:11.778 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.773+0000 7f1ddbfff6c0 1 -- 10.20.193.11:0/1284554092 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1ddc10bb10 msgr2=0x7f1ddc114fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 11 2026-02-13T02:17:11.778 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.773+0000 7f1ddbfff6c0 1 -- 10.20.193.11:0/1284554092 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1ddc10bb10 msgr2=0x7f1ddc114fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T02:17:11.778 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.773+0000 7f1ddbfff6c0 1 --2- 10.20.193.11:0/1284554092 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1ddc10bb10 0x7f1ddc114fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-13T02:17:11.778 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.773+0000 7f1de0ff36c0 1 -- 10.20.193.11:0/1284554092 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1ddc10bb10 msgr2=0x7f1ddc114fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:11.778 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.773+0000 7f1ddbfff6c0 1 --2- 10.20.193.11:0/1284554092 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1ddc10bb10 0x7f1ddc114fa0 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-13T02:17:11.778 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.773+0000 7f1de0ff36c0 1 --2- 10.20.193.11:0/1284554092 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1ddc10bb10 0x7f1ddc114fa0 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.778 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.773+0000 7f1ddb7fe6c0 1 -- 10.20.193.11:0/1284554092 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f1ddc10cc90 msgr2=0x7f1ddc1155f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 9 2026-02-13T02:17:11.778 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.773+0000 7f1ddb7fe6c0 1 -- 10.20.193.11:0/1284554092 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f1ddc10cc90 msgr2=0x7f1ddc1155f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T02:17:11.779 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.773+0000 7f1ddb7fe6c0 1 --2- 10.20.193.11:0/1284554092 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f1ddc10cc90 0x7f1ddc1155f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-13T02:17:11.779 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.773+0000 7f1de0ff36c0 1 -- 10.20.193.11:0/1284554092 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f1ddc10cc90 msgr2=0x7f1ddc1155f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:11.779 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.773+0000 7f1ddb7fe6c0 1 --2- 10.20.193.11:0/1284554092 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f1ddc10cc90 0x7f1ddc1155f0 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-13T02:17:11.779 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.773+0000 7f1de0ff36c0 1 --2- 10.20.193.11:0/1284554092 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f1ddc10cc90 0x7f1ddc1155f0 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.779 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.773+0000 7f1de0ff36c0 1 -- 10.20.193.11:0/1284554092 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dc80094c0 con 0x7f1ddc10d640 2026-02-13T02:17:11.779 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.773+0000 7f1de0ff36c0 1 --2- 10.20.193.11:0/1284554092 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f1ddc10d640 0x7f1ddc1161e0 secure :-1 s=READY pgs=136 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1dd0006ea0 tx=0x7f1dd000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:17:11.779 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.773+0000 7f1dd97fa6c0 1 -- 10.20.193.11:0/1284554092 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1dd0003a30 con 0x7f1ddc10d640 2026-02-13T02:17:11.779 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.773+0000 7f1de2a816c0 1 -- 10.20.193.11:0/1284554092 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ddc116f80 con 0x7f1ddc10d640 2026-02-13T02:17:11.779 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.773+0000 7f1dd97fa6c0 1 -- 10.20.193.11:0/1284554092 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1dd0005510 con 0x7f1ddc10d640 2026-02-13T02:17:11.779 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.773+0000 7f1dd97fa6c0 1 -- 10.20.193.11:0/1284554092 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1dd000dd70 con 0x7f1ddc10d640 2026-02-13T02:17:11.779 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.773+0000 7f1de2a816c0 1 -- 10.20.193.11:0/1284554092 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ddc157530 con 0x7f1ddc10d640 2026-02-13T02:17:11.780 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.774+0000 7f1de2a816c0 1 -- 10.20.193.11:0/1284554092 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ddc16fe40 con 0x7f1ddc10d640 2026-02-13T02:17:11.780 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.774+0000 7f1dd97fa6c0 1 -- 10.20.193.11:0/1284554092 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (secure 0 0 0) 0x7f1dd0003b90 con 0x7f1ddc10d640 2026-02-13T02:17:11.781 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.774+0000 7f08259a86c0 1 -- 10.20.193.11:0/233226243 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f07f403f8f0 msgr2=0x7f07f405fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:11.781 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.774+0000 7f08259a86c0 1 --2- 10.20.193.11:0/233226243 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f07f403f8f0 0x7f07f405fda0 secure :-1 s=READY pgs=66 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f08140023e0 tx=0x7f0814005c00 comp rx=0 tx=0).stop 2026-02-13T02:17:11.781 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.774+0000 7f08259a86c0 1 -- 10.20.193.11:0/233226243 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f082010ddd0 msgr2=0x7f082014f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:11.781 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.774+0000 7f08259a86c0 1 --2- 10.20.193.11:0/233226243 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f082010ddd0 0x7f082014f160 secure :-1 s=READY pgs=126 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f080800b710 tx=0x7f080800bbe0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.781 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.774+0000 7f08259a86c0 1 -- 10.20.193.11:0/233226243 shutdown_connections 2026-02-13T02:17:11.781 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.774+0000 7f08259a86c0 1 --2- 10.20.193.11:0/233226243 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f07f403f8f0 0x7f07f405fda0 unknown :-1 s=CLOSED pgs=66 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.781 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.774+0000 7f08259a86c0 1 --2- 10.20.193.11:0/233226243 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f082010e780 0x7f082014f8b0 unknown :-1 s=CLOSED pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.781 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.774+0000 7f08259a86c0 1 --2- 10.20.193.11:0/233226243 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f082010ddd0 0x7f082014f160 unknown :-1 s=CLOSED pgs=126 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.781 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.774+0000 7f08259a86c0 1 --2- 10.20.193.11:0/233226243 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f082010cc50 0x7f082017d430 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.781 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.774+0000 7f08259a86c0 1 -- 10.20.193.11:0/233226243 >> 10.20.193.11:0/233226243 conn(0x7f08200ea370 msgr2=0x7f082010a750 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:17:11.782 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.774+0000 7f08259a86c0 1 -- 10.20.193.11:0/233226243 shutdown_connections 2026-02-13T02:17:11.782 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.774+0000 7f08259a86c0 1 -- 10.20.193.11:0/233226243 wait complete. 2026-02-13T02:17:11.782 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.774+0000 7f1dd97fa6c0 1 --2- 10.20.193.11:0/1284554092 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f1db003f8f0 0x7f1db005fda0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:11.782 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.774+0000 7f1dd97fa6c0 1 -- 10.20.193.11:0/1284554092 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 935+0+0 (secure 0 0 0) 0x7f1dd0052310 con 0x7f1ddc10d640 2026-02-13T02:17:11.782 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.774+0000 7f1ddbfff6c0 1 --2- 10.20.193.11:0/1284554092 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f1db003f8f0 0x7f1db005fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:11.783 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.775+0000 7f1ddbfff6c0 1 --2- 10.20.193.11:0/1284554092 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f1db003f8f0 0x7f1db005fda0 secure :-1 s=READY pgs=71 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1dc802f9c0 tx=0x7f1dc80023a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:17:11.784 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.776+0000 7f1dd97fa6c0 1 -- 10.20.193.11:0/1284554092 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f1dd000be50 con 0x7f1ddc10d640 2026-02-13T02:17:11.820 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.818+0000 7f7bd20586c0 1 -- 10.20.193.11:0/3253384130 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command([{prefix=config set, name=debug_client}] v 0) -- 0x7f7bcc1753c0 con 0x7f7bcc110a00 2026-02-13T02:17:11.822 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.820+0000 7f7bc8ff96c0 1 -- 10.20.193.11:0/3253384130 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_client}]=0 v30)=0 v30) ==== 111+0+0 (secure 0 0 0) 0x7f7bc00348d0 con 0x7f7bcc110a00 2026-02-13T02:17:11.824 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.821+0000 7f63d48186c0 1 -- 10.20.193.11:0/2313699882 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7f63cc1792d0 con 0x7f63cc113f10 2026-02-13T02:17:11.826 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.822+0000 7f7bd20586c0 1 -- 10.20.193.11:0/3253384130 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f7ba403f8f0 msgr2=0x7f7ba405fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:11.826 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.822+0000 7f7bd20586c0 1 --2- 10.20.193.11:0/3253384130 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f7ba403f8f0 0x7f7ba405fda0 secure :-1 s=READY pgs=67 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7bb8007240 tx=0x7f7bb8007620 comp rx=0 tx=0).stop 2026-02-13T02:17:11.826 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.823+0000 7f7bd20586c0 1 -- 10.20.193.11:0/3253384130 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f7bcc110a00 msgr2=0x7f7bcc0f9700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:11.826 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.823+0000 7f7bd20586c0 1 --2- 10.20.193.11:0/3253384130 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f7bcc110a00 0x7f7bcc0f9700 secure :-1 s=READY pgs=129 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7bc00302f0 tx=0x7f7bc0030ef0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.826 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.823+0000 7f7bd20586c0 1 -- 10.20.193.11:0/3253384130 shutdown_connections 2026-02-13T02:17:11.826 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.823+0000 7f7bd20586c0 1 --2- 10.20.193.11:0/3253384130 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f7ba403f8f0 0x7f7ba405fda0 unknown :-1 s=CLOSED pgs=67 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.826 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.823+0000 7f7bd20586c0 1 --2- 10.20.193.11:0/3253384130 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f7bcc110a00 0x7f7bcc0f9700 unknown :-1 s=CLOSED pgs=129 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.826 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.823+0000 7f7bd20586c0 1 --2- 10.20.193.11:0/3253384130 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f7bcc110050 0x7f7bcc171370 unknown :-1 s=CLOSED pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.827 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.823+0000 7f7bd20586c0 1 --2- 10.20.193.11:0/3253384130 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f7bcc10eed0 0x7f7bcc0f8ec0 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.827 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.823+0000 7f7bd20586c0 1 -- 10.20.193.11:0/3253384130 >> 10.20.193.11:0/3253384130 conn(0x7f7bcc0ec5f0 msgr2=0x7f7bcc0ef470 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:17:11.827 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.823+0000 7f7bd20586c0 1 -- 10.20.193.11:0/3253384130 shutdown_connections 2026-02-13T02:17:11.827 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.823+0000 7f7bd20586c0 1 -- 10.20.193.11:0/3253384130 wait complete. 2026-02-13T02:17:11.827 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.823+0000 7f63b77fe6c0 1 -- 10.20.193.11:0/2313699882 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v31)=0 v31) ==== 121+0+0 (secure 0 0 0) 0x7f63b8032880 con 0x7f63cc113f10 2026-02-13T02:17:11.829 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.826+0000 7f63d48186c0 1 -- 10.20.193.11:0/2313699882 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f63a803f8f0 msgr2=0x7f63a805fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:11.829 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.826+0000 7f63d48186c0 1 --2- 10.20.193.11:0/2313699882 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f63a803f8f0 0x7f63a805fda0 secure :-1 s=READY pgs=68 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f63c4005980 tx=0x7f63c4005910 comp rx=0 tx=0).stop 2026-02-13T02:17:11.829 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.826+0000 7f63d48186c0 1 -- 10.20.193.11:0/2313699882 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f63cc113f10 msgr2=0x7f63cc175870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:11.829 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.826+0000 7f63d48186c0 1 --2- 10.20.193.11:0/2313699882 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f63cc113f10 0x7f63cc175870 secure :-1 s=READY pgs=130 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f63b80023c0 tx=0x7f63b80028e0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.830 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.826+0000 7f63d48186c0 1 -- 10.20.193.11:0/2313699882 shutdown_connections 2026-02-13T02:17:11.830 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.826+0000 7f63d48186c0 1 --2- 10.20.193.11:0/2313699882 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f63a803f8f0 0x7f63a805fda0 unknown :-1 s=CLOSED pgs=68 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.830 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.826+0000 7f63d48186c0 1 --2- 10.20.193.11:0/2313699882 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f63cc1147f0 0x7f63cc0ff180 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.830 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.826+0000 7f63d48186c0 1 --2- 10.20.193.11:0/2313699882 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f63cc113f10 0x7f63cc175870 unknown :-1 s=CLOSED pgs=130 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.830 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.826+0000 7f63d48186c0 1 --2- 10.20.193.11:0/2313699882 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f63cc113560 0x7f63cc0fe920 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.830 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.826+0000 7f63d48186c0 1 -- 10.20.193.11:0/2313699882 >> 10.20.193.11:0/2313699882 conn(0x7f63cc064300 msgr2=0x7f63cc0f4e30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:17:11.831 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.826+0000 7f63d48186c0 1 -- 10.20.193.11:0/2313699882 shutdown_connections 2026-02-13T02:17:11.831 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.826+0000 7f63d48186c0 1 -- 10.20.193.11:0/2313699882 wait complete. 2026-02-13T02:17:11.834 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.832+0000 7fd99d6686c0 1 -- 10.20.193.11:0/916440633 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7fd998061190 con 0x7fd998060d20 2026-02-13T02:17:11.836 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.834+0000 7fd977fff6c0 1 -- 10.20.193.11:0/916440633 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v32)=0 v32) ==== 121+0+0 (secure 0 0 0) 0x7fd98c034c30 con 0x7fd998060d20 2026-02-13T02:17:11.839 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.836+0000 7fd99d6686c0 1 -- 10.20.193.11:0/916440633 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fd96c03f8f0 msgr2=0x7fd96c05fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:11.839 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.836+0000 7fd99d6686c0 1 --2- 10.20.193.11:0/916440633 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fd96c03f8f0 0x7fd96c05fda0 secure :-1 s=READY pgs=69 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd980009260 tx=0x7fd980009050 comp rx=0 tx=0).stop 2026-02-13T02:17:11.839 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.836+0000 7fd99d6686c0 1 -- 10.20.193.11:0/916440633 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fd998060d20 msgr2=0x7fd99815c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:11.839 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.836+0000 7fd99d6686c0 1 --2- 10.20.193.11:0/916440633 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fd998060d20 0x7fd99815c550 secure :-1 s=READY pgs=132 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd98c006010 tx=0x7fd98c0045f0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.839 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.836+0000 7fd99d6686c0 1 -- 10.20.193.11:0/916440633 shutdown_connections 2026-02-13T02:17:11.839 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.836+0000 7fd99d6686c0 1 --2- 10.20.193.11:0/916440633 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fd96c03f8f0 0x7fd96c05fda0 unknown :-1 s=CLOSED pgs=69 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.839 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.836+0000 7fd99d6686c0 1 --2- 10.20.193.11:0/916440633 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fd998150d00 0x7fd99815d790 unknown :-1 s=CLOSED pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.839 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.836+0000 7fd99d6686c0 1 --2- 10.20.193.11:0/916440633 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd998062160 0x7fd99815cba0 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.839 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.836+0000 7fd99d6686c0 1 --2- 10.20.193.11:0/916440633 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fd998060d20 0x7fd99815c550 unknown :-1 s=CLOSED pgs=132 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.840 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.836+0000 7fd99d6686c0 1 -- 10.20.193.11:0/916440633 >> 10.20.193.11:0/916440633 conn(0x7fd9980ea370 msgr2=0x7fd99810a750 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:17:11.840 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.836+0000 7fd99d6686c0 1 -- 10.20.193.11:0/916440633 shutdown_connections 2026-02-13T02:17:11.840 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.836+0000 7fd99d6686c0 1 -- 10.20.193.11:0/916440633 wait complete. 2026-02-13T02:17:11.872 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.870+0000 7f6ea5fb86c0 1 -- 10.20.193.11:0/2978527764 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f6ea010d020 con 0x7f6ea010e760 2026-02-13T02:17:11.873 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.870+0000 7f6e9cff96c0 1 -- 10.20.193.11:0/2978527764 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v32)=0 v32) ==== 106+0+0 (secure 0 0 0) 0x7f6e94011040 con 0x7f6ea010e760 2026-02-13T02:17:11.875 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.872+0000 7f6ea5fb86c0 1 -- 10.20.193.11:0/2978527764 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f6e7803f8f0 msgr2=0x7f6e7805fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:11.875 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.872+0000 7f6ea5fb86c0 1 --2- 10.20.193.11:0/2978527764 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f6e7803f8f0 0x7f6e7805fda0 secure :-1 s=READY pgs=70 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6e8c005f90 tx=0x7f6e8c004420 comp rx=0 tx=0).stop 2026-02-13T02:17:11.875 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.872+0000 7f6ea5fb86c0 1 -- 10.20.193.11:0/2978527764 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f6ea010e760 msgr2=0x7f6ea00f34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:11.875 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.872+0000 7f6ea5fb86c0 1 --2- 10.20.193.11:0/2978527764 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f6ea010e760 0x7f6ea00f34f0 secure :-1 s=READY pgs=134 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6e94006090 tx=0x7f6e94006560 comp rx=0 tx=0).stop 2026-02-13T02:17:11.875 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.872+0000 7f6ea5fb86c0 1 -- 10.20.193.11:0/2978527764 shutdown_connections 2026-02-13T02:17:11.875 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.872+0000 7f6ea5fb86c0 1 --2- 10.20.193.11:0/2978527764 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f6e7803f8f0 0x7f6e7805fda0 unknown :-1 s=CLOSED pgs=70 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.876 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.872+0000 7f6ea5fb86c0 1 --2- 10.20.193.11:0/2978527764 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f6ea010e760 0x7f6ea00f34f0 unknown :-1 s=CLOSED pgs=134 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.876 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.872+0000 7f6ea5fb86c0 1 --2- 10.20.193.11:0/2978527764 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6ea010ddb0 0x7f6ea016f0f0 unknown :-1 s=CLOSED pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.876 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.872+0000 7f6ea5fb86c0 1 --2- 10.20.193.11:0/2978527764 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f6ea010cc30 0x7f6ea00f2c90 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.876 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.872+0000 7f6ea5fb86c0 1 -- 10.20.193.11:0/2978527764 >> 10.20.193.11:0/2978527764 conn(0x7f6ea00ea330 msgr2=0x7f6ea0109b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:17:11.876 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.872+0000 7f6ea5fb86c0 1 -- 10.20.193.11:0/2978527764 shutdown_connections 2026-02-13T02:17:11.877 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.872+0000 7f6ea5fb86c0 1 -- 10.20.193.11:0/2978527764 wait complete. 2026-02-13T02:17:11.881 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'fc631695-0881-11f1-899c-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='trial011') 2026-02-13T02:17:11.881 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'fc631695-0881-11f1-899c-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='trial011') 2026-02-13T02:17:11.881 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'fc631695-0881-11f1-899c-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='trial011') 2026-02-13T02:17:11.881 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'fc631695-0881-11f1-899c-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='trial011') 2026-02-13T02:17:11.881 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'fc631695-0881-11f1-899c-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mgr', 'client_mount_timeout', '30'], check_status=True, hostname='trial011') 2026-02-13T02:17:11.881 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'fc631695-0881-11f1-899c-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mgr', 'debug_client', '20'], check_status=True, hostname='trial011') 2026-02-13T02:17:11.882 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'fc631695-0881-11f1-899c-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mgr', 'debug_mgr', '20'], check_status=True, hostname='trial011') 2026-02-13T02:17:11.882 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.880+0000 7f1de2a816c0 1 -- 10.20.193.11:0/1284554092 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command([{prefix=config set, name=debug_mgr}] v 0) -- 0x7f1ddc10d100 con 0x7f1ddc10d640 2026-02-13T02:17:11.883 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.880+0000 7f1dd97fa6c0 1 -- 10.20.193.11:0/1284554092 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mgr}]=0 v32)=0 v32) ==== 108+0+0 (secure 0 0 0) 0x7f1dd000be50 con 0x7f1ddc10d640 2026-02-13T02:17:11.885 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.882+0000 7f1de2a816c0 1 -- 10.20.193.11:0/1284554092 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f1db003f8f0 msgr2=0x7f1db005fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:11.885 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.882+0000 7f1de2a816c0 1 --2- 10.20.193.11:0/1284554092 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f1db003f8f0 0x7f1db005fda0 secure :-1 s=READY pgs=71 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1dc802f9c0 tx=0x7f1dc80023a0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.885 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.882+0000 7f1de2a816c0 1 -- 10.20.193.11:0/1284554092 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f1ddc10d640 msgr2=0x7f1ddc1161e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:11.885 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.882+0000 7f1de2a816c0 1 --2- 10.20.193.11:0/1284554092 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f1ddc10d640 0x7f1ddc1161e0 secure :-1 s=READY pgs=136 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1dd0006ea0 tx=0x7f1dd000cca0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.885 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.882+0000 7f1de2a816c0 1 -- 10.20.193.11:0/1284554092 shutdown_connections 2026-02-13T02:17:11.885 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.882+0000 7f1de2a816c0 1 --2- 10.20.193.11:0/1284554092 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f1db003f8f0 0x7f1db005fda0 unknown :-1 s=CLOSED pgs=71 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.886 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.882+0000 7f1de2a816c0 1 --2- 10.20.193.11:0/1284554092 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f1ddc10cc90 0x7f1ddc1155f0 unknown :-1 s=CLOSED pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.886 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.882+0000 7f1de2a816c0 1 --2- 10.20.193.11:0/1284554092 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f1ddc10d640 0x7f1ddc1161e0 unknown :-1 s=CLOSED pgs=136 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.886 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.882+0000 7f1de2a816c0 1 --2- 10.20.193.11:0/1284554092 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1ddc10bb10 0x7f1ddc114fa0 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:11.886 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.882+0000 7f1de2a816c0 1 -- 10.20.193.11:0/1284554092 >> 10.20.193.11:0/1284554092 conn(0x7f1ddc0e9230 msgr2=0x7f1ddc109610 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:17:11.886 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.882+0000 7f1de2a816c0 1 -- 10.20.193.11:0/1284554092 shutdown_connections 2026-02-13T02:17:11.886 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:11.882+0000 7f1de2a816c0 1 -- 10.20.193.11:0/1284554092 wait complete. 2026-02-13T02:17:11.912 INFO:journalctl@ceph.mgr.z.trial078.stdout:Feb 13 02:17:11 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-z[16372]: 2026-02-13T02:17:11.660+0000 7f0e76c7bfc0 -1 mgr[py] Loading module smb in main interpreter 2026-02-13T02:17:11.912 INFO:journalctl@ceph.mgr.z.trial078.stdout:Feb 13 02:17:11 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-z[16372]: 2026-02-13T02:17:11.685+0000 7f0e76c7bfc0 -1 mgr[py] Loading module snap_schedule in main interpreter 2026-02-13T02:17:11.912 INFO:journalctl@ceph.mgr.z.trial078.stdout:Feb 13 02:17:11 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-z[16372]: 2026-02-13T02:17:11.691+0000 7f0e76c7bfc0 -1 mgr[py] Loading module stats in main interpreter 2026-02-13T02:17:11.912 INFO:journalctl@ceph.mgr.z.trial078.stdout:Feb 13 02:17:11 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-z[16372]: 2026-02-13T02:17:11.694+0000 7f0e76c7bfc0 -1 mgr[py] Loading module devicehealth in main interpreter 2026-02-13T02:17:11.912 INFO:journalctl@ceph.mgr.z.trial078.stdout:Feb 13 02:17:11 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-z[16372]: 2026-02-13T02:17:11.697+0000 7f0e76c7bfc0 -1 mgr[py] Loading module iostat in main interpreter 2026-02-13T02:17:11.912 INFO:journalctl@ceph.mgr.z.trial078.stdout:Feb 13 02:17:11 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-z[16372]: 2026-02-13T02:17:11.697+0000 7f0e76c7bfc0 -1 mgr[py] Loading module influx in main interpreter 2026-02-13T02:17:11.912 INFO:journalctl@ceph.mgr.z.trial078.stdout:Feb 13 02:17:11 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-z[16372]: 2026-02-13T02:17:11.699+0000 7f0e76c7bfc0 -1 mgr[py] Loading module telegraf in main interpreter 2026-02-13T02:17:11.912 INFO:journalctl@ceph.mgr.z.trial078.stdout:Feb 13 02:17:11 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-z[16372]: 2026-02-13T02:17:11.701+0000 7f0e76c7bfc0 -1 mgr[py] Loading module volumes in main interpreter 2026-02-13T02:17:11.912 INFO:journalctl@ceph.mgr.z.trial078.stdout:Feb 13 02:17:11 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-z[16372]: 2026-02-13T02:17:11.730+0000 7f0e76c7bfc0 -1 mgr[py] Loading module rbd_support in main interpreter 2026-02-13T02:17:11.912 INFO:journalctl@ceph.mgr.z.trial078.stdout:Feb 13 02:17:11 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-z[16372]: 2026-02-13T02:17:11.742+0000 7f0e76c7bfc0 -1 mgr[py] Loading module mirroring in main interpreter 2026-02-13T02:17:11.912 INFO:journalctl@ceph.mgr.z.trial078.stdout:Feb 13 02:17:11 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-z[16372]: 2026-02-13T02:17:11.752+0000 7f0e76c7bfc0 -1 mgr[py] Loading module rgw in main interpreter 2026-02-13T02:17:11.913 INFO:journalctl@ceph.mgr.z.trial078.stdout:Feb 13 02:17:11 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-z[16372]: 2026-02-13T02:17:11.755+0000 7f0e76c7bfc0 -1 mgr[py] Loading module pg_autoscaler in main interpreter 2026-02-13T02:17:11.913 INFO:journalctl@ceph.mgr.z.trial078.stdout:Feb 13 02:17:11 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-z[16372]: 2026-02-13T02:17:11.759+0000 7f0e76c7bfc0 -1 mgr[py] Loading module mds_autoscaler in main interpreter 2026-02-13T02:17:11.913 INFO:journalctl@ceph.mgr.z.trial078.stdout:Feb 13 02:17:11 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-z[16372]: 2026-02-13T02:17:11.759+0000 7f0e76c7bfc0 -1 mgr[py] Loading module localpool in main interpreter 2026-02-13T02:17:11.913 INFO:journalctl@ceph.mgr.z.trial078.stdout:Feb 13 02:17:11 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-z[16372]: 2026-02-13T02:17:11.760+0000 7f0e76c7bfc0 -1 mgr[py] Loading module k8sevents in main interpreter 2026-02-13T02:17:11.913 INFO:journalctl@ceph.mgr.z.trial078.stdout:Feb 13 02:17:11 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-z[16372]: 2026-02-13T02:17:11.898+0000 7f0e76c7bfc0 -1 mgr[py] Loading module crash in main interpreter 2026-02-13T02:17:11.913 INFO:journalctl@ceph.mgr.z.trial078.stdout:Feb 13 02:17:11 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-z[16372]: 2026-02-13T02:17:11.901+0000 7f0e76c7bfc0 -1 mgr[py] Loading module prometheus in main interpreter 2026-02-13T02:17:11.913 INFO:journalctl@ceph.mgr.z.trial078.stdout:Feb 13 02:17:11 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-z[16372]: 2026-02-13T02:17:11.909+0000 7f0e76c7bfc0 -1 mgr[py] Loading module insights in main interpreter 2026-02-13T02:17:11.922 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'fc631695-0881-11f1-899c-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mgr', 'debug_ms', '1'], check_status=True, hostname='trial011') 2026-02-13T02:17:11.922 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'fc631695-0881-11f1-899c-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mgr', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='trial011') 2026-02-13T02:17:11.922 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'fc631695-0881-11f1-899c-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='trial011') 2026-02-13T02:17:11.922 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'fc631695-0881-11f1-899c-d404e6e7d460', '--', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='trial011') 2026-02-13T02:17:11.923 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph config dump 2026-02-13T02:17:12.083 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:17:12.204 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:12.199+0000 7f4de28e86c0 1 -- 10.20.193.11:0/1738241776 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f4ddc1109f0 msgr2=0x7f4ddc171380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:12.205 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:12.199+0000 7f4de28e86c0 1 --2- 10.20.193.11:0/1738241776 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f4ddc1109f0 0x7f4ddc171380 secure :-1 s=READY pgs=139 gs=1 cs=0 l=1 c_cookie=13611745433884970563 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4dd000aa40 tx=0x7f4dd002fde0 comp rx=0 tx=0).stop 2026-02-13T02:17:12.205 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:12.199+0000 7f4de28e86c0 1 -- 10.20.193.11:0/1738241776 shutdown_connections 2026-02-13T02:17:12.205 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:12.199+0000 7f4de28e86c0 1 --2- 10.20.193.11:0/1738241776 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f4ddc1109f0 0x7f4ddc171380 unknown :-1 s=CLOSED pgs=139 gs=1 cs=0 l=1 c_cookie=13611745433884970563 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:12.205 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:12.199+0000 7f4de28e86c0 1 --2- 10.20.193.11:0/1738241776 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f4ddc110040 0x7f4ddc1104b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:12.205 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:12.199+0000 7f4de28e86c0 1 --2- 10.20.193.11:0/1738241776 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f4ddc10eec0 0x7f4ddc10f2b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:12.205 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:12.199+0000 7f4de28e86c0 1 -- 10.20.193.11:0/1738241776 >> 10.20.193.11:0/1738241776 conn(0x7f4ddc0ec5c0 msgr2=0x7f4ddc10c9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:17:12.205 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:12.199+0000 7f4de28e86c0 1 -- 10.20.193.11:0/1738241776 shutdown_connections 2026-02-13T02:17:12.205 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:12.199+0000 7f4de28e86c0 1 -- 10.20.193.11:0/1738241776 wait complete. 2026-02-13T02:17:12.206 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:12.199+0000 7f4de28e86c0 1 Processor -- start 2026-02-13T02:17:12.206 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:12.199+0000 7f4de28e86c0 1 -- start start 2026-02-13T02:17:12.206 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:12.199+0000 7f4de28e86c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f4ddc10eec0 0x7f4ddc0f8f90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:12.206 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:12.199+0000 7f4de28e86c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f4ddc110040 0x7f4ddc171380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:12.206 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:12.199+0000 7f4de28e86c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f4ddc1109f0 0x7f4ddc0f97f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:12.206 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:12.199+0000 7f4de28e86c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f4ddc0fa420 con 0x7f4ddc1109f0 2026-02-13T02:17:12.206 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:12.199+0000 7f4de28e86c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f4ddc0fa590 con 0x7f4ddc10eec0 2026-02-13T02:17:12.206 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:12.199+0000 7f4de28e86c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f4ddc0fa750 con 0x7f4ddc110040 2026-02-13T02:17:12.206 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:12.199+0000 7f4de0e5e6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f4ddc1109f0 0x7f4ddc0f97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:12.206 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:12.199+0000 7f4de0e5e6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f4ddc1109f0 0x7f4ddc0f97f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:34624/0 (socket says 10.20.193.11:34624) 2026-02-13T02:17:12.206 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:12.199+0000 7f4de0e5e6c0 1 -- 10.20.193.11:0/3594275265 learned_addr learned my addr 10.20.193.11:0/3594275265 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:17:12.206 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:12.200+0000 7f4ddb7fe6c0 1 --2- 10.20.193.11:0/3594275265 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f4ddc110040 0x7f4ddc171380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:12.207 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:12.200+0000 7f4ddbfff6c0 1 --2- 10.20.193.11:0/3594275265 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f4ddc10eec0 0x7f4ddc0f8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:12.207 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:12.200+0000 7f4de0e5e6c0 1 -- 10.20.193.11:0/3594275265 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f4ddc110040 msgr2=0x7f4ddc171380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:12.207 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:12.200+0000 7f4de0e5e6c0 1 --2- 10.20.193.11:0/3594275265 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f4ddc110040 0x7f4ddc171380 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:12.207 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:12.200+0000 7f4de0e5e6c0 1 -- 10.20.193.11:0/3594275265 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f4ddc10eec0 msgr2=0x7f4ddc0f8f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:12.207 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:12.200+0000 7f4de0e5e6c0 1 --2- 10.20.193.11:0/3594275265 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f4ddc10eec0 0x7f4ddc0f8f90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:12.207 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:12.200+0000 7f4de0e5e6c0 1 -- 10.20.193.11:0/3594275265 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dd000a660 con 0x7f4ddc1109f0 2026-02-13T02:17:12.207 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:12.200+0000 7f4de0e5e6c0 1 --2- 10.20.193.11:0/3594275265 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f4ddc1109f0 0x7f4ddc0f97f0 secure :-1 s=READY pgs=140 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4dd000a390 tx=0x7f4dd0005490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:17:12.207 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:12.200+0000 7f4dd97fa6c0 1 -- 10.20.193.11:0/3594275265 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4dd0003c40 con 0x7f4ddc1109f0 2026-02-13T02:17:12.207 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:12.200+0000 7f4de28e86c0 1 -- 10.20.193.11:0/3594275265 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ddc0fa9d0 con 0x7f4ddc1109f0 2026-02-13T02:17:12.207 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:12.200+0000 7f4dd97fa6c0 1 -- 10.20.193.11:0/3594275265 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4dd0005740 con 0x7f4ddc1109f0 2026-02-13T02:17:12.207 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:12.200+0000 7f4dd97fa6c0 1 -- 10.20.193.11:0/3594275265 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4dd0038480 con 0x7f4ddc1109f0 2026-02-13T02:17:12.207 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:12.200+0000 7f4de28e86c0 1 -- 10.20.193.11:0/3594275265 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ddc0fae50 con 0x7f4ddc1109f0 2026-02-13T02:17:12.208 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:12.200+0000 7f4de28e86c0 1 -- 10.20.193.11:0/3594275265 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ddc0fb070 con 0x7f4ddc1109f0 2026-02-13T02:17:12.208 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:12.200+0000 7f4dd97fa6c0 1 -- 10.20.193.11:0/3594275265 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 8) ==== 52814+0+0 (secure 0 0 0) 0x7f4dd0038620 con 0x7f4ddc1109f0 2026-02-13T02:17:12.208 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:12.201+0000 7f4dd97fa6c0 1 --2- 10.20.193.11:0/3594275265 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f4db003f8f0 0x7f4db005fda0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:12.208 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:12.201+0000 7f4ddbfff6c0 1 --2- 10.20.193.11:0/3594275265 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f4db003f8f0 0x7f4db005fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:12.208 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:12.201+0000 7f4dd97fa6c0 1 -- 10.20.193.11:0/3594275265 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 935+0+0 (secure 0 0 0) 0x7f4dd00766d0 con 0x7f4ddc1109f0 2026-02-13T02:17:12.208 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:12.201+0000 7f4ddbfff6c0 1 --2- 10.20.193.11:0/3594275265 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f4db003f8f0 0x7f4db005fda0 secure :-1 s=READY pgs=73 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4dc8005980 tx=0x7f4dc8005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:17:12.209 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:12.202+0000 7f4dd97fa6c0 1 -- 10.20.193.11:0/3594275265 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f4dd0038900 con 0x7f4ddc1109f0 2026-02-13T02:17:12.212 INFO:journalctl@ceph.mgr.y.trial060.stdout:Feb 13 02:17:12 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-y[15958]: 2026-02-13T02:17:12.120+0000 7fa73b776fc0 -1 mgr[py] Loading module orchestrator in main interpreter 2026-02-13T02:17:12.212 INFO:journalctl@ceph.mgr.y.trial060.stdout:Feb 13 02:17:12 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-y[15958]: 2026-02-13T02:17:12.211+0000 7fa73b776fc0 -1 mgr[py] Loading module dashboard in main interpreter 2026-02-13T02:17:12.291 INFO:journalctl@ceph.mgr.z.trial078.stdout:Feb 13 02:17:11 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-z[16372]: 2026-02-13T02:17:11.911+0000 7f0e76c7bfc0 -1 mgr[py] Loading module test_orchestrator in main interpreter 2026-02-13T02:17:12.291 INFO:journalctl@ceph.mgr.z.trial078.stdout:Feb 13 02:17:11 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-z[16372]: 2026-02-13T02:17:11.912+0000 7f0e76c7bfc0 -1 mgr[py] Loading module selftest in main interpreter 2026-02-13T02:17:12.291 INFO:journalctl@ceph.mgr.z.trial078.stdout:Feb 13 02:17:11 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-z[16372]: 2026-02-13T02:17:11.915+0000 7f0e76c7bfc0 -1 mgr[py] Loading module cephadm in main interpreter 2026-02-13T02:17:12.291 INFO:journalctl@ceph.mgr.z.trial078.stdout:Feb 13 02:17:12 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-z[16372]: 2026-02-13T02:17:12.058+0000 7f0e76c7bfc0 -1 mgr[py] Loading module nfs in main interpreter 2026-02-13T02:17:12.291 INFO:journalctl@ceph.mgr.z.trial078.stdout:Feb 13 02:17:12 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-z[16372]: 2026-02-13T02:17:12.067+0000 7f0e76c7bfc0 -1 mgr[py] Loading module telemetry in main interpreter 2026-02-13T02:17:12.291 INFO:journalctl@ceph.mgr.z.trial078.stdout:Feb 13 02:17:12 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-z[16372]: 2026-02-13T02:17:12.074+0000 7f0e76c7bfc0 -1 mgr[py] Loading module progress in main interpreter 2026-02-13T02:17:12.292 INFO:journalctl@ceph.mgr.z.trial078.stdout:Feb 13 02:17:12 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-z[16372]: 2026-02-13T02:17:12.076+0000 7f0e76c7bfc0 -1 mgr[py] Loading module diskprediction_local in main interpreter 2026-02-13T02:17:12.292 INFO:journalctl@ceph.mgr.z.trial078.stdout:Feb 13 02:17:12 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-z[16372]: 2026-02-13T02:17:12.115+0000 7f0e76c7bfc0 -1 mgr[py] Loading module rook in main interpreter 2026-02-13T02:17:12.292 INFO:journalctl@ceph.mgr.z.trial078.stdout:Feb 13 02:17:12 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-z[16372]: 2026-02-13T02:17:12.146+0000 7f0e76c7bfc0 -1 mgr[py] Loading module balancer in main interpreter 2026-02-13T02:17:12.292 INFO:journalctl@ceph.mgr.z.trial078.stdout:Feb 13 02:17:12 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-z[16372]: 2026-02-13T02:17:12.152+0000 7f0e76c7bfc0 -1 mgr[py] Loading module osd_perf_query in main interpreter 2026-02-13T02:17:12.292 INFO:journalctl@ceph.mgr.z.trial078.stdout:Feb 13 02:17:12 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-z[16372]: 2026-02-13T02:17:12.153+0000 7f0e76c7bfc0 -1 mgr[py] Loading module status in main interpreter 2026-02-13T02:17:12.292 INFO:journalctl@ceph.mgr.z.trial078.stdout:Feb 13 02:17:12 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-z[16372]: 2026-02-13T02:17:12.155+0000 7f0e76c7bfc0 -1 mgr[py] Loading module osd_support in main interpreter 2026-02-13T02:17:12.294 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:12.292+0000 7f4de28e86c0 1 -- 10.20.193.11:0/3594275265 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f4ddc174a80 con 0x7f4ddc1109f0 2026-02-13T02:17:12.295 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:12.292+0000 7f4dd97fa6c0 1 -- 10.20.193.11:0/3594275265 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v32) ==== 59+0+19402 (secure 0 0 0) 0x7f4dd00348d0 con 0x7f4ddc1109f0 2026-02-13T02:17:12.296 INFO:teuthology.orchestra.run.trial011.stdout:WHO MASK LEVEL OPTION VALUE RO 2026-02-13T02:17:12.296 INFO:teuthology.orchestra.run.trial011.stdout:global dev auth_debug true 2026-02-13T02:17:12.296 INFO:teuthology.orchestra.run.trial011.stdout:global basic container_image quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 * 2026-02-13T02:17:12.296 INFO:teuthology.orchestra.run.trial011.stdout:global dev debug_asserts_on_shutdown true 2026-02-13T02:17:12.296 INFO:teuthology.orchestra.run.trial011.stdout:global basic log_to_file true 2026-02-13T02:17:12.296 INFO:teuthology.orchestra.run.trial011.stdout:global basic log_to_journald false 2026-02-13T02:17:12.296 INFO:teuthology.orchestra.run.trial011.stdout:global basic log_to_stderr false 2026-02-13T02:17:12.296 INFO:teuthology.orchestra.run.trial011.stdout:global advanced mon_allow_pool_delete true 2026-02-13T02:17:12.297 INFO:teuthology.orchestra.run.trial011.stdout:global advanced mon_clock_drift_allowed 1.000000 2026-02-13T02:17:12.297 INFO:teuthology.orchestra.run.trial011.stdout:global advanced mon_cluster_log_to_file true 2026-02-13T02:17:12.297 INFO:teuthology.orchestra.run.trial011.stdout:global advanced mon_max_pg_per_osd 10000 2026-02-13T02:17:12.297 INFO:teuthology.orchestra.run.trial011.stdout:global advanced mon_pg_warn_max_object_skew 0.000000 2026-02-13T02:17:12.297 INFO:teuthology.orchestra.run.trial011.stdout:global advanced mon_warn_on_crush_straw_calc_version_zero false 2026-02-13T02:17:12.297 INFO:teuthology.orchestra.run.trial011.stdout:global advanced mon_warn_on_legacy_crush_tunables false 2026-02-13T02:17:12.297 INFO:teuthology.orchestra.run.trial011.stdout:global advanced mon_warn_on_osd_down_out_interval_zero false 2026-02-13T02:17:12.297 INFO:teuthology.orchestra.run.trial011.stdout:global dev mon_warn_on_pool_pg_num_not_power_of_two false 2026-02-13T02:17:12.297 INFO:teuthology.orchestra.run.trial011.stdout:global advanced mon_warn_on_too_few_osds false 2026-02-13T02:17:12.297 INFO:teuthology.orchestra.run.trial011.stdout:global dev ms_die_on_bug true 2026-02-13T02:17:12.297 INFO:teuthology.orchestra.run.trial011.stdout:global dev ms_die_on_old_message true 2026-02-13T02:17:12.297 INFO:teuthology.orchestra.run.trial011.stdout:global dev ms_die_on_skipped_message false 2026-02-13T02:17:12.298 INFO:teuthology.orchestra.run.trial011.stdout:global advanced osd_pool_default_erasure_code_profile plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-13T02:17:12.298 INFO:teuthology.orchestra.run.trial011.stdout:global advanced osd_pool_default_pg_autoscale_mode off 2026-02-13T02:17:12.298 INFO:teuthology.orchestra.run.trial011.stdout:global advanced public_network 10.20.192.0/20 * 2026-02-13T02:17:12.298 INFO:teuthology.orchestra.run.trial011.stdout:mon advanced auth_allow_insecure_global_id_reclaim false 2026-02-13T02:17:12.298 INFO:teuthology.orchestra.run.trial011.stdout:mon advanced auth_mon_ticket_ttl 660.000000 2026-02-13T02:17:12.298 INFO:teuthology.orchestra.run.trial011.stdout:mon advanced auth_service_ticket_ttl 240.000000 2026-02-13T02:17:12.298 INFO:teuthology.orchestra.run.trial011.stdout:mon advanced debug_mon 20/20 2026-02-13T02:17:12.298 INFO:teuthology.orchestra.run.trial011.stdout:mon advanced debug_ms 1/1 2026-02-13T02:17:12.298 INFO:teuthology.orchestra.run.trial011.stdout:mon advanced debug_paxos 20/20 2026-02-13T02:17:12.298 INFO:teuthology.orchestra.run.trial011.stdout:mon advanced mon_data_avail_warn 5 2026-02-13T02:17:12.298 INFO:teuthology.orchestra.run.trial011.stdout:mon advanced mon_down_mkfs_grace 300 2026-02-13T02:17:12.298 INFO:teuthology.orchestra.run.trial011.stdout:mon advanced mon_mgr_mkfs_grace 240 2026-02-13T02:17:12.298 INFO:teuthology.orchestra.run.trial011.stdout:mon advanced mon_op_complaint_time 120 2026-02-13T02:17:12.299 INFO:teuthology.orchestra.run.trial011.stdout:mon dev mon_osd_prime_pg_temp true 2026-02-13T02:17:12.299 INFO:teuthology.orchestra.run.trial011.stdout:mon advanced mon_osd_reporter_subtree_level osd 2026-02-13T02:17:12.299 INFO:teuthology.orchestra.run.trial011.stdout:mon advanced mon_reweight_min_bytes_per_osd 10 2026-02-13T02:17:12.299 INFO:teuthology.orchestra.run.trial011.stdout:mon advanced mon_reweight_min_pgs_per_osd 4 2026-02-13T02:17:12.299 INFO:teuthology.orchestra.run.trial011.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim false 2026-02-13T02:17:12.299 INFO:teuthology.orchestra.run.trial011.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim_allowed false 2026-02-13T02:17:12.299 INFO:teuthology.orchestra.run.trial011.stdout:mgr advanced cephsqlite_lock_renewal_timeout 900000 2026-02-13T02:17:12.299 INFO:teuthology.orchestra.run.trial011.stdout:mgr advanced client_mount_timeout 30 2026-02-13T02:17:12.299 INFO:teuthology.orchestra.run.trial011.stdout:mgr advanced debug_client 20/20 2026-02-13T02:17:12.299 INFO:teuthology.orchestra.run.trial011.stdout:mgr advanced debug_mgr 20/20 2026-02-13T02:17:12.299 INFO:teuthology.orchestra.run.trial011.stdout:mgr advanced debug_ms 1/1 2026-02-13T02:17:12.299 INFO:teuthology.orchestra.run.trial011.stdout:mgr advanced mgr/cephadm/allow_ptrace true * 2026-02-13T02:17:12.299 INFO:teuthology.orchestra.run.trial011.stdout:mgr advanced mgr/cephadm/container_init True * 2026-02-13T02:17:12.300 INFO:teuthology.orchestra.run.trial011.stdout:mgr advanced mgr/cephadm/migration_current 8 * 2026-02-13T02:17:12.300 INFO:teuthology.orchestra.run.trial011.stdout:mgr advanced mgr/orchestrator/orchestrator cephadm 2026-02-13T02:17:12.300 INFO:teuthology.orchestra.run.trial011.stdout:mgr advanced mon_reweight_min_bytes_per_osd 10 2026-02-13T02:17:12.300 INFO:teuthology.orchestra.run.trial011.stdout:mgr advanced mon_reweight_min_pgs_per_osd 4 2026-02-13T02:17:12.300 INFO:teuthology.orchestra.run.trial011.stdout:mgr dev mon_warn_on_pool_no_app false 2026-02-13T02:17:12.300 INFO:teuthology.orchestra.run.trial011.stdout:osd advanced bdev_async_discard true 2026-02-13T02:17:12.300 INFO:teuthology.orchestra.run.trial011.stdout:osd dev bdev_debug_aio true 2026-02-13T02:17:12.300 INFO:teuthology.orchestra.run.trial011.stdout:osd advanced bdev_enable_discard true 2026-02-13T02:17:12.300 INFO:teuthology.orchestra.run.trial011.stdout:osd advanced bluestore_allocator bitmap * 2026-02-13T02:17:12.300 INFO:teuthology.orchestra.run.trial011.stdout:osd dev bluestore_block_size 96636764160 * 2026-02-13T02:17:12.300 INFO:teuthology.orchestra.run.trial011.stdout:osd dev bluestore_fsck_on_mount true 2026-02-13T02:17:12.300 INFO:teuthology.orchestra.run.trial011.stdout:osd advanced debug_bluefs 1/20 2026-02-13T02:17:12.301 INFO:teuthology.orchestra.run.trial011.stdout:osd advanced debug_bluestore 1/20 2026-02-13T02:17:12.301 INFO:teuthology.orchestra.run.trial011.stdout:osd advanced debug_ms 1/1 2026-02-13T02:17:12.301 INFO:teuthology.orchestra.run.trial011.stdout:osd advanced debug_osd 20/20 2026-02-13T02:17:12.301 INFO:teuthology.orchestra.run.trial011.stdout:osd advanced debug_rocksdb 4/10 2026-02-13T02:17:12.301 INFO:teuthology.orchestra.run.trial011.stdout:osd dev osd_debug_misdirected_ops true 2026-02-13T02:17:12.301 INFO:teuthology.orchestra.run.trial011.stdout:osd dev osd_debug_op_order true 2026-02-13T02:17:12.301 INFO:teuthology.orchestra.run.trial011.stdout:osd dev osd_debug_pg_log_writeout true 2026-02-13T02:17:12.301 INFO:teuthology.orchestra.run.trial011.stdout:osd dev osd_debug_shutdown true 2026-02-13T02:17:12.301 INFO:teuthology.orchestra.run.trial011.stdout:osd dev osd_debug_verify_cached_snaps true 2026-02-13T02:17:12.301 INFO:teuthology.orchestra.run.trial011.stdout:osd dev osd_debug_verify_missing_on_start true 2026-02-13T02:17:12.301 INFO:teuthology.orchestra.run.trial011.stdout:osd dev osd_debug_verify_stray_on_activate true 2026-02-13T02:17:12.301 INFO:teuthology.orchestra.run.trial011.stdout:osd advanced osd_deep_scrub_update_digest_min_age 30 2026-02-13T02:17:12.301 INFO:teuthology.orchestra.run.trial011.stdout:osd advanced osd_failsafe_full_ratio 0.950000 2026-02-13T02:17:12.302 INFO:teuthology.orchestra.run.trial011.stdout:osd advanced osd_max_omap_entries_per_request 10000 2026-02-13T02:17:12.302 INFO:teuthology.orchestra.run.trial011.stdout:osd advanced osd_mclock_profile high_recovery_ops 2026-02-13T02:17:12.302 INFO:teuthology.orchestra.run.trial011.stdout:osd dev osd_mclock_skip_benchmark true 2026-02-13T02:17:12.302 INFO:teuthology.orchestra.run.trial011.stdout:osd advanced osd_memory_target_autotune true 2026-02-13T02:17:12.302 INFO:teuthology.orchestra.run.trial011.stdout:osd advanced osd_objectstore bluestore * 2026-02-13T02:17:12.302 INFO:teuthology.orchestra.run.trial011.stdout:osd advanced osd_op_complaint_time 180.000000 2026-02-13T02:17:12.302 INFO:teuthology.orchestra.run.trial011.stdout:osd advanced osd_op_queue debug_random * 2026-02-13T02:17:12.302 INFO:teuthology.orchestra.run.trial011.stdout:osd advanced osd_op_queue_cut_off debug_random * 2026-02-13T02:17:12.302 INFO:teuthology.orchestra.run.trial011.stdout:osd advanced osd_recover_clone_overlap true 2026-02-13T02:17:12.302 INFO:teuthology.orchestra.run.trial011.stdout:osd advanced osd_recovery_max_chunk 1048576 2026-02-13T02:17:12.302 INFO:teuthology.orchestra.run.trial011.stdout:osd advanced osd_scrub_load_threshold 5.000000 2026-02-13T02:17:12.302 INFO:teuthology.orchestra.run.trial011.stdout:osd advanced osd_scrub_max_interval 600.000000 2026-02-13T02:17:12.303 INFO:teuthology.orchestra.run.trial011.stdout:osd advanced osd_shutdown_pgref_assert true 2026-02-13T02:17:12.303 INFO:teuthology.orchestra.run.trial011.stdout:mds advanced debug_mds 20/20 2026-02-13T02:17:12.303 INFO:teuthology.orchestra.run.trial011.stdout:mds advanced debug_mds_balancer 20/20 2026-02-13T02:17:12.303 INFO:teuthology.orchestra.run.trial011.stdout:mds advanced debug_ms 2/2 2026-02-13T02:17:12.303 INFO:teuthology.orchestra.run.trial011.stdout:mds advanced mds_bal_fragment_size_max 10000 2026-02-13T02:17:12.303 INFO:teuthology.orchestra.run.trial011.stdout:mds advanced mds_bal_merge_size 5 2026-02-13T02:17:12.303 INFO:teuthology.orchestra.run.trial011.stdout:mds advanced mds_bal_replicate_threshold 1.000000 2026-02-13T02:17:12.303 INFO:teuthology.orchestra.run.trial011.stdout:mds advanced mds_bal_split_bits 3 2026-02-13T02:17:12.303 INFO:teuthology.orchestra.run.trial011.stdout:mds advanced mds_bal_split_size 100 2026-02-13T02:17:12.303 INFO:teuthology.orchestra.run.trial011.stdout:mds dev mds_debug_frag true 2026-02-13T02:17:12.303 INFO:teuthology.orchestra.run.trial011.stdout:mds dev mds_debug_scatterstat true 2026-02-13T02:17:12.303 INFO:teuthology.orchestra.run.trial011.stdout:mds advanced mds_export_ephemeral_random_max 0.200000 2026-02-13T02:17:12.303 INFO:teuthology.orchestra.run.trial011.stdout:mds advanced mds_op_complaint_time 180.000000 2026-02-13T02:17:12.304 INFO:teuthology.orchestra.run.trial011.stdout:mds dev mds_verify_scatter true 2026-02-13T02:17:12.304 INFO:teuthology.orchestra.run.trial011.stdout:mds advanced osd_op_complaint_time 180.000000 2026-02-13T02:17:12.304 INFO:teuthology.orchestra.run.trial011.stdout:mds advanced rados_mon_op_timeout 900 2026-02-13T02:17:12.304 INFO:teuthology.orchestra.run.trial011.stdout:mds advanced rados_osd_op_timeout 900 2026-02-13T02:17:12.304 INFO:teuthology.orchestra.run.trial011.stdout:client dev client_fscrypt_dummy_encryption true 2026-02-13T02:17:12.304 INFO:teuthology.orchestra.run.trial011.stdout:client advanced client_mount_timeout 600 2026-02-13T02:17:12.304 INFO:teuthology.orchestra.run.trial011.stdout:client advanced debug_client 20/20 2026-02-13T02:17:12.304 INFO:teuthology.orchestra.run.trial011.stdout:client advanced debug_ms 1/1 2026-02-13T02:17:12.304 INFO:teuthology.orchestra.run.trial011.stdout:client advanced rados_mon_op_timeout 900 2026-02-13T02:17:12.304 INFO:teuthology.orchestra.run.trial011.stdout:client advanced rados_osd_op_timeout 900 2026-02-13T02:17:12.304 INFO:teuthology.orchestra.run.trial011.stdout:client.rgw advanced rgw_cache_enabled true 2026-02-13T02:17:12.304 INFO:teuthology.orchestra.run.trial011.stdout:client.rgw advanced rgw_enable_ops_log true 2026-02-13T02:17:12.304 INFO:teuthology.orchestra.run.trial011.stdout:client.rgw advanced rgw_enable_usage_log true 2026-02-13T02:17:12.305 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:12.293+0000 7f4de28e86c0 1 -- 10.20.193.11:0/3594275265 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f4db003f8f0 msgr2=0x7f4db005fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:12.306 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:12.293+0000 7f4de28e86c0 1 --2- 10.20.193.11:0/3594275265 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f4db003f8f0 0x7f4db005fda0 secure :-1 s=READY pgs=73 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4dc8005980 tx=0x7f4dc8005910 comp rx=0 tx=0).stop 2026-02-13T02:17:12.306 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:12.293+0000 7f4de28e86c0 1 -- 10.20.193.11:0/3594275265 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f4ddc1109f0 msgr2=0x7f4ddc0f97f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:12.306 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:12.293+0000 7f4de28e86c0 1 --2- 10.20.193.11:0/3594275265 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f4ddc1109f0 0x7f4ddc0f97f0 secure :-1 s=READY pgs=140 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4dd000a390 tx=0x7f4dd0005490 comp rx=0 tx=0).stop 2026-02-13T02:17:12.306 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:12.293+0000 7f4de28e86c0 1 -- 10.20.193.11:0/3594275265 shutdown_connections 2026-02-13T02:17:12.306 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:12.293+0000 7f4de28e86c0 1 --2- 10.20.193.11:0/3594275265 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f4db003f8f0 0x7f4db005fda0 unknown :-1 s=CLOSED pgs=73 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:12.306 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:12.293+0000 7f4de28e86c0 1 --2- 10.20.193.11:0/3594275265 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f4ddc1109f0 0x7f4ddc0f97f0 unknown :-1 s=CLOSED pgs=140 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:12.306 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:12.293+0000 7f4de28e86c0 1 --2- 10.20.193.11:0/3594275265 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f4ddc110040 0x7f4ddc171380 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:12.306 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:12.293+0000 7f4de28e86c0 1 --2- 10.20.193.11:0/3594275265 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f4ddc10eec0 0x7f4ddc0f8f90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:12.306 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:12.293+0000 7f4de28e86c0 1 -- 10.20.193.11:0/3594275265 >> 10.20.193.11:0/3594275265 conn(0x7f4ddc0ec5c0 msgr2=0x7f4ddc0ef570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:17:12.306 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:12.293+0000 7f4de28e86c0 1 -- 10.20.193.11:0/3594275265 shutdown_connections 2026-02-13T02:17:12.306 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:12.293+0000 7f4de28e86c0 1 -- 10.20.193.11:0/3594275265 wait complete. 2026-02-13T02:17:12.333 INFO:tasks.cephadm:Deploying OSDs... 2026-02-13T02:17:12.333 DEBUG:teuthology.orchestra.run.trial011:> set -ex 2026-02-13T02:17:12.333 DEBUG:teuthology.orchestra.run.trial011:> dd if=/scratch_devs of=/dev/stdout 2026-02-13T02:17:12.352 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-13T02:17:12.352 DEBUG:teuthology.orchestra.run.trial011:> stat /dev/vg_nvme/lv_1 2026-02-13T02:17:12.409 INFO:teuthology.orchestra.run.trial011.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-13T02:17:12.410 INFO:teuthology.orchestra.run.trial011.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T02:17:12.410 INFO:teuthology.orchestra.run.trial011.stdout:Device: 0,6 Inode: 888 Links: 1 2026-02-13T02:17:12.410 INFO:teuthology.orchestra.run.trial011.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T02:17:12.410 INFO:teuthology.orchestra.run.trial011.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T02:17:12.410 INFO:teuthology.orchestra.run.trial011.stdout:Access: 2026-02-13 02:16:48.501504122 +0000 2026-02-13T02:17:12.410 INFO:teuthology.orchestra.run.trial011.stdout:Modify: 2026-02-13 02:15:23.444508290 +0000 2026-02-13T02:17:12.410 INFO:teuthology.orchestra.run.trial011.stdout:Change: 2026-02-13 02:15:23.444508290 +0000 2026-02-13T02:17:12.410 INFO:teuthology.orchestra.run.trial011.stdout: Birth: 2026-02-13 02:15:23.444508290 +0000 2026-02-13T02:17:12.411 DEBUG:teuthology.orchestra.run.trial011:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-13T02:17:12.476 INFO:teuthology.orchestra.run.trial011.stderr:1+0 records in 2026-02-13T02:17:12.476 INFO:teuthology.orchestra.run.trial011.stderr:1+0 records out 2026-02-13T02:17:12.476 INFO:teuthology.orchestra.run.trial011.stderr:512 bytes copied, 0.000153646 s, 3.3 MB/s 2026-02-13T02:17:12.478 DEBUG:teuthology.orchestra.run.trial011:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-13T02:17:12.490 INFO:journalctl@ceph.mgr.y.trial060.stdout:Feb 13 02:17:12 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-y[15958]: 2026-02-13T02:17:12.416+0000 7fa73b776fc0 -1 mgr[py] Loading module alerts in main interpreter 2026-02-13T02:17:12.490 INFO:journalctl@ceph.mgr.y.trial060.stdout:Feb 13 02:17:12 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-y[15958]: 2026-02-13T02:17:12.417+0000 7fa73b776fc0 -1 mgr[py] Loading module smb in main interpreter 2026-02-13T02:17:12.490 INFO:journalctl@ceph.mgr.y.trial060.stdout:Feb 13 02:17:12 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-y[15958]: 2026-02-13T02:17:12.442+0000 7fa73b776fc0 -1 mgr[py] Loading module snap_schedule in main interpreter 2026-02-13T02:17:12.490 INFO:journalctl@ceph.mgr.y.trial060.stdout:Feb 13 02:17:12 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-y[15958]: 2026-02-13T02:17:12.449+0000 7fa73b776fc0 -1 mgr[py] Loading module stats in main interpreter 2026-02-13T02:17:12.490 INFO:journalctl@ceph.mgr.y.trial060.stdout:Feb 13 02:17:12 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-y[15958]: 2026-02-13T02:17:12.451+0000 7fa73b776fc0 -1 mgr[py] Loading module devicehealth in main interpreter 2026-02-13T02:17:12.491 INFO:journalctl@ceph.mgr.y.trial060.stdout:Feb 13 02:17:12 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-y[15958]: 2026-02-13T02:17:12.454+0000 7fa73b776fc0 -1 mgr[py] Loading module iostat in main interpreter 2026-02-13T02:17:12.491 INFO:journalctl@ceph.mgr.y.trial060.stdout:Feb 13 02:17:12 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-y[15958]: 2026-02-13T02:17:12.455+0000 7fa73b776fc0 -1 mgr[py] Loading module influx in main interpreter 2026-02-13T02:17:12.491 INFO:journalctl@ceph.mgr.y.trial060.stdout:Feb 13 02:17:12 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-y[15958]: 2026-02-13T02:17:12.457+0000 7fa73b776fc0 -1 mgr[py] Loading module telegraf in main interpreter 2026-02-13T02:17:12.491 INFO:journalctl@ceph.mgr.y.trial060.stdout:Feb 13 02:17:12 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-y[15958]: 2026-02-13T02:17:12.459+0000 7fa73b776fc0 -1 mgr[py] Loading module volumes in main interpreter 2026-02-13T02:17:12.491 INFO:journalctl@ceph.mgr.y.trial060.stdout:Feb 13 02:17:12 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-y[15958]: 2026-02-13T02:17:12.489+0000 7fa73b776fc0 -1 mgr[py] Loading module rbd_support in main interpreter 2026-02-13T02:17:12.491 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:12 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/971774583' entity='client.admin' 2026-02-13T02:17:12.491 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:12 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/336177196' entity='client.admin' 2026-02-13T02:17:12.491 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:12 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:12.491 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:12 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:12.492 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:12 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:12.492 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:12 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-13T02:17:12.492 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:12 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-02-13T02:17:12.492 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:12 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-13T02:17:12.492 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:12 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:12.492 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:12 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/1318020250' entity='client.admin' 2026-02-13T02:17:12.492 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:12 trial060 ceph-mon[14797]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T02:17:12.492 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:12 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/1838688982' entity='client.admin' 2026-02-13T02:17:12.492 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:12 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/2441853076' entity='client.admin' 2026-02-13T02:17:12.492 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:12 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/3209558962' entity='client.admin' 2026-02-13T02:17:12.492 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:12 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/2179077860' entity='client.admin' 2026-02-13T02:17:12.492 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:12 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/1419240367' entity='client.admin' 2026-02-13T02:17:12.493 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:12 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/2265151936' entity='client.admin' 2026-02-13T02:17:12.493 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:12 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/3215374523' entity='client.admin' 2026-02-13T02:17:12.493 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:12 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/2207396411' entity='client.admin' 2026-02-13T02:17:12.493 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:12 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/1050377170' entity='client.admin' 2026-02-13T02:17:12.493 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:12 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/4041610032' entity='client.admin' 2026-02-13T02:17:12.493 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:12 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/2201656460' entity='client.admin' 2026-02-13T02:17:12.493 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:12 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/2266448957' entity='client.admin' 2026-02-13T02:17:12.493 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:12 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/2615278576' entity='client.admin' 2026-02-13T02:17:12.493 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:12 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/233226243' entity='client.admin' 2026-02-13T02:17:12.493 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:12 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/3253384130' entity='client.admin' 2026-02-13T02:17:12.493 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:12 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/2313699882' entity='client.admin' 2026-02-13T02:17:12.493 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:12 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/916440633' entity='client.admin' 2026-02-13T02:17:12.493 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:12 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:12.494 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:12 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:12.494 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:12 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:12.494 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:12 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:12.494 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:12 trial060 ceph-mon[14797]: Standby manager daemon z started 2026-02-13T02:17:12.494 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:12 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:17:12.494 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:12 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/3594275265' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2026-02-13T02:17:12.537 DEBUG:teuthology.orchestra.run.trial011:> stat /dev/vg_nvme/lv_2 2026-02-13T02:17:12.596 INFO:teuthology.orchestra.run.trial011.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-13T02:17:12.596 INFO:teuthology.orchestra.run.trial011.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T02:17:12.596 INFO:teuthology.orchestra.run.trial011.stdout:Device: 0,6 Inode: 898 Links: 1 2026-02-13T02:17:12.596 INFO:teuthology.orchestra.run.trial011.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T02:17:12.596 INFO:teuthology.orchestra.run.trial011.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T02:17:12.596 INFO:teuthology.orchestra.run.trial011.stdout:Access: 2026-02-13 02:16:48.501504122 +0000 2026-02-13T02:17:12.596 INFO:teuthology.orchestra.run.trial011.stdout:Modify: 2026-02-13 02:15:23.726502983 +0000 2026-02-13T02:17:12.597 INFO:teuthology.orchestra.run.trial011.stdout:Change: 2026-02-13 02:15:23.726502983 +0000 2026-02-13T02:17:12.597 INFO:teuthology.orchestra.run.trial011.stdout: Birth: 2026-02-13 02:15:23.726502983 +0000 2026-02-13T02:17:12.597 DEBUG:teuthology.orchestra.run.trial011:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-13T02:17:12.658 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:12 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/971774583' entity='client.admin' 2026-02-13T02:17:12.658 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:12 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/336177196' entity='client.admin' 2026-02-13T02:17:12.658 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:12 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:12.658 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:12 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:12.658 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:12 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:12.658 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:12 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-13T02:17:12.658 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:12 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-02-13T02:17:12.659 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:12 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-13T02:17:12.659 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:12 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:12.659 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:12 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/1318020250' entity='client.admin' 2026-02-13T02:17:12.659 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:12 trial011 ceph-mon[11956]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T02:17:12.659 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:12 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/1838688982' entity='client.admin' 2026-02-13T02:17:12.659 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:12 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/2441853076' entity='client.admin' 2026-02-13T02:17:12.659 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:12 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/3209558962' entity='client.admin' 2026-02-13T02:17:12.659 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:12 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/2179077860' entity='client.admin' 2026-02-13T02:17:12.659 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:12 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/1419240367' entity='client.admin' 2026-02-13T02:17:12.659 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:12 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/2265151936' entity='client.admin' 2026-02-13T02:17:12.659 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:12 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/3215374523' entity='client.admin' 2026-02-13T02:17:12.659 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:12 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/2207396411' entity='client.admin' 2026-02-13T02:17:12.660 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:12 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/1050377170' entity='client.admin' 2026-02-13T02:17:12.660 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:12 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/4041610032' entity='client.admin' 2026-02-13T02:17:12.660 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:12 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/2201656460' entity='client.admin' 2026-02-13T02:17:12.660 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:12 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/2266448957' entity='client.admin' 2026-02-13T02:17:12.660 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:12 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/2615278576' entity='client.admin' 2026-02-13T02:17:12.660 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:12 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/233226243' entity='client.admin' 2026-02-13T02:17:12.660 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:12 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/3253384130' entity='client.admin' 2026-02-13T02:17:12.660 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:12 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/2313699882' entity='client.admin' 2026-02-13T02:17:12.660 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:12 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/916440633' entity='client.admin' 2026-02-13T02:17:12.660 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:12 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:12.660 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:12 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:12.660 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:12 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:12.660 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:12 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:12.661 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:12 trial011 ceph-mon[11956]: Standby manager daemon z started 2026-02-13T02:17:12.661 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:12 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:17:12.661 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:12 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/3594275265' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2026-02-13T02:17:12.662 INFO:teuthology.orchestra.run.trial011.stderr:1+0 records in 2026-02-13T02:17:12.662 INFO:teuthology.orchestra.run.trial011.stderr:1+0 records out 2026-02-13T02:17:12.662 INFO:teuthology.orchestra.run.trial011.stderr:512 bytes copied, 0.00014028 s, 3.6 MB/s 2026-02-13T02:17:12.662 DEBUG:teuthology.orchestra.run.trial011:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-13T02:17:12.721 DEBUG:teuthology.orchestra.run.trial011:> stat /dev/vg_nvme/lv_3 2026-02-13T02:17:12.750 INFO:journalctl@ceph.mgr.y.trial060.stdout:Feb 13 02:17:12 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-y[15958]: 2026-02-13T02:17:12.502+0000 7fa73b776fc0 -1 mgr[py] Loading module mirroring in main interpreter 2026-02-13T02:17:12.750 INFO:journalctl@ceph.mgr.y.trial060.stdout:Feb 13 02:17:12 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-y[15958]: 2026-02-13T02:17:12.511+0000 7fa73b776fc0 -1 mgr[py] Loading module rgw in main interpreter 2026-02-13T02:17:12.750 INFO:journalctl@ceph.mgr.y.trial060.stdout:Feb 13 02:17:12 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-y[15958]: 2026-02-13T02:17:12.515+0000 7fa73b776fc0 -1 mgr[py] Loading module pg_autoscaler in main interpreter 2026-02-13T02:17:12.750 INFO:journalctl@ceph.mgr.y.trial060.stdout:Feb 13 02:17:12 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-y[15958]: 2026-02-13T02:17:12.518+0000 7fa73b776fc0 -1 mgr[py] Loading module mds_autoscaler in main interpreter 2026-02-13T02:17:12.750 INFO:journalctl@ceph.mgr.y.trial060.stdout:Feb 13 02:17:12 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-y[15958]: 2026-02-13T02:17:12.519+0000 7fa73b776fc0 -1 mgr[py] Loading module localpool in main interpreter 2026-02-13T02:17:12.751 INFO:journalctl@ceph.mgr.y.trial060.stdout:Feb 13 02:17:12 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-y[15958]: 2026-02-13T02:17:12.520+0000 7fa73b776fc0 -1 mgr[py] Loading module k8sevents in main interpreter 2026-02-13T02:17:12.751 INFO:journalctl@ceph.mgr.y.trial060.stdout:Feb 13 02:17:12 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-y[15958]: 2026-02-13T02:17:12.654+0000 7fa73b776fc0 -1 mgr[py] Loading module crash in main interpreter 2026-02-13T02:17:12.751 INFO:journalctl@ceph.mgr.y.trial060.stdout:Feb 13 02:17:12 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-y[15958]: 2026-02-13T02:17:12.656+0000 7fa73b776fc0 -1 mgr[py] Loading module prometheus in main interpreter 2026-02-13T02:17:12.751 INFO:journalctl@ceph.mgr.y.trial060.stdout:Feb 13 02:17:12 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-y[15958]: 2026-02-13T02:17:12.664+0000 7fa73b776fc0 -1 mgr[py] Loading module insights in main interpreter 2026-02-13T02:17:12.751 INFO:journalctl@ceph.mgr.y.trial060.stdout:Feb 13 02:17:12 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-y[15958]: 2026-02-13T02:17:12.666+0000 7fa73b776fc0 -1 mgr[py] Loading module test_orchestrator in main interpreter 2026-02-13T02:17:12.751 INFO:journalctl@ceph.mgr.y.trial060.stdout:Feb 13 02:17:12 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-y[15958]: 2026-02-13T02:17:12.667+0000 7fa73b776fc0 -1 mgr[py] Loading module selftest in main interpreter 2026-02-13T02:17:12.751 INFO:journalctl@ceph.mgr.y.trial060.stdout:Feb 13 02:17:12 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-y[15958]: 2026-02-13T02:17:12.670+0000 7fa73b776fc0 -1 mgr[py] Loading module cephadm in main interpreter 2026-02-13T02:17:12.781 INFO:teuthology.orchestra.run.trial011.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-13T02:17:12.781 INFO:teuthology.orchestra.run.trial011.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T02:17:12.781 INFO:teuthology.orchestra.run.trial011.stdout:Device: 0,6 Inode: 910 Links: 1 2026-02-13T02:17:12.781 INFO:teuthology.orchestra.run.trial011.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T02:17:12.781 INFO:teuthology.orchestra.run.trial011.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T02:17:12.781 INFO:teuthology.orchestra.run.trial011.stdout:Access: 2026-02-13 02:16:48.501504122 +0000 2026-02-13T02:17:12.782 INFO:teuthology.orchestra.run.trial011.stdout:Modify: 2026-02-13 02:15:24.033497206 +0000 2026-02-13T02:17:12.782 INFO:teuthology.orchestra.run.trial011.stdout:Change: 2026-02-13 02:15:24.033497206 +0000 2026-02-13T02:17:12.782 INFO:teuthology.orchestra.run.trial011.stdout: Birth: 2026-02-13 02:15:24.033497206 +0000 2026-02-13T02:17:12.782 DEBUG:teuthology.orchestra.run.trial011:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-13T02:17:12.791 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:12 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/971774583' entity='client.admin' 2026-02-13T02:17:12.791 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:12 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/336177196' entity='client.admin' 2026-02-13T02:17:12.791 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:12 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:12.792 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:12 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:12.792 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:12 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:12.792 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:12 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-13T02:17:12.792 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:12 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-02-13T02:17:12.792 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:12 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-13T02:17:12.792 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:12 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:12.792 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:12 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/1318020250' entity='client.admin' 2026-02-13T02:17:12.792 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:12 trial078 ceph-mon[14969]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T02:17:12.792 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:12 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/1838688982' entity='client.admin' 2026-02-13T02:17:12.792 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:12 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/2441853076' entity='client.admin' 2026-02-13T02:17:12.792 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:12 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/3209558962' entity='client.admin' 2026-02-13T02:17:12.792 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:12 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/2179077860' entity='client.admin' 2026-02-13T02:17:12.793 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:12 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/1419240367' entity='client.admin' 2026-02-13T02:17:12.793 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:12 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/2265151936' entity='client.admin' 2026-02-13T02:17:12.793 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:12 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/3215374523' entity='client.admin' 2026-02-13T02:17:12.793 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:12 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/2207396411' entity='client.admin' 2026-02-13T02:17:12.793 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:12 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/1050377170' entity='client.admin' 2026-02-13T02:17:12.793 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:12 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/4041610032' entity='client.admin' 2026-02-13T02:17:12.793 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:12 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/2201656460' entity='client.admin' 2026-02-13T02:17:12.793 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:12 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/2266448957' entity='client.admin' 2026-02-13T02:17:12.793 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:12 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/2615278576' entity='client.admin' 2026-02-13T02:17:12.793 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:12 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/233226243' entity='client.admin' 2026-02-13T02:17:12.793 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:12 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/3253384130' entity='client.admin' 2026-02-13T02:17:12.793 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:12 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/2313699882' entity='client.admin' 2026-02-13T02:17:12.794 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:12 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/916440633' entity='client.admin' 2026-02-13T02:17:12.794 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:12 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:12.794 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:12 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:12.794 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:12 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:12.794 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:12 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:12.794 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:12 trial078 ceph-mon[14969]: Standby manager daemon z started 2026-02-13T02:17:12.794 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:12 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:17:12.794 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:12 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/3594275265' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2026-02-13T02:17:12.848 INFO:teuthology.orchestra.run.trial011.stderr:1+0 records in 2026-02-13T02:17:12.848 INFO:teuthology.orchestra.run.trial011.stderr:1+0 records out 2026-02-13T02:17:12.848 INFO:teuthology.orchestra.run.trial011.stderr:512 bytes copied, 0.00020953 s, 2.4 MB/s 2026-02-13T02:17:12.850 DEBUG:teuthology.orchestra.run.trial011:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-13T02:17:12.908 DEBUG:teuthology.orchestra.run.trial011:> stat /dev/vg_nvme/lv_4 2026-02-13T02:17:12.965 INFO:teuthology.orchestra.run.trial011.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-13T02:17:12.965 INFO:teuthology.orchestra.run.trial011.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T02:17:12.965 INFO:teuthology.orchestra.run.trial011.stdout:Device: 0,6 Inode: 921 Links: 1 2026-02-13T02:17:12.965 INFO:teuthology.orchestra.run.trial011.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T02:17:12.965 INFO:teuthology.orchestra.run.trial011.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T02:17:12.965 INFO:teuthology.orchestra.run.trial011.stdout:Access: 2026-02-13 02:16:48.501504122 +0000 2026-02-13T02:17:12.965 INFO:teuthology.orchestra.run.trial011.stdout:Modify: 2026-02-13 02:15:24.317491861 +0000 2026-02-13T02:17:12.965 INFO:teuthology.orchestra.run.trial011.stdout:Change: 2026-02-13 02:15:24.317491861 +0000 2026-02-13T02:17:12.965 INFO:teuthology.orchestra.run.trial011.stdout: Birth: 2026-02-13 02:15:24.317491861 +0000 2026-02-13T02:17:12.965 DEBUG:teuthology.orchestra.run.trial011:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-13T02:17:13.031 INFO:teuthology.orchestra.run.trial011.stderr:1+0 records in 2026-02-13T02:17:13.031 INFO:teuthology.orchestra.run.trial011.stderr:1+0 records out 2026-02-13T02:17:13.031 INFO:teuthology.orchestra.run.trial011.stderr:512 bytes copied, 0.000135802 s, 3.8 MB/s 2026-02-13T02:17:13.032 DEBUG:teuthology.orchestra.run.trial011:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-13T02:17:13.091 DEBUG:teuthology.orchestra.run.trial060:> set -ex 2026-02-13T02:17:13.092 DEBUG:teuthology.orchestra.run.trial060:> dd if=/scratch_devs of=/dev/stdout 2026-02-13T02:17:13.112 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-13T02:17:13.112 DEBUG:teuthology.orchestra.run.trial060:> stat /dev/vg_nvme/lv_1 2026-02-13T02:17:13.170 INFO:teuthology.orchestra.run.trial060.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-13T02:17:13.171 INFO:teuthology.orchestra.run.trial060.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T02:17:13.171 INFO:teuthology.orchestra.run.trial060.stdout:Device: 0,6 Inode: 885 Links: 1 2026-02-13T02:17:13.171 INFO:teuthology.orchestra.run.trial060.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T02:17:13.171 INFO:teuthology.orchestra.run.trial060.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T02:17:13.171 INFO:teuthology.orchestra.run.trial060.stdout:Access: 2026-02-13 02:17:11.902554412 +0000 2026-02-13T02:17:13.171 INFO:teuthology.orchestra.run.trial060.stdout:Modify: 2026-02-13 02:15:25.197450728 +0000 2026-02-13T02:17:13.171 INFO:teuthology.orchestra.run.trial060.stdout:Change: 2026-02-13 02:15:25.197450728 +0000 2026-02-13T02:17:13.171 INFO:teuthology.orchestra.run.trial060.stdout: Birth: 2026-02-13 02:15:25.197450728 +0000 2026-02-13T02:17:13.172 DEBUG:teuthology.orchestra.run.trial060:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-13T02:17:13.235 INFO:journalctl@ceph.mgr.y.trial060.stdout:Feb 13 02:17:12 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-y[15958]: 2026-02-13T02:17:12.810+0000 7fa73b776fc0 -1 mgr[py] Loading module nfs in main interpreter 2026-02-13T02:17:13.235 INFO:journalctl@ceph.mgr.y.trial060.stdout:Feb 13 02:17:12 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-y[15958]: 2026-02-13T02:17:12.820+0000 7fa73b776fc0 -1 mgr[py] Loading module telemetry in main interpreter 2026-02-13T02:17:13.235 INFO:journalctl@ceph.mgr.y.trial060.stdout:Feb 13 02:17:12 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-y[15958]: 2026-02-13T02:17:12.826+0000 7fa73b776fc0 -1 mgr[py] Loading module progress in main interpreter 2026-02-13T02:17:13.235 INFO:journalctl@ceph.mgr.y.trial060.stdout:Feb 13 02:17:12 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-y[15958]: 2026-02-13T02:17:12.829+0000 7fa73b776fc0 -1 mgr[py] Loading module diskprediction_local in main interpreter 2026-02-13T02:17:13.235 INFO:journalctl@ceph.mgr.y.trial060.stdout:Feb 13 02:17:12 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-y[15958]: 2026-02-13T02:17:12.868+0000 7fa73b776fc0 -1 mgr[py] Loading module rook in main interpreter 2026-02-13T02:17:13.235 INFO:journalctl@ceph.mgr.y.trial060.stdout:Feb 13 02:17:12 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-y[15958]: 2026-02-13T02:17:12.897+0000 7fa73b776fc0 -1 mgr[py] Loading module balancer in main interpreter 2026-02-13T02:17:13.235 INFO:journalctl@ceph.mgr.y.trial060.stdout:Feb 13 02:17:12 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-y[15958]: 2026-02-13T02:17:12.903+0000 7fa73b776fc0 -1 mgr[py] Loading module osd_perf_query in main interpreter 2026-02-13T02:17:13.235 INFO:journalctl@ceph.mgr.y.trial060.stdout:Feb 13 02:17:12 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-y[15958]: 2026-02-13T02:17:12.904+0000 7fa73b776fc0 -1 mgr[py] Loading module status in main interpreter 2026-02-13T02:17:13.235 INFO:journalctl@ceph.mgr.y.trial060.stdout:Feb 13 02:17:12 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-y[15958]: 2026-02-13T02:17:12.906+0000 7fa73b776fc0 -1 mgr[py] Loading module osd_support in main interpreter 2026-02-13T02:17:13.237 INFO:teuthology.orchestra.run.trial060.stderr:1+0 records in 2026-02-13T02:17:13.238 INFO:teuthology.orchestra.run.trial060.stderr:1+0 records out 2026-02-13T02:17:13.238 INFO:teuthology.orchestra.run.trial060.stderr:512 bytes copied, 0.000147264 s, 3.5 MB/s 2026-02-13T02:17:13.239 DEBUG:teuthology.orchestra.run.trial060:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-13T02:17:13.298 DEBUG:teuthology.orchestra.run.trial060:> stat /dev/vg_nvme/lv_2 2026-02-13T02:17:13.356 INFO:teuthology.orchestra.run.trial060.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-13T02:17:13.356 INFO:teuthology.orchestra.run.trial060.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T02:17:13.357 INFO:teuthology.orchestra.run.trial060.stdout:Device: 0,6 Inode: 892 Links: 1 2026-02-13T02:17:13.357 INFO:teuthology.orchestra.run.trial060.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T02:17:13.357 INFO:teuthology.orchestra.run.trial060.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T02:17:13.357 INFO:teuthology.orchestra.run.trial060.stdout:Access: 2026-02-13 02:17:11.903554403 +0000 2026-02-13T02:17:13.357 INFO:teuthology.orchestra.run.trial060.stdout:Modify: 2026-02-13 02:15:25.449447717 +0000 2026-02-13T02:17:13.357 INFO:teuthology.orchestra.run.trial060.stdout:Change: 2026-02-13 02:15:25.449447717 +0000 2026-02-13T02:17:13.357 INFO:teuthology.orchestra.run.trial060.stdout: Birth: 2026-02-13 02:15:25.449447717 +0000 2026-02-13T02:17:13.357 DEBUG:teuthology.orchestra.run.trial060:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-13T02:17:13.421 INFO:teuthology.orchestra.run.trial060.stderr:1+0 records in 2026-02-13T02:17:13.421 INFO:teuthology.orchestra.run.trial060.stderr:1+0 records out 2026-02-13T02:17:13.421 INFO:teuthology.orchestra.run.trial060.stderr:512 bytes copied, 0.000130212 s, 3.9 MB/s 2026-02-13T02:17:13.422 DEBUG:teuthology.orchestra.run.trial060:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-13T02:17:13.481 DEBUG:teuthology.orchestra.run.trial060:> stat /dev/vg_nvme/lv_3 2026-02-13T02:17:13.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:13 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:13.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:13 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:13.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:13 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:13.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:13 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:13.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:13 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:13.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:13 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:13.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:13 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:17:13.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:13 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:13.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:13 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-13T02:17:13.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:13 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-13T02:17:13.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:13 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:13.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:13 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:13.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:13 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:13.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:13 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:17:13.502 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:13 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:13.502 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:13 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:17:13.502 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:13 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:13.502 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:13 trial060 ceph-mon[14797]: Standby manager daemon y started 2026-02-13T02:17:13.502 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:13 trial060 ceph-mon[14797]: mgrmap e9: x(active, since 31s), standbys: z, y 2026-02-13T02:17:13.502 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:13 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2026-02-13T02:17:13.502 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:13 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2026-02-13T02:17:13.519 INFO:teuthology.orchestra.run.trial060.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-13T02:17:13.519 INFO:teuthology.orchestra.run.trial060.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T02:17:13.520 INFO:teuthology.orchestra.run.trial060.stdout:Device: 0,6 Inode: 904 Links: 1 2026-02-13T02:17:13.520 INFO:teuthology.orchestra.run.trial060.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T02:17:13.520 INFO:teuthology.orchestra.run.trial060.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T02:17:13.520 INFO:teuthology.orchestra.run.trial060.stdout:Access: 2026-02-13 02:17:11.903554403 +0000 2026-02-13T02:17:13.520 INFO:teuthology.orchestra.run.trial060.stdout:Modify: 2026-02-13 02:15:25.740444241 +0000 2026-02-13T02:17:13.520 INFO:teuthology.orchestra.run.trial060.stdout:Change: 2026-02-13 02:15:25.740444241 +0000 2026-02-13T02:17:13.520 INFO:teuthology.orchestra.run.trial060.stdout: Birth: 2026-02-13 02:15:25.740444241 +0000 2026-02-13T02:17:13.521 DEBUG:teuthology.orchestra.run.trial060:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-13T02:17:13.586 INFO:teuthology.orchestra.run.trial060.stderr:1+0 records in 2026-02-13T02:17:13.586 INFO:teuthology.orchestra.run.trial060.stderr:1+0 records out 2026-02-13T02:17:13.586 INFO:teuthology.orchestra.run.trial060.stderr:512 bytes copied, 0.000238274 s, 2.1 MB/s 2026-02-13T02:17:13.588 DEBUG:teuthology.orchestra.run.trial060:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-13T02:17:13.646 DEBUG:teuthology.orchestra.run.trial060:> stat /dev/vg_nvme/lv_4 2026-02-13T02:17:13.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:13 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:13.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:13 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:13.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:13 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:13.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:13 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:13.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:13 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:13.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:13 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:13.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:13 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:17:13.703 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:13 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:13.703 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:13 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-13T02:17:13.703 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:13 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-13T02:17:13.703 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:13 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:13.703 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:13 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:13.703 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:13 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:13.703 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:13 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:17:13.703 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:13 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:13.703 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:13 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:17:13.703 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:13 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:13.703 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:13 trial011 ceph-mon[11956]: Standby manager daemon y started 2026-02-13T02:17:13.703 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:13 trial011 ceph-mon[11956]: mgrmap e9: x(active, since 31s), standbys: z, y 2026-02-13T02:17:13.704 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:13 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2026-02-13T02:17:13.704 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:13 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2026-02-13T02:17:13.705 INFO:teuthology.orchestra.run.trial060.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-13T02:17:13.705 INFO:teuthology.orchestra.run.trial060.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T02:17:13.705 INFO:teuthology.orchestra.run.trial060.stdout:Device: 0,6 Inode: 915 Links: 1 2026-02-13T02:17:13.705 INFO:teuthology.orchestra.run.trial060.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T02:17:13.705 INFO:teuthology.orchestra.run.trial060.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T02:17:13.705 INFO:teuthology.orchestra.run.trial060.stdout:Access: 2026-02-13 02:17:11.903554403 +0000 2026-02-13T02:17:13.705 INFO:teuthology.orchestra.run.trial060.stdout:Modify: 2026-02-13 02:15:26.017440930 +0000 2026-02-13T02:17:13.705 INFO:teuthology.orchestra.run.trial060.stdout:Change: 2026-02-13 02:15:26.017440930 +0000 2026-02-13T02:17:13.706 INFO:teuthology.orchestra.run.trial060.stdout: Birth: 2026-02-13 02:15:26.017440930 +0000 2026-02-13T02:17:13.706 DEBUG:teuthology.orchestra.run.trial060:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-13T02:17:13.770 INFO:teuthology.orchestra.run.trial060.stderr:1+0 records in 2026-02-13T02:17:13.770 INFO:teuthology.orchestra.run.trial060.stderr:1+0 records out 2026-02-13T02:17:13.770 INFO:teuthology.orchestra.run.trial060.stderr:512 bytes copied, 0.000195965 s, 2.6 MB/s 2026-02-13T02:17:13.771 DEBUG:teuthology.orchestra.run.trial060:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-13T02:17:13.791 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:13 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:13.791 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:13 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:13.791 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:13 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:13.791 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:13 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:13.791 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:13 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:13.792 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:13 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:13.792 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:13 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:17:13.792 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:13 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:13.792 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:13 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-13T02:17:13.792 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:13 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-13T02:17:13.792 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:13 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:13.792 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:13 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:13.792 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:13 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:13.792 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:13 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:17:13.792 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:13 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:13.792 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:13 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:17:13.792 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:13 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:13.793 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:13 trial078 ceph-mon[14969]: Standby manager daemon y started 2026-02-13T02:17:13.793 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:13 trial078 ceph-mon[14969]: mgrmap e9: x(active, since 31s), standbys: z, y 2026-02-13T02:17:13.793 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:13 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2026-02-13T02:17:13.793 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:13 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2026-02-13T02:17:13.830 DEBUG:teuthology.orchestra.run.trial078:> set -ex 2026-02-13T02:17:13.830 DEBUG:teuthology.orchestra.run.trial078:> dd if=/scratch_devs of=/dev/stdout 2026-02-13T02:17:13.850 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-13T02:17:13.850 DEBUG:teuthology.orchestra.run.trial078:> stat /dev/vg_nvme/lv_1 2026-02-13T02:17:13.908 INFO:teuthology.orchestra.run.trial078.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-13T02:17:13.909 INFO:teuthology.orchestra.run.trial078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T02:17:13.909 INFO:teuthology.orchestra.run.trial078.stdout:Device: 0,6 Inode: 884 Links: 1 2026-02-13T02:17:13.909 INFO:teuthology.orchestra.run.trial078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T02:17:13.909 INFO:teuthology.orchestra.run.trial078.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T02:17:13.909 INFO:teuthology.orchestra.run.trial078.stdout:Access: 2026-02-13 02:17:11.161880377 +0000 2026-02-13T02:17:13.909 INFO:teuthology.orchestra.run.trial078.stdout:Modify: 2026-02-13 02:15:28.893856124 +0000 2026-02-13T02:17:13.909 INFO:teuthology.orchestra.run.trial078.stdout:Change: 2026-02-13 02:15:28.893856124 +0000 2026-02-13T02:17:13.909 INFO:teuthology.orchestra.run.trial078.stdout: Birth: 2026-02-13 02:15:28.893856124 +0000 2026-02-13T02:17:13.910 DEBUG:teuthology.orchestra.run.trial078:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-13T02:17:13.976 INFO:teuthology.orchestra.run.trial078.stderr:1+0 records in 2026-02-13T02:17:13.977 INFO:teuthology.orchestra.run.trial078.stderr:1+0 records out 2026-02-13T02:17:13.977 INFO:teuthology.orchestra.run.trial078.stderr:512 bytes copied, 0.000143928 s, 3.6 MB/s 2026-02-13T02:17:13.978 DEBUG:teuthology.orchestra.run.trial078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-13T02:17:14.037 DEBUG:teuthology.orchestra.run.trial078:> stat /dev/vg_nvme/lv_2 2026-02-13T02:17:14.095 INFO:teuthology.orchestra.run.trial078.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-13T02:17:14.095 INFO:teuthology.orchestra.run.trial078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T02:17:14.095 INFO:teuthology.orchestra.run.trial078.stdout:Device: 0,6 Inode: 894 Links: 1 2026-02-13T02:17:14.096 INFO:teuthology.orchestra.run.trial078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T02:17:14.096 INFO:teuthology.orchestra.run.trial078.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T02:17:14.096 INFO:teuthology.orchestra.run.trial078.stdout:Access: 2026-02-13 02:17:11.161880377 +0000 2026-02-13T02:17:14.096 INFO:teuthology.orchestra.run.trial078.stdout:Modify: 2026-02-13 02:15:29.186852144 +0000 2026-02-13T02:17:14.096 INFO:teuthology.orchestra.run.trial078.stdout:Change: 2026-02-13 02:15:29.186852144 +0000 2026-02-13T02:17:14.096 INFO:teuthology.orchestra.run.trial078.stdout: Birth: 2026-02-13 02:15:29.186852144 +0000 2026-02-13T02:17:14.096 DEBUG:teuthology.orchestra.run.trial078:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-13T02:17:14.161 INFO:teuthology.orchestra.run.trial078.stderr:1+0 records in 2026-02-13T02:17:14.161 INFO:teuthology.orchestra.run.trial078.stderr:1+0 records out 2026-02-13T02:17:14.161 INFO:teuthology.orchestra.run.trial078.stderr:512 bytes copied, 0.000131536 s, 3.9 MB/s 2026-02-13T02:17:14.162 DEBUG:teuthology.orchestra.run.trial078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-13T02:17:14.221 DEBUG:teuthology.orchestra.run.trial078:> stat /dev/vg_nvme/lv_3 2026-02-13T02:17:14.279 INFO:teuthology.orchestra.run.trial078.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-13T02:17:14.279 INFO:teuthology.orchestra.run.trial078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T02:17:14.280 INFO:teuthology.orchestra.run.trial078.stdout:Device: 0,6 Inode: 906 Links: 1 2026-02-13T02:17:14.280 INFO:teuthology.orchestra.run.trial078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T02:17:14.280 INFO:teuthology.orchestra.run.trial078.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T02:17:14.280 INFO:teuthology.orchestra.run.trial078.stdout:Access: 2026-02-13 02:17:11.161880377 +0000 2026-02-13T02:17:14.280 INFO:teuthology.orchestra.run.trial078.stdout:Modify: 2026-02-13 02:15:29.481848137 +0000 2026-02-13T02:17:14.280 INFO:teuthology.orchestra.run.trial078.stdout:Change: 2026-02-13 02:15:29.481848137 +0000 2026-02-13T02:17:14.280 INFO:teuthology.orchestra.run.trial078.stdout: Birth: 2026-02-13 02:15:29.481848137 +0000 2026-02-13T02:17:14.281 DEBUG:teuthology.orchestra.run.trial078:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-13T02:17:14.344 INFO:teuthology.orchestra.run.trial078.stderr:1+0 records in 2026-02-13T02:17:14.344 INFO:teuthology.orchestra.run.trial078.stderr:1+0 records out 2026-02-13T02:17:14.345 INFO:teuthology.orchestra.run.trial078.stderr:512 bytes copied, 0.000159217 s, 3.2 MB/s 2026-02-13T02:17:14.346 DEBUG:teuthology.orchestra.run.trial078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-13T02:17:14.405 DEBUG:teuthology.orchestra.run.trial078:> stat /dev/vg_nvme/lv_4 2026-02-13T02:17:14.463 INFO:teuthology.orchestra.run.trial078.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-13T02:17:14.463 INFO:teuthology.orchestra.run.trial078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T02:17:14.463 INFO:teuthology.orchestra.run.trial078.stdout:Device: 0,6 Inode: 915 Links: 1 2026-02-13T02:17:14.464 INFO:teuthology.orchestra.run.trial078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T02:17:14.464 INFO:teuthology.orchestra.run.trial078.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T02:17:14.464 INFO:teuthology.orchestra.run.trial078.stdout:Access: 2026-02-13 02:17:11.162880365 +0000 2026-02-13T02:17:14.464 INFO:teuthology.orchestra.run.trial078.stdout:Modify: 2026-02-13 02:15:29.774844158 +0000 2026-02-13T02:17:14.464 INFO:teuthology.orchestra.run.trial078.stdout:Change: 2026-02-13 02:15:29.774844158 +0000 2026-02-13T02:17:14.464 INFO:teuthology.orchestra.run.trial078.stdout: Birth: 2026-02-13 02:15:29.774844158 +0000 2026-02-13T02:17:14.464 DEBUG:teuthology.orchestra.run.trial078:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-13T02:17:14.528 INFO:teuthology.orchestra.run.trial078.stderr:1+0 records in 2026-02-13T02:17:14.529 INFO:teuthology.orchestra.run.trial078.stderr:1+0 records out 2026-02-13T02:17:14.529 INFO:teuthology.orchestra.run.trial078.stderr:512 bytes copied, 0.00012848 s, 4.0 MB/s 2026-02-13T02:17:14.530 DEBUG:teuthology.orchestra.run.trial078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-13T02:17:14.589 INFO:tasks.cephadm:Deploying osd.0 on trial011 with /dev/vg_nvme/lv_4... 2026-02-13T02:17:14.590 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_4 2026-02-13T02:17:14.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:14 trial011 ceph-mon[11956]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T02:17:14.712 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:17:14.750 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:14 trial060 ceph-mon[14797]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T02:17:14.791 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:14 trial078 ceph-mon[14969]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T02:17:15.142 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:17:15.161 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph orch daemon add osd trial011:vg_nvme/lv_4 --skip-validation 2026-02-13T02:17:15.285 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:17:15.404 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:15.401+0000 7ff2647806c0 1 -- 10.20.193.11:0/260152024 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7ff25c110a00 msgr2=0x7ff25c171390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:15.404 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:15.401+0000 7ff2647806c0 1 --2- 10.20.193.11:0/260152024 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7ff25c110a00 0x7ff25c171390 secure :-1 s=READY pgs=141 gs=1 cs=0 l=1 c_cookie=5455089711349148101 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff25800aa40 tx=0x7ff25802fde0 comp rx=0 tx=0).stop 2026-02-13T02:17:15.405 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:15.401+0000 7ff2647806c0 1 -- 10.20.193.11:0/260152024 shutdown_connections 2026-02-13T02:17:15.405 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:15.401+0000 7ff2647806c0 1 --2- 10.20.193.11:0/260152024 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7ff25c110a00 0x7ff25c171390 unknown :-1 s=CLOSED pgs=141 gs=1 cs=0 l=1 c_cookie=5455089711349148101 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:15.405 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:15.401+0000 7ff2647806c0 1 --2- 10.20.193.11:0/260152024 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff25c110050 0x7ff25c1104c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:15.405 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:15.401+0000 7ff2647806c0 1 --2- 10.20.193.11:0/260152024 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7ff25c10eed0 0x7ff25c10f2c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:15.405 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:15.401+0000 7ff2647806c0 1 -- 10.20.193.11:0/260152024 >> 10.20.193.11:0/260152024 conn(0x7ff25c0ec5f0 msgr2=0x7ff25c10ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:17:15.405 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:15.401+0000 7ff2647806c0 1 -- 10.20.193.11:0/260152024 shutdown_connections 2026-02-13T02:17:15.405 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:15.401+0000 7ff2647806c0 1 -- 10.20.193.11:0/260152024 wait complete. 2026-02-13T02:17:15.405 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:15.401+0000 7ff2647806c0 1 Processor -- start 2026-02-13T02:17:15.405 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:15.401+0000 7ff2647806c0 1 -- start start 2026-02-13T02:17:15.405 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:15.401+0000 7ff2647806c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7ff25c10eed0 0x7ff25c0f8f10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:15.406 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:15.401+0000 7ff2647806c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff25c110050 0x7ff25c171390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:15.406 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:15.401+0000 7ff2647806c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7ff25c110a00 0x7ff25c0f9770 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:15.406 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:15.401+0000 7ff2647806c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7ff25c0fa3a0 con 0x7ff25c10eed0 2026-02-13T02:17:15.406 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:15.401+0000 7ff2647806c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff25c0fa510 con 0x7ff25c110a00 2026-02-13T02:17:15.406 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:15.401+0000 7ff2647806c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7ff25c0fa6d0 con 0x7ff25c110050 2026-02-13T02:17:15.406 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:15.401+0000 7ff2624f16c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7ff25c10eed0 0x7ff25c0f8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:15.406 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:15.401+0000 7ff2624f16c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7ff25c10eed0 0x7ff25c0f8f10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:34638/0 (socket says 10.20.193.11:34638) 2026-02-13T02:17:15.406 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:15.401+0000 7ff2624f16c0 1 -- 10.20.193.11:0/3537751791 learned_addr learned my addr 10.20.193.11:0/3537751791 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:17:15.406 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:15.401+0000 7ff261cf06c0 1 --2- 10.20.193.11:0/3537751791 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff25c110050 0x7ff25c171390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:15.406 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:15.401+0000 7ff262cf26c0 1 --2- 10.20.193.11:0/3537751791 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7ff25c110a00 0x7ff25c0f9770 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:15.406 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:15.401+0000 7ff2624f16c0 1 -- 10.20.193.11:0/3537751791 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff25c110050 msgr2=0x7ff25c171390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:15.407 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:15.401+0000 7ff2624f16c0 1 --2- 10.20.193.11:0/3537751791 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff25c110050 0x7ff25c171390 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:15.407 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:15.401+0000 7ff2624f16c0 1 -- 10.20.193.11:0/3537751791 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7ff25c110a00 msgr2=0x7ff25c0f9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:15.407 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:15.401+0000 7ff2624f16c0 1 --2- 10.20.193.11:0/3537751791 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7ff25c110a00 0x7ff25c0f9770 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:15.407 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:15.401+0000 7ff2624f16c0 1 -- 10.20.193.11:0/3537751791 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff25800a660 con 0x7ff25c10eed0 2026-02-13T02:17:15.407 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:15.401+0000 7ff261cf06c0 1 --2- 10.20.193.11:0/3537751791 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff25c110050 0x7ff25c171390 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:17:15.407 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:15.402+0000 7ff2624f16c0 1 --2- 10.20.193.11:0/3537751791 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7ff25c10eed0 0x7ff25c0f8f10 secure :-1 s=READY pgs=142 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff24c0092e0 tx=0x7ff24c00bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:17:15.407 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:15.402+0000 7ff2437fe6c0 1 -- 10.20.193.11:0/3537751791 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff24c004250 con 0x7ff25c10eed0 2026-02-13T02:17:15.407 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:15.402+0000 7ff2437fe6c0 1 -- 10.20.193.11:0/3537751791 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff24c0043b0 con 0x7ff25c10eed0 2026-02-13T02:17:15.407 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:15.402+0000 7ff2647806c0 1 -- 10.20.193.11:0/3537751791 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff25c0fa9b0 con 0x7ff25c10eed0 2026-02-13T02:17:15.407 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:15.402+0000 7ff2437fe6c0 1 -- 10.20.193.11:0/3537751791 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff24c00cde0 con 0x7ff25c10eed0 2026-02-13T02:17:15.407 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:15.402+0000 7ff2647806c0 1 -- 10.20.193.11:0/3537751791 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff25c0fae90 con 0x7ff25c10eed0 2026-02-13T02:17:15.407 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:15.402+0000 7ff2647806c0 1 -- 10.20.193.11:0/3537751791 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff25c1753c0 con 0x7ff25c10eed0 2026-02-13T02:17:15.408 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:15.403+0000 7ff2437fe6c0 1 -- 10.20.193.11:0/3537751791 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 9) ==== 157010+0+0 (secure 0 0 0) 0x7ff24c0026b0 con 0x7ff25c10eed0 2026-02-13T02:17:15.409 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:15.404+0000 7ff2437fe6c0 1 --2- 10.20.193.11:0/3537751791 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7ff2380b5570 0x7ff2380d5a20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:15.409 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:15.404+0000 7ff2437fe6c0 1 -- 10.20.193.11:0/3537751791 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 935+0+0 (secure 0 0 0) 0x7ff24c0e1d90 con 0x7ff25c10eed0 2026-02-13T02:17:15.409 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:15.404+0000 7ff261cf06c0 1 --2- 10.20.193.11:0/3537751791 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7ff2380b5570 0x7ff2380d5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:15.409 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:15.404+0000 7ff261cf06c0 1 --2- 10.20.193.11:0/3537751791 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7ff2380b5570 0x7ff2380d5a20 secure :-1 s=READY pgs=77 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff250005fd0 tx=0x7ff250005d50 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:17:15.409 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:15.404+0000 7ff2437fe6c0 1 -- 10.20.193.11:0/3537751791 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7ff24c0a64a0 con 0x7ff25c10eed0 2026-02-13T02:17:15.502 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:15.500+0000 7ff2647806c0 1 -- 10.20.193.11:0/3537751791 --> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial011:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7ff25c0f1dd0 con 0x7ff2380b5570 2026-02-13T02:17:16.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:16 trial011 ceph-mon[11956]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T02:17:16.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:16 trial011 ceph-mon[11956]: from='client.14364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial011:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:17:16.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:16 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:16.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:16 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:16.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:16 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:17:16.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:16 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:17:16.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:16 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:17:16.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:16 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:16.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:16 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:16.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:16 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:16.703 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:16 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:16.703 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:16 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:17:16.703 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:16 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:16.703 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:16 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:17:16.703 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:16 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:17:16.703 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:16 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:16.703 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:16 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/2746745612' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "bb9a005b-9a16-4fda-95c0-d23831f0cffc"} : dispatch 2026-02-13T02:17:16.703 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:16 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/2746745612' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bb9a005b-9a16-4fda-95c0-d23831f0cffc"}]': finished 2026-02-13T02:17:16.703 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:16 trial011 ceph-mon[11956]: osdmap e4: 1 total, 0 up, 1 in 2026-02-13T02:17:16.703 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:16 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T02:17:16.703 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:16 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/3699203274' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T02:17:16.791 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:16 trial078 ceph-mon[14969]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T02:17:16.792 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:16 trial078 ceph-mon[14969]: from='client.14364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial011:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:17:16.792 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:16 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:16.792 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:16 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:16.792 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:16 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:17:16.792 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:16 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:17:16.793 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:16 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:17:16.793 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:16 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:16.793 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:16 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:16.793 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:16 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:16.793 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:16 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:16.793 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:16 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:17:16.793 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:16 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:16.794 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:16 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:17:16.794 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:16 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:17:16.794 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:16 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:16.794 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:16 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/2746745612' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "bb9a005b-9a16-4fda-95c0-d23831f0cffc"} : dispatch 2026-02-13T02:17:16.794 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:16 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/2746745612' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bb9a005b-9a16-4fda-95c0-d23831f0cffc"}]': finished 2026-02-13T02:17:16.794 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:16 trial078 ceph-mon[14969]: osdmap e4: 1 total, 0 up, 1 in 2026-02-13T02:17:16.794 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:16 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T02:17:16.795 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:16 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/3699203274' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T02:17:17.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:16 trial060 ceph-mon[14797]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T02:17:17.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:16 trial060 ceph-mon[14797]: from='client.14364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial011:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:17:17.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:16 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:17.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:16 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:17.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:16 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:17:17.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:16 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:17:17.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:16 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:17:17.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:16 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:17.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:16 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:17.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:16 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:17.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:16 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:17.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:16 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:17:17.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:16 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:17.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:16 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:17:17.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:16 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:17:17.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:16 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:17.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:16 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/2746745612' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "bb9a005b-9a16-4fda-95c0-d23831f0cffc"} : dispatch 2026-02-13T02:17:17.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:16 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/2746745612' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bb9a005b-9a16-4fda-95c0-d23831f0cffc"}]': finished 2026-02-13T02:17:17.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:16 trial060 ceph-mon[14797]: osdmap e4: 1 total, 0 up, 1 in 2026-02-13T02:17:17.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:16 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T02:17:17.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:16 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/3699203274' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T02:17:18.694 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:18 trial011 ceph-mon[11956]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T02:17:18.694 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:18 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2026-02-13T02:17:18.694 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:18 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:18.791 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:18 trial078 ceph-mon[14969]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T02:17:18.791 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:18 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2026-02-13T02:17:18.792 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:18 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:19.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:18 trial060 ceph-mon[14797]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T02:17:19.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:18 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2026-02-13T02:17:19.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:18 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:19.791 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:19 trial078 ceph-mon[14969]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T02:17:19.791 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:19 trial078 ceph-mon[14969]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:17:19.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:19 trial011 ceph-mon[11956]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T02:17:19.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:19 trial011 ceph-mon[11956]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:17:20.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:19 trial060 ceph-mon[14797]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T02:17:20.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:19 trial060 ceph-mon[14797]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:17:20.620 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:20 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:17:20.621 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:20 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:20.621 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:20 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:20.791 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:20 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:17:20.791 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:20 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:20.791 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:20 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:21.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:20 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:17:21.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:20 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:21.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:20 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:21.276 INFO:teuthology.orchestra.run.trial011.stdout:Created osd(s) 0 on host 'trial011' 2026-02-13T02:17:21.277 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:21.274+0000 7ff2437fe6c0 1 -- 10.20.193.11:0/3537751791 <== mgr.14116 v2:10.20.193.11:6800/861334768 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7ff25c0f1dd0 con 0x7ff2380b5570 2026-02-13T02:17:21.279 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:21.276+0000 7ff2647806c0 1 -- 10.20.193.11:0/3537751791 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7ff2380b5570 msgr2=0x7ff2380d5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:21.279 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:21.276+0000 7ff2647806c0 1 --2- 10.20.193.11:0/3537751791 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7ff2380b5570 0x7ff2380d5a20 secure :-1 s=READY pgs=77 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff250005fd0 tx=0x7ff250005d50 comp rx=0 tx=0).stop 2026-02-13T02:17:21.279 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:21.276+0000 7ff2647806c0 1 -- 10.20.193.11:0/3537751791 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7ff25c10eed0 msgr2=0x7ff25c0f8f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:21.279 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:21.276+0000 7ff2647806c0 1 --2- 10.20.193.11:0/3537751791 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7ff25c10eed0 0x7ff25c0f8f10 secure :-1 s=READY pgs=142 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff24c0092e0 tx=0x7ff24c00bc50 comp rx=0 tx=0).stop 2026-02-13T02:17:21.279 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:21.277+0000 7ff2647806c0 1 -- 10.20.193.11:0/3537751791 shutdown_connections 2026-02-13T02:17:21.279 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:21.277+0000 7ff2647806c0 1 --2- 10.20.193.11:0/3537751791 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7ff2380b5570 0x7ff2380d5a20 unknown :-1 s=CLOSED pgs=77 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:21.279 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:21.277+0000 7ff2647806c0 1 --2- 10.20.193.11:0/3537751791 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7ff25c110a00 0x7ff25c0f9770 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:21.280 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:21.277+0000 7ff2647806c0 1 --2- 10.20.193.11:0/3537751791 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff25c110050 0x7ff25c171390 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:21.280 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:21.277+0000 7ff2647806c0 1 --2- 10.20.193.11:0/3537751791 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7ff25c10eed0 0x7ff25c0f8f10 unknown :-1 s=CLOSED pgs=142 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:21.280 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:21.277+0000 7ff2647806c0 1 -- 10.20.193.11:0/3537751791 >> 10.20.193.11:0/3537751791 conn(0x7ff25c0ec5f0 msgr2=0x7ff25c0ef4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:17:21.280 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:21.277+0000 7ff2647806c0 1 -- 10.20.193.11:0/3537751791 shutdown_connections 2026-02-13T02:17:21.280 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:21.277+0000 7ff2647806c0 1 -- 10.20.193.11:0/3537751791 wait complete. 2026-02-13T02:17:21.319 DEBUG:teuthology.orchestra.run.trial011:osd.0> sudo journalctl -f -n 0 -u ceph-fc631695-0881-11f1-899c-d404e6e7d460@osd.0.service 2026-02-13T02:17:21.321 INFO:tasks.cephadm:Deploying osd.1 on trial060 with /dev/vg_nvme/lv_4... 2026-02-13T02:17:21.321 DEBUG:teuthology.orchestra.run.trial060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_4 2026-02-13T02:17:21.442 INFO:teuthology.orchestra.run.trial060.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.b/config 2026-02-13T02:17:21.598 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:21 trial060 ceph-mon[14797]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T02:17:21.599 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:21 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:21.599 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:21 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:21.599 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:21 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:21.599 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:21 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:17:21.599 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:21 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:21.599 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:21 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:17:21.599 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:21 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:17:21.599 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:21 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:21.599 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:21 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:21.599 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:21 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:21.600 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:21 trial060 ceph-mon[14797]: from='osd.0 [v2:10.20.193.11:6802/1061379396,v1:10.20.193.11:6803/1061379396]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2026-02-13T02:17:21.771 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:21 trial011 ceph-mon[11956]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T02:17:21.771 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:21 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:21.771 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:21 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:21.771 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:21 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:21.771 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:21 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:17:21.771 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:21 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:21.772 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:21 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:17:21.772 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:21 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:17:21.772 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:21 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:21.772 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:21 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:21.772 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:21 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:21.772 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:21 trial011 ceph-mon[11956]: from='osd.0 [v2:10.20.193.11:6802/1061379396,v1:10.20.193.11:6803/1061379396]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2026-02-13T02:17:21.791 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:21 trial078 ceph-mon[14969]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T02:17:21.791 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:21 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:21.791 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:21 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:21.791 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:21 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:21.791 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:21 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:17:21.791 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:21 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:21.792 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:21 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:17:21.792 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:21 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:17:21.792 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:21 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:21.792 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:21 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:21.792 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:21 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:21.792 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:21 trial078 ceph-mon[14969]: from='osd.0 [v2:10.20.193.11:6802/1061379396,v1:10.20.193.11:6803/1061379396]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2026-02-13T02:17:21.894 INFO:teuthology.orchestra.run.trial060.stdout: 2026-02-13T02:17:21.910 DEBUG:teuthology.orchestra.run.trial060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph orch daemon add osd trial060:vg_nvme/lv_4 --skip-validation 2026-02-13T02:17:22.034 INFO:teuthology.orchestra.run.trial060.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.b/config 2026-02-13T02:17:22.145 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:22.143+0000 7fdd10f996c0 1 -- 10.20.193.60:0/2369679741 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fdd0c1109f0 msgr2=0x7fdd0c171380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:22.145 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:22.143+0000 7fdd10f996c0 1 --2- 10.20.193.60:0/2369679741 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fdd0c1109f0 0x7fdd0c171380 secure :-1 s=READY pgs=5 gs=1 cs=0 l=1 c_cookie=14236357189285660640 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdcfc00aa40 tx=0x7fdcfc02fde0 comp rx=0 tx=0).stop 2026-02-13T02:17:22.145 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:22.143+0000 7fdd10f996c0 1 -- 10.20.193.60:0/2369679741 shutdown_connections 2026-02-13T02:17:22.146 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:22.143+0000 7fdd10f996c0 1 --2- 10.20.193.60:0/2369679741 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fdd0c1109f0 0x7fdd0c171380 unknown :-1 s=CLOSED pgs=5 gs=1 cs=0 l=1 c_cookie=14236357189285660640 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:22.146 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:22.143+0000 7fdd10f996c0 1 --2- 10.20.193.60:0/2369679741 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fdd0c110040 0x7fdd0c1104b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:22.146 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:22.143+0000 7fdd10f996c0 1 --2- 10.20.193.60:0/2369679741 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fdd0c10eec0 0x7fdd0c10f2b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:22.146 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:22.143+0000 7fdd10f996c0 1 -- 10.20.193.60:0/2369679741 >> 10.20.193.60:0/2369679741 conn(0x7fdd0c0ec5c0 msgr2=0x7fdd0c10c9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:17:22.146 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:22.143+0000 7fdd10f996c0 1 -- 10.20.193.60:0/2369679741 shutdown_connections 2026-02-13T02:17:22.146 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:22.143+0000 7fdd10f996c0 1 -- 10.20.193.60:0/2369679741 wait complete. 2026-02-13T02:17:22.146 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:22.143+0000 7fdd10f996c0 1 Processor -- start 2026-02-13T02:17:22.146 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:22.143+0000 7fdd10f996c0 1 -- start start 2026-02-13T02:17:22.146 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:22.143+0000 7fdd10f996c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fdd0c10eec0 0x7fdd0c0f8f60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:22.146 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:22.143+0000 7fdd10f996c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fdd0c110040 0x7fdd0c171380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:22.147 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:22.143+0000 7fdd10f996c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fdd0c1109f0 0x7fdd0c0f97c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:22.147 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:22.143+0000 7fdd10f996c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7fdd0c0fa3f0 con 0x7fdd0c10eec0 2026-02-13T02:17:22.147 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:22.143+0000 7fdd10f996c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7fdd0c0fa560 con 0x7fdd0c1109f0 2026-02-13T02:17:22.147 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:22.143+0000 7fdd10f996c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fdd0c0fa720 con 0x7fdd0c110040 2026-02-13T02:17:22.147 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:22.143+0000 7fdd0ad766c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fdd0c1109f0 0x7fdd0c0f97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:22.147 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:22.143+0000 7fdd0ad766c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fdd0c1109f0 0x7fdd0c0f97c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.60:3300/0 says I am v2:10.20.193.60:38576/0 (socket says 10.20.193.60:38576) 2026-02-13T02:17:22.147 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:22.143+0000 7fdd0ad766c0 1 -- 10.20.193.60:0/4097636386 learned_addr learned my addr 10.20.193.60:0/4097636386 (peer_addr_for_me v2:10.20.193.60:0/0) 2026-02-13T02:17:22.147 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:22.143+0000 7fdd09d746c0 1 --2- 10.20.193.60:0/4097636386 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fdd0c110040 0x7fdd0c171380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:22.147 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:22.143+0000 7fdd0a5756c0 1 --2- 10.20.193.60:0/4097636386 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fdd0c10eec0 0x7fdd0c0f8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:22.147 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:22.144+0000 7fdd0ad766c0 1 -- 10.20.193.60:0/4097636386 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fdd0c110040 msgr2=0x7fdd0c171380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:22.147 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:22.144+0000 7fdd0ad766c0 1 --2- 10.20.193.60:0/4097636386 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fdd0c110040 0x7fdd0c171380 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:22.147 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:22.144+0000 7fdd0ad766c0 1 -- 10.20.193.60:0/4097636386 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fdd0c10eec0 msgr2=0x7fdd0c0f8f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:22.148 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:22.144+0000 7fdd0ad766c0 1 --2- 10.20.193.60:0/4097636386 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fdd0c10eec0 0x7fdd0c0f8f60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:22.148 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:22.144+0000 7fdd0ad766c0 1 -- 10.20.193.60:0/4097636386 --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcfc00a660 con 0x7fdd0c1109f0 2026-02-13T02:17:22.148 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:22.144+0000 7fdd0a5756c0 1 --2- 10.20.193.60:0/4097636386 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fdd0c10eec0 0x7fdd0c0f8f60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T02:17:22.148 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:22.144+0000 7fdd0ad766c0 1 --2- 10.20.193.60:0/4097636386 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fdd0c1109f0 0x7fdd0c0f97c0 secure :-1 s=READY pgs=6 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdcfc00a390 tx=0x7fdcfc005530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:17:22.148 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:22.144+0000 7fdcf37fe6c0 1 -- 10.20.193.60:0/4097636386 <== mon.2 v2:10.20.193.60:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdcfc0057e0 con 0x7fdd0c1109f0 2026-02-13T02:17:22.148 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:22.144+0000 7fdcf37fe6c0 1 -- 10.20.193.60:0/4097636386 <== mon.2 v2:10.20.193.60:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fdcfc003c40 con 0x7fdd0c1109f0 2026-02-13T02:17:22.148 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:22.144+0000 7fdcf37fe6c0 1 -- 10.20.193.60:0/4097636386 <== mon.2 v2:10.20.193.60:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdcfc038480 con 0x7fdd0c1109f0 2026-02-13T02:17:22.148 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:22.144+0000 7fdd10f996c0 1 -- 10.20.193.60:0/4097636386 --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd0c0fa9a0 con 0x7fdd0c1109f0 2026-02-13T02:17:22.148 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:22.144+0000 7fdd10f996c0 1 -- 10.20.193.60:0/4097636386 --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd0c0fadd0 con 0x7fdd0c1109f0 2026-02-13T02:17:22.148 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:22.144+0000 7fdd10f996c0 1 -- 10.20.193.60:0/4097636386 --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd0c0faff0 con 0x7fdd0c1109f0 2026-02-13T02:17:22.149 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:22.146+0000 7fdcf37fe6c0 1 -- 10.20.193.60:0/4097636386 <== mon.2 v2:10.20.193.60:3300/0 4 ==== mgrmap(e 9) ==== 157010+0+0 (secure 0 0 0) 0x7fdcfc008350 con 0x7fdd0c1109f0 2026-02-13T02:17:22.150 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:22.146+0000 7fdcf37fe6c0 1 --2- 10.20.193.60:0/4097636386 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fdce40b55f0 0x7fdce40d5aa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:22.150 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:22.146+0000 7fdcf37fe6c0 1 -- 10.20.193.60:0/4097636386 <== mon.2 v2:10.20.193.60:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1050+0+0 (secure 0 0 0) 0x7fdcfc107280 con 0x7fdd0c1109f0 2026-02-13T02:17:22.150 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:22.146+0000 7fdd0a5756c0 1 --2- 10.20.193.60:0/4097636386 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fdce40b55f0 0x7fdce40d5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:22.150 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:22.147+0000 7fdd0a5756c0 1 --2- 10.20.193.60:0/4097636386 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fdce40b55f0 0x7fdce40d5aa0 secure :-1 s=READY pgs=80 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdd00005fd0 tx=0x7fdd000092c0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:17:22.150 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:22.147+0000 7fdcf37fe6c0 1 -- 10.20.193.60:0/4097636386 <== mon.2 v2:10.20.193.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fdcfc0cb920 con 0x7fdd0c1109f0 2026-02-13T02:17:22.242 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:22.242+0000 7fdd10f996c0 1 -- 10.20.193.60:0/4097636386 --> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial060:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7fdd0c174d30 con 0x7fdce40b55f0 2026-02-13T02:17:22.728 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:22 trial060 ceph-mon[14797]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T02:17:22.728 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:22 trial060 ceph-mon[14797]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T02:17:22.728 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:22 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:17:22.728 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:22 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:22.728 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:22 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:22.728 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:22 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:17:22.729 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:22 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:17:22.729 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:22 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:22.729 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:22 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:22.729 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:22 trial060 ceph-mon[14797]: from='osd.0 [v2:10.20.193.11:6802/1061379396,v1:10.20.193.11:6803/1061379396]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2026-02-13T02:17:22.729 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:22 trial060 ceph-mon[14797]: osdmap e5: 1 total, 0 up, 1 in 2026-02-13T02:17:22.729 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:22 trial060 ceph-mon[14797]: from='osd.0 [v2:10.20.193.11:6802/1061379396,v1:10.20.193.11:6803/1061379396]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial011", "root=default"]} : dispatch 2026-02-13T02:17:22.729 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:22 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T02:17:22.729 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:22 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:22.729 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:22 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T02:17:22.729 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:22 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:22.729 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:22 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:22.730 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:22 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:17:22.730 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:22 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:22.730 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:22 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:17:22.730 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:22 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:17:22.730 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:22 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:22.791 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:22 trial078 ceph-mon[14969]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T02:17:22.791 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:22 trial078 ceph-mon[14969]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T02:17:22.791 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:22 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:17:22.791 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:22 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:22.791 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:22 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:22.792 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:22 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:17:22.792 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:22 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:17:22.792 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:22 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:22.792 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:22 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:22.792 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:22 trial078 ceph-mon[14969]: from='osd.0 [v2:10.20.193.11:6802/1061379396,v1:10.20.193.11:6803/1061379396]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2026-02-13T02:17:22.792 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:22 trial078 ceph-mon[14969]: osdmap e5: 1 total, 0 up, 1 in 2026-02-13T02:17:22.792 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:22 trial078 ceph-mon[14969]: from='osd.0 [v2:10.20.193.11:6802/1061379396,v1:10.20.193.11:6803/1061379396]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial011", "root=default"]} : dispatch 2026-02-13T02:17:22.792 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:22 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T02:17:22.792 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:22 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:22.792 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:22 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T02:17:22.792 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:22 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:22.793 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:22 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:22.793 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:22 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:17:22.793 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:22 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:22.793 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:22 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:17:22.793 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:22 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:17:22.793 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:22 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:22.903 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:22 trial011 ceph-mon[11956]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T02:17:22.903 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:22 trial011 ceph-mon[11956]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T02:17:22.903 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:22 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:17:22.903 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:22 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:22.903 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:22 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:22.903 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:22 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:17:22.903 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:22 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:17:22.903 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:22 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:22.903 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:22 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:22.904 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:22 trial011 ceph-mon[11956]: from='osd.0 [v2:10.20.193.11:6802/1061379396,v1:10.20.193.11:6803/1061379396]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2026-02-13T02:17:22.904 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:22 trial011 ceph-mon[11956]: osdmap e5: 1 total, 0 up, 1 in 2026-02-13T02:17:22.904 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:22 trial011 ceph-mon[11956]: from='osd.0 [v2:10.20.193.11:6802/1061379396,v1:10.20.193.11:6803/1061379396]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial011", "root=default"]} : dispatch 2026-02-13T02:17:22.904 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:22 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T02:17:22.904 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:22 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:22.904 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:22 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T02:17:22.904 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:22 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:22.904 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:22 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:22.904 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:22 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:17:22.904 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:22 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:22.904 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:22 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:17:22.905 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:22 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:17:22.905 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:22 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:23.202 INFO:journalctl@ceph.osd.0.trial011.stdout:Feb 13 02:17:22 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-0[24273]: 2026-02-13T02:17:22.900+0000 7f79b092f6c0 -1 osd.0 0 waiting for initial osdmap 2026-02-13T02:17:23.202 INFO:journalctl@ceph.osd.0.trial011.stdout:Feb 13 02:17:22 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-0[24273]: 2026-02-13T02:17:22.901+0000 7f79a87fc6c0 -1 osd.0 6 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T02:17:23.791 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:23 trial078 ceph-mon[14969]: from='client.24131 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial060:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:17:23.791 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:23 trial078 ceph-mon[14969]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T02:17:23.791 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:23 trial078 ceph-mon[14969]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c1786ae4-a736-47b0-8302-b06423efd012"} : dispatch 2026-02-13T02:17:23.791 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:23 trial078 ceph-mon[14969]: from='osd.0 [v2:10.20.193.11:6802/1061379396,v1:10.20.193.11:6803/1061379396]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial011", "root=default"]}]': finished 2026-02-13T02:17:23.791 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:23 trial078 ceph-mon[14969]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c1786ae4-a736-47b0-8302-b06423efd012"}]': finished 2026-02-13T02:17:23.791 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:23 trial078 ceph-mon[14969]: from='client.? 10.20.193.60:0/279739339' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c1786ae4-a736-47b0-8302-b06423efd012"} : dispatch 2026-02-13T02:17:23.791 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:23 trial078 ceph-mon[14969]: osdmap e6: 2 total, 0 up, 2 in 2026-02-13T02:17:23.791 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:23 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T02:17:23.791 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:23 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T02:17:23.791 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:23 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T02:17:23.791 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:23 trial078 ceph-mon[14969]: from='client.? 10.20.193.60:0/1999358629' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T02:17:23.791 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:23 trial078 ceph-mon[14969]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:17:23.791 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:23 trial078 ceph-mon[14969]: Cluster is now healthy 2026-02-13T02:17:23.951 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:23 trial011 ceph-mon[11956]: from='client.24131 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial060:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:17:23.951 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:23 trial011 ceph-mon[11956]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T02:17:23.951 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:23 trial011 ceph-mon[11956]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c1786ae4-a736-47b0-8302-b06423efd012"} : dispatch 2026-02-13T02:17:23.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:23 trial011 ceph-mon[11956]: from='osd.0 [v2:10.20.193.11:6802/1061379396,v1:10.20.193.11:6803/1061379396]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial011", "root=default"]}]': finished 2026-02-13T02:17:23.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:23 trial011 ceph-mon[11956]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c1786ae4-a736-47b0-8302-b06423efd012"}]': finished 2026-02-13T02:17:23.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:23 trial011 ceph-mon[11956]: from='client.? 10.20.193.60:0/279739339' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c1786ae4-a736-47b0-8302-b06423efd012"} : dispatch 2026-02-13T02:17:23.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:23 trial011 ceph-mon[11956]: osdmap e6: 2 total, 0 up, 2 in 2026-02-13T02:17:23.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:23 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T02:17:23.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:23 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T02:17:23.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:23 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T02:17:23.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:23 trial011 ceph-mon[11956]: from='client.? 10.20.193.60:0/1999358629' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T02:17:23.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:23 trial011 ceph-mon[11956]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:17:23.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:23 trial011 ceph-mon[11956]: Cluster is now healthy 2026-02-13T02:17:24.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:23 trial060 ceph-mon[14797]: from='client.24131 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial060:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:17:24.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:23 trial060 ceph-mon[14797]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T02:17:24.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:23 trial060 ceph-mon[14797]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c1786ae4-a736-47b0-8302-b06423efd012"} : dispatch 2026-02-13T02:17:24.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:23 trial060 ceph-mon[14797]: from='osd.0 [v2:10.20.193.11:6802/1061379396,v1:10.20.193.11:6803/1061379396]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial011", "root=default"]}]': finished 2026-02-13T02:17:24.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:23 trial060 ceph-mon[14797]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c1786ae4-a736-47b0-8302-b06423efd012"}]': finished 2026-02-13T02:17:24.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:23 trial060 ceph-mon[14797]: from='client.? 10.20.193.60:0/279739339' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c1786ae4-a736-47b0-8302-b06423efd012"} : dispatch 2026-02-13T02:17:24.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:23 trial060 ceph-mon[14797]: osdmap e6: 2 total, 0 up, 2 in 2026-02-13T02:17:24.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:23 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T02:17:24.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:23 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T02:17:24.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:23 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T02:17:24.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:23 trial060 ceph-mon[14797]: from='client.? 10.20.193.60:0/1999358629' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T02:17:24.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:23 trial060 ceph-mon[14797]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:17:24.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:23 trial060 ceph-mon[14797]: Cluster is now healthy 2026-02-13T02:17:25.031 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:24 trial060 ceph-mon[14797]: purged_snaps scrub starts 2026-02-13T02:17:25.032 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:24 trial060 ceph-mon[14797]: purged_snaps scrub ok 2026-02-13T02:17:25.032 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:24 trial060 ceph-mon[14797]: osd.0 [v2:10.20.193.11:6802/1061379396,v1:10.20.193.11:6803/1061379396] boot 2026-02-13T02:17:25.032 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:24 trial060 ceph-mon[14797]: osdmap e7: 2 total, 1 up, 2 in 2026-02-13T02:17:25.032 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:24 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T02:17:25.032 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:24 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T02:17:25.032 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:24 trial060 ceph-mon[14797]: pgmap v22: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T02:17:25.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:24 trial011 ceph-mon[11956]: purged_snaps scrub starts 2026-02-13T02:17:25.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:24 trial011 ceph-mon[11956]: purged_snaps scrub ok 2026-02-13T02:17:25.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:24 trial011 ceph-mon[11956]: osd.0 [v2:10.20.193.11:6802/1061379396,v1:10.20.193.11:6803/1061379396] boot 2026-02-13T02:17:25.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:24 trial011 ceph-mon[11956]: osdmap e7: 2 total, 1 up, 2 in 2026-02-13T02:17:25.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:24 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T02:17:25.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:24 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T02:17:25.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:24 trial011 ceph-mon[11956]: pgmap v22: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T02:17:25.291 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:24 trial078 ceph-mon[14969]: purged_snaps scrub starts 2026-02-13T02:17:25.291 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:24 trial078 ceph-mon[14969]: purged_snaps scrub ok 2026-02-13T02:17:25.291 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:24 trial078 ceph-mon[14969]: osd.0 [v2:10.20.193.11:6802/1061379396,v1:10.20.193.11:6803/1061379396] boot 2026-02-13T02:17:25.291 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:24 trial078 ceph-mon[14969]: osdmap e7: 2 total, 1 up, 2 in 2026-02-13T02:17:25.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:24 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T02:17:25.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:24 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T02:17:25.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:24 trial078 ceph-mon[14969]: pgmap v22: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T02:17:26.184 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:25 trial060 ceph-mon[14797]: pgmap v23: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T02:17:26.184 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:25 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:17:26.184 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:25 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:26.184 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:25 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:26.184 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:25 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:26.184 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:25 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:17:26.184 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:25 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:26.184 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:25 trial060 ceph-mon[14797]: pgmap v24: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T02:17:26.185 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:25 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:17:26.185 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:25 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:17:26.185 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:25 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:26.185 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:25 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2026-02-13T02:17:26.185 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:25 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:26.185 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:25 trial060 ceph-mon[14797]: pgmap v25: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T02:17:26.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:25 trial011 ceph-mon[11956]: pgmap v23: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T02:17:26.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:25 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:17:26.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:25 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:26.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:25 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:26.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:25 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:26.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:25 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:17:26.203 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:25 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:26.203 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:25 trial011 ceph-mon[11956]: pgmap v24: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T02:17:26.203 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:25 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:17:26.203 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:25 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:17:26.203 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:25 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:26.203 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:25 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2026-02-13T02:17:26.203 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:25 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:26.203 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:25 trial011 ceph-mon[11956]: pgmap v25: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T02:17:26.291 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:25 trial078 ceph-mon[14969]: pgmap v23: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T02:17:26.291 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:25 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:17:26.291 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:25 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:26.291 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:25 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:26.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:25 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:26.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:25 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:17:26.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:25 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:26.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:25 trial078 ceph-mon[14969]: pgmap v24: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T02:17:26.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:25 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:17:26.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:25 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:17:26.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:25 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:26.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:25 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2026-02-13T02:17:26.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:25 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:26.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:25 trial078 ceph-mon[14969]: pgmap v25: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T02:17:27.199 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:26 trial060 ceph-mon[14797]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:17:27.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:26 trial011 ceph-mon[11956]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:17:27.291 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:26 trial078 ceph-mon[14969]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:17:28.176 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:27 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:17:28.176 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:27 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:28.176 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:27 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:28.176 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:27 trial060 ceph-mon[14797]: pgmap v26: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T02:17:28.177 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:27 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:28.177 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:27 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:28.177 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:27 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:28.177 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:27 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:17:28.177 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:27 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:28.177 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:27 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:17:28.177 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:27 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:17:28.177 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:27 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:28.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:27 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:17:28.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:27 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:28.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:27 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:28.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:27 trial011 ceph-mon[11956]: pgmap v26: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T02:17:28.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:27 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:28.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:27 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:28.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:27 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:28.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:27 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:17:28.203 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:27 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:28.203 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:27 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:17:28.203 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:27 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:17:28.203 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:27 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:28.221 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:28.220+0000 7fdcf37fe6c0 1 -- 10.20.193.60:0/4097636386 <== mgr.14116 v2:10.20.193.11:6800/861334768 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7fdd0c174d30 con 0x7fdce40b55f0 2026-02-13T02:17:28.222 INFO:teuthology.orchestra.run.trial060.stdout:Created osd(s) 1 on host 'trial060' 2026-02-13T02:17:28.224 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:28.223+0000 7fdd10f996c0 1 -- 10.20.193.60:0/4097636386 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fdce40b55f0 msgr2=0x7fdce40d5aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:28.224 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:28.223+0000 7fdd10f996c0 1 --2- 10.20.193.60:0/4097636386 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fdce40b55f0 0x7fdce40d5aa0 secure :-1 s=READY pgs=80 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdd00005fd0 tx=0x7fdd000092c0 comp rx=0 tx=0).stop 2026-02-13T02:17:28.224 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:28.223+0000 7fdd10f996c0 1 -- 10.20.193.60:0/4097636386 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fdd0c1109f0 msgr2=0x7fdd0c0f97c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:28.224 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:28.223+0000 7fdd10f996c0 1 --2- 10.20.193.60:0/4097636386 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fdd0c1109f0 0x7fdd0c0f97c0 secure :-1 s=READY pgs=6 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdcfc00a390 tx=0x7fdcfc005530 comp rx=0 tx=0).stop 2026-02-13T02:17:28.224 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:28.223+0000 7fdd10f996c0 1 -- 10.20.193.60:0/4097636386 shutdown_connections 2026-02-13T02:17:28.224 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:28.223+0000 7fdd10f996c0 1 --2- 10.20.193.60:0/4097636386 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fdce40b55f0 0x7fdce40d5aa0 unknown :-1 s=CLOSED pgs=80 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:28.224 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:28.223+0000 7fdd10f996c0 1 --2- 10.20.193.60:0/4097636386 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fdd0c1109f0 0x7fdd0c0f97c0 unknown :-1 s=CLOSED pgs=6 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:28.224 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:28.223+0000 7fdd10f996c0 1 --2- 10.20.193.60:0/4097636386 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fdd0c110040 0x7fdd0c171380 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:28.224 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:28.223+0000 7fdd10f996c0 1 --2- 10.20.193.60:0/4097636386 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fdd0c10eec0 0x7fdd0c0f8f60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:28.224 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:28.223+0000 7fdd10f996c0 1 -- 10.20.193.60:0/4097636386 >> 10.20.193.60:0/4097636386 conn(0x7fdd0c0ec5c0 msgr2=0x7fdd0c0ef510 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:17:28.225 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:28.223+0000 7fdd10f996c0 1 -- 10.20.193.60:0/4097636386 shutdown_connections 2026-02-13T02:17:28.225 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:28.223+0000 7fdd10f996c0 1 -- 10.20.193.60:0/4097636386 wait complete. 2026-02-13T02:17:28.266 DEBUG:teuthology.orchestra.run.trial060:osd.1> sudo journalctl -f -n 0 -u ceph-fc631695-0881-11f1-899c-d404e6e7d460@osd.1.service 2026-02-13T02:17:28.268 INFO:tasks.cephadm:Deploying osd.2 on trial078 with /dev/vg_nvme/lv_4... 2026-02-13T02:17:28.268 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_4 2026-02-13T02:17:28.291 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:27 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:17:28.291 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:27 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:28.291 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:27 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:28.291 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:27 trial078 ceph-mon[14969]: pgmap v26: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T02:17:28.291 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:27 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:28.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:27 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:28.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:27 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:28.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:27 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:17:28.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:27 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:28.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:27 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:17:28.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:27 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:17:28.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:27 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:28.394 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.c/config 2026-02-13T02:17:28.895 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:17:28.911 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph orch daemon add osd trial078:vg_nvme/lv_4 --skip-validation 2026-02-13T02:17:29.081 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.c/config 2026-02-13T02:17:29.198 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:29.195+0000 7fa0a301b6c0 1 -- 10.20.193.78:0/3332229394 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa09c110040 msgr2=0x7fa09c1104b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:29.198 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:29.195+0000 7fa0a301b6c0 1 --2- 10.20.193.78:0/3332229394 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa09c110040 0x7fa09c1104b0 secure :-1 s=READY pgs=10 gs=1 cs=0 l=1 c_cookie=45340542142055807 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa084009970 tx=0x7fa08402ed20 comp rx=0 tx=0).stop 2026-02-13T02:17:29.198 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:29.195+0000 7fa0a301b6c0 1 -- 10.20.193.78:0/3332229394 shutdown_connections 2026-02-13T02:17:29.198 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:29.195+0000 7fa0a301b6c0 1 --2- 10.20.193.78:0/3332229394 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fa09c1109f0 0x7fa09c171380 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:29.198 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:29.195+0000 7fa0a301b6c0 1 --2- 10.20.193.78:0/3332229394 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa09c110040 0x7fa09c1104b0 unknown :-1 s=CLOSED pgs=10 gs=1 cs=0 l=1 c_cookie=45340542142055807 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:29.199 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:29.195+0000 7fa0a301b6c0 1 --2- 10.20.193.78:0/3332229394 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fa09c10eec0 0x7fa09c10f2b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:29.199 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:29.195+0000 7fa0a301b6c0 1 -- 10.20.193.78:0/3332229394 >> 10.20.193.78:0/3332229394 conn(0x7fa09c0ec5c0 msgr2=0x7fa09c10c9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:17:29.199 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:29.195+0000 7fa0a301b6c0 1 -- 10.20.193.78:0/3332229394 shutdown_connections 2026-02-13T02:17:29.199 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:29.195+0000 7fa0a301b6c0 1 -- 10.20.193.78:0/3332229394 wait complete. 2026-02-13T02:17:29.199 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:29.195+0000 7fa0a301b6c0 1 Processor -- start 2026-02-13T02:17:29.199 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:29.195+0000 7fa0a301b6c0 1 -- start start 2026-02-13T02:17:29.199 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:29.195+0000 7fa0a301b6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa09c10eec0 0x7fa09c0f90a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:29.199 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:29.195+0000 7fa0a301b6c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fa09c110040 0x7fa09c171380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:29.199 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:29.195+0000 7fa0a301b6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fa09c1109f0 0x7fa09c0f9900 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:29.199 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:29.195+0000 7fa0a301b6c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7fa09c0fa530 con 0x7fa09c1109f0 2026-02-13T02:17:29.199 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:29.195+0000 7fa0a301b6c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa09c0fa6a0 con 0x7fa09c110040 2026-02-13T02:17:29.199 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:29.195+0000 7fa0a301b6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa09c0fa860 con 0x7fa09c10eec0 2026-02-13T02:17:29.199 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:29.195+0000 7fa0a0d8c6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa09c10eec0 0x7fa09c0f90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:29.199 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:29.195+0000 7fa0a0d8c6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa09c10eec0 0x7fa09c0f90a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.78:3300/0 says I am v2:10.20.193.78:53288/0 (socket says 10.20.193.78:53288) 2026-02-13T02:17:29.199 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:29.195+0000 7fa0a0d8c6c0 1 -- 10.20.193.78:0/3593810048 learned_addr learned my addr 10.20.193.78:0/3593810048 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:17:29.199 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:29.196+0000 7fa0a158d6c0 1 --2- 10.20.193.78:0/3593810048 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fa09c1109f0 0x7fa09c0f9900 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:29.199 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:29.196+0000 7fa0a0d8c6c0 1 -- 10.20.193.78:0/3593810048 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fa09c110040 msgr2=0x7fa09c171380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:29.199 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:29.196+0000 7fa0a0d8c6c0 1 --2- 10.20.193.78:0/3593810048 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fa09c110040 0x7fa09c171380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:29.199 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:29.196+0000 7fa0a0d8c6c0 1 -- 10.20.193.78:0/3593810048 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fa09c1109f0 msgr2=0x7fa09c0f9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:29.199 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:29.196+0000 7fa0a0d8c6c0 1 --2- 10.20.193.78:0/3593810048 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fa09c1109f0 0x7fa09c0f9900 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:29.199 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:29.196+0000 7fa0a0d8c6c0 1 -- 10.20.193.78:0/3593810048 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa084009590 con 0x7fa09c10eec0 2026-02-13T02:17:29.199 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:29.196+0000 7fa0a0d8c6c0 1 --2- 10.20.193.78:0/3593810048 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa09c10eec0 0x7fa09c0f90a0 secure :-1 s=READY pgs=11 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa08c00b710 tx=0x7fa08c00bbe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:17:29.199 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:29.196+0000 7fa091ffb6c0 1 -- 10.20.193.78:0/3593810048 <== mon.1 v2:10.20.193.78:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa08c004250 con 0x7fa09c10eec0 2026-02-13T02:17:29.199 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:29.196+0000 7fa091ffb6c0 1 -- 10.20.193.78:0/3593810048 <== mon.1 v2:10.20.193.78:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa08c002da0 con 0x7fa09c10eec0 2026-02-13T02:17:29.199 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:29.196+0000 7fa0a301b6c0 1 -- 10.20.193.78:0/3593810048 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa09c0fab40 con 0x7fa09c10eec0 2026-02-13T02:17:29.199 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:29.196+0000 7fa091ffb6c0 1 -- 10.20.193.78:0/3593810048 <== mon.1 v2:10.20.193.78:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa08c00ce40 con 0x7fa09c10eec0 2026-02-13T02:17:29.199 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:29.196+0000 7fa0a301b6c0 1 -- 10.20.193.78:0/3593810048 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa09c0fb070 con 0x7fa09c10eec0 2026-02-13T02:17:29.200 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:29.196+0000 7fa0a301b6c0 1 -- 10.20.193.78:0/3593810048 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa09c175390 con 0x7fa09c10eec0 2026-02-13T02:17:29.200 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:29.198+0000 7fa091ffb6c0 1 -- 10.20.193.78:0/3593810048 <== mon.1 v2:10.20.193.78:3300/0 4 ==== mgrmap(e 9) ==== 157010+0+0 (secure 0 0 0) 0x7fa08c00c410 con 0x7fa09c10eec0 2026-02-13T02:17:29.201 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:29.198+0000 7fa091ffb6c0 1 --2- 10.20.193.78:0/3593810048 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fa0780b55f0 0x7fa0780d5aa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:29.201 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:29.199+0000 7fa091ffb6c0 1 -- 10.20.193.78:0/3593810048 <== mon.1 v2:10.20.193.78:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1660+0+0 (secure 0 0 0) 0x7fa08c0e21e0 con 0x7fa09c10eec0 2026-02-13T02:17:29.201 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:29.199+0000 7fa093fff6c0 1 --2- 10.20.193.78:0/3593810048 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fa0780b55f0 0x7fa0780d5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:29.201 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:29.199+0000 7fa091ffb6c0 1 -- 10.20.193.78:0/3593810048 <== mon.1 v2:10.20.193.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fa08c0a6620 con 0x7fa09c10eec0 2026-02-13T02:17:29.202 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:29.199+0000 7fa093fff6c0 1 --2- 10.20.193.78:0/3593810048 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fa0780b55f0 0x7fa0780d5aa0 secure :-1 s=READY pgs=85 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa084005b40 tx=0x7fa084005bc0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:17:29.299 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:29.296+0000 7fa0a301b6c0 1 -- 10.20.193.78:0/3593810048 --> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial078:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7fa09c0efc80 con 0x7fa0780b55f0 2026-02-13T02:17:29.457 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:29 trial078 ceph-mon[14969]: pgmap v27: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T02:17:29.457 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:29 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:29.457 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:29 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:29.457 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:29 trial078 ceph-mon[14969]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2026-02-13T02:17:29.457 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:29 trial078 ceph-mon[14969]: from='osd.1 [v2:10.20.193.60:6800/2198425396,v1:10.20.193.60:6801/2198425396]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2026-02-13T02:17:29.457 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:29 trial078 ceph-mon[14969]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:17:29.458 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:29 trial078 ceph-mon[14969]: Cluster is now healthy 2026-02-13T02:17:29.458 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:29 trial078 ceph-mon[14969]: pgmap v28: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T02:17:29.458 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:29 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:17:29.458 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:29 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:29.458 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:29 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:29.458 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:29 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T02:17:29.458 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:29 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:29.458 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:29 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:29.458 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:29 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:17:29.458 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:29 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:29.458 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:29 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:17:29.458 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:29 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:17:29.459 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:29 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:29.463 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:29 trial060 ceph-mon[14797]: pgmap v27: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T02:17:29.463 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:29 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:29.463 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:29 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:29.463 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:29 trial060 ceph-mon[14797]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2026-02-13T02:17:29.464 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:29 trial060 ceph-mon[14797]: from='osd.1 [v2:10.20.193.60:6800/2198425396,v1:10.20.193.60:6801/2198425396]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2026-02-13T02:17:29.464 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:29 trial060 ceph-mon[14797]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:17:29.464 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:29 trial060 ceph-mon[14797]: Cluster is now healthy 2026-02-13T02:17:29.464 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:29 trial060 ceph-mon[14797]: pgmap v28: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T02:17:29.464 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:29 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:17:29.464 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:29 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:29.464 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:29 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:29.464 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:29 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T02:17:29.464 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:29 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:29.464 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:29 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:29.464 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:29 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:17:29.465 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:29 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:29.465 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:29 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:17:29.465 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:29 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:17:29.465 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:29 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:29.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:29 trial011 ceph-mon[11956]: pgmap v27: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T02:17:29.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:29 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:29.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:29 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:29.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:29 trial011 ceph-mon[11956]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2026-02-13T02:17:29.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:29 trial011 ceph-mon[11956]: from='osd.1 [v2:10.20.193.60:6800/2198425396,v1:10.20.193.60:6801/2198425396]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2026-02-13T02:17:29.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:29 trial011 ceph-mon[11956]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:17:29.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:29 trial011 ceph-mon[11956]: Cluster is now healthy 2026-02-13T02:17:29.703 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:29 trial011 ceph-mon[11956]: pgmap v28: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T02:17:29.703 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:29 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:17:29.703 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:29 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:29.703 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:29 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:29.703 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:29 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T02:17:29.703 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:29 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:29.703 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:29 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:29.703 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:29 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:17:29.703 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:29 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:29.703 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:29 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:17:29.703 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:29 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:17:29.703 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:29 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:30.250 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:30 trial060 ceph-mon[14797]: pgmap v29: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T02:17:30.251 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:30 trial060 ceph-mon[14797]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2026-02-13T02:17:30.251 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:30 trial060 ceph-mon[14797]: osdmap e8: 2 total, 1 up, 2 in 2026-02-13T02:17:30.251 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:30 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T02:17:30.251 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:30 trial060 ceph-mon[14797]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial060", "root=default"]} : dispatch 2026-02-13T02:17:30.251 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:30 trial060 ceph-mon[14797]: from='osd.1 [v2:10.20.193.60:6800/2198425396,v1:10.20.193.60:6801/2198425396]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial060", "root=default"]} : dispatch 2026-02-13T02:17:30.251 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:30 trial060 ceph-mon[14797]: from='client.24145 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial078:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:17:30.251 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:30 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:30.251 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:30 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:30.251 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:30 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:17:30.252 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:30 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:17:30.252 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:30 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:30.252 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:30 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:17:30.252 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:30 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:30.252 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:30 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:30.252 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:30 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:30.252 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:30 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:17:30.252 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:30 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:30.252 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:30 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:17:30.252 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:30 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:17:30.252 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:30 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:30.252 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:30 trial060 ceph-mon[14797]: from='client.? 10.20.193.78:0/2544986036' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "516f1aa0-bc7c-4808-8ac8-4ff406c71890"} : dispatch 2026-02-13T02:17:30.253 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:30 trial060 ceph-mon[14797]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "516f1aa0-bc7c-4808-8ac8-4ff406c71890"} : dispatch 2026-02-13T02:17:30.253 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:30 trial060 ceph-mon[14797]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial060", "root=default"]}]': finished 2026-02-13T02:17:30.253 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:30 trial060 ceph-mon[14797]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "516f1aa0-bc7c-4808-8ac8-4ff406c71890"}]': finished 2026-02-13T02:17:30.253 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:30 trial060 ceph-mon[14797]: osdmap e9: 3 total, 1 up, 3 in 2026-02-13T02:17:30.253 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:30 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T02:17:30.253 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:30 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T02:17:30.253 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:30 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T02:17:30.253 INFO:journalctl@ceph.osd.1.trial060.stdout:Feb 13 02:17:29 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-1[19684]: 2026-02-13T02:17:29.983+0000 7f1e495746c0 -1 osd.1 0 waiting for initial osdmap 2026-02-13T02:17:30.254 INFO:journalctl@ceph.osd.1.trial060.stdout:Feb 13 02:17:29 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-1[19684]: 2026-02-13T02:17:29.986+0000 7f1e454496c0 -1 osd.1 9 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T02:17:30.541 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:30 trial078 ceph-mon[14969]: pgmap v29: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T02:17:30.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:30 trial078 ceph-mon[14969]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2026-02-13T02:17:30.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:30 trial078 ceph-mon[14969]: osdmap e8: 2 total, 1 up, 2 in 2026-02-13T02:17:30.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:30 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T02:17:30.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:30 trial078 ceph-mon[14969]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial060", "root=default"]} : dispatch 2026-02-13T02:17:30.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:30 trial078 ceph-mon[14969]: from='osd.1 [v2:10.20.193.60:6800/2198425396,v1:10.20.193.60:6801/2198425396]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial060", "root=default"]} : dispatch 2026-02-13T02:17:30.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:30 trial078 ceph-mon[14969]: from='client.24145 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial078:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:17:30.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:30 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:30.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:30 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:30.543 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:30 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:17:30.543 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:30 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:17:30.543 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:30 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:30.543 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:30 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:17:30.543 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:30 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:30.543 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:30 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:30.543 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:30 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:30.543 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:30 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:17:30.543 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:30 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:30.543 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:30 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:17:30.543 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:30 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:17:30.543 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:30 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:30.544 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:30 trial078 ceph-mon[14969]: from='client.? 10.20.193.78:0/2544986036' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "516f1aa0-bc7c-4808-8ac8-4ff406c71890"} : dispatch 2026-02-13T02:17:30.544 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:30 trial078 ceph-mon[14969]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "516f1aa0-bc7c-4808-8ac8-4ff406c71890"} : dispatch 2026-02-13T02:17:30.544 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:30 trial078 ceph-mon[14969]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial060", "root=default"]}]': finished 2026-02-13T02:17:30.544 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:30 trial078 ceph-mon[14969]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "516f1aa0-bc7c-4808-8ac8-4ff406c71890"}]': finished 2026-02-13T02:17:30.544 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:30 trial078 ceph-mon[14969]: osdmap e9: 3 total, 1 up, 3 in 2026-02-13T02:17:30.544 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:30 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T02:17:30.544 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:30 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T02:17:30.544 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:30 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T02:17:30.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:30 trial011 ceph-mon[11956]: pgmap v29: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T02:17:30.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:30 trial011 ceph-mon[11956]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2026-02-13T02:17:30.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:30 trial011 ceph-mon[11956]: osdmap e8: 2 total, 1 up, 2 in 2026-02-13T02:17:30.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:30 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T02:17:30.703 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:30 trial011 ceph-mon[11956]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial060", "root=default"]} : dispatch 2026-02-13T02:17:30.703 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:30 trial011 ceph-mon[11956]: from='osd.1 [v2:10.20.193.60:6800/2198425396,v1:10.20.193.60:6801/2198425396]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial060", "root=default"]} : dispatch 2026-02-13T02:17:30.703 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:30 trial011 ceph-mon[11956]: from='client.24145 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial078:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:17:30.703 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:30 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:30.703 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:30 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:30.703 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:30 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:17:30.703 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:30 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:17:30.703 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:30 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:30.703 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:30 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:17:30.703 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:30 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:30.703 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:30 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:30.703 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:30 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:30.704 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:30 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:17:30.704 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:30 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:30.704 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:30 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:17:30.704 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:30 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:17:30.704 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:30 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:30.704 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:30 trial011 ceph-mon[11956]: from='client.? 10.20.193.78:0/2544986036' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "516f1aa0-bc7c-4808-8ac8-4ff406c71890"} : dispatch 2026-02-13T02:17:30.704 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:30 trial011 ceph-mon[11956]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "516f1aa0-bc7c-4808-8ac8-4ff406c71890"} : dispatch 2026-02-13T02:17:30.704 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:30 trial011 ceph-mon[11956]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial060", "root=default"]}]': finished 2026-02-13T02:17:30.704 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:30 trial011 ceph-mon[11956]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "516f1aa0-bc7c-4808-8ac8-4ff406c71890"}]': finished 2026-02-13T02:17:30.704 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:30 trial011 ceph-mon[11956]: osdmap e9: 3 total, 1 up, 3 in 2026-02-13T02:17:30.704 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:30 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T02:17:30.704 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:30 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T02:17:30.705 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:30 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T02:17:31.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:31 trial060 ceph-mon[14797]: pgmap v31: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T02:17:31.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:31 trial060 ceph-mon[14797]: pgmap v32: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T02:17:31.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:31 trial060 ceph-mon[14797]: from='client.? 10.20.193.78:0/2678504636' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T02:17:31.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:31 trial060 ceph-mon[14797]: osd.1 [v2:10.20.193.60:6800/2198425396,v1:10.20.193.60:6801/2198425396] boot 2026-02-13T02:17:31.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:31 trial060 ceph-mon[14797]: osdmap e10: 3 total, 2 up, 3 in 2026-02-13T02:17:31.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:31 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T02:17:31.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:31 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T02:17:31.541 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:31 trial078 ceph-mon[14969]: pgmap v31: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T02:17:31.541 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:31 trial078 ceph-mon[14969]: pgmap v32: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T02:17:31.541 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:31 trial078 ceph-mon[14969]: from='client.? 10.20.193.78:0/2678504636' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T02:17:31.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:31 trial078 ceph-mon[14969]: osd.1 [v2:10.20.193.60:6800/2198425396,v1:10.20.193.60:6801/2198425396] boot 2026-02-13T02:17:31.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:31 trial078 ceph-mon[14969]: osdmap e10: 3 total, 2 up, 3 in 2026-02-13T02:17:31.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:31 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T02:17:31.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:31 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T02:17:31.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:31 trial011 ceph-mon[11956]: pgmap v31: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T02:17:31.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:31 trial011 ceph-mon[11956]: pgmap v32: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T02:17:31.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:31 trial011 ceph-mon[11956]: from='client.? 10.20.193.78:0/2678504636' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T02:17:31.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:31 trial011 ceph-mon[11956]: osd.1 [v2:10.20.193.60:6800/2198425396,v1:10.20.193.60:6801/2198425396] boot 2026-02-13T02:17:31.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:31 trial011 ceph-mon[11956]: osdmap e10: 3 total, 2 up, 3 in 2026-02-13T02:17:31.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:31 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T02:17:31.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:31 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T02:17:32.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:32 trial060 ceph-mon[14797]: purged_snaps scrub starts 2026-02-13T02:17:32.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:32 trial060 ceph-mon[14797]: purged_snaps scrub ok 2026-02-13T02:17:32.541 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:32 trial078 ceph-mon[14969]: purged_snaps scrub starts 2026-02-13T02:17:32.541 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:32 trial078 ceph-mon[14969]: purged_snaps scrub ok 2026-02-13T02:17:32.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:32 trial011 ceph-mon[11956]: purged_snaps scrub starts 2026-02-13T02:17:32.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:32 trial011 ceph-mon[11956]: purged_snaps scrub ok 2026-02-13T02:17:33.395 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:33 trial078 ceph-mon[14969]: pgmap v35: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T02:17:33.396 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:33 trial078 ceph-mon[14969]: pgmap v36: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T02:17:33.396 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:33 trial078 ceph-mon[14969]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:17:33.396 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:33 trial078 ceph-mon[14969]: osdmap e11: 3 total, 2 up, 3 in 2026-02-13T02:17:33.396 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:33 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T02:17:33.396 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:33 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2026-02-13T02:17:33.396 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:33 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:33.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:33 trial060 ceph-mon[14797]: pgmap v35: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T02:17:33.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:33 trial060 ceph-mon[14797]: pgmap v36: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T02:17:33.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:33 trial060 ceph-mon[14797]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:17:33.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:33 trial060 ceph-mon[14797]: osdmap e11: 3 total, 2 up, 3 in 2026-02-13T02:17:33.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:33 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T02:17:33.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:33 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2026-02-13T02:17:33.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:33 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:33.701 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:33 trial011 ceph-mon[11956]: pgmap v35: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T02:17:33.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:33 trial011 ceph-mon[11956]: pgmap v36: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T02:17:33.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:33 trial011 ceph-mon[11956]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:17:33.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:33 trial011 ceph-mon[11956]: osdmap e11: 3 total, 2 up, 3 in 2026-02-13T02:17:33.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:33 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T02:17:33.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:33 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2026-02-13T02:17:33.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:33 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:35.165 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:35.162+0000 7fa091ffb6c0 1 -- 10.20.193.78:0/3593810048 <== mgr.14116 v2:10.20.193.11:6800/861334768 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7fa09c0efc80 con 0x7fa0780b55f0 2026-02-13T02:17:35.166 INFO:teuthology.orchestra.run.trial078.stdout:Created osd(s) 2 on host 'trial078' 2026-02-13T02:17:35.168 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:35.165+0000 7fa0a301b6c0 1 -- 10.20.193.78:0/3593810048 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fa0780b55f0 msgr2=0x7fa0780d5aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:35.168 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:35.165+0000 7fa0a301b6c0 1 --2- 10.20.193.78:0/3593810048 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fa0780b55f0 0x7fa0780d5aa0 secure :-1 s=READY pgs=85 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa084005b40 tx=0x7fa084005bc0 comp rx=0 tx=0).stop 2026-02-13T02:17:35.168 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:35.165+0000 7fa0a301b6c0 1 -- 10.20.193.78:0/3593810048 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa09c10eec0 msgr2=0x7fa09c0f90a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:35.168 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:35.165+0000 7fa0a301b6c0 1 --2- 10.20.193.78:0/3593810048 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa09c10eec0 0x7fa09c0f90a0 secure :-1 s=READY pgs=11 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa08c00b710 tx=0x7fa08c00bbe0 comp rx=0 tx=0).stop 2026-02-13T02:17:35.169 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:35.165+0000 7fa0a301b6c0 1 -- 10.20.193.78:0/3593810048 shutdown_connections 2026-02-13T02:17:35.169 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:35.165+0000 7fa0a301b6c0 1 --2- 10.20.193.78:0/3593810048 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fa0780b55f0 0x7fa0780d5aa0 unknown :-1 s=CLOSED pgs=85 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:35.169 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:35.165+0000 7fa0a301b6c0 1 --2- 10.20.193.78:0/3593810048 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fa09c110040 0x7fa09c171380 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:35.169 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:35.165+0000 7fa0a301b6c0 1 --2- 10.20.193.78:0/3593810048 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fa09c1109f0 0x7fa09c0f9900 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:35.169 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:35.165+0000 7fa0a301b6c0 1 --2- 10.20.193.78:0/3593810048 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa09c10eec0 0x7fa09c0f90a0 unknown :-1 s=CLOSED pgs=11 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:35.169 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:35.165+0000 7fa0a301b6c0 1 -- 10.20.193.78:0/3593810048 >> 10.20.193.78:0/3593810048 conn(0x7fa09c0ec5c0 msgr2=0x7fa09c0ef570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:17:35.169 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:35.165+0000 7fa0a301b6c0 1 -- 10.20.193.78:0/3593810048 shutdown_connections 2026-02-13T02:17:35.169 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:35.165+0000 7fa0a301b6c0 1 -- 10.20.193.78:0/3593810048 wait complete. 2026-02-13T02:17:35.215 DEBUG:teuthology.orchestra.run.trial078:osd.2> sudo journalctl -f -n 0 -u ceph-fc631695-0881-11f1-899c-d404e6e7d460@osd.2.service 2026-02-13T02:17:35.218 INFO:tasks.cephadm:Deploying osd.3 on trial011 with /dev/vg_nvme/lv_3... 2026-02-13T02:17:35.218 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_3 2026-02-13T02:17:35.346 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:17:35.389 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:35 trial078 ceph-mon[14969]: pgmap v38: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T02:17:35.389 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:35 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:17:35.389 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:35 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:35.389 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:35 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:35.389 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:35 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:35.389 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:35 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:35.389 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:35 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:35.389 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:35 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:17:35.390 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:35 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:35.390 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:35 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:17:35.390 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:35 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:17:35.390 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:35 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:35.390 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:35 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:35.390 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:35 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:35.390 INFO:journalctl@ceph.osd.2.trial078.stdout:Feb 13 02:17:35 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-2[20023]: 2026-02-13T02:17:35.275+0000 7f11342c5780 -1 osd.2 0 log_to_monitors true 2026-02-13T02:17:35.490 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:35 trial011 ceph-mon[11956]: pgmap v38: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T02:17:35.490 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:35 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:17:35.490 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:35 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:35.490 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:35 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:35.490 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:35 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:35.490 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:35 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:35.490 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:35 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:35.490 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:35 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:17:35.491 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:35 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:35.491 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:35 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:17:35.491 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:35 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:17:35.491 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:35 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:35.491 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:35 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:35.491 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:35 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:35.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:35 trial060 ceph-mon[14797]: pgmap v38: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T02:17:35.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:35 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:17:35.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:35 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:35.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:35 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:35.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:35 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:35.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:35 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:35.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:35 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:35.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:35 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:17:35.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:35 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:35.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:35 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:17:35.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:35 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:17:35.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:35 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:35.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:35 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:35.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:35 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:35.819 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:17:35.837 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph orch daemon add osd trial011:vg_nvme/lv_3 --skip-validation 2026-02-13T02:17:35.960 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:17:36.078 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:36.074+0000 7f7302ee96c0 1 -- 10.20.193.11:0/2782774550 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f72fc110050 msgr2=0x7f72fc1104c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:36.079 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:36.074+0000 7f7302ee96c0 1 --2- 10.20.193.11:0/2782774550 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f72fc110050 0x7f72fc1104c0 secure :-1 s=READY pgs=149 gs=1 cs=0 l=1 c_cookie=10407813574389509274 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f72e4009970 tx=0x7f72e402ed20 comp rx=0 tx=0).stop 2026-02-13T02:17:36.079 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:36.074+0000 7f7302ee96c0 1 -- 10.20.193.11:0/2782774550 shutdown_connections 2026-02-13T02:17:36.079 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:36.074+0000 7f7302ee96c0 1 --2- 10.20.193.11:0/2782774550 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f72fc110a00 0x7f72fc171390 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:36.079 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:36.074+0000 7f7302ee96c0 1 --2- 10.20.193.11:0/2782774550 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f72fc110050 0x7f72fc1104c0 unknown :-1 s=CLOSED pgs=149 gs=1 cs=0 l=1 c_cookie=10407813574389509274 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:36.079 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:36.074+0000 7f7302ee96c0 1 --2- 10.20.193.11:0/2782774550 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f72fc10eed0 0x7f72fc10f2c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:36.079 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:36.074+0000 7f7302ee96c0 1 -- 10.20.193.11:0/2782774550 >> 10.20.193.11:0/2782774550 conn(0x7f72fc0ec5f0 msgr2=0x7f72fc10ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:17:36.079 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:36.074+0000 7f7302ee96c0 1 -- 10.20.193.11:0/2782774550 shutdown_connections 2026-02-13T02:17:36.079 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:36.074+0000 7f7302ee96c0 1 -- 10.20.193.11:0/2782774550 wait complete. 2026-02-13T02:17:36.079 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:36.075+0000 7f7302ee96c0 1 Processor -- start 2026-02-13T02:17:36.079 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:36.075+0000 7f7302ee96c0 1 -- start start 2026-02-13T02:17:36.080 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:36.075+0000 7f7302ee96c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f72fc10eed0 0x7f72fc0f9020 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:36.080 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:36.075+0000 7f7302ee96c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f72fc110050 0x7f72fc171390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:36.080 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:36.075+0000 7f7302ee96c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f72fc110a00 0x7f72fc0f9880 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:36.080 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:36.075+0000 7f7302ee96c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f72fc0fa4b0 con 0x7f72fc110050 2026-02-13T02:17:36.080 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:36.075+0000 7f7302ee96c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f72fc0fa620 con 0x7f72fc110a00 2026-02-13T02:17:36.080 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:36.075+0000 7f7302ee96c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f72fc0fa7e0 con 0x7f72fc10eed0 2026-02-13T02:17:36.080 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:36.075+0000 7f72f3fff6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f72fc110050 0x7f72fc171390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:36.080 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:36.075+0000 7f72f3fff6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f72fc110050 0x7f72fc171390 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:53830/0 (socket says 10.20.193.11:53830) 2026-02-13T02:17:36.080 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:36.075+0000 7f72f3fff6c0 1 -- 10.20.193.11:0/390998011 learned_addr learned my addr 10.20.193.11:0/390998011 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:17:36.080 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:36.075+0000 7f7300c5a6c0 1 --2- 10.20.193.11:0/390998011 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f72fc10eed0 0x7f72fc0f9020 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:36.080 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:36.075+0000 7f730145b6c0 1 --2- 10.20.193.11:0/390998011 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f72fc110a00 0x7f72fc0f9880 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:36.081 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:36.075+0000 7f72f3fff6c0 1 -- 10.20.193.11:0/390998011 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f72fc10eed0 msgr2=0x7f72fc0f9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:36.081 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:36.075+0000 7f72f3fff6c0 1 --2- 10.20.193.11:0/390998011 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f72fc10eed0 0x7f72fc0f9020 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:36.081 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:36.075+0000 7f72f3fff6c0 1 -- 10.20.193.11:0/390998011 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f72fc110a00 msgr2=0x7f72fc0f9880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:36.081 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:36.075+0000 7f72f3fff6c0 1 --2- 10.20.193.11:0/390998011 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f72fc110a00 0x7f72fc0f9880 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:36.081 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:36.075+0000 7f72f3fff6c0 1 -- 10.20.193.11:0/390998011 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72e4009590 con 0x7f72fc110050 2026-02-13T02:17:36.081 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:36.075+0000 7f7300c5a6c0 1 --2- 10.20.193.11:0/390998011 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f72fc10eed0 0x7f72fc0f9020 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T02:17:36.081 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:36.075+0000 7f72f3fff6c0 1 --2- 10.20.193.11:0/390998011 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f72fc110050 0x7f72fc171390 secure :-1 s=READY pgs=150 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f72e4009290 tx=0x7f72e4004650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:17:36.081 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:36.075+0000 7f72f1ffb6c0 1 -- 10.20.193.11:0/390998011 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f72e4002ae0 con 0x7f72fc110050 2026-02-13T02:17:36.081 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:36.075+0000 7f72f1ffb6c0 1 -- 10.20.193.11:0/390998011 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f72e4002c40 con 0x7f72fc110050 2026-02-13T02:17:36.081 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:36.075+0000 7f7302ee96c0 1 -- 10.20.193.11:0/390998011 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72fc0faa60 con 0x7f72fc110050 2026-02-13T02:17:36.081 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:36.075+0000 7f72f1ffb6c0 1 -- 10.20.193.11:0/390998011 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f72e40373a0 con 0x7f72fc110050 2026-02-13T02:17:36.081 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:36.075+0000 7f7302ee96c0 1 -- 10.20.193.11:0/390998011 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72fc0faee0 con 0x7f72fc110050 2026-02-13T02:17:36.081 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:36.075+0000 7f7302ee96c0 1 -- 10.20.193.11:0/390998011 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72fc0fb100 con 0x7f72fc110050 2026-02-13T02:17:36.082 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:36.077+0000 7f72f1ffb6c0 1 -- 10.20.193.11:0/390998011 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 9) ==== 157010+0+0 (secure 0 0 0) 0x7f72e4007990 con 0x7f72fc110050 2026-02-13T02:17:36.083 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:36.077+0000 7f72f1ffb6c0 1 --2- 10.20.193.11:0/390998011 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f72d80b5570 0x7f72d80d5a20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:36.083 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:36.078+0000 7f7300c5a6c0 1 --2- 10.20.193.11:0/390998011 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f72d80b5570 0x7f72d80d5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:36.083 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:36.078+0000 7f72f1ffb6c0 1 -- 10.20.193.11:0/390998011 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(11..11 src has 1..11) ==== 2200+0+0 (secure 0 0 0) 0x7f72e4106590 con 0x7f72fc110050 2026-02-13T02:17:36.083 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:36.078+0000 7f72f1ffb6c0 1 -- 10.20.193.11:0/390998011 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f72e40ca7f0 con 0x7f72fc110050 2026-02-13T02:17:36.083 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:36.078+0000 7f7300c5a6c0 1 --2- 10.20.193.11:0/390998011 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f72d80b5570 0x7f72d80d5a20 secure :-1 s=READY pgs=90 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f72ec004750 tx=0x7f72ec009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:17:36.174 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:36.172+0000 7f7302ee96c0 1 -- 10.20.193.11:0/390998011 --> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial011:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7f72fc174d20 con 0x7f72d80b5570 2026-02-13T02:17:36.337 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:36 trial011 ceph-mon[11956]: pgmap v39: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T02:17:36.337 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:36 trial011 ceph-mon[11956]: from='osd.2 [v2:10.20.193.78:6800/3723638526,v1:10.20.193.78:6801/3723638526]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2026-02-13T02:17:36.337 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:36 trial011 ceph-mon[11956]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2026-02-13T02:17:36.337 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:36 trial011 ceph-mon[11956]: pgmap v40: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T02:17:36.338 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:36 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:17:36.338 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:36 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:36.338 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:36 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:36.338 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:36 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:36.338 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:36 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:17:36.338 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:36 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:36.338 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:36 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T02:17:36.338 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:36 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:17:36.338 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:36 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:36.338 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:36 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:36.338 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:36 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:36.339 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:36 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:17:36.339 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:36 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:36.339 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:36 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:17:36.339 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:36 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:17:36.339 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:36 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:36.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:36 trial060 ceph-mon[14797]: pgmap v39: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T02:17:36.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:36 trial060 ceph-mon[14797]: from='osd.2 [v2:10.20.193.78:6800/3723638526,v1:10.20.193.78:6801/3723638526]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2026-02-13T02:17:36.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:36 trial060 ceph-mon[14797]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2026-02-13T02:17:36.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:36 trial060 ceph-mon[14797]: pgmap v40: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T02:17:36.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:36 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:17:36.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:36 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:36.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:36 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:36.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:36 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:36.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:36 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:17:36.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:36 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:36.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:36 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T02:17:36.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:36 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:17:36.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:36 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:36.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:36 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:36.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:36 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:36.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:36 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:17:36.502 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:36 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:36.502 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:36 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:17:36.502 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:36 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:17:36.502 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:36 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:36.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:36 trial078 ceph-mon[14969]: pgmap v39: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T02:17:36.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:36 trial078 ceph-mon[14969]: from='osd.2 [v2:10.20.193.78:6800/3723638526,v1:10.20.193.78:6801/3723638526]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2026-02-13T02:17:36.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:36 trial078 ceph-mon[14969]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2026-02-13T02:17:36.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:36 trial078 ceph-mon[14969]: pgmap v40: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T02:17:36.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:36 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:17:36.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:36 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:36.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:36 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:36.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:36 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:36.543 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:36 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:17:36.543 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:36 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:36.543 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:36 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T02:17:36.543 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:36 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:17:36.543 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:36 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:36.543 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:36 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:36.543 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:36 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:36.543 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:36 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:17:36.543 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:36 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:36.543 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:36 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:17:36.543 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:36 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:17:36.544 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:36 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:37.490 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:37 trial011 ceph-mon[11956]: from='client.14442 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial011:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:17:37.490 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:37 trial011 ceph-mon[11956]: pgmap v41: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T02:17:37.490 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:37 trial011 ceph-mon[11956]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2026-02-13T02:17:37.491 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:37 trial011 ceph-mon[11956]: from='osd.2 [v2:10.20.193.78:6800/3723638526,v1:10.20.193.78:6801/3723638526]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial078", "root=default"]} : dispatch 2026-02-13T02:17:37.491 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:37 trial011 ceph-mon[11956]: osdmap e12: 3 total, 2 up, 3 in 2026-02-13T02:17:37.491 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:37 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T02:17:37.491 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:37 trial011 ceph-mon[11956]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial078", "root=default"]} : dispatch 2026-02-13T02:17:37.491 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:37 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:17:37.491 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:37 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:37.491 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:37 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:37.491 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:37 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:37.491 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:37 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:17:37.491 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:37 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:37.492 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:37 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:17:37.492 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:37 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:17:37.492 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:37 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:37.492 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:37 trial011 ceph-mon[11956]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:17:37.492 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:37 trial011 ceph-mon[11956]: Cluster is now healthy 2026-02-13T02:17:37.492 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:37 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/2372529974' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8cf508c2-b05d-42be-92e3-db0a57d22a85"} : dispatch 2026-02-13T02:17:37.492 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:37 trial011 ceph-mon[11956]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial078", "root=default"]}]': finished 2026-02-13T02:17:37.492 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:37 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/2372529974' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8cf508c2-b05d-42be-92e3-db0a57d22a85"}]': finished 2026-02-13T02:17:37.492 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:37 trial011 ceph-mon[11956]: osdmap e13: 4 total, 2 up, 4 in 2026-02-13T02:17:37.492 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:37 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T02:17:37.493 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:37 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T02:17:37.493 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:37 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T02:17:37.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:37 trial060 ceph-mon[14797]: from='client.14442 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial011:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:17:37.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:37 trial060 ceph-mon[14797]: pgmap v41: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T02:17:37.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:37 trial060 ceph-mon[14797]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2026-02-13T02:17:37.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:37 trial060 ceph-mon[14797]: from='osd.2 [v2:10.20.193.78:6800/3723638526,v1:10.20.193.78:6801/3723638526]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial078", "root=default"]} : dispatch 2026-02-13T02:17:37.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:37 trial060 ceph-mon[14797]: osdmap e12: 3 total, 2 up, 3 in 2026-02-13T02:17:37.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:37 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T02:17:37.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:37 trial060 ceph-mon[14797]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial078", "root=default"]} : dispatch 2026-02-13T02:17:37.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:37 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:17:37.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:37 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:37.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:37 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:37.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:37 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:37.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:37 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:17:37.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:37 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:37.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:37 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:17:37.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:37 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:17:37.502 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:37 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:37.502 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:37 trial060 ceph-mon[14797]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:17:37.502 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:37 trial060 ceph-mon[14797]: Cluster is now healthy 2026-02-13T02:17:37.502 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:37 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/2372529974' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8cf508c2-b05d-42be-92e3-db0a57d22a85"} : dispatch 2026-02-13T02:17:37.502 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:37 trial060 ceph-mon[14797]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial078", "root=default"]}]': finished 2026-02-13T02:17:37.502 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:37 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/2372529974' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8cf508c2-b05d-42be-92e3-db0a57d22a85"}]': finished 2026-02-13T02:17:37.502 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:37 trial060 ceph-mon[14797]: osdmap e13: 4 total, 2 up, 4 in 2026-02-13T02:17:37.502 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:37 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T02:17:37.502 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:37 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T02:17:37.502 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:37 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T02:17:37.541 INFO:journalctl@ceph.osd.2.trial078.stdout:Feb 13 02:17:37 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-2[20023]: 2026-02-13T02:17:37.194+0000 7f11301e66c0 -1 osd.2 0 waiting for initial osdmap 2026-02-13T02:17:37.542 INFO:journalctl@ceph.osd.2.trial078.stdout:Feb 13 02:17:37 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-2[20023]: 2026-02-13T02:17:37.196+0000 7f112c0bb6c0 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T02:17:37.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:37 trial078 ceph-mon[14969]: from='client.14442 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial011:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:17:37.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:37 trial078 ceph-mon[14969]: pgmap v41: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T02:17:37.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:37 trial078 ceph-mon[14969]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2026-02-13T02:17:37.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:37 trial078 ceph-mon[14969]: from='osd.2 [v2:10.20.193.78:6800/3723638526,v1:10.20.193.78:6801/3723638526]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial078", "root=default"]} : dispatch 2026-02-13T02:17:37.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:37 trial078 ceph-mon[14969]: osdmap e12: 3 total, 2 up, 3 in 2026-02-13T02:17:37.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:37 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T02:17:37.543 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:37 trial078 ceph-mon[14969]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial078", "root=default"]} : dispatch 2026-02-13T02:17:37.543 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:37 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:17:37.543 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:37 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:37.543 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:37 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:37.543 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:37 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:37.543 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:37 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:17:37.543 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:37 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:37.543 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:37 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:17:37.543 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:37 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:17:37.543 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:37 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:37.544 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:37 trial078 ceph-mon[14969]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:17:37.544 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:37 trial078 ceph-mon[14969]: Cluster is now healthy 2026-02-13T02:17:37.544 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:37 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/2372529974' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8cf508c2-b05d-42be-92e3-db0a57d22a85"} : dispatch 2026-02-13T02:17:37.544 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:37 trial078 ceph-mon[14969]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial078", "root=default"]}]': finished 2026-02-13T02:17:37.544 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:37 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/2372529974' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8cf508c2-b05d-42be-92e3-db0a57d22a85"}]': finished 2026-02-13T02:17:37.544 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:37 trial078 ceph-mon[14969]: osdmap e13: 4 total, 2 up, 4 in 2026-02-13T02:17:37.544 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:37 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T02:17:37.544 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:37 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T02:17:37.544 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:37 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T02:17:38.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:38 trial060 ceph-mon[14797]: pgmap v43: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T02:17:38.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:38 trial060 ceph-mon[14797]: pgmap v44: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T02:17:38.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:38 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/808224907' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T02:17:38.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:38 trial060 ceph-mon[14797]: osd.2 [v2:10.20.193.78:6800/3723638526,v1:10.20.193.78:6801/3723638526] boot 2026-02-13T02:17:38.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:38 trial060 ceph-mon[14797]: osdmap e14: 4 total, 3 up, 4 in 2026-02-13T02:17:38.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:38 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T02:17:38.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:38 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T02:17:38.541 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:38 trial078 ceph-mon[14969]: pgmap v43: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T02:17:38.541 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:38 trial078 ceph-mon[14969]: pgmap v44: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T02:17:38.541 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:38 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/808224907' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T02:17:38.541 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:38 trial078 ceph-mon[14969]: osd.2 [v2:10.20.193.78:6800/3723638526,v1:10.20.193.78:6801/3723638526] boot 2026-02-13T02:17:38.541 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:38 trial078 ceph-mon[14969]: osdmap e14: 4 total, 3 up, 4 in 2026-02-13T02:17:38.541 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:38 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T02:17:38.541 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:38 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T02:17:38.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:38 trial011 ceph-mon[11956]: pgmap v43: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T02:17:38.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:38 trial011 ceph-mon[11956]: pgmap v44: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T02:17:38.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:38 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/808224907' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T02:17:38.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:38 trial011 ceph-mon[11956]: osd.2 [v2:10.20.193.78:6800/3723638526,v1:10.20.193.78:6801/3723638526] boot 2026-02-13T02:17:38.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:38 trial011 ceph-mon[11956]: osdmap e14: 4 total, 3 up, 4 in 2026-02-13T02:17:38.703 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:38 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T02:17:38.703 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:38 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T02:17:39.416 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:39 trial011 ceph-mon[11956]: purged_snaps scrub starts 2026-02-13T02:17:39.416 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:39 trial011 ceph-mon[11956]: purged_snaps scrub ok 2026-02-13T02:17:39.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:39 trial060 ceph-mon[14797]: purged_snaps scrub starts 2026-02-13T02:17:39.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:39 trial060 ceph-mon[14797]: purged_snaps scrub ok 2026-02-13T02:17:39.541 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:39 trial078 ceph-mon[14969]: purged_snaps scrub starts 2026-02-13T02:17:39.541 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:39 trial078 ceph-mon[14969]: purged_snaps scrub ok 2026-02-13T02:17:40.296 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:40 trial011 ceph-mon[11956]: pgmap v47: 0 pgs: ; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T02:17:40.296 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:40 trial011 ceph-mon[11956]: osdmap e15: 4 total, 3 up, 4 in 2026-02-13T02:17:40.296 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:40 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T02:17:40.296 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:40 trial011 ceph-mon[11956]: pgmap v49: 0 pgs: ; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T02:17:40.296 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:40 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2026-02-13T02:17:40.297 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:40 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:40.297 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:40 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2026-02-13T02:17:40.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:40 trial060 ceph-mon[14797]: pgmap v47: 0 pgs: ; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T02:17:40.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:40 trial060 ceph-mon[14797]: osdmap e15: 4 total, 3 up, 4 in 2026-02-13T02:17:40.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:40 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T02:17:40.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:40 trial060 ceph-mon[14797]: pgmap v49: 0 pgs: ; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T02:17:40.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:40 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2026-02-13T02:17:40.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:40 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:40.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:40 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2026-02-13T02:17:40.541 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:40 trial078 ceph-mon[14969]: pgmap v47: 0 pgs: ; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T02:17:40.541 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:40 trial078 ceph-mon[14969]: osdmap e15: 4 total, 3 up, 4 in 2026-02-13T02:17:40.541 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:40 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T02:17:40.541 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:40 trial078 ceph-mon[14969]: pgmap v49: 0 pgs: ; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T02:17:40.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:40 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2026-02-13T02:17:40.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:40 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:40.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:40 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2026-02-13T02:17:41.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:41 trial060 ceph-mon[14797]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:17:41.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:41 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2026-02-13T02:17:41.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:41 trial060 ceph-mon[14797]: osdmap e16: 4 total, 3 up, 4 in 2026-02-13T02:17:41.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:41 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T02:17:41.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:41 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2026-02-13T02:17:41.501 INFO:journalctl@ceph.osd.1.trial060.stdout:Feb 13 02:17:41 trial060 sudo[22907]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme2n1 2026-02-13T02:17:41.501 INFO:journalctl@ceph.osd.1.trial060.stdout:Feb 13 02:17:41 trial060 sudo[22907]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T02:17:41.501 INFO:journalctl@ceph.osd.1.trial060.stdout:Feb 13 02:17:41 trial060 sudo[22907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T02:17:41.501 INFO:journalctl@ceph.osd.1.trial060.stdout:Feb 13 02:17:41 trial060 sudo[22907]: pam_unix(sudo:session): session closed for user root 2026-02-13T02:17:41.502 INFO:journalctl@ceph.osd.1.trial060.stdout:Feb 13 02:17:41 trial060 sudo[22911]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme2n1 2026-02-13T02:17:41.502 INFO:journalctl@ceph.osd.1.trial060.stdout:Feb 13 02:17:41 trial060 sudo[22911]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T02:17:41.502 INFO:journalctl@ceph.osd.1.trial060.stdout:Feb 13 02:17:41 trial060 sudo[22911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T02:17:41.502 INFO:journalctl@ceph.osd.1.trial060.stdout:Feb 13 02:17:41 trial060 sudo[22911]: pam_unix(sudo:session): session closed for user root 2026-02-13T02:17:41.505 INFO:journalctl@ceph.osd.0.trial011.stdout:Feb 13 02:17:41 trial011 sudo[30225]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme1n1 2026-02-13T02:17:41.505 INFO:journalctl@ceph.osd.0.trial011.stdout:Feb 13 02:17:41 trial011 sudo[30225]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T02:17:41.505 INFO:journalctl@ceph.osd.0.trial011.stdout:Feb 13 02:17:41 trial011 sudo[30225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T02:17:41.505 INFO:journalctl@ceph.osd.0.trial011.stdout:Feb 13 02:17:41 trial011 sudo[30225]: pam_unix(sudo:session): session closed for user root 2026-02-13T02:17:41.505 INFO:journalctl@ceph.osd.0.trial011.stdout:Feb 13 02:17:41 trial011 sudo[30229]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme1n1 2026-02-13T02:17:41.506 INFO:journalctl@ceph.osd.0.trial011.stdout:Feb 13 02:17:41 trial011 sudo[30229]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T02:17:41.506 INFO:journalctl@ceph.osd.0.trial011.stdout:Feb 13 02:17:41 trial011 sudo[30229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T02:17:41.506 INFO:journalctl@ceph.osd.0.trial011.stdout:Feb 13 02:17:41 trial011 sudo[30229]: pam_unix(sudo:session): session closed for user root 2026-02-13T02:17:41.506 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:41 trial011 ceph-mon[11956]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:17:41.506 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:41 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2026-02-13T02:17:41.506 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:41 trial011 ceph-mon[11956]: osdmap e16: 4 total, 3 up, 4 in 2026-02-13T02:17:41.506 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:41 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T02:17:41.506 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:41 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2026-02-13T02:17:41.507 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:41 trial011 sudo[30245]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2026-02-13T02:17:41.507 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:41 trial011 sudo[30245]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T02:17:41.507 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:41 trial011 sudo[30245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T02:17:41.507 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:41 trial011 sudo[30245]: pam_unix(sudo:session): session closed for user root 2026-02-13T02:17:41.507 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:41 trial011 sudo[30249]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme0n1 2026-02-13T02:17:41.507 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:41 trial011 sudo[30249]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T02:17:41.507 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:41 trial011 sudo[30249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T02:17:41.507 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:41 trial011 sudo[30249]: pam_unix(sudo:session): session closed for user root 2026-02-13T02:17:41.541 INFO:journalctl@ceph.osd.2.trial078.stdout:Feb 13 02:17:41 trial078 sudo[22998]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme2n1 2026-02-13T02:17:41.542 INFO:journalctl@ceph.osd.2.trial078.stdout:Feb 13 02:17:41 trial078 sudo[22998]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T02:17:41.542 INFO:journalctl@ceph.osd.2.trial078.stdout:Feb 13 02:17:41 trial078 sudo[22998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T02:17:41.542 INFO:journalctl@ceph.osd.2.trial078.stdout:Feb 13 02:17:41 trial078 sudo[22998]: pam_unix(sudo:session): session closed for user root 2026-02-13T02:17:41.542 INFO:journalctl@ceph.osd.2.trial078.stdout:Feb 13 02:17:41 trial078 sudo[23002]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme2n1 2026-02-13T02:17:41.542 INFO:journalctl@ceph.osd.2.trial078.stdout:Feb 13 02:17:41 trial078 sudo[23002]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T02:17:41.542 INFO:journalctl@ceph.osd.2.trial078.stdout:Feb 13 02:17:41 trial078 sudo[23002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T02:17:41.542 INFO:journalctl@ceph.osd.2.trial078.stdout:Feb 13 02:17:41 trial078 sudo[23002]: pam_unix(sudo:session): session closed for user root 2026-02-13T02:17:41.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:41 trial078 ceph-mon[14969]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:17:41.543 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:41 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2026-02-13T02:17:41.543 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:41 trial078 ceph-mon[14969]: osdmap e16: 4 total, 3 up, 4 in 2026-02-13T02:17:41.543 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:41 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T02:17:41.543 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:41 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2026-02-13T02:17:41.543 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:41 trial078 sudo[23006]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme1n1 2026-02-13T02:17:41.543 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:41 trial078 sudo[23006]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T02:17:41.543 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:41 trial078 sudo[23006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T02:17:41.543 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:41 trial078 sudo[23006]: pam_unix(sudo:session): session closed for user root 2026-02-13T02:17:41.543 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:41 trial078 sudo[23010]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme1n1 2026-02-13T02:17:41.543 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:41 trial078 sudo[23010]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T02:17:41.544 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:41 trial078 sudo[23010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T02:17:41.544 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:41 trial078 sudo[23010]: pam_unix(sudo:session): session closed for user root 2026-02-13T02:17:42.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:41 trial060 sudo[22915]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2026-02-13T02:17:42.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:41 trial060 sudo[22915]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T02:17:42.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:41 trial060 sudo[22915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T02:17:42.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:41 trial060 sudo[22915]: pam_unix(sudo:session): session closed for user root 2026-02-13T02:17:42.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:41 trial060 sudo[22919]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme0n1 2026-02-13T02:17:42.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:41 trial060 sudo[22919]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T02:17:42.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:41 trial060 sudo[22919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T02:17:42.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:41 trial060 sudo[22919]: pam_unix(sudo:session): session closed for user root 2026-02-13T02:17:42.265 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:42 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2026-02-13T02:17:42.266 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:42 trial011 ceph-mon[11956]: osdmap e17: 4 total, 3 up, 4 in 2026-02-13T02:17:42.266 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:42 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T02:17:42.266 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:42 trial011 ceph-mon[11956]: pgmap v52: 1 pgs: 1 creating+peering; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T02:17:42.266 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:42 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:42.266 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:42 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:42.266 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:42 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:42.266 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:42 trial011 ceph-mon[11956]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-13T02:17:42.266 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:42 trial011 ceph-mon[11956]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-13T02:17:42.266 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:42 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T02:17:42.266 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:42 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T02:17:42.267 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:42 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T02:17:42.267 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:42 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:42.267 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:42 trial011 ceph-mon[11956]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-13T02:17:42.267 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:42 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T02:17:42.267 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:42 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T02:17:42.267 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:42 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T02:17:42.267 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:42 trial011 ceph-mon[11956]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-13T02:17:42.267 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:42 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:42.267 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:42 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T02:17:42.267 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:42 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T02:17:42.267 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:42 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T02:17:42.267 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:42 trial011 ceph-mon[11956]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-13T02:17:42.268 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:42 trial011 ceph-mon[11956]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-13T02:17:42.268 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:42 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:42.268 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:42 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:17:42.268 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:42 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:42.268 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:42 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:42.268 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:42 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:42.268 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:42 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:42.268 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:42 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:42.268 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:42 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:17:42.268 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:42 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:42.268 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:42 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:17:42.268 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:42 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:17:42.268 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:42 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:42.415 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:42.413+0000 7f72f1ffb6c0 1 -- 10.20.193.11:0/390998011 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mgrmap(e 10) ==== 157066+0+0 (secure 0 0 0) 0x7f72e40ca410 con 0x7f72fc110050 2026-02-13T02:17:42.534 INFO:teuthology.orchestra.run.trial011.stdout:Created osd(s) 3 on host 'trial011' 2026-02-13T02:17:42.534 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:42.531+0000 7f72f1ffb6c0 1 -- 10.20.193.11:0/390998011 <== mgr.14116 v2:10.20.193.11:6800/861334768 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f72fc174d20 con 0x7f72d80b5570 2026-02-13T02:17:42.536 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:42.534+0000 7f7302ee96c0 1 -- 10.20.193.11:0/390998011 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f72d80b5570 msgr2=0x7f72d80d5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:42.536 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:42.534+0000 7f7302ee96c0 1 --2- 10.20.193.11:0/390998011 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f72d80b5570 0x7f72d80d5a20 secure :-1 s=READY pgs=90 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f72ec004750 tx=0x7f72ec009260 comp rx=0 tx=0).stop 2026-02-13T02:17:42.536 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:42.534+0000 7f7302ee96c0 1 -- 10.20.193.11:0/390998011 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f72fc110050 msgr2=0x7f72fc171390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:42.536 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:42.534+0000 7f7302ee96c0 1 --2- 10.20.193.11:0/390998011 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f72fc110050 0x7f72fc171390 secure :-1 s=READY pgs=150 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f72e4009290 tx=0x7f72e4004650 comp rx=0 tx=0).stop 2026-02-13T02:17:42.536 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:42.534+0000 7f7302ee96c0 1 -- 10.20.193.11:0/390998011 shutdown_connections 2026-02-13T02:17:42.536 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:42.534+0000 7f7302ee96c0 1 --2- 10.20.193.11:0/390998011 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f72d80b5570 0x7f72d80d5a20 unknown :-1 s=CLOSED pgs=90 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:42.537 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:42.534+0000 7f7302ee96c0 1 --2- 10.20.193.11:0/390998011 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f72fc110a00 0x7f72fc0f9880 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:42.537 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:42.534+0000 7f7302ee96c0 1 --2- 10.20.193.11:0/390998011 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f72fc110050 0x7f72fc171390 unknown :-1 s=CLOSED pgs=150 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:42.537 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:42.534+0000 7f7302ee96c0 1 --2- 10.20.193.11:0/390998011 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f72fc10eed0 0x7f72fc0f9020 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:42.537 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:42.534+0000 7f7302ee96c0 1 -- 10.20.193.11:0/390998011 >> 10.20.193.11:0/390998011 conn(0x7f72fc0ec5f0 msgr2=0x7f72fc0ef570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:17:42.537 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:42.534+0000 7f7302ee96c0 1 -- 10.20.193.11:0/390998011 shutdown_connections 2026-02-13T02:17:42.537 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:42.534+0000 7f7302ee96c0 1 -- 10.20.193.11:0/390998011 wait complete. 2026-02-13T02:17:42.541 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:42 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2026-02-13T02:17:42.541 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:42 trial078 ceph-mon[14969]: osdmap e17: 4 total, 3 up, 4 in 2026-02-13T02:17:42.541 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:42 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T02:17:42.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:42 trial078 ceph-mon[14969]: pgmap v52: 1 pgs: 1 creating+peering; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T02:17:42.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:42 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:42.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:42 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:42.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:42 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:42.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:42 trial078 ceph-mon[14969]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-13T02:17:42.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:42 trial078 ceph-mon[14969]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-13T02:17:42.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:42 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T02:17:42.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:42 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T02:17:42.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:42 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T02:17:42.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:42 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:42.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:42 trial078 ceph-mon[14969]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-13T02:17:42.543 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:42 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T02:17:42.543 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:42 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T02:17:42.543 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:42 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T02:17:42.543 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:42 trial078 ceph-mon[14969]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-13T02:17:42.543 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:42 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:42.543 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:42 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T02:17:42.543 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:42 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T02:17:42.543 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:42 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T02:17:42.543 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:42 trial078 ceph-mon[14969]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-13T02:17:42.543 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:42 trial078 ceph-mon[14969]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-13T02:17:42.543 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:42 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:42.543 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:42 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:17:42.543 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:42 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:42.544 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:42 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:42.544 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:42 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:42.544 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:42 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:42.544 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:42 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:42.544 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:42 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:17:42.544 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:42 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:42.544 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:42 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:17:42.544 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:42 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:17:42.544 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:42 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:42.576 DEBUG:teuthology.orchestra.run.trial011:osd.3> sudo journalctl -f -n 0 -u ceph-fc631695-0881-11f1-899c-d404e6e7d460@osd.3.service 2026-02-13T02:17:42.579 INFO:tasks.cephadm:Deploying osd.4 on trial060 with /dev/vg_nvme/lv_3... 2026-02-13T02:17:42.579 DEBUG:teuthology.orchestra.run.trial060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_3 2026-02-13T02:17:42.608 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:42 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2026-02-13T02:17:42.608 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:42 trial060 ceph-mon[14797]: osdmap e17: 4 total, 3 up, 4 in 2026-02-13T02:17:42.608 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:42 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T02:17:42.609 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:42 trial060 ceph-mon[14797]: pgmap v52: 1 pgs: 1 creating+peering; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T02:17:42.609 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:42 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:42.609 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:42 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:42.609 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:42 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:42.609 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:42 trial060 ceph-mon[14797]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-13T02:17:42.609 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:42 trial060 ceph-mon[14797]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-13T02:17:42.609 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:42 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T02:17:42.609 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:42 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T02:17:42.609 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:42 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T02:17:42.609 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:42 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:42.609 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:42 trial060 ceph-mon[14797]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-13T02:17:42.609 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:42 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T02:17:42.610 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:42 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T02:17:42.610 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:42 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T02:17:42.610 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:42 trial060 ceph-mon[14797]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-13T02:17:42.610 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:42 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:42.610 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:42 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T02:17:42.610 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:42 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T02:17:42.610 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:42 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T02:17:42.610 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:42 trial060 ceph-mon[14797]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-13T02:17:42.610 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:42 trial060 ceph-mon[14797]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-13T02:17:42.610 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:42 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:42.610 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:42 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:17:42.610 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:42 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:42.610 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:42 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:42.611 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:42 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:42.611 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:42 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:42.611 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:42 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:42.611 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:42 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:17:42.611 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:42 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:42.611 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:42 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:17:42.611 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:42 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:17:42.611 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:42 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:42.709 INFO:teuthology.orchestra.run.trial060.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.b/config 2026-02-13T02:17:42.768 INFO:journalctl@ceph.osd.3.trial011.stdout:Feb 13 02:17:42 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-3[30441]: 2026-02-13T02:17:42.669+0000 7fb659813780 -1 osd.3 0 log_to_monitors true 2026-02-13T02:17:43.162 INFO:teuthology.orchestra.run.trial060.stdout: 2026-02-13T02:17:43.181 DEBUG:teuthology.orchestra.run.trial060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph orch daemon add osd trial060:vg_nvme/lv_3 --skip-validation 2026-02-13T02:17:43.346 INFO:teuthology.orchestra.run.trial060.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.b/config 2026-02-13T02:17:43.390 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:43 trial060 ceph-mon[14797]: pgmap v53: 1 pgs: 1 creating+peering; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T02:17:43.391 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:43 trial060 ceph-mon[14797]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:17:43.391 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:43 trial060 ceph-mon[14797]: Cluster is now healthy 2026-02-13T02:17:43.391 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:43 trial060 ceph-mon[14797]: osdmap e18: 4 total, 3 up, 4 in 2026-02-13T02:17:43.391 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:43 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T02:17:43.391 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:43 trial060 ceph-mon[14797]: mgrmap e10: x(active, since 60s), standbys: z, y 2026-02-13T02:17:43.391 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:43 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:43.391 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:43 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:43.391 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:43 trial060 ceph-mon[14797]: from='osd.3 [v2:10.20.193.11:6810/4224399876,v1:10.20.193.11:6811/4224399876]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2026-02-13T02:17:43.391 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:43 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:17:43.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:43 trial011 ceph-mon[11956]: pgmap v53: 1 pgs: 1 creating+peering; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T02:17:43.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:43 trial011 ceph-mon[11956]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:17:43.453 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:43 trial011 ceph-mon[11956]: Cluster is now healthy 2026-02-13T02:17:43.453 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:43 trial011 ceph-mon[11956]: osdmap e18: 4 total, 3 up, 4 in 2026-02-13T02:17:43.453 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:43 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T02:17:43.453 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:43 trial011 ceph-mon[11956]: mgrmap e10: x(active, since 60s), standbys: z, y 2026-02-13T02:17:43.453 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:43 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:43.453 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:43 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:43.453 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:43 trial011 ceph-mon[11956]: from='osd.3 [v2:10.20.193.11:6810/4224399876,v1:10.20.193.11:6811/4224399876]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2026-02-13T02:17:43.453 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:43 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:17:43.466 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:43.464+0000 7f482a7776c0 1 -- 10.20.193.60:0/2349970798 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f4824110040 msgr2=0x7f48241104b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:43.466 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:43.464+0000 7f482a7776c0 1 --2- 10.20.193.60:0/2349970798 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f4824110040 0x7f48241104b0 secure :-1 s=READY pgs=15 gs=1 cs=0 l=1 c_cookie=13777182827875450292 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4814009970 tx=0x7f481402ed50 comp rx=0 tx=0).stop 2026-02-13T02:17:43.467 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:43.464+0000 7f482a7776c0 1 -- 10.20.193.60:0/2349970798 shutdown_connections 2026-02-13T02:17:43.467 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:43.464+0000 7f482a7776c0 1 --2- 10.20.193.60:0/2349970798 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f4824110040 0x7f48241104b0 unknown :-1 s=CLOSED pgs=15 gs=1 cs=0 l=1 c_cookie=13777182827875450292 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:43.467 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:43.464+0000 7f482a7776c0 1 --2- 10.20.193.60:0/2349970798 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f48241109f0 0x7f4824171380 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:43.467 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:43.464+0000 7f482a7776c0 1 --2- 10.20.193.60:0/2349970798 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f482410eec0 0x7f482410f2b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:43.467 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:43.464+0000 7f482a7776c0 1 -- 10.20.193.60:0/2349970798 >> 10.20.193.60:0/2349970798 conn(0x7f48240ec5c0 msgr2=0x7f482410c9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:17:43.467 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:43.464+0000 7f482a7776c0 1 -- 10.20.193.60:0/2349970798 shutdown_connections 2026-02-13T02:17:43.467 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:43.464+0000 7f482a7776c0 1 -- 10.20.193.60:0/2349970798 wait complete. 2026-02-13T02:17:43.467 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:43.464+0000 7f482a7776c0 1 Processor -- start 2026-02-13T02:17:43.467 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:43.464+0000 7f482a7776c0 1 -- start start 2026-02-13T02:17:43.467 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:43.464+0000 7f482a7776c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f482410eec0 0x7f48240f9060 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:43.467 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:43.464+0000 7f482a7776c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f4824110040 0x7f4824171380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:43.468 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:43.464+0000 7f482a7776c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f48241109f0 0x7f48240f98c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:43.468 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:43.464+0000 7f482a7776c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f48240fa4f0 con 0x7f4824110040 2026-02-13T02:17:43.468 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:43.464+0000 7f482a7776c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f48240fa660 con 0x7f482410eec0 2026-02-13T02:17:43.468 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:43.464+0000 7f482a7776c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f48240fa820 con 0x7f48241109f0 2026-02-13T02:17:43.468 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:43.464+0000 7f4823fff6c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f482410eec0 0x7f48240f9060 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:43.468 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:43.464+0000 7f4823fff6c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f482410eec0 0x7f48240f9060 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.60:3300/0 says I am v2:10.20.193.60:40846/0 (socket says 10.20.193.60:40846) 2026-02-13T02:17:43.468 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:43.464+0000 7f4823fff6c0 1 -- 10.20.193.60:0/2991949029 learned_addr learned my addr 10.20.193.60:0/2991949029 (peer_addr_for_me v2:10.20.193.60:0/0) 2026-02-13T02:17:43.468 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:43.464+0000 7f48237fe6c0 1 --2- 10.20.193.60:0/2991949029 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f4824110040 0x7f4824171380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:43.468 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:43.464+0000 7f4828ce96c0 1 --2- 10.20.193.60:0/2991949029 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f48241109f0 0x7f48240f98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:43.468 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:43.464+0000 7f4823fff6c0 1 -- 10.20.193.60:0/2991949029 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f48241109f0 msgr2=0x7f48240f98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:43.468 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:43.464+0000 7f4823fff6c0 1 --2- 10.20.193.60:0/2991949029 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f48241109f0 0x7f48240f98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:43.468 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:43.464+0000 7f4823fff6c0 1 -- 10.20.193.60:0/2991949029 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f4824110040 msgr2=0x7f4824171380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:43.469 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:43.464+0000 7f4823fff6c0 1 --2- 10.20.193.60:0/2991949029 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f4824110040 0x7f4824171380 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:43.469 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:43.464+0000 7f4823fff6c0 1 -- 10.20.193.60:0/2991949029 --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4814009590 con 0x7f482410eec0 2026-02-13T02:17:43.469 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:43.464+0000 7f48237fe6c0 1 --2- 10.20.193.60:0/2991949029 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f4824110040 0x7f4824171380 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T02:17:43.469 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:43.464+0000 7f4823fff6c0 1 --2- 10.20.193.60:0/2991949029 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f482410eec0 0x7f48240f9060 secure :-1 s=READY pgs=16 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f481000b710 tx=0x7f481000bbe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:17:43.469 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:43.465+0000 7f48217fa6c0 1 -- 10.20.193.60:0/2991949029 <== mon.2 v2:10.20.193.60:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4810004250 con 0x7f482410eec0 2026-02-13T02:17:43.469 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:43.465+0000 7f48217fa6c0 1 -- 10.20.193.60:0/2991949029 <== mon.2 v2:10.20.193.60:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4810009070 con 0x7f482410eec0 2026-02-13T02:17:43.469 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:43.465+0000 7f482a7776c0 1 -- 10.20.193.60:0/2991949029 --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48240fab00 con 0x7f482410eec0 2026-02-13T02:17:43.469 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:43.465+0000 7f48217fa6c0 1 -- 10.20.193.60:0/2991949029 <== mon.2 v2:10.20.193.60:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f481000cd70 con 0x7f482410eec0 2026-02-13T02:17:43.469 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:43.465+0000 7f482a7776c0 1 -- 10.20.193.60:0/2991949029 --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48240fafe0 con 0x7f482410eec0 2026-02-13T02:17:43.469 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:43.465+0000 7f482a7776c0 1 -- 10.20.193.60:0/2991949029 --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48241753e0 con 0x7f482410eec0 2026-02-13T02:17:43.470 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:43.466+0000 7f48217fa6c0 1 -- 10.20.193.60:0/2991949029 <== mon.2 v2:10.20.193.60:3300/0 4 ==== mgrmap(e 10) ==== 157066+0+0 (secure 0 0 0) 0x7f48100028c0 con 0x7f482410eec0 2026-02-13T02:17:43.470 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:43.467+0000 7f48217fa6c0 1 --2- 10.20.193.60:0/2991949029 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f47f80b5600 0x7f47f80d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:43.471 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:43.467+0000 7f48217fa6c0 1 -- 10.20.193.60:0/2991949029 <== mon.2 v2:10.20.193.60:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3129+0+0 (secure 0 0 0) 0x7f48100e2810 con 0x7f482410eec0 2026-02-13T02:17:43.471 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:43.467+0000 7f48237fe6c0 1 --2- 10.20.193.60:0/2991949029 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f47f80b5600 0x7f47f80d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:43.471 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:43.468+0000 7f48217fa6c0 1 -- 10.20.193.60:0/2991949029 <== mon.2 v2:10.20.193.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f48100a65b0 con 0x7f482410eec0 2026-02-13T02:17:43.471 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:43.468+0000 7f48237fe6c0 1 --2- 10.20.193.60:0/2991949029 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f47f80b5600 0x7f47f80d5ab0 secure :-1 s=READY pgs=96 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f48140023e0 tx=0x7f4814005c40 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:17:43.541 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:43 trial078 ceph-mon[14969]: pgmap v53: 1 pgs: 1 creating+peering; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T02:17:43.541 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:43 trial078 ceph-mon[14969]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:17:43.541 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:43 trial078 ceph-mon[14969]: Cluster is now healthy 2026-02-13T02:17:43.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:43 trial078 ceph-mon[14969]: osdmap e18: 4 total, 3 up, 4 in 2026-02-13T02:17:43.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:43 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T02:17:43.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:43 trial078 ceph-mon[14969]: mgrmap e10: x(active, since 60s), standbys: z, y 2026-02-13T02:17:43.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:43 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:43.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:43 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:43.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:43 trial078 ceph-mon[14969]: from='osd.3 [v2:10.20.193.11:6810/4224399876,v1:10.20.193.11:6811/4224399876]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2026-02-13T02:17:43.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:43 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:17:43.566 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:43.566+0000 7f482a7776c0 1 -- 10.20.193.60:0/2991949029 --> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial060:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7f48240f1f50 con 0x7f47f80b5600 2026-02-13T02:17:44.317 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:44 trial060 ceph-mon[14797]: pgmap v55: 1 pgs: 1 creating+peering; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T02:17:44.317 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:44 trial060 ceph-mon[14797]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:17:44.317 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:44 trial060 ceph-mon[14797]: from='osd.3 [v2:10.20.193.11:6810/4224399876,v1:10.20.193.11:6811/4224399876]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2026-02-13T02:17:44.317 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:44 trial060 ceph-mon[14797]: osdmap e19: 4 total, 3 up, 4 in 2026-02-13T02:17:44.317 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:44 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T02:17:44.318 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:44 trial060 ceph-mon[14797]: from='osd.3 [v2:10.20.193.11:6810/4224399876,v1:10.20.193.11:6811/4224399876]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial011", "root=default"]} : dispatch 2026-02-13T02:17:44.318 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:44 trial060 ceph-mon[14797]: from='client.24215 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial060:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:17:44.318 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:44 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:44.318 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:44 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:44.318 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:44 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:17:44.318 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:44 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:17:44.318 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:44 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:44.318 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:44 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:44.318 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:44 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:44.318 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:44 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T02:17:44.318 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:44 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-13T02:17:44.319 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:44 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:44.319 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:44 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:44.319 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:44 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:17:44.319 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:44 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:44.319 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:44 trial060 ceph-mon[14797]: pgmap v57: 1 pgs: 1 creating+peering; 0 B data, 81 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T02:17:44.319 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:44 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:17:44.319 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:44 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:17:44.319 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:44 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:44.319 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:44 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:17:44.319 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:44 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:44.319 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:44 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:44.319 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:44 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:44.320 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:44 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:17:44.320 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:44 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:44.320 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:44 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:17:44.320 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:44 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:17:44.320 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:44 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:44.541 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:44 trial011 ceph-mon[11956]: pgmap v55: 1 pgs: 1 creating+peering; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T02:17:44.541 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:44 trial011 ceph-mon[11956]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:17:44.541 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:44 trial011 ceph-mon[11956]: from='osd.3 [v2:10.20.193.11:6810/4224399876,v1:10.20.193.11:6811/4224399876]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2026-02-13T02:17:44.542 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:44 trial011 ceph-mon[11956]: osdmap e19: 4 total, 3 up, 4 in 2026-02-13T02:17:44.542 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:44 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T02:17:44.542 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:44 trial011 ceph-mon[11956]: from='osd.3 [v2:10.20.193.11:6810/4224399876,v1:10.20.193.11:6811/4224399876]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial011", "root=default"]} : dispatch 2026-02-13T02:17:44.542 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:44 trial011 ceph-mon[11956]: from='client.24215 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial060:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:17:44.542 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:44 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:44.542 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:44 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:44.542 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:44 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:17:44.542 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:44 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:17:44.542 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:44 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:44.542 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:44 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:44.542 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:44 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:44.543 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:44 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T02:17:44.543 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:44 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-13T02:17:44.543 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:44 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:44.543 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:44 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:44.543 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:44 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:17:44.543 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:44 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:44.543 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:44 trial011 ceph-mon[11956]: pgmap v57: 1 pgs: 1 creating+peering; 0 B data, 81 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T02:17:44.543 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:44 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:17:44.543 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:44 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:17:44.543 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:44 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:44.543 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:44 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:17:44.543 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:44 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:44.544 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:44 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:44.544 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:44 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:44.544 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:44 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:17:44.544 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:44 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:44.544 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:44 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:17:44.544 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:44 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:17:44.544 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:44 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:44.545 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:44 trial078 ceph-mon[14969]: pgmap v55: 1 pgs: 1 creating+peering; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T02:17:44.545 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:44 trial078 ceph-mon[14969]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:17:44.545 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:44 trial078 ceph-mon[14969]: from='osd.3 [v2:10.20.193.11:6810/4224399876,v1:10.20.193.11:6811/4224399876]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2026-02-13T02:17:44.545 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:44 trial078 ceph-mon[14969]: osdmap e19: 4 total, 3 up, 4 in 2026-02-13T02:17:44.545 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:44 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T02:17:44.545 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:44 trial078 ceph-mon[14969]: from='osd.3 [v2:10.20.193.11:6810/4224399876,v1:10.20.193.11:6811/4224399876]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial011", "root=default"]} : dispatch 2026-02-13T02:17:44.545 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:44 trial078 ceph-mon[14969]: from='client.24215 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial060:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:17:44.545 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:44 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:44.546 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:44 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:44.546 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:44 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:17:44.546 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:44 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:17:44.546 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:44 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:44.546 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:44 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:44.546 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:44 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:44.546 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:44 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T02:17:44.546 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:44 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-13T02:17:44.546 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:44 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:44.546 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:44 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:44.546 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:44 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:17:44.546 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:44 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:44.546 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:44 trial078 ceph-mon[14969]: pgmap v57: 1 pgs: 1 creating+peering; 0 B data, 81 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T02:17:44.547 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:44 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:17:44.547 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:44 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:17:44.547 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:44 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:44.547 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:44 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:17:44.547 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:44 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:44.547 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:44 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:44.547 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:44 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:44.547 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:44 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:17:44.547 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:44 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:44.547 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:44 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:17:44.547 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:44 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:17:44.547 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:44 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:44.952 INFO:journalctl@ceph.osd.3.trial011.stdout:Feb 13 02:17:44 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-3[30441]: 2026-02-13T02:17:44.538+0000 7fb6557346c0 -1 osd.3 0 waiting for initial osdmap 2026-02-13T02:17:44.952 INFO:journalctl@ceph.osd.3.trial011.stdout:Feb 13 02:17:44 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-3[30441]: 2026-02-13T02:17:44.541+0000 7fb64d6016c0 -1 osd.3 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T02:17:45.791 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:45 trial078 ceph-mon[14969]: pgmap v58: 1 pgs: 1 creating+peering; 0 B data, 82 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T02:17:45.792 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:45 trial078 ceph-mon[14969]: pgmap v59: 1 pgs: 1 creating+peering; 0 B data, 82 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T02:17:45.792 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:45 trial078 ceph-mon[14969]: from='osd.3 [v2:10.20.193.11:6810/4224399876,v1:10.20.193.11:6811/4224399876]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial011", "root=default"]}]': finished 2026-02-13T02:17:45.792 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:45 trial078 ceph-mon[14969]: osdmap e20: 4 total, 3 up, 4 in 2026-02-13T02:17:45.792 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:45 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T02:17:45.792 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:45 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T02:17:45.792 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:45 trial078 ceph-mon[14969]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:17:45.792 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:45 trial078 ceph-mon[14969]: Cluster is now healthy 2026-02-13T02:17:45.792 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:45 trial078 ceph-mon[14969]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "abf31616-2588-43c1-b15a-7f703ae8e1c7"} : dispatch 2026-02-13T02:17:45.792 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:45 trial078 ceph-mon[14969]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "abf31616-2588-43c1-b15a-7f703ae8e1c7"}]': finished 2026-02-13T02:17:45.792 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:45 trial078 ceph-mon[14969]: from='client.? 10.20.193.60:0/3400543256' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "abf31616-2588-43c1-b15a-7f703ae8e1c7"} : dispatch 2026-02-13T02:17:45.793 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:45 trial078 ceph-mon[14969]: osd.3 [v2:10.20.193.11:6810/4224399876,v1:10.20.193.11:6811/4224399876] boot 2026-02-13T02:17:45.793 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:45 trial078 ceph-mon[14969]: osdmap e21: 5 total, 4 up, 5 in 2026-02-13T02:17:45.793 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:45 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T02:17:45.793 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:45 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T02:17:45.793 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:45 trial078 ceph-mon[14969]: from='client.? 10.20.193.60:0/2883843524' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T02:17:45.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:45 trial011 ceph-mon[11956]: pgmap v58: 1 pgs: 1 creating+peering; 0 B data, 82 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T02:17:45.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:45 trial011 ceph-mon[11956]: pgmap v59: 1 pgs: 1 creating+peering; 0 B data, 82 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T02:17:45.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:45 trial011 ceph-mon[11956]: from='osd.3 [v2:10.20.193.11:6810/4224399876,v1:10.20.193.11:6811/4224399876]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial011", "root=default"]}]': finished 2026-02-13T02:17:45.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:45 trial011 ceph-mon[11956]: osdmap e20: 4 total, 3 up, 4 in 2026-02-13T02:17:45.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:45 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T02:17:45.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:45 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T02:17:45.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:45 trial011 ceph-mon[11956]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:17:45.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:45 trial011 ceph-mon[11956]: Cluster is now healthy 2026-02-13T02:17:45.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:45 trial011 ceph-mon[11956]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "abf31616-2588-43c1-b15a-7f703ae8e1c7"} : dispatch 2026-02-13T02:17:45.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:45 trial011 ceph-mon[11956]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "abf31616-2588-43c1-b15a-7f703ae8e1c7"}]': finished 2026-02-13T02:17:45.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:45 trial011 ceph-mon[11956]: from='client.? 10.20.193.60:0/3400543256' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "abf31616-2588-43c1-b15a-7f703ae8e1c7"} : dispatch 2026-02-13T02:17:45.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:45 trial011 ceph-mon[11956]: osd.3 [v2:10.20.193.11:6810/4224399876,v1:10.20.193.11:6811/4224399876] boot 2026-02-13T02:17:45.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:45 trial011 ceph-mon[11956]: osdmap e21: 5 total, 4 up, 5 in 2026-02-13T02:17:45.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:45 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T02:17:45.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:45 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T02:17:45.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:45 trial011 ceph-mon[11956]: from='client.? 10.20.193.60:0/2883843524' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T02:17:46.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:45 trial060 ceph-mon[14797]: pgmap v58: 1 pgs: 1 creating+peering; 0 B data, 82 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T02:17:46.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:45 trial060 ceph-mon[14797]: pgmap v59: 1 pgs: 1 creating+peering; 0 B data, 82 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T02:17:46.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:45 trial060 ceph-mon[14797]: from='osd.3 [v2:10.20.193.11:6810/4224399876,v1:10.20.193.11:6811/4224399876]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial011", "root=default"]}]': finished 2026-02-13T02:17:46.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:45 trial060 ceph-mon[14797]: osdmap e20: 4 total, 3 up, 4 in 2026-02-13T02:17:46.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:45 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T02:17:46.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:45 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T02:17:46.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:45 trial060 ceph-mon[14797]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:17:46.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:45 trial060 ceph-mon[14797]: Cluster is now healthy 2026-02-13T02:17:46.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:45 trial060 ceph-mon[14797]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "abf31616-2588-43c1-b15a-7f703ae8e1c7"} : dispatch 2026-02-13T02:17:46.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:45 trial060 ceph-mon[14797]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "abf31616-2588-43c1-b15a-7f703ae8e1c7"}]': finished 2026-02-13T02:17:46.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:45 trial060 ceph-mon[14797]: from='client.? 10.20.193.60:0/3400543256' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "abf31616-2588-43c1-b15a-7f703ae8e1c7"} : dispatch 2026-02-13T02:17:46.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:45 trial060 ceph-mon[14797]: osd.3 [v2:10.20.193.11:6810/4224399876,v1:10.20.193.11:6811/4224399876] boot 2026-02-13T02:17:46.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:45 trial060 ceph-mon[14797]: osdmap e21: 5 total, 4 up, 5 in 2026-02-13T02:17:46.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:45 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T02:17:46.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:45 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T02:17:46.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:45 trial060 ceph-mon[14797]: from='client.? 10.20.193.60:0/2883843524' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T02:17:46.750 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:46 trial060 ceph-mon[14797]: purged_snaps scrub starts 2026-02-13T02:17:46.750 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:46 trial060 ceph-mon[14797]: purged_snaps scrub ok 2026-02-13T02:17:46.751 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:46 trial060 ceph-mon[14797]: osdmap e22: 5 total, 4 up, 5 in 2026-02-13T02:17:46.751 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:46 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T02:17:46.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:46 trial011 ceph-mon[11956]: purged_snaps scrub starts 2026-02-13T02:17:46.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:46 trial011 ceph-mon[11956]: purged_snaps scrub ok 2026-02-13T02:17:46.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:46 trial011 ceph-mon[11956]: osdmap e22: 5 total, 4 up, 5 in 2026-02-13T02:17:46.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:46 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T02:17:47.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:46 trial078 ceph-mon[14969]: purged_snaps scrub starts 2026-02-13T02:17:47.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:46 trial078 ceph-mon[14969]: purged_snaps scrub ok 2026-02-13T02:17:47.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:46 trial078 ceph-mon[14969]: osdmap e22: 5 total, 4 up, 5 in 2026-02-13T02:17:47.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:46 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T02:17:47.717 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:47 trial060 ceph-mon[14797]: pgmap v63: 1 pgs: 1 remapped+peering; 577 KiB data, 109 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T02:17:47.717 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:47 trial060 ceph-mon[14797]: osdmap e23: 5 total, 4 up, 5 in 2026-02-13T02:17:47.718 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:47 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T02:17:47.718 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:47 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2026-02-13T02:17:47.718 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:47 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:47.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:47 trial011 ceph-mon[11956]: pgmap v63: 1 pgs: 1 remapped+peering; 577 KiB data, 109 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T02:17:47.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:47 trial011 ceph-mon[11956]: osdmap e23: 5 total, 4 up, 5 in 2026-02-13T02:17:47.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:47 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T02:17:47.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:47 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2026-02-13T02:17:47.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:47 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:48.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:47 trial078 ceph-mon[14969]: pgmap v63: 1 pgs: 1 remapped+peering; 577 KiB data, 109 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T02:17:48.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:47 trial078 ceph-mon[14969]: osdmap e23: 5 total, 4 up, 5 in 2026-02-13T02:17:48.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:47 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T02:17:48.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:47 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2026-02-13T02:17:48.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:47 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:48.898 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:48 trial060 ceph-mon[14797]: pgmap v65: 1 pgs: 1 remapped+peering; 577 KiB data, 109 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T02:17:48.898 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:48 trial060 ceph-mon[14797]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:17:48.898 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:48 trial060 ceph-mon[14797]: osdmap e24: 5 total, 4 up, 5 in 2026-02-13T02:17:48.898 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:48 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T02:17:48.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:48 trial011 ceph-mon[11956]: pgmap v65: 1 pgs: 1 remapped+peering; 577 KiB data, 109 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T02:17:48.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:48 trial011 ceph-mon[11956]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:17:48.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:48 trial011 ceph-mon[11956]: osdmap e24: 5 total, 4 up, 5 in 2026-02-13T02:17:48.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:48 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T02:17:49.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:48 trial078 ceph-mon[14969]: pgmap v65: 1 pgs: 1 remapped+peering; 577 KiB data, 109 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T02:17:49.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:48 trial078 ceph-mon[14969]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:17:49.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:48 trial078 ceph-mon[14969]: osdmap e24: 5 total, 4 up, 5 in 2026-02-13T02:17:49.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:48 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T02:17:49.885 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:49 trial060 ceph-mon[14797]: osdmap e25: 5 total, 4 up, 5 in 2026-02-13T02:17:49.885 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:49 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T02:17:49.885 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:49 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:17:49.885 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:49 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:49.885 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:49 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:49.886 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:49 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:49.886 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:49 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:49.886 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:49 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:49.886 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:49 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:17:49.886 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:49 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:49.886 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:49 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:17:49.886 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:49 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:17:49.886 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:49 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:49.931 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:49.931+0000 7f48217fa6c0 1 -- 10.20.193.60:0/2991949029 <== mgr.14116 v2:10.20.193.11:6800/861334768 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f48240f1f50 con 0x7f47f80b5600 2026-02-13T02:17:49.931 INFO:teuthology.orchestra.run.trial060.stdout:Created osd(s) 4 on host 'trial060' 2026-02-13T02:17:49.933 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:49.933+0000 7f482a7776c0 1 -- 10.20.193.60:0/2991949029 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f47f80b5600 msgr2=0x7f47f80d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:49.934 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:49.933+0000 7f482a7776c0 1 --2- 10.20.193.60:0/2991949029 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f47f80b5600 0x7f47f80d5ab0 secure :-1 s=READY pgs=96 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f48140023e0 tx=0x7f4814005c40 comp rx=0 tx=0).stop 2026-02-13T02:17:49.934 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:49.933+0000 7f482a7776c0 1 -- 10.20.193.60:0/2991949029 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f482410eec0 msgr2=0x7f48240f9060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:49.934 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:49.933+0000 7f482a7776c0 1 --2- 10.20.193.60:0/2991949029 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f482410eec0 0x7f48240f9060 secure :-1 s=READY pgs=16 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f481000b710 tx=0x7f481000bbe0 comp rx=0 tx=0).stop 2026-02-13T02:17:49.934 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:49.934+0000 7f482a7776c0 1 -- 10.20.193.60:0/2991949029 shutdown_connections 2026-02-13T02:17:49.934 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:49.934+0000 7f482a7776c0 1 --2- 10.20.193.60:0/2991949029 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f47f80b5600 0x7f47f80d5ab0 unknown :-1 s=CLOSED pgs=96 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:49.934 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:49.934+0000 7f482a7776c0 1 --2- 10.20.193.60:0/2991949029 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f48241109f0 0x7f48240f98c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:49.934 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:49.934+0000 7f482a7776c0 1 --2- 10.20.193.60:0/2991949029 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f4824110040 0x7f4824171380 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:49.934 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:49.934+0000 7f482a7776c0 1 --2- 10.20.193.60:0/2991949029 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f482410eec0 0x7f48240f9060 unknown :-1 s=CLOSED pgs=16 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:49.934 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:49.934+0000 7f482a7776c0 1 -- 10.20.193.60:0/2991949029 >> 10.20.193.60:0/2991949029 conn(0x7f48240ec5c0 msgr2=0x7f48240ef610 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:17:49.934 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:49.934+0000 7f482a7776c0 1 -- 10.20.193.60:0/2991949029 shutdown_connections 2026-02-13T02:17:49.935 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:17:49.934+0000 7f482a7776c0 1 -- 10.20.193.60:0/2991949029 wait complete. 2026-02-13T02:17:49.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:49 trial011 ceph-mon[11956]: osdmap e25: 5 total, 4 up, 5 in 2026-02-13T02:17:49.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:49 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T02:17:49.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:49 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:17:49.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:49 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:49.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:49 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:49.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:49 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:49.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:49 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:49.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:49 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:49.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:49 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:17:49.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:49 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:49.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:49 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:17:49.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:49 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:17:49.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:49 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:49.972 DEBUG:teuthology.orchestra.run.trial060:osd.4> sudo journalctl -f -n 0 -u ceph-fc631695-0881-11f1-899c-d404e6e7d460@osd.4.service 2026-02-13T02:17:49.974 INFO:tasks.cephadm:Deploying osd.5 on trial078 with /dev/vg_nvme/lv_3... 2026-02-13T02:17:49.974 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_3 2026-02-13T02:17:50.000 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:49 trial078 ceph-mon[14969]: osdmap e25: 5 total, 4 up, 5 in 2026-02-13T02:17:50.000 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:49 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T02:17:50.000 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:49 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:17:50.000 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:49 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:50.001 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:49 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:50.001 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:49 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:50.001 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:49 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:50.001 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:49 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:50.001 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:49 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:17:50.001 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:49 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:50.001 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:49 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:17:50.001 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:49 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:17:50.001 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:49 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:50.100 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.c/config 2026-02-13T02:17:50.198 INFO:journalctl@ceph.osd.4.trial060.stdout:Feb 13 02:17:50 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-4[26005]: 2026-02-13T02:17:50.089+0000 7f0e2fc7c780 -1 osd.4 0 log_to_monitors true 2026-02-13T02:17:50.562 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:17:50.582 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph orch daemon add osd trial078:vg_nvme/lv_3 --skip-validation 2026-02-13T02:17:50.749 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.c/config 2026-02-13T02:17:50.750 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:50 trial060 ceph-mon[14797]: pgmap v68: 1 pgs: 1 remapped+peering; 577 KiB data, 109 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T02:17:50.750 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:50 trial060 ceph-mon[14797]: pgmap v69: 1 pgs: 1 remapped+peering; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T02:17:50.750 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:50 trial060 ceph-mon[14797]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:17:50.750 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:50 trial060 ceph-mon[14797]: Cluster is now healthy 2026-02-13T02:17:50.751 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:50 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:50.751 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:50 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:50.751 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:50 trial060 ceph-mon[14797]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2026-02-13T02:17:50.751 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:50 trial060 ceph-mon[14797]: from='osd.4 [v2:10.20.193.60:6808/3289387254,v1:10.20.193.60:6809/3289387254]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2026-02-13T02:17:50.751 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:50 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:17:50.770 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:50 trial078 ceph-mon[14969]: pgmap v68: 1 pgs: 1 remapped+peering; 577 KiB data, 109 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T02:17:50.770 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:50 trial078 ceph-mon[14969]: pgmap v69: 1 pgs: 1 remapped+peering; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T02:17:50.770 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:50 trial078 ceph-mon[14969]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:17:50.771 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:50 trial078 ceph-mon[14969]: Cluster is now healthy 2026-02-13T02:17:50.771 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:50 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:50.771 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:50 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:50.771 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:50 trial078 ceph-mon[14969]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2026-02-13T02:17:50.771 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:50 trial078 ceph-mon[14969]: from='osd.4 [v2:10.20.193.60:6808/3289387254,v1:10.20.193.60:6809/3289387254]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2026-02-13T02:17:50.771 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:50 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:17:50.868 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:50.863+0000 7f19c0f556c0 1 -- 10.20.193.78:0/2477159580 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f19bc1109f0 msgr2=0x7f19bc171380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:50.868 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:50.863+0000 7f19c0f556c0 1 --2- 10.20.193.78:0/2477159580 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f19bc1109f0 0x7f19bc171380 secure :-1 s=READY pgs=20 gs=1 cs=0 l=1 c_cookie=1835911189889902281 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f19ac00aa40 tx=0x7f19ac02fde0 comp rx=0 tx=0).stop 2026-02-13T02:17:50.868 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:50.863+0000 7f19c0f556c0 1 -- 10.20.193.78:0/2477159580 shutdown_connections 2026-02-13T02:17:50.868 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:50.863+0000 7f19c0f556c0 1 --2- 10.20.193.78:0/2477159580 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f19bc1109f0 0x7f19bc171380 unknown :-1 s=CLOSED pgs=20 gs=1 cs=0 l=1 c_cookie=1835911189889902281 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:50.868 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:50.863+0000 7f19c0f556c0 1 --2- 10.20.193.78:0/2477159580 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f19bc110040 0x7f19bc1104b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:50.868 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:50.863+0000 7f19c0f556c0 1 --2- 10.20.193.78:0/2477159580 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f19bc10eec0 0x7f19bc10f2b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:50.868 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:50.863+0000 7f19c0f556c0 1 -- 10.20.193.78:0/2477159580 >> 10.20.193.78:0/2477159580 conn(0x7f19bc0ec5c0 msgr2=0x7f19bc10c9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:17:50.868 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:50.863+0000 7f19c0f556c0 1 -- 10.20.193.78:0/2477159580 shutdown_connections 2026-02-13T02:17:50.868 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:50.863+0000 7f19c0f556c0 1 -- 10.20.193.78:0/2477159580 wait complete. 2026-02-13T02:17:50.869 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:50.863+0000 7f19c0f556c0 1 Processor -- start 2026-02-13T02:17:50.869 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:50.863+0000 7f19c0f556c0 1 -- start start 2026-02-13T02:17:50.869 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:50.863+0000 7f19c0f556c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f19bc10eec0 0x7f19bc0f8590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:50.869 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:50.863+0000 7f19c0f556c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f19bc110040 0x7f19bc171360 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:50.869 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:50.863+0000 7f19c0f556c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f19bc1109f0 0x7f19bc0f8dd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:50.869 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:50.863+0000 7f19c0f556c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f19bc0f9990 con 0x7f19bc110040 2026-02-13T02:17:50.869 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:50.863+0000 7f19c0f556c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f19bc0f9b00 con 0x7f19bc10eec0 2026-02-13T02:17:50.869 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:50.863+0000 7f19c0f556c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f19bc0f9cc0 con 0x7f19bc1109f0 2026-02-13T02:17:50.869 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:50.863+0000 7f19bad766c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f19bc1109f0 0x7f19bc0f8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:50.869 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:50.863+0000 7f19bad766c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f19bc1109f0 0x7f19bc0f8dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.78:3300/0 says I am v2:10.20.193.78:33922/0 (socket says 10.20.193.78:33922) 2026-02-13T02:17:50.869 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:50.863+0000 7f19bad766c0 1 -- 10.20.193.78:0/564261309 learned_addr learned my addr 10.20.193.78:0/564261309 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:17:50.870 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:50.863+0000 7f19ba5756c0 1 --2- 10.20.193.78:0/564261309 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f19bc10eec0 0x7f19bc0f8590 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:50.870 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:50.863+0000 7f19b9d746c0 1 --2- 10.20.193.78:0/564261309 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f19bc110040 0x7f19bc171360 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:50.870 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:50.864+0000 7f19bad766c0 1 -- 10.20.193.78:0/564261309 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f19bc10eec0 msgr2=0x7f19bc0f8590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:50.870 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:50.864+0000 7f19bad766c0 1 --2- 10.20.193.78:0/564261309 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f19bc10eec0 0x7f19bc0f8590 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:50.870 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:50.864+0000 7f19bad766c0 1 -- 10.20.193.78:0/564261309 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f19bc110040 msgr2=0x7f19bc171360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:50.870 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:50.864+0000 7f19bad766c0 1 --2- 10.20.193.78:0/564261309 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f19bc110040 0x7f19bc171360 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:50.870 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:50.864+0000 7f19bad766c0 1 -- 10.20.193.78:0/564261309 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19ac00a660 con 0x7f19bc1109f0 2026-02-13T02:17:50.870 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:50.864+0000 7f19bad766c0 1 --2- 10.20.193.78:0/564261309 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f19bc1109f0 0x7f19bc0f8dd0 secure :-1 s=READY pgs=21 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f19ac006c20 tx=0x7f19ac0055f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:17:50.870 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:50.864+0000 7f19a37fe6c0 1 -- 10.20.193.78:0/564261309 <== mon.1 v2:10.20.193.78:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f19ac003c40 con 0x7f19bc1109f0 2026-02-13T02:17:50.870 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:50.864+0000 7f19a37fe6c0 1 -- 10.20.193.78:0/564261309 <== mon.1 v2:10.20.193.78:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f19ac003da0 con 0x7f19bc1109f0 2026-02-13T02:17:50.870 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:50.864+0000 7f19c0f556c0 1 -- 10.20.193.78:0/564261309 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19bc0f9ee0 con 0x7f19bc1109f0 2026-02-13T02:17:50.870 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:50.864+0000 7f19a37fe6c0 1 -- 10.20.193.78:0/564261309 <== mon.1 v2:10.20.193.78:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f19ac038520 con 0x7f19bc1109f0 2026-02-13T02:17:50.870 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:50.864+0000 7f19c0f556c0 1 -- 10.20.193.78:0/564261309 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19bc0fa360 con 0x7f19bc1109f0 2026-02-13T02:17:50.871 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:50.864+0000 7f19c0f556c0 1 -- 10.20.193.78:0/564261309 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19bc175400 con 0x7f19bc1109f0 2026-02-13T02:17:50.872 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:50.865+0000 7f19a37fe6c0 1 -- 10.20.193.78:0/564261309 <== mon.1 v2:10.20.193.78:3300/0 4 ==== mgrmap(e 10) ==== 157066+0+0 (secure 0 0 0) 0x7f19ac008350 con 0x7f19bc1109f0 2026-02-13T02:17:50.872 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:50.866+0000 7f19a37fe6c0 1 --2- 10.20.193.78:0/564261309 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f19940b5680 0x7f19940d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:50.872 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:50.866+0000 7f19a37fe6c0 1 -- 10.20.193.78:0/564261309 <== mon.1 v2:10.20.193.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 3561+0+0 (secure 0 0 0) 0x7f19ac107ed0 con 0x7f19bc1109f0 2026-02-13T02:17:50.872 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:50.866+0000 7f19ba5756c0 1 --2- 10.20.193.78:0/564261309 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f19940b5680 0x7f19940d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:50.872 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:50.867+0000 7f19a37fe6c0 1 -- 10.20.193.78:0/564261309 <== mon.1 v2:10.20.193.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f19ac0cbac0 con 0x7f19bc1109f0 2026-02-13T02:17:50.872 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:50.867+0000 7f19ba5756c0 1 --2- 10.20.193.78:0/564261309 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f19940b5680 0x7f19940d5b30 secure :-1 s=READY pgs=101 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f19b0005980 tx=0x7f19b0005ee0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:17:50.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:50 trial011 ceph-mon[11956]: pgmap v68: 1 pgs: 1 remapped+peering; 577 KiB data, 109 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T02:17:50.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:50 trial011 ceph-mon[11956]: pgmap v69: 1 pgs: 1 remapped+peering; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T02:17:50.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:50 trial011 ceph-mon[11956]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:17:50.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:50 trial011 ceph-mon[11956]: Cluster is now healthy 2026-02-13T02:17:50.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:50 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:50.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:50 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:50.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:50 trial011 ceph-mon[11956]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2026-02-13T02:17:50.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:50 trial011 ceph-mon[11956]: from='osd.4 [v2:10.20.193.60:6808/3289387254,v1:10.20.193.60:6809/3289387254]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2026-02-13T02:17:50.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:50 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:17:50.968 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:50.965+0000 7f19c0f556c0 1 -- 10.20.193.78:0/564261309 --> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial078:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7f19bc174d20 con 0x7f19940b5680 2026-02-13T02:17:51.725 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:51 trial078 ceph-mon[14969]: pgmap v70: 1 pgs: 1 remapped+peering; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T02:17:51.725 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:51 trial078 ceph-mon[14969]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:17:51.725 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:51 trial078 ceph-mon[14969]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2026-02-13T02:17:51.725 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:51 trial078 ceph-mon[14969]: osdmap e26: 5 total, 4 up, 5 in 2026-02-13T02:17:51.726 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:51 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T02:17:51.726 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:51 trial078 ceph-mon[14969]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial060", "root=default"]} : dispatch 2026-02-13T02:17:51.726 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:51 trial078 ceph-mon[14969]: from='osd.4 [v2:10.20.193.60:6808/3289387254,v1:10.20.193.60:6809/3289387254]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial060", "root=default"]} : dispatch 2026-02-13T02:17:51.726 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:51 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:51.726 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:51 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:51.726 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:51 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:17:51.726 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:51 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:17:51.726 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:51 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:51.726 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:51 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:51.726 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:51 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:51.726 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:51 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T02:17:51.727 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:51 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-13T02:17:51.727 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:51 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:51.727 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:51 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:51.727 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:51 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:17:51.727 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:51 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:51.727 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:51 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:17:51.727 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:51 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:17:51.727 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:51 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:51.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:51 trial011 ceph-mon[11956]: pgmap v70: 1 pgs: 1 remapped+peering; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T02:17:51.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:51 trial011 ceph-mon[11956]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:17:51.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:51 trial011 ceph-mon[11956]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2026-02-13T02:17:51.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:51 trial011 ceph-mon[11956]: osdmap e26: 5 total, 4 up, 5 in 2026-02-13T02:17:51.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:51 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T02:17:51.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:51 trial011 ceph-mon[11956]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial060", "root=default"]} : dispatch 2026-02-13T02:17:51.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:51 trial011 ceph-mon[11956]: from='osd.4 [v2:10.20.193.60:6808/3289387254,v1:10.20.193.60:6809/3289387254]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial060", "root=default"]} : dispatch 2026-02-13T02:17:51.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:51 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:51.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:51 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:51.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:51 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:17:51.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:51 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:17:51.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:51 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:51.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:51 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:51.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:51 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:51.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:51 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T02:17:51.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:51 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-13T02:17:51.954 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:51 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:51.954 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:51 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:51.954 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:51 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:17:51.954 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:51 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:51.954 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:51 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:17:51.954 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:51 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:17:51.954 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:51 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:52.000 INFO:journalctl@ceph.osd.4.trial060.stdout:Feb 13 02:17:51 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-4[26005]: 2026-02-13T02:17:51.631+0000 7f0e2bb9d6c0 -1 osd.4 0 waiting for initial osdmap 2026-02-13T02:17:52.000 INFO:journalctl@ceph.osd.4.trial060.stdout:Feb 13 02:17:51 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-4[26005]: 2026-02-13T02:17:51.634+0000 7f0e23a6a6c0 -1 osd.4 27 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T02:17:52.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:51 trial060 ceph-mon[14797]: pgmap v70: 1 pgs: 1 remapped+peering; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T02:17:52.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:51 trial060 ceph-mon[14797]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:17:52.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:51 trial060 ceph-mon[14797]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2026-02-13T02:17:52.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:51 trial060 ceph-mon[14797]: osdmap e26: 5 total, 4 up, 5 in 2026-02-13T02:17:52.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:51 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T02:17:52.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:51 trial060 ceph-mon[14797]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial060", "root=default"]} : dispatch 2026-02-13T02:17:52.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:51 trial060 ceph-mon[14797]: from='osd.4 [v2:10.20.193.60:6808/3289387254,v1:10.20.193.60:6809/3289387254]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial060", "root=default"]} : dispatch 2026-02-13T02:17:52.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:51 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:52.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:51 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:52.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:51 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:17:52.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:51 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:17:52.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:51 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:52.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:51 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:52.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:51 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:52.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:51 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T02:17:52.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:51 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-13T02:17:52.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:51 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:52.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:51 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:52.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:51 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:17:52.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:51 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:52.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:51 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:17:52.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:51 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:17:52.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:51 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:52.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:52 trial011 ceph-mon[11956]: from='client.24229 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial078:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:17:52.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:52 trial011 ceph-mon[11956]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail; 167 KiB/s, 0 objects/s recovering 2026-02-13T02:17:52.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:52 trial011 ceph-mon[11956]: from='client.? 10.20.193.78:0/244871183' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "70c3d0b0-8e3d-4432-87e2-bb5391cf0167"} : dispatch 2026-02-13T02:17:52.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:52 trial011 ceph-mon[11956]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "70c3d0b0-8e3d-4432-87e2-bb5391cf0167"} : dispatch 2026-02-13T02:17:52.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:52 trial011 ceph-mon[11956]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial060", "root=default"]}]': finished 2026-02-13T02:17:52.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:52 trial011 ceph-mon[11956]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "70c3d0b0-8e3d-4432-87e2-bb5391cf0167"}]': finished 2026-02-13T02:17:52.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:52 trial011 ceph-mon[11956]: osdmap e27: 6 total, 4 up, 6 in 2026-02-13T02:17:52.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:52 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T02:17:52.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:52 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T02:17:52.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:52 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T02:17:52.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:52 trial011 ceph-mon[11956]: from='client.? 10.20.193.78:0/3886644833' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T02:17:52.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:52 trial011 ceph-mon[11956]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:17:52.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:52 trial011 ceph-mon[11956]: Cluster is now healthy 2026-02-13T02:17:53.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:52 trial060 ceph-mon[14797]: from='client.24229 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial078:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:17:53.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:52 trial060 ceph-mon[14797]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail; 167 KiB/s, 0 objects/s recovering 2026-02-13T02:17:53.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:52 trial060 ceph-mon[14797]: from='client.? 10.20.193.78:0/244871183' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "70c3d0b0-8e3d-4432-87e2-bb5391cf0167"} : dispatch 2026-02-13T02:17:53.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:52 trial060 ceph-mon[14797]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "70c3d0b0-8e3d-4432-87e2-bb5391cf0167"} : dispatch 2026-02-13T02:17:53.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:52 trial060 ceph-mon[14797]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial060", "root=default"]}]': finished 2026-02-13T02:17:53.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:52 trial060 ceph-mon[14797]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "70c3d0b0-8e3d-4432-87e2-bb5391cf0167"}]': finished 2026-02-13T02:17:53.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:52 trial060 ceph-mon[14797]: osdmap e27: 6 total, 4 up, 6 in 2026-02-13T02:17:53.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:52 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T02:17:53.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:52 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T02:17:53.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:52 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T02:17:53.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:52 trial060 ceph-mon[14797]: from='client.? 10.20.193.78:0/3886644833' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T02:17:53.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:52 trial060 ceph-mon[14797]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:17:53.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:52 trial060 ceph-mon[14797]: Cluster is now healthy 2026-02-13T02:17:53.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:52 trial078 ceph-mon[14969]: from='client.24229 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial078:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:17:53.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:52 trial078 ceph-mon[14969]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail; 167 KiB/s, 0 objects/s recovering 2026-02-13T02:17:53.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:52 trial078 ceph-mon[14969]: from='client.? 10.20.193.78:0/244871183' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "70c3d0b0-8e3d-4432-87e2-bb5391cf0167"} : dispatch 2026-02-13T02:17:53.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:52 trial078 ceph-mon[14969]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "70c3d0b0-8e3d-4432-87e2-bb5391cf0167"} : dispatch 2026-02-13T02:17:53.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:52 trial078 ceph-mon[14969]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial060", "root=default"]}]': finished 2026-02-13T02:17:53.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:52 trial078 ceph-mon[14969]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "70c3d0b0-8e3d-4432-87e2-bb5391cf0167"}]': finished 2026-02-13T02:17:53.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:52 trial078 ceph-mon[14969]: osdmap e27: 6 total, 4 up, 6 in 2026-02-13T02:17:53.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:52 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T02:17:53.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:52 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T02:17:53.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:52 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T02:17:53.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:52 trial078 ceph-mon[14969]: from='client.? 10.20.193.78:0/3886644833' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T02:17:53.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:52 trial078 ceph-mon[14969]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:17:53.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:52 trial078 ceph-mon[14969]: Cluster is now healthy 2026-02-13T02:17:53.758 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:53 trial078 ceph-mon[14969]: purged_snaps scrub starts 2026-02-13T02:17:53.758 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:53 trial078 ceph-mon[14969]: purged_snaps scrub ok 2026-02-13T02:17:53.758 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:53 trial078 ceph-mon[14969]: osd.4 [v2:10.20.193.60:6808/3289387254,v1:10.20.193.60:6809/3289387254] boot 2026-02-13T02:17:53.758 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:53 trial078 ceph-mon[14969]: osdmap e28: 6 total, 5 up, 6 in 2026-02-13T02:17:53.758 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:53 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T02:17:53.758 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:53 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T02:17:53.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:53 trial011 ceph-mon[11956]: purged_snaps scrub starts 2026-02-13T02:17:53.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:53 trial011 ceph-mon[11956]: purged_snaps scrub ok 2026-02-13T02:17:53.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:53 trial011 ceph-mon[11956]: osd.4 [v2:10.20.193.60:6808/3289387254,v1:10.20.193.60:6809/3289387254] boot 2026-02-13T02:17:53.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:53 trial011 ceph-mon[11956]: osdmap e28: 6 total, 5 up, 6 in 2026-02-13T02:17:53.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:53 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T02:17:53.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:53 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T02:17:54.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:53 trial060 ceph-mon[14797]: purged_snaps scrub starts 2026-02-13T02:17:54.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:53 trial060 ceph-mon[14797]: purged_snaps scrub ok 2026-02-13T02:17:54.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:53 trial060 ceph-mon[14797]: osd.4 [v2:10.20.193.60:6808/3289387254,v1:10.20.193.60:6809/3289387254] boot 2026-02-13T02:17:54.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:53 trial060 ceph-mon[14797]: osdmap e28: 6 total, 5 up, 6 in 2026-02-13T02:17:54.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:53 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T02:17:54.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:53 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T02:17:54.691 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:54 trial078 ceph-mon[14969]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail; 162 KiB/s, 0 objects/s recovering 2026-02-13T02:17:54.691 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:54 trial078 ceph-mon[14969]: osdmap e29: 6 total, 5 up, 6 in 2026-02-13T02:17:54.692 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:54 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T02:17:54.692 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:54 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:17:54.692 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:54 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:54.692 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:54 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:54.692 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:54 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:54.692 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:54 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:17:54.692 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:54 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:54.692 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:54 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:17:54.692 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:54 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:17:54.692 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:54 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:54.692 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:54 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2026-02-13T02:17:54.693 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:54 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:54.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:54 trial011 ceph-mon[11956]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail; 162 KiB/s, 0 objects/s recovering 2026-02-13T02:17:54.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:54 trial011 ceph-mon[11956]: osdmap e29: 6 total, 5 up, 6 in 2026-02-13T02:17:54.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:54 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T02:17:54.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:54 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:17:54.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:54 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:54.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:54 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:54.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:54 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:54.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:54 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:17:54.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:54 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:54.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:54 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:17:54.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:54 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:17:54.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:54 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:54.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:54 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2026-02-13T02:17:54.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:54 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:55.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:54 trial060 ceph-mon[14797]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail; 162 KiB/s, 0 objects/s recovering 2026-02-13T02:17:55.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:54 trial060 ceph-mon[14797]: osdmap e29: 6 total, 5 up, 6 in 2026-02-13T02:17:55.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:54 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T02:17:55.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:54 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:17:55.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:54 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:55.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:54 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:55.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:54 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:55.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:54 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:17:55.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:54 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:55.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:54 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:17:55.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:54 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:17:55.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:54 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:55.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:54 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2026-02-13T02:17:55.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:54 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:55.893 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:55 trial078 ceph-mon[14969]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail; 209 KiB/s, 0 objects/s recovering 2026-02-13T02:17:55.894 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:55 trial078 ceph-mon[14969]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T02:17:55.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:55 trial011 ceph-mon[11956]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail; 209 KiB/s, 0 objects/s recovering 2026-02-13T02:17:55.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:55 trial011 ceph-mon[11956]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T02:17:56.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:55 trial060 ceph-mon[14797]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail; 209 KiB/s, 0 objects/s recovering 2026-02-13T02:17:56.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:55 trial060 ceph-mon[14797]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T02:17:57.024 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:57.021+0000 7f19a37fe6c0 1 -- 10.20.193.78:0/564261309 <== mgr.14116 v2:10.20.193.11:6800/861334768 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f19bc174d20 con 0x7f19940b5680 2026-02-13T02:17:57.025 INFO:teuthology.orchestra.run.trial078.stdout:Created osd(s) 5 on host 'trial078' 2026-02-13T02:17:57.028 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:57.025+0000 7f19c0f556c0 1 -- 10.20.193.78:0/564261309 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f19940b5680 msgr2=0x7f19940d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:57.028 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:57.025+0000 7f19c0f556c0 1 --2- 10.20.193.78:0/564261309 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f19940b5680 0x7f19940d5b30 secure :-1 s=READY pgs=101 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f19b0005980 tx=0x7f19b0005ee0 comp rx=0 tx=0).stop 2026-02-13T02:17:57.028 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:57.025+0000 7f19c0f556c0 1 -- 10.20.193.78:0/564261309 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f19bc1109f0 msgr2=0x7f19bc0f8dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:57.028 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:57.025+0000 7f19c0f556c0 1 --2- 10.20.193.78:0/564261309 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f19bc1109f0 0x7f19bc0f8dd0 secure :-1 s=READY pgs=21 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f19ac006c20 tx=0x7f19ac0055f0 comp rx=0 tx=0).stop 2026-02-13T02:17:57.028 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:57.025+0000 7f19c0f556c0 1 -- 10.20.193.78:0/564261309 shutdown_connections 2026-02-13T02:17:57.029 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:57.025+0000 7f19c0f556c0 1 --2- 10.20.193.78:0/564261309 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f19940b5680 0x7f19940d5b30 unknown :-1 s=CLOSED pgs=101 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:57.029 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:57.025+0000 7f19c0f556c0 1 --2- 10.20.193.78:0/564261309 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f19bc1109f0 0x7f19bc0f8dd0 unknown :-1 s=CLOSED pgs=21 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:57.029 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:57.025+0000 7f19c0f556c0 1 --2- 10.20.193.78:0/564261309 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f19bc110040 0x7f19bc171360 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:57.029 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:57.025+0000 7f19c0f556c0 1 --2- 10.20.193.78:0/564261309 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f19bc10eec0 0x7f19bc0f8590 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:57.029 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:57.025+0000 7f19c0f556c0 1 -- 10.20.193.78:0/564261309 >> 10.20.193.78:0/564261309 conn(0x7f19bc0ec5c0 msgr2=0x7f19bc0ee610 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:17:57.029 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:57.025+0000 7f19c0f556c0 1 -- 10.20.193.78:0/564261309 shutdown_connections 2026-02-13T02:17:57.029 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:17:57.025+0000 7f19c0f556c0 1 -- 10.20.193.78:0/564261309 wait complete. 2026-02-13T02:17:57.068 DEBUG:teuthology.orchestra.run.trial078:osd.5> sudo journalctl -f -n 0 -u ceph-fc631695-0881-11f1-899c-d404e6e7d460@osd.5.service 2026-02-13T02:17:57.070 INFO:tasks.cephadm:Deploying osd.6 on trial011 with /dev/vg_nvme/lv_2... 2026-02-13T02:17:57.070 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_2 2026-02-13T02:17:57.195 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:17:57.213 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:57 trial078 ceph-mon[14969]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T02:17:57.214 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:57 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:57.214 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:57 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:57.214 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:57 trial078 ceph-mon[14969]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T02:17:57.214 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:57 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:17:57.214 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:57 trial078 ceph-mon[14969]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:17:57.214 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:57 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:57.214 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:57 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:57.214 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:57 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:57.214 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:57 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:57.319 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:57 trial011 ceph-mon[11956]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T02:17:57.320 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:57 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:57.320 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:57 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:57.320 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:57 trial011 ceph-mon[11956]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T02:17:57.320 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:57 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:17:57.320 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:57 trial011 ceph-mon[11956]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:17:57.320 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:57 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:57.320 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:57 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:57.320 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:57 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:57.320 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:57 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:57.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:57 trial060 ceph-mon[14797]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T02:17:57.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:57 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:57.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:57 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:57.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:57 trial060 ceph-mon[14797]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T02:17:57.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:57 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:17:57.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:57 trial060 ceph-mon[14797]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:17:57.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:57 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:57.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:57 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:57.502 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:57 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:57.502 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:57 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:57.644 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:17:57.660 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph orch daemon add osd trial011:vg_nvme/lv_2 --skip-validation 2026-02-13T02:17:57.784 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:17:57.903 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:57.898+0000 7f80d1c746c0 1 -- 10.20.193.11:0/2218075396 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f80cc110a00 msgr2=0x7f80cc171390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:57.903 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:57.898+0000 7f80d1c746c0 1 --2- 10.20.193.11:0/2218075396 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f80cc110a00 0x7f80cc171390 secure :-1 s=READY pgs=161 gs=1 cs=0 l=1 c_cookie=1724388706050701504 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f80c000aa40 tx=0x7f80c002fde0 comp rx=0 tx=0).stop 2026-02-13T02:17:57.903 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:57.898+0000 7f80d1c746c0 1 -- 10.20.193.11:0/2218075396 shutdown_connections 2026-02-13T02:17:57.903 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:57.898+0000 7f80d1c746c0 1 --2- 10.20.193.11:0/2218075396 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f80cc110a00 0x7f80cc171390 unknown :-1 s=CLOSED pgs=161 gs=1 cs=0 l=1 c_cookie=1724388706050701504 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:57.903 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:57.898+0000 7f80d1c746c0 1 --2- 10.20.193.11:0/2218075396 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f80cc110050 0x7f80cc1104c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:57.903 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:57.898+0000 7f80d1c746c0 1 --2- 10.20.193.11:0/2218075396 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f80cc10eed0 0x7f80cc10f2c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:57.903 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:57.898+0000 7f80d1c746c0 1 -- 10.20.193.11:0/2218075396 >> 10.20.193.11:0/2218075396 conn(0x7f80cc0ec5f0 msgr2=0x7f80cc10ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:17:57.904 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:57.898+0000 7f80d1c746c0 1 -- 10.20.193.11:0/2218075396 shutdown_connections 2026-02-13T02:17:57.904 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:57.898+0000 7f80d1c746c0 1 -- 10.20.193.11:0/2218075396 wait complete. 2026-02-13T02:17:57.904 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:57.898+0000 7f80d1c746c0 1 Processor -- start 2026-02-13T02:17:57.904 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:57.898+0000 7f80d1c746c0 1 -- start start 2026-02-13T02:17:57.904 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:57.898+0000 7f80d1c746c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f80cc10eed0 0x7f80cc0f84a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:57.904 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:57.898+0000 7f80d1c746c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f80cc110050 0x7f80cc171390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:57.904 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:57.898+0000 7f80d1c746c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f80cc110a00 0x7f80cc0f8d00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:57.904 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:57.898+0000 7f80d1c746c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f80cc0f9930 con 0x7f80cc10eed0 2026-02-13T02:17:57.904 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:57.898+0000 7f80d1c746c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f80cc0f9aa0 con 0x7f80cc110050 2026-02-13T02:17:57.904 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:57.898+0000 7f80d1c746c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f80cc0f9c60 con 0x7f80cc110a00 2026-02-13T02:17:57.904 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:57.899+0000 7f80cb7fe6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f80cc10eed0 0x7f80cc0f84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:57.905 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:57.899+0000 7f80cb7fe6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f80cc10eed0 0x7f80cc0f84a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:57606/0 (socket says 10.20.193.11:57606) 2026-02-13T02:17:57.905 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:57.899+0000 7f80cb7fe6c0 1 -- 10.20.193.11:0/3680408981 learned_addr learned my addr 10.20.193.11:0/3680408981 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:17:57.905 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:57.899+0000 7f80cbfff6c0 1 --2- 10.20.193.11:0/3680408981 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f80cc110a00 0x7f80cc0f8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:57.905 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:57.899+0000 7f80caffd6c0 1 --2- 10.20.193.11:0/3680408981 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f80cc110050 0x7f80cc171390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:57.905 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:57.899+0000 7f80cb7fe6c0 1 -- 10.20.193.11:0/3680408981 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f80cc110a00 msgr2=0x7f80cc0f8d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:57.905 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:57.899+0000 7f80cb7fe6c0 1 --2- 10.20.193.11:0/3680408981 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f80cc110a00 0x7f80cc0f8d00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:57.905 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:57.899+0000 7f80cb7fe6c0 1 -- 10.20.193.11:0/3680408981 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f80cc110050 msgr2=0x7f80cc171390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:17:57.905 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:57.899+0000 7f80cb7fe6c0 1 --2- 10.20.193.11:0/3680408981 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f80cc110050 0x7f80cc171390 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:17:57.905 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:57.899+0000 7f80cb7fe6c0 1 -- 10.20.193.11:0/3680408981 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80c000a660 con 0x7f80cc10eed0 2026-02-13T02:17:57.905 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:57.899+0000 7f80caffd6c0 1 --2- 10.20.193.11:0/3680408981 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f80cc110050 0x7f80cc171390 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:17:57.905 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:57.899+0000 7f80cb7fe6c0 1 --2- 10.20.193.11:0/3680408981 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f80cc10eed0 0x7f80cc0f84a0 secure :-1 s=READY pgs=162 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f80b8009490 tx=0x7f80b800bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:17:57.905 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:57.899+0000 7f80c8ff96c0 1 -- 10.20.193.11:0/3680408981 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f80b8004a80 con 0x7f80cc10eed0 2026-02-13T02:17:57.906 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:57.899+0000 7f80d1c746c0 1 -- 10.20.193.11:0/3680408981 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80cc0f9f40 con 0x7f80cc10eed0 2026-02-13T02:17:57.906 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:57.899+0000 7f80c8ff96c0 1 -- 10.20.193.11:0/3680408981 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f80b8009030 con 0x7f80cc10eed0 2026-02-13T02:17:57.906 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:57.899+0000 7f80c8ff96c0 1 -- 10.20.193.11:0/3680408981 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f80b80071c0 con 0x7f80cc10eed0 2026-02-13T02:17:57.906 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:57.899+0000 7f80d1c746c0 1 -- 10.20.193.11:0/3680408981 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80cc0fa420 con 0x7f80cc10eed0 2026-02-13T02:17:57.906 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:57.899+0000 7f80d1c746c0 1 -- 10.20.193.11:0/3680408981 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80cc1753f0 con 0x7f80cc10eed0 2026-02-13T02:17:57.907 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:57.900+0000 7f80c8ff96c0 1 -- 10.20.193.11:0/3680408981 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 10) ==== 157066+0+0 (secure 0 0 0) 0x7f80b8004060 con 0x7f80cc10eed0 2026-02-13T02:17:57.907 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:57.901+0000 7f80c8ff96c0 1 --2- 10.20.193.11:0/3680408981 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f80a00b5600 0x7f80a00d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:17:57.907 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:57.901+0000 7f80caffd6c0 1 --2- 10.20.193.11:0/3680408981 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f80a00b5600 0x7f80a00d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:17:57.907 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:57.901+0000 7f80c8ff96c0 1 -- 10.20.193.11:0/3680408981 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 3993+0+0 (secure 0 0 0) 0x7f80b80e2bd0 con 0x7f80cc10eed0 2026-02-13T02:17:57.907 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:57.902+0000 7f80caffd6c0 1 --2- 10.20.193.11:0/3680408981 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f80a00b5600 0x7f80a00d5ab0 secure :-1 s=READY pgs=106 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f80bc005980 tx=0x7f80bc005df0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:17:57.907 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:57.902+0000 7f80c8ff96c0 1 -- 10.20.193.11:0/3680408981 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f80b80aa070 con 0x7f80cc10eed0 2026-02-13T02:17:57.999 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:17:57.996+0000 7f80d1c746c0 1 -- 10.20.193.11:0/3680408981 --> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial011:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7f80cc0efd60 con 0x7f80a00b5600 2026-02-13T02:17:58.158 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:58 trial011 ceph-mon[11956]: from='osd.5 [v2:10.20.193.78:6808/3975711592,v1:10.20.193.78:6809/3975711592]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2026-02-13T02:17:58.158 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:58 trial011 ceph-mon[11956]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2026-02-13T02:17:58.158 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:58 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:58.158 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:58 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:58.158 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:58 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T02:17:58.158 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:58 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-13T02:17:58.158 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:58 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:58.159 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:58 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:58.159 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:58 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:17:58.159 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:58 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:58.159 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:58 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:17:58.159 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:58 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:17:58.159 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:58 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:58.159 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:58 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:58.159 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:58 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:58.159 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:58 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:17:58.159 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:58 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:17:58.159 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:58 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:58.243 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:58 trial078 ceph-mon[14969]: from='osd.5 [v2:10.20.193.78:6808/3975711592,v1:10.20.193.78:6809/3975711592]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2026-02-13T02:17:58.243 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:58 trial078 ceph-mon[14969]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2026-02-13T02:17:58.243 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:58 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:58.243 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:58 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:58.243 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:58 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T02:17:58.244 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:58 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-13T02:17:58.244 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:58 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:58.244 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:58 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:58.244 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:58 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:17:58.244 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:58 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:58.244 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:58 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:17:58.244 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:58 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:17:58.244 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:58 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:58.244 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:58 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:58.244 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:58 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:58.244 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:58 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:17:58.245 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:58 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:17:58.245 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:58 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:58.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:58 trial060 ceph-mon[14797]: from='osd.5 [v2:10.20.193.78:6808/3975711592,v1:10.20.193.78:6809/3975711592]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2026-02-13T02:17:58.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:58 trial060 ceph-mon[14797]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2026-02-13T02:17:58.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:58 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:58.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:58 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:58.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:58 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T02:17:58.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:58 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-13T02:17:58.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:58 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:58.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:58 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:58.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:58 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:17:58.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:58 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:58.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:58 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:17:58.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:58 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:17:58.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:58 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:58.502 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:58 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:58.502 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:58 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:58.502 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:58 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:17:58.502 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:58 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:17:58.502 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:58 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:59.042 INFO:journalctl@ceph.osd.5.trial078.stdout:Feb 13 02:17:58 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-5[26065]: 2026-02-13T02:17:58.675+0000 7f033a4dd6c0 -1 osd.5 0 waiting for initial osdmap 2026-02-13T02:17:59.042 INFO:journalctl@ceph.osd.5.trial078.stdout:Feb 13 02:17:58 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-5[26065]: 2026-02-13T02:17:58.680+0000 7f03323aa6c0 -1 osd.5 31 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T02:17:59.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:59 trial011 ceph-mon[11956]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T02:17:59.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:59 trial011 ceph-mon[11956]: from='client.14523 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial011:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:17:59.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:59 trial011 ceph-mon[11956]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2026-02-13T02:17:59.453 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:59 trial011 ceph-mon[11956]: from='osd.5 [v2:10.20.193.78:6808/3975711592,v1:10.20.193.78:6809/3975711592]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial078", "root=default"]} : dispatch 2026-02-13T02:17:59.453 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:59 trial011 ceph-mon[11956]: osdmap e30: 6 total, 5 up, 6 in 2026-02-13T02:17:59.453 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:59 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T02:17:59.453 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:59 trial011 ceph-mon[11956]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial078", "root=default"]} : dispatch 2026-02-13T02:17:59.453 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:59 trial011 ceph-mon[11956]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T02:17:59.453 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:59 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:17:59.453 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:59 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:59.453 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:59 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:59.453 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:59 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:59.454 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:59 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:17:59.454 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:59 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:59.454 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:59 trial011 ceph-mon[11956]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T02:17:59.454 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:59 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:17:59.454 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:59 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:17:59.454 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:59 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:59.454 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:59 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/1114953011' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "bc1293b8-53e6-4386-b02b-31ca7030976d"} : dispatch 2026-02-13T02:17:59.454 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:59 trial011 ceph-mon[11956]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial078", "root=default"]}]': finished 2026-02-13T02:17:59.454 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:59 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/1114953011' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bc1293b8-53e6-4386-b02b-31ca7030976d"}]': finished 2026-02-13T02:17:59.454 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:59 trial011 ceph-mon[11956]: osdmap e31: 7 total, 5 up, 7 in 2026-02-13T02:17:59.454 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:59 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T02:17:59.454 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:59 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T02:17:59.455 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:59 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T02:17:59.455 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:59 trial011 ceph-mon[11956]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:17:59.455 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:59 trial011 ceph-mon[11956]: Cluster is now healthy 2026-02-13T02:17:59.455 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:17:59 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/1798204784' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T02:17:59.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:59 trial060 ceph-mon[14797]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T02:17:59.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:59 trial060 ceph-mon[14797]: from='client.14523 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial011:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:17:59.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:59 trial060 ceph-mon[14797]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2026-02-13T02:17:59.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:59 trial060 ceph-mon[14797]: from='osd.5 [v2:10.20.193.78:6808/3975711592,v1:10.20.193.78:6809/3975711592]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial078", "root=default"]} : dispatch 2026-02-13T02:17:59.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:59 trial060 ceph-mon[14797]: osdmap e30: 6 total, 5 up, 6 in 2026-02-13T02:17:59.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:59 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T02:17:59.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:59 trial060 ceph-mon[14797]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial078", "root=default"]} : dispatch 2026-02-13T02:17:59.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:59 trial060 ceph-mon[14797]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T02:17:59.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:59 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:17:59.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:59 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:59.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:59 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:59.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:59 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:59.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:59 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:17:59.502 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:59 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:59.502 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:59 trial060 ceph-mon[14797]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T02:17:59.502 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:59 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:17:59.502 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:59 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:17:59.502 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:59 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:59.502 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:59 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/1114953011' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "bc1293b8-53e6-4386-b02b-31ca7030976d"} : dispatch 2026-02-13T02:17:59.502 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:59 trial060 ceph-mon[14797]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial078", "root=default"]}]': finished 2026-02-13T02:17:59.502 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:59 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/1114953011' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bc1293b8-53e6-4386-b02b-31ca7030976d"}]': finished 2026-02-13T02:17:59.502 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:59 trial060 ceph-mon[14797]: osdmap e31: 7 total, 5 up, 7 in 2026-02-13T02:17:59.502 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:59 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T02:17:59.502 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:59 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T02:17:59.502 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:59 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T02:17:59.503 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:59 trial060 ceph-mon[14797]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:17:59.503 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:59 trial060 ceph-mon[14797]: Cluster is now healthy 2026-02-13T02:17:59.503 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:17:59 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/1798204784' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T02:17:59.541 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:59 trial078 ceph-mon[14969]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T02:17:59.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:59 trial078 ceph-mon[14969]: from='client.14523 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial011:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:17:59.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:59 trial078 ceph-mon[14969]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2026-02-13T02:17:59.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:59 trial078 ceph-mon[14969]: from='osd.5 [v2:10.20.193.78:6808/3975711592,v1:10.20.193.78:6809/3975711592]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial078", "root=default"]} : dispatch 2026-02-13T02:17:59.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:59 trial078 ceph-mon[14969]: osdmap e30: 6 total, 5 up, 6 in 2026-02-13T02:17:59.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:59 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T02:17:59.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:59 trial078 ceph-mon[14969]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial078", "root=default"]} : dispatch 2026-02-13T02:17:59.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:59 trial078 ceph-mon[14969]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T02:17:59.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:59 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:17:59.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:59 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:59.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:59 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:59.543 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:59 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:59.543 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:59 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:17:59.543 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:59 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:17:59.543 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:59 trial078 ceph-mon[14969]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T02:17:59.543 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:59 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:17:59.543 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:59 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:17:59.543 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:59 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:17:59.543 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:59 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/1114953011' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "bc1293b8-53e6-4386-b02b-31ca7030976d"} : dispatch 2026-02-13T02:17:59.543 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:59 trial078 ceph-mon[14969]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial078", "root=default"]}]': finished 2026-02-13T02:17:59.543 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:59 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/1114953011' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bc1293b8-53e6-4386-b02b-31ca7030976d"}]': finished 2026-02-13T02:17:59.543 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:59 trial078 ceph-mon[14969]: osdmap e31: 7 total, 5 up, 7 in 2026-02-13T02:17:59.543 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:59 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T02:17:59.544 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:59 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T02:17:59.544 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:59 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T02:17:59.544 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:59 trial078 ceph-mon[14969]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:17:59.544 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:59 trial078 ceph-mon[14969]: Cluster is now healthy 2026-02-13T02:17:59.544 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:17:59 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/1798204784' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T02:18:00.763 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:00 trial011 ceph-mon[11956]: purged_snaps scrub starts 2026-02-13T02:18:00.763 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:00 trial011 ceph-mon[11956]: purged_snaps scrub ok 2026-02-13T02:18:00.763 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:00 trial011 ceph-mon[11956]: osd.5 [v2:10.20.193.78:6808/3975711592,v1:10.20.193.78:6809/3975711592] boot 2026-02-13T02:18:00.763 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:00 trial011 ceph-mon[11956]: osdmap e32: 7 total, 6 up, 7 in 2026-02-13T02:18:00.763 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:00 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T02:18:00.763 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:00 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T02:18:00.763 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:00 trial011 ceph-mon[11956]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-13T02:18:01.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:00 trial060 ceph-mon[14797]: purged_snaps scrub starts 2026-02-13T02:18:01.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:00 trial060 ceph-mon[14797]: purged_snaps scrub ok 2026-02-13T02:18:01.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:00 trial060 ceph-mon[14797]: osd.5 [v2:10.20.193.78:6808/3975711592,v1:10.20.193.78:6809/3975711592] boot 2026-02-13T02:18:01.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:00 trial060 ceph-mon[14797]: osdmap e32: 7 total, 6 up, 7 in 2026-02-13T02:18:01.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:00 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T02:18:01.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:00 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T02:18:01.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:00 trial060 ceph-mon[14797]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-13T02:18:01.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:00 trial078 ceph-mon[14969]: purged_snaps scrub starts 2026-02-13T02:18:01.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:00 trial078 ceph-mon[14969]: purged_snaps scrub ok 2026-02-13T02:18:01.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:00 trial078 ceph-mon[14969]: osd.5 [v2:10.20.193.78:6808/3975711592,v1:10.20.193.78:6809/3975711592] boot 2026-02-13T02:18:01.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:00 trial078 ceph-mon[14969]: osdmap e32: 7 total, 6 up, 7 in 2026-02-13T02:18:01.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:00 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T02:18:01.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:00 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T02:18:01.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:00 trial078 ceph-mon[14969]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-13T02:18:01.938 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:01 trial011 ceph-mon[11956]: osdmap e33: 7 total, 6 up, 7 in 2026-02-13T02:18:01.938 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:01 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T02:18:01.938 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:01 trial011 ceph-mon[11956]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-13T02:18:01.938 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:01 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2026-02-13T02:18:01.938 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:01 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:01.938 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:01 trial011 ceph-mon[11956]: osdmap e34: 7 total, 6 up, 7 in 2026-02-13T02:18:01.938 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:01 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T02:18:02.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:01 trial060 ceph-mon[14797]: osdmap e33: 7 total, 6 up, 7 in 2026-02-13T02:18:02.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:01 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T02:18:02.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:01 trial060 ceph-mon[14797]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-13T02:18:02.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:01 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2026-02-13T02:18:02.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:01 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:02.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:01 trial060 ceph-mon[14797]: osdmap e34: 7 total, 6 up, 7 in 2026-02-13T02:18:02.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:01 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T02:18:02.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:01 trial078 ceph-mon[14969]: osdmap e33: 7 total, 6 up, 7 in 2026-02-13T02:18:02.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:01 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T02:18:02.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:01 trial078 ceph-mon[14969]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-13T02:18:02.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:01 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2026-02-13T02:18:02.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:01 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:02.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:01 trial078 ceph-mon[14969]: osdmap e34: 7 total, 6 up, 7 in 2026-02-13T02:18:02.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:01 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T02:18:02.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:02 trial011 ceph-mon[11956]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:18:03.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:02 trial060 ceph-mon[14797]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:18:03.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:02 trial078 ceph-mon[14969]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:18:03.943 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:03 trial078 ceph-mon[14969]: osdmap e35: 7 total, 6 up, 7 in 2026-02-13T02:18:03.943 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:03 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T02:18:03.943 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:03 trial078 ceph-mon[14969]: pgmap v92: 1 pgs: 1 remapped+peering; 577 KiB data, 161 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-13T02:18:03.943 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:03 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:18:03.943 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:03 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:03.943 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:03 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:03.943 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:03 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:03.944 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:03 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:03.944 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:03 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:03.944 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:03 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:18:03.944 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:03 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:03.944 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:03 trial078 ceph-mon[14969]: pgmap v93: 1 pgs: 1 remapped+peering; 577 KiB data, 161 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-13T02:18:03.944 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:03 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:18:03.944 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:03 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:18:03.944 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:03 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:03.950 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:03 trial011 ceph-mon[11956]: osdmap e35: 7 total, 6 up, 7 in 2026-02-13T02:18:03.950 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:03 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T02:18:03.950 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:03 trial011 ceph-mon[11956]: pgmap v92: 1 pgs: 1 remapped+peering; 577 KiB data, 161 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-13T02:18:03.950 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:03 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:18:03.950 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:03 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:03.950 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:03 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:03.950 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:03 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:03.950 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:03 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:03.950 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:03 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:03.951 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:03 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:18:03.951 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:03 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:03.951 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:03 trial011 ceph-mon[11956]: pgmap v93: 1 pgs: 1 remapped+peering; 577 KiB data, 161 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-13T02:18:03.951 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:03 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:18:03.951 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:03 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:18:03.951 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:03 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:03.996 INFO:teuthology.orchestra.run.trial011.stdout:Created osd(s) 6 on host 'trial011' 2026-02-13T02:18:03.996 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:03.993+0000 7f80c8ff96c0 1 -- 10.20.193.11:0/3680408981 <== mgr.14116 v2:10.20.193.11:6800/861334768 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f80cc0efd60 con 0x7f80a00b5600 2026-02-13T02:18:03.998 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:03.996+0000 7f80d1c746c0 1 -- 10.20.193.11:0/3680408981 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f80a00b5600 msgr2=0x7f80a00d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:03.998 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:03.996+0000 7f80d1c746c0 1 --2- 10.20.193.11:0/3680408981 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f80a00b5600 0x7f80a00d5ab0 secure :-1 s=READY pgs=106 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f80bc005980 tx=0x7f80bc005df0 comp rx=0 tx=0).stop 2026-02-13T02:18:03.998 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:03.996+0000 7f80d1c746c0 1 -- 10.20.193.11:0/3680408981 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f80cc10eed0 msgr2=0x7f80cc0f84a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:03.999 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:03.996+0000 7f80d1c746c0 1 --2- 10.20.193.11:0/3680408981 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f80cc10eed0 0x7f80cc0f84a0 secure :-1 s=READY pgs=162 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f80b8009490 tx=0x7f80b800bca0 comp rx=0 tx=0).stop 2026-02-13T02:18:03.999 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:03.996+0000 7f80d1c746c0 1 -- 10.20.193.11:0/3680408981 shutdown_connections 2026-02-13T02:18:03.999 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:03.996+0000 7f80d1c746c0 1 --2- 10.20.193.11:0/3680408981 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f80a00b5600 0x7f80a00d5ab0 unknown :-1 s=CLOSED pgs=106 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:03.999 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:03.996+0000 7f80d1c746c0 1 --2- 10.20.193.11:0/3680408981 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f80cc110050 0x7f80cc171390 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:03.999 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:03.996+0000 7f80d1c746c0 1 --2- 10.20.193.11:0/3680408981 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f80cc110a00 0x7f80cc0f8d00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:03.999 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:03.996+0000 7f80d1c746c0 1 --2- 10.20.193.11:0/3680408981 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f80cc10eed0 0x7f80cc0f84a0 unknown :-1 s=CLOSED pgs=162 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:03.999 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:03.996+0000 7f80d1c746c0 1 -- 10.20.193.11:0/3680408981 >> 10.20.193.11:0/3680408981 conn(0x7f80cc0ec5f0 msgr2=0x7f80cc0ee520 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:18:03.999 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:03.996+0000 7f80d1c746c0 1 -- 10.20.193.11:0/3680408981 shutdown_connections 2026-02-13T02:18:03.999 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:03.996+0000 7f80d1c746c0 1 -- 10.20.193.11:0/3680408981 wait complete. 2026-02-13T02:18:04.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:03 trial060 ceph-mon[14797]: osdmap e35: 7 total, 6 up, 7 in 2026-02-13T02:18:04.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:03 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T02:18:04.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:03 trial060 ceph-mon[14797]: pgmap v92: 1 pgs: 1 remapped+peering; 577 KiB data, 161 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-13T02:18:04.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:03 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:18:04.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:03 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:04.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:03 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:04.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:03 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:04.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:03 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:04.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:03 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:04.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:03 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:18:04.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:03 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:04.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:03 trial060 ceph-mon[14797]: pgmap v93: 1 pgs: 1 remapped+peering; 577 KiB data, 161 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-13T02:18:04.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:03 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:18:04.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:03 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:18:04.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:03 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:04.036 DEBUG:teuthology.orchestra.run.trial011:osd.6> sudo journalctl -f -n 0 -u ceph-fc631695-0881-11f1-899c-d404e6e7d460@osd.6.service 2026-02-13T02:18:04.039 INFO:tasks.cephadm:Deploying osd.7 on trial060 with /dev/vg_nvme/lv_2... 2026-02-13T02:18:04.039 DEBUG:teuthology.orchestra.run.trial060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_2 2026-02-13T02:18:04.167 INFO:teuthology.orchestra.run.trial060.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.b/config 2026-02-13T02:18:04.202 INFO:journalctl@ceph.osd.6.trial011.stdout:Feb 13 02:18:04 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-6[36692]: 2026-02-13T02:18:04.130+0000 7f2a6ab0c780 -1 osd.6 0 log_to_monitors true 2026-02-13T02:18:04.623 INFO:teuthology.orchestra.run.trial060.stdout: 2026-02-13T02:18:04.639 DEBUG:teuthology.orchestra.run.trial060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph orch daemon add osd trial060:vg_nvme/lv_2 --skip-validation 2026-02-13T02:18:04.763 INFO:teuthology.orchestra.run.trial060.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.b/config 2026-02-13T02:18:04.876 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:04 trial060 ceph-mon[14797]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:18:04.877 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:04 trial060 ceph-mon[14797]: Cluster is now healthy 2026-02-13T02:18:04.877 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:04 trial060 ceph-mon[14797]: osdmap e36: 7 total, 6 up, 7 in 2026-02-13T02:18:04.877 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:04 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T02:18:04.877 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:04 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:04.877 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:04 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:04.877 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:04 trial060 ceph-mon[14797]: from='osd.6 [v2:10.20.193.11:6818/2393344644,v1:10.20.193.11:6819/2393344644]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2026-02-13T02:18:04.877 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:04 trial060 ceph-mon[14797]: pgmap v95: 1 pgs: 1 remapped+peering; 577 KiB data, 161 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-13T02:18:04.877 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:04 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:18:04.890 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:04.888+0000 7f134b25c6c0 1 -- 10.20.193.60:0/3932011285 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f1344110050 msgr2=0x7f13441104c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:04.890 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:04.888+0000 7f134b25c6c0 1 --2- 10.20.193.60:0/3932011285 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f1344110050 0x7f13441104c0 secure :-1 s=READY pgs=24 gs=1 cs=0 l=1 c_cookie=13599342935862978433 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f132c009970 tx=0x7f132c02ed20 comp rx=0 tx=0).stop 2026-02-13T02:18:04.890 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:04.888+0000 7f134b25c6c0 1 -- 10.20.193.60:0/3932011285 shutdown_connections 2026-02-13T02:18:04.890 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:04.888+0000 7f134b25c6c0 1 --2- 10.20.193.60:0/3932011285 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f1344110050 0x7f13441104c0 unknown :-1 s=CLOSED pgs=24 gs=1 cs=0 l=1 c_cookie=13599342935862978433 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:04.890 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:04.888+0000 7f134b25c6c0 1 --2- 10.20.193.60:0/3932011285 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1344110a00 0x7f1344171390 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:04.890 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:04.888+0000 7f134b25c6c0 1 --2- 10.20.193.60:0/3932011285 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f134410eed0 0x7f134410f2c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:04.890 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:04.888+0000 7f134b25c6c0 1 -- 10.20.193.60:0/3932011285 >> 10.20.193.60:0/3932011285 conn(0x7f13440ec5f0 msgr2=0x7f134410ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:18:04.891 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:04.888+0000 7f134b25c6c0 1 -- 10.20.193.60:0/3932011285 shutdown_connections 2026-02-13T02:18:04.891 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:04.888+0000 7f134b25c6c0 1 -- 10.20.193.60:0/3932011285 wait complete. 2026-02-13T02:18:04.891 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:04.888+0000 7f134b25c6c0 1 Processor -- start 2026-02-13T02:18:04.891 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:04.888+0000 7f134b25c6c0 1 -- start start 2026-02-13T02:18:04.891 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:04.888+0000 7f134b25c6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f134410eed0 0x7f13440f8fa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:18:04.891 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:04.888+0000 7f134b25c6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1344110050 0x7f1344171390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:18:04.891 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:04.888+0000 7f134b25c6c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f1344110a00 0x7f13440f9800 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:18:04.891 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:04.888+0000 7f134b25c6c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f13440fa430 con 0x7f134410eed0 2026-02-13T02:18:04.891 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:04.888+0000 7f134b25c6c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f13440fa5a0 con 0x7f1344110a00 2026-02-13T02:18:04.891 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:04.888+0000 7f134b25c6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f13440fa760 con 0x7f1344110050 2026-02-13T02:18:04.891 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:04.888+0000 7f13497ce6c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f1344110a00 0x7f13440f9800 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:18:04.892 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:04.888+0000 7f13497ce6c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f1344110a00 0x7f13440f9800 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.60:3300/0 says I am v2:10.20.193.60:55864/0 (socket says 10.20.193.60:55864) 2026-02-13T02:18:04.892 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:04.888+0000 7f13497ce6c0 1 -- 10.20.193.60:0/1165765346 learned_addr learned my addr 10.20.193.60:0/1165765346 (peer_addr_for_me v2:10.20.193.60:0/0) 2026-02-13T02:18:04.892 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:04.888+0000 7f1348fcd6c0 1 --2- 10.20.193.60:0/1165765346 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f134410eed0 0x7f13440f8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:18:04.892 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:04.888+0000 7f133bfff6c0 1 --2- 10.20.193.60:0/1165765346 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1344110050 0x7f1344171390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:18:04.892 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:04.889+0000 7f13497ce6c0 1 -- 10.20.193.60:0/1165765346 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1344110050 msgr2=0x7f1344171390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:04.892 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:04.889+0000 7f13497ce6c0 1 --2- 10.20.193.60:0/1165765346 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1344110050 0x7f1344171390 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:04.892 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:04.889+0000 7f13497ce6c0 1 -- 10.20.193.60:0/1165765346 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f134410eed0 msgr2=0x7f13440f8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:04.892 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:04.889+0000 7f13497ce6c0 1 --2- 10.20.193.60:0/1165765346 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f134410eed0 0x7f13440f8fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:04.892 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:04.889+0000 7f13497ce6c0 1 -- 10.20.193.60:0/1165765346 --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f132c009590 con 0x7f1344110a00 2026-02-13T02:18:04.892 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:04.889+0000 7f13497ce6c0 1 --2- 10.20.193.60:0/1165765346 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f1344110a00 0x7f13440f9800 secure :-1 s=READY pgs=25 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f134000c6c0 tx=0x7f134000cb90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:18:04.892 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:04.889+0000 7f1339ffb6c0 1 -- 10.20.193.60:0/1165765346 <== mon.2 v2:10.20.193.60:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1340003c40 con 0x7f1344110a00 2026-02-13T02:18:04.893 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:04.889+0000 7f1339ffb6c0 1 -- 10.20.193.60:0/1165765346 <== mon.2 v2:10.20.193.60:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f134000a030 con 0x7f1344110a00 2026-02-13T02:18:04.893 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:04.889+0000 7f1339ffb6c0 1 -- 10.20.193.60:0/1165765346 <== mon.2 v2:10.20.193.60:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f134000dc50 con 0x7f1344110a00 2026-02-13T02:18:04.893 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:04.889+0000 7f134b25c6c0 1 -- 10.20.193.60:0/1165765346 --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13440faa40 con 0x7f1344110a00 2026-02-13T02:18:04.893 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:04.889+0000 7f134b25c6c0 1 -- 10.20.193.60:0/1165765346 --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13440faf20 con 0x7f1344110a00 2026-02-13T02:18:04.893 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:04.889+0000 7f134b25c6c0 1 -- 10.20.193.60:0/1165765346 --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13441753c0 con 0x7f1344110a00 2026-02-13T02:18:04.893 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:04.890+0000 7f1339ffb6c0 1 -- 10.20.193.60:0/1165765346 <== mon.2 v2:10.20.193.60:3300/0 4 ==== mgrmap(e 10) ==== 157066+0+0 (secure 0 0 0) 0x7f1340005030 con 0x7f1344110a00 2026-02-13T02:18:04.894 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:04.891+0000 7f1339ffb6c0 1 --2- 10.20.193.60:0/1165765346 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f13200b5680 0x7f13200d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:18:04.894 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:04.891+0000 7f1339ffb6c0 1 -- 10.20.193.60:0/1165765346 <== mon.2 v2:10.20.193.60:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4425+0+0 (secure 0 0 0) 0x7f13400e39d0 con 0x7f1344110a00 2026-02-13T02:18:04.894 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:04.891+0000 7f1348fcd6c0 1 --2- 10.20.193.60:0/1165765346 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f13200b5680 0x7f13200d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:18:04.894 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:04.892+0000 7f1348fcd6c0 1 --2- 10.20.193.60:0/1165765346 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f13200b5680 0x7f13200d5b30 secure :-1 s=READY pgs=111 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1334004750 tx=0x7f1334009390 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:18:04.894 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:04.892+0000 7f1339ffb6c0 1 -- 10.20.193.60:0/1165765346 <== mon.2 v2:10.20.193.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f13400a7260 con 0x7f1344110a00 2026-02-13T02:18:04.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:04 trial011 ceph-mon[11956]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:18:04.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:04 trial011 ceph-mon[11956]: Cluster is now healthy 2026-02-13T02:18:04.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:04 trial011 ceph-mon[11956]: osdmap e36: 7 total, 6 up, 7 in 2026-02-13T02:18:04.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:04 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T02:18:04.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:04 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:04.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:04 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:04.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:04 trial011 ceph-mon[11956]: from='osd.6 [v2:10.20.193.11:6818/2393344644,v1:10.20.193.11:6819/2393344644]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2026-02-13T02:18:04.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:04 trial011 ceph-mon[11956]: pgmap v95: 1 pgs: 1 remapped+peering; 577 KiB data, 161 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-13T02:18:04.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:04 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:18:04.987 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:04.988+0000 7f134b25c6c0 1 -- 10.20.193.60:0/1165765346 --> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial060:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7f13440f1e40 con 0x7f13200b5680 2026-02-13T02:18:05.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:04 trial078 ceph-mon[14969]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:18:05.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:04 trial078 ceph-mon[14969]: Cluster is now healthy 2026-02-13T02:18:05.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:04 trial078 ceph-mon[14969]: osdmap e36: 7 total, 6 up, 7 in 2026-02-13T02:18:05.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:04 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T02:18:05.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:04 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:05.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:04 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:05.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:04 trial078 ceph-mon[14969]: from='osd.6 [v2:10.20.193.11:6818/2393344644,v1:10.20.193.11:6819/2393344644]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2026-02-13T02:18:05.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:04 trial078 ceph-mon[14969]: pgmap v95: 1 pgs: 1 remapped+peering; 577 KiB data, 161 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-13T02:18:05.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:04 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:18:05.952 INFO:journalctl@ceph.osd.6.trial011.stdout:Feb 13 02:18:05 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-6[36692]: 2026-02-13T02:18:05.630+0000 7f2a66a2d6c0 -1 osd.6 0 waiting for initial osdmap 2026-02-13T02:18:05.952 INFO:journalctl@ceph.osd.6.trial011.stdout:Feb 13 02:18:05 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-6[36692]: 2026-02-13T02:18:05.634+0000 7f2a629026c0 -1 osd.6 38 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T02:18:06.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:05 trial060 ceph-mon[14797]: from='client.24278 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial060:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:18:06.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:05 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:06.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:05 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:06.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:05 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:18:06.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:05 trial060 ceph-mon[14797]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:18:06.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:05 trial060 ceph-mon[14797]: from='osd.6 [v2:10.20.193.11:6818/2393344644,v1:10.20.193.11:6819/2393344644]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2026-02-13T02:18:06.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:05 trial060 ceph-mon[14797]: osdmap e37: 7 total, 6 up, 7 in 2026-02-13T02:18:06.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:05 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:18:06.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:05 trial060 ceph-mon[14797]: from='osd.6 [v2:10.20.193.11:6818/2393344644,v1:10.20.193.11:6819/2393344644]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial011", "root=default"]} : dispatch 2026-02-13T02:18:06.002 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:05 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T02:18:06.002 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:05 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:06.002 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:05 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:06.002 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:05 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:06.002 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:05 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T02:18:06.002 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:05 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-13T02:18:06.002 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:05 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2026-02-13T02:18:06.002 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:05 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:06.002 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:05 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:06.002 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:05 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:18:06.003 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:05 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:06.003 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:05 trial060 ceph-mon[14797]: pgmap v97: 1 pgs: 1 remapped+peering; 577 KiB data, 162 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-13T02:18:06.003 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:05 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:18:06.003 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:05 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:18:06.003 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:05 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:06.003 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:05 trial060 ceph-mon[14797]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "da596d81-14dc-403b-9a20-90a7587da04c"} : dispatch 2026-02-13T02:18:06.003 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:05 trial060 ceph-mon[14797]: from='osd.6 [v2:10.20.193.11:6818/2393344644,v1:10.20.193.11:6819/2393344644]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial011", "root=default"]}]': finished 2026-02-13T02:18:06.003 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:05 trial060 ceph-mon[14797]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "da596d81-14dc-403b-9a20-90a7587da04c"}]': finished 2026-02-13T02:18:06.003 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:05 trial060 ceph-mon[14797]: from='client.? 10.20.193.60:0/3188029206' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "da596d81-14dc-403b-9a20-90a7587da04c"} : dispatch 2026-02-13T02:18:06.003 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:05 trial060 ceph-mon[14797]: osdmap e38: 8 total, 6 up, 8 in 2026-02-13T02:18:06.004 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:05 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T02:18:06.004 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:05 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T02:18:06.004 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:05 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T02:18:06.004 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:05 trial060 ceph-mon[14797]: from='client.? 10.20.193.60:0/613222343' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T02:18:06.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:05 trial078 ceph-mon[14969]: from='client.24278 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial060:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:18:06.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:05 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:06.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:05 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:06.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:05 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:18:06.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:05 trial078 ceph-mon[14969]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:18:06.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:05 trial078 ceph-mon[14969]: from='osd.6 [v2:10.20.193.11:6818/2393344644,v1:10.20.193.11:6819/2393344644]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2026-02-13T02:18:06.293 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:05 trial078 ceph-mon[14969]: osdmap e37: 7 total, 6 up, 7 in 2026-02-13T02:18:06.293 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:05 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:18:06.293 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:05 trial078 ceph-mon[14969]: from='osd.6 [v2:10.20.193.11:6818/2393344644,v1:10.20.193.11:6819/2393344644]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial011", "root=default"]} : dispatch 2026-02-13T02:18:06.293 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:05 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T02:18:06.293 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:05 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:06.293 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:05 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:06.293 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:05 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:06.293 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:05 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T02:18:06.293 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:05 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-13T02:18:06.294 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:05 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2026-02-13T02:18:06.294 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:05 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:06.294 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:05 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:06.294 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:05 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:18:06.294 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:05 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:06.294 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:05 trial078 ceph-mon[14969]: pgmap v97: 1 pgs: 1 remapped+peering; 577 KiB data, 162 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-13T02:18:06.294 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:05 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:18:06.294 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:05 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:18:06.294 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:05 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:06.294 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:05 trial078 ceph-mon[14969]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "da596d81-14dc-403b-9a20-90a7587da04c"} : dispatch 2026-02-13T02:18:06.295 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:05 trial078 ceph-mon[14969]: from='osd.6 [v2:10.20.193.11:6818/2393344644,v1:10.20.193.11:6819/2393344644]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial011", "root=default"]}]': finished 2026-02-13T02:18:06.295 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:05 trial078 ceph-mon[14969]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "da596d81-14dc-403b-9a20-90a7587da04c"}]': finished 2026-02-13T02:18:06.295 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:05 trial078 ceph-mon[14969]: from='client.? 10.20.193.60:0/3188029206' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "da596d81-14dc-403b-9a20-90a7587da04c"} : dispatch 2026-02-13T02:18:06.295 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:05 trial078 ceph-mon[14969]: osdmap e38: 8 total, 6 up, 8 in 2026-02-13T02:18:06.295 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:05 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T02:18:06.295 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:05 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T02:18:06.295 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:05 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T02:18:06.295 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:05 trial078 ceph-mon[14969]: from='client.? 10.20.193.60:0/613222343' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T02:18:06.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:05 trial011 ceph-mon[11956]: from='client.24278 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial060:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:18:06.453 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:05 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:06.453 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:05 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:06.453 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:05 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:18:06.453 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:05 trial011 ceph-mon[11956]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:18:06.453 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:05 trial011 ceph-mon[11956]: from='osd.6 [v2:10.20.193.11:6818/2393344644,v1:10.20.193.11:6819/2393344644]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2026-02-13T02:18:06.453 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:05 trial011 ceph-mon[11956]: osdmap e37: 7 total, 6 up, 7 in 2026-02-13T02:18:06.453 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:05 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:18:06.453 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:05 trial011 ceph-mon[11956]: from='osd.6 [v2:10.20.193.11:6818/2393344644,v1:10.20.193.11:6819/2393344644]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial011", "root=default"]} : dispatch 2026-02-13T02:18:06.453 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:05 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T02:18:06.454 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:05 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:06.454 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:05 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:06.454 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:05 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:06.454 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:05 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T02:18:06.454 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:05 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-13T02:18:06.454 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:05 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2026-02-13T02:18:06.454 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:05 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:06.454 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:05 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:06.454 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:05 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:18:06.454 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:05 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:06.455 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:05 trial011 ceph-mon[11956]: pgmap v97: 1 pgs: 1 remapped+peering; 577 KiB data, 162 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-13T02:18:06.455 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:05 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:18:06.455 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:05 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:18:06.455 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:05 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:06.455 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:05 trial011 ceph-mon[11956]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "da596d81-14dc-403b-9a20-90a7587da04c"} : dispatch 2026-02-13T02:18:06.455 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:05 trial011 ceph-mon[11956]: from='osd.6 [v2:10.20.193.11:6818/2393344644,v1:10.20.193.11:6819/2393344644]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial011", "root=default"]}]': finished 2026-02-13T02:18:06.455 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:05 trial011 ceph-mon[11956]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "da596d81-14dc-403b-9a20-90a7587da04c"}]': finished 2026-02-13T02:18:06.455 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:05 trial011 ceph-mon[11956]: from='client.? 10.20.193.60:0/3188029206' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "da596d81-14dc-403b-9a20-90a7587da04c"} : dispatch 2026-02-13T02:18:06.455 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:05 trial011 ceph-mon[11956]: osdmap e38: 8 total, 6 up, 8 in 2026-02-13T02:18:06.455 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:05 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T02:18:06.455 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:05 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T02:18:06.456 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:05 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T02:18:06.456 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:05 trial011 ceph-mon[11956]: from='client.? 10.20.193.60:0/613222343' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T02:18:07.250 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:06 trial060 ceph-mon[14797]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:18:07.251 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:06 trial060 ceph-mon[14797]: Cluster is now healthy 2026-02-13T02:18:07.251 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:06 trial060 ceph-mon[14797]: osd.6 [v2:10.20.193.11:6818/2393344644,v1:10.20.193.11:6819/2393344644] boot 2026-02-13T02:18:07.251 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:06 trial060 ceph-mon[14797]: osdmap e39: 8 total, 7 up, 8 in 2026-02-13T02:18:07.251 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:06 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T02:18:07.251 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:06 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T02:18:07.291 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:06 trial078 ceph-mon[14969]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:18:07.291 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:06 trial078 ceph-mon[14969]: Cluster is now healthy 2026-02-13T02:18:07.291 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:06 trial078 ceph-mon[14969]: osd.6 [v2:10.20.193.11:6818/2393344644,v1:10.20.193.11:6819/2393344644] boot 2026-02-13T02:18:07.291 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:06 trial078 ceph-mon[14969]: osdmap e39: 8 total, 7 up, 8 in 2026-02-13T02:18:07.291 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:06 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T02:18:07.291 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:06 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T02:18:07.451 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:06 trial011 ceph-mon[11956]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:18:07.451 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:06 trial011 ceph-mon[11956]: Cluster is now healthy 2026-02-13T02:18:07.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:06 trial011 ceph-mon[11956]: osd.6 [v2:10.20.193.11:6818/2393344644,v1:10.20.193.11:6819/2393344644] boot 2026-02-13T02:18:07.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:06 trial011 ceph-mon[11956]: osdmap e39: 8 total, 7 up, 8 in 2026-02-13T02:18:07.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:06 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T02:18:07.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:06 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T02:18:08.110 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:07 trial060 ceph-mon[14797]: purged_snaps scrub starts 2026-02-13T02:18:08.110 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:07 trial060 ceph-mon[14797]: purged_snaps scrub ok 2026-02-13T02:18:08.110 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:07 trial060 ceph-mon[14797]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 4.8 TiB / 4.8 TiB avail; 170 KiB/s, 0 objects/s recovering 2026-02-13T02:18:08.110 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:07 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:18:08.110 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:07 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:08.110 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:07 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:08.110 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:07 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:08.110 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:07 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:18:08.110 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:07 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:08.110 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:07 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:18:08.110 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:07 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:18:08.110 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:07 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:08.291 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:07 trial078 ceph-mon[14969]: purged_snaps scrub starts 2026-02-13T02:18:08.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:07 trial078 ceph-mon[14969]: purged_snaps scrub ok 2026-02-13T02:18:08.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:07 trial078 ceph-mon[14969]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 4.8 TiB / 4.8 TiB avail; 170 KiB/s, 0 objects/s recovering 2026-02-13T02:18:08.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:07 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:18:08.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:07 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:08.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:07 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:08.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:07 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:08.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:07 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:18:08.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:07 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:08.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:07 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:18:08.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:07 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:18:08.293 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:07 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:08.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:07 trial011 ceph-mon[11956]: purged_snaps scrub starts 2026-02-13T02:18:08.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:07 trial011 ceph-mon[11956]: purged_snaps scrub ok 2026-02-13T02:18:08.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:07 trial011 ceph-mon[11956]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 4.8 TiB / 4.8 TiB avail; 170 KiB/s, 0 objects/s recovering 2026-02-13T02:18:08.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:07 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:18:08.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:07 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:08.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:07 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:08.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:07 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:08.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:07 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:18:08.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:07 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:08.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:07 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:18:08.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:07 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:18:08.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:07 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:09.250 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:09 trial060 ceph-mon[14797]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 4.8 TiB / 4.8 TiB avail; 167 KiB/s, 0 objects/s recovering 2026-02-13T02:18:09.251 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:09 trial060 ceph-mon[14797]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 4.8 TiB / 4.8 TiB avail; 205 KiB/s, 0 objects/s recovering 2026-02-13T02:18:09.251 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:09 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2026-02-13T02:18:09.251 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:09 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:09.251 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:09 trial060 ceph-mon[14797]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 4.8 TiB / 4.8 TiB avail; 178 KiB/s, 0 objects/s recovering 2026-02-13T02:18:09.291 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:08 trial078 ceph-mon[14969]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 4.8 TiB / 4.8 TiB avail; 167 KiB/s, 0 objects/s recovering 2026-02-13T02:18:09.291 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:08 trial078 ceph-mon[14969]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 4.8 TiB / 4.8 TiB avail; 205 KiB/s, 0 objects/s recovering 2026-02-13T02:18:09.291 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:08 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2026-02-13T02:18:09.291 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:08 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:09.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:08 trial078 ceph-mon[14969]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 4.8 TiB / 4.8 TiB avail; 178 KiB/s, 0 objects/s recovering 2026-02-13T02:18:09.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:08 trial011 ceph-mon[11956]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 4.8 TiB / 4.8 TiB avail; 167 KiB/s, 0 objects/s recovering 2026-02-13T02:18:09.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:08 trial011 ceph-mon[11956]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 4.8 TiB / 4.8 TiB avail; 205 KiB/s, 0 objects/s recovering 2026-02-13T02:18:09.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:08 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2026-02-13T02:18:09.453 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:08 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:09.453 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:08 trial011 ceph-mon[11956]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 4.8 TiB / 4.8 TiB avail; 178 KiB/s, 0 objects/s recovering 2026-02-13T02:18:10.270 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:10 trial060 ceph-mon[14797]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:18:10.291 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:09 trial078 ceph-mon[14969]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:18:10.353 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:10 trial011 ceph-mon[11956]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:18:11.202 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:11.202+0000 7f1339ffb6c0 1 -- 10.20.193.60:0/1165765346 <== mgr.14116 v2:10.20.193.11:6800/861334768 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f13440f1e40 con 0x7f13200b5680 2026-02-13T02:18:11.202 INFO:teuthology.orchestra.run.trial060.stdout:Created osd(s) 7 on host 'trial060' 2026-02-13T02:18:11.205 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:11.205+0000 7f134b25c6c0 1 -- 10.20.193.60:0/1165765346 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f13200b5680 msgr2=0x7f13200d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:11.205 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:11.205+0000 7f134b25c6c0 1 --2- 10.20.193.60:0/1165765346 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f13200b5680 0x7f13200d5b30 secure :-1 s=READY pgs=111 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1334004750 tx=0x7f1334009390 comp rx=0 tx=0).stop 2026-02-13T02:18:11.205 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:11.205+0000 7f134b25c6c0 1 -- 10.20.193.60:0/1165765346 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f1344110a00 msgr2=0x7f13440f9800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:11.205 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:11.205+0000 7f134b25c6c0 1 --2- 10.20.193.60:0/1165765346 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f1344110a00 0x7f13440f9800 secure :-1 s=READY pgs=25 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f134000c6c0 tx=0x7f134000cb90 comp rx=0 tx=0).stop 2026-02-13T02:18:11.205 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:11.205+0000 7f134b25c6c0 1 -- 10.20.193.60:0/1165765346 shutdown_connections 2026-02-13T02:18:11.205 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:11.205+0000 7f134b25c6c0 1 --2- 10.20.193.60:0/1165765346 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f13200b5680 0x7f13200d5b30 unknown :-1 s=CLOSED pgs=111 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:11.206 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:11.205+0000 7f134b25c6c0 1 --2- 10.20.193.60:0/1165765346 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f1344110a00 0x7f13440f9800 unknown :-1 s=CLOSED pgs=25 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:11.206 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:11.205+0000 7f134b25c6c0 1 --2- 10.20.193.60:0/1165765346 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1344110050 0x7f1344171390 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:11.206 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:11.205+0000 7f134b25c6c0 1 --2- 10.20.193.60:0/1165765346 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f134410eed0 0x7f13440f8fa0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:11.206 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:11.205+0000 7f134b25c6c0 1 -- 10.20.193.60:0/1165765346 >> 10.20.193.60:0/1165765346 conn(0x7f13440ec5f0 msgr2=0x7f13440ef530 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:18:11.206 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:11.205+0000 7f134b25c6c0 1 -- 10.20.193.60:0/1165765346 shutdown_connections 2026-02-13T02:18:11.206 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:11.205+0000 7f134b25c6c0 1 -- 10.20.193.60:0/1165765346 wait complete. 2026-02-13T02:18:11.215 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:11 trial060 ceph-mon[14797]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 4.8 TiB / 4.8 TiB avail; 123 KiB/s, 0 objects/s recovering 2026-02-13T02:18:11.215 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:11 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:18:11.215 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:11 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:11.215 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:11 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:11.215 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:11 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:11.215 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:11 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:11.216 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:11 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:11.216 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:11 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:18:11.216 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:11 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:11.216 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:11 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:18:11.216 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:11 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:18:11.216 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:11 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:11.242 DEBUG:teuthology.orchestra.run.trial060:osd.7> sudo journalctl -f -n 0 -u ceph-fc631695-0881-11f1-899c-d404e6e7d460@osd.7.service 2026-02-13T02:18:11.245 INFO:tasks.cephadm:Deploying osd.8 on trial078 with /dev/vg_nvme/lv_2... 2026-02-13T02:18:11.245 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_2 2026-02-13T02:18:11.273 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:11 trial078 ceph-mon[14969]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 4.8 TiB / 4.8 TiB avail; 123 KiB/s, 0 objects/s recovering 2026-02-13T02:18:11.273 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:11 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:18:11.273 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:11 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:11.273 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:11 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:11.273 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:11 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:11.273 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:11 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:11.273 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:11 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:11.274 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:11 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:18:11.274 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:11 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:11.274 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:11 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:18:11.274 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:11 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:18:11.274 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:11 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:11.373 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.c/config 2026-02-13T02:18:11.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:11 trial011 ceph-mon[11956]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 4.8 TiB / 4.8 TiB avail; 123 KiB/s, 0 objects/s recovering 2026-02-13T02:18:11.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:11 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:18:11.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:11 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:11.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:11 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:11.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:11 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:11.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:11 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:11.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:11 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:11.453 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:11 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:18:11.453 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:11 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:11.453 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:11 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:18:11.453 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:11 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:18:11.453 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:11 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:11.465 INFO:journalctl@ceph.osd.7.trial060.stdout:Feb 13 02:18:11 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-7[32498]: 2026-02-13T02:18:11.355+0000 7feac3f73780 -1 osd.7 0 log_to_monitors true 2026-02-13T02:18:11.816 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:18:11.835 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph orch daemon add osd trial078:vg_nvme/lv_2 --skip-validation 2026-02-13T02:18:11.999 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.c/config 2026-02-13T02:18:12.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:12 trial078 ceph-mon[14969]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T02:18:12.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:12 trial078 ceph-mon[14969]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:18:12.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:12 trial078 ceph-mon[14969]: Cluster is now healthy 2026-02-13T02:18:12.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:12 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:12.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:12 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:12.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:12 trial078 ceph-mon[14969]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2026-02-13T02:18:12.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:12 trial078 ceph-mon[14969]: from='osd.7 [v2:10.20.193.60:6816/2908560893,v1:10.20.193.60:6817/2908560893]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2026-02-13T02:18:12.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:12 trial078 ceph-mon[14969]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T02:18:12.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:12 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:18:12.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:12.116+0000 7fb85fcc86c0 1 -- 10.20.193.78:0/2431865522 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb8581109f0 msgr2=0x7fb858171380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:12.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:12.116+0000 7fb85fcc86c0 1 --2- 10.20.193.78:0/2431865522 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb8581109f0 0x7fb858171380 secure :-1 s=READY pgs=29 gs=1 cs=0 l=1 c_cookie=14674160143733913292 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb85400aa40 tx=0x7fb85402fde0 comp rx=0 tx=0).stop 2026-02-13T02:18:12.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:12.116+0000 7fb85fcc86c0 1 -- 10.20.193.78:0/2431865522 shutdown_connections 2026-02-13T02:18:12.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:12.116+0000 7fb85fcc86c0 1 --2- 10.20.193.78:0/2431865522 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fb858110040 0x7fb8581104b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:12.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:12.116+0000 7fb85fcc86c0 1 --2- 10.20.193.78:0/2431865522 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb8581109f0 0x7fb858171380 unknown :-1 s=CLOSED pgs=29 gs=1 cs=0 l=1 c_cookie=14674160143733913292 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:12.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:12.116+0000 7fb85fcc86c0 1 --2- 10.20.193.78:0/2431865522 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fb85810eec0 0x7fb85810f2b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:12.122 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:12.116+0000 7fb85fcc86c0 1 -- 10.20.193.78:0/2431865522 >> 10.20.193.78:0/2431865522 conn(0x7fb8580ec5c0 msgr2=0x7fb85810c9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:18:12.123 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:12.116+0000 7fb85fcc86c0 1 -- 10.20.193.78:0/2431865522 shutdown_connections 2026-02-13T02:18:12.123 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:12.116+0000 7fb85fcc86c0 1 -- 10.20.193.78:0/2431865522 wait complete. 2026-02-13T02:18:12.123 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:12.117+0000 7fb85fcc86c0 1 Processor -- start 2026-02-13T02:18:12.123 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:12.117+0000 7fb85fcc86c0 1 -- start start 2026-02-13T02:18:12.123 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:12.117+0000 7fb85fcc86c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb85810eec0 0x7fb8580f8f60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:18:12.123 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:12.117+0000 7fb85fcc86c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fb858110040 0x7fb858171380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:18:12.123 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:12.117+0000 7fb85fcc86c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fb8581109f0 0x7fb8580f97c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:18:12.123 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:12.117+0000 7fb85fcc86c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7fb8580fa360 con 0x7fb858110040 2026-02-13T02:18:12.123 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:12.117+0000 7fb85fcc86c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb8580fa4d0 con 0x7fb8581109f0 2026-02-13T02:18:12.123 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:12.117+0000 7fb85fcc86c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fb8580fa690 con 0x7fb85810eec0 2026-02-13T02:18:12.123 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:12.117+0000 7fb85da396c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb85810eec0 0x7fb8580f8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:18:12.124 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:12.117+0000 7fb85da396c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb85810eec0 0x7fb8580f8f60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.78:3300/0 says I am v2:10.20.193.78:56786/0 (socket says 10.20.193.78:56786) 2026-02-13T02:18:12.124 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:12.117+0000 7fb85da396c0 1 -- 10.20.193.78:0/1615274360 learned_addr learned my addr 10.20.193.78:0/1615274360 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:18:12.124 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:12.117+0000 7fb85d2386c0 1 --2- 10.20.193.78:0/1615274360 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fb858110040 0x7fb858171380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:18:12.124 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:12.117+0000 7fb85e23a6c0 1 --2- 10.20.193.78:0/1615274360 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fb8581109f0 0x7fb8580f97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:18:12.124 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:12.117+0000 7fb85da396c0 1 -- 10.20.193.78:0/1615274360 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fb8581109f0 msgr2=0x7fb8580f97c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:12.124 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:12.117+0000 7fb85da396c0 1 --2- 10.20.193.78:0/1615274360 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fb8581109f0 0x7fb8580f97c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:12.124 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:12.117+0000 7fb85da396c0 1 -- 10.20.193.78:0/1615274360 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fb858110040 msgr2=0x7fb858171380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:12.124 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:12.117+0000 7fb85da396c0 1 --2- 10.20.193.78:0/1615274360 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fb858110040 0x7fb858171380 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:12.124 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:12.117+0000 7fb85da396c0 1 -- 10.20.193.78:0/1615274360 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb85400a660 con 0x7fb85810eec0 2026-02-13T02:18:12.124 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:12.117+0000 7fb85e23a6c0 1 --2- 10.20.193.78:0/1615274360 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fb8581109f0 0x7fb8580f97c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:18:12.124 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:12.117+0000 7fb85da396c0 1 --2- 10.20.193.78:0/1615274360 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb85810eec0 0x7fb8580f8f60 secure :-1 s=READY pgs=30 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb84800b6c0 tx=0x7fb84800bb90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:18:12.124 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:12.117+0000 7fb846ffd6c0 1 -- 10.20.193.78:0/1615274360 <== mon.1 v2:10.20.193.78:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb848004560 con 0x7fb85810eec0 2026-02-13T02:18:12.125 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:12.117+0000 7fb846ffd6c0 1 -- 10.20.193.78:0/1615274360 <== mon.1 v2:10.20.193.78:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb848009030 con 0x7fb85810eec0 2026-02-13T02:18:12.125 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:12.117+0000 7fb846ffd6c0 1 -- 10.20.193.78:0/1615274360 <== mon.1 v2:10.20.193.78:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb84800ce30 con 0x7fb85810eec0 2026-02-13T02:18:12.125 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:12.117+0000 7fb85fcc86c0 1 -- 10.20.193.78:0/1615274360 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8580fa970 con 0x7fb85810eec0 2026-02-13T02:18:12.125 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:12.117+0000 7fb85fcc86c0 1 -- 10.20.193.78:0/1615274360 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8580fae00 con 0x7fb85810eec0 2026-02-13T02:18:12.125 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:12.118+0000 7fb85fcc86c0 1 -- 10.20.193.78:0/1615274360 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb858175390 con 0x7fb85810eec0 2026-02-13T02:18:12.125 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:12.119+0000 7fb846ffd6c0 1 -- 10.20.193.78:0/1615274360 <== mon.1 v2:10.20.193.78:3300/0 4 ==== mgrmap(e 10) ==== 157066+0+0 (secure 0 0 0) 0x7fb84800c410 con 0x7fb85810eec0 2026-02-13T02:18:12.126 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:12.120+0000 7fb846ffd6c0 1 --2- 10.20.193.78:0/1615274360 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fb8340b5680 0x7fb8340d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:18:12.126 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:12.120+0000 7fb846ffd6c0 1 -- 10.20.193.78:0/1615274360 <== mon.1 v2:10.20.193.78:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4857+0+0 (secure 0 0 0) 0x7fb8480e2cd0 con 0x7fb85810eec0 2026-02-13T02:18:12.126 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:12.120+0000 7fb85d2386c0 1 --2- 10.20.193.78:0/1615274360 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fb8340b5680 0x7fb8340d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:18:12.126 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:12.120+0000 7fb85d2386c0 1 --2- 10.20.193.78:0/1615274360 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fb8340b5680 0x7fb8340d5b30 secure :-1 s=READY pgs=116 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb84c005980 tx=0x7fb84c005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:18:12.126 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:12.120+0000 7fb846ffd6c0 1 -- 10.20.193.78:0/1615274360 <== mon.1 v2:10.20.193.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fb8480a63b0 con 0x7fb85810eec0 2026-02-13T02:18:12.220 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:12.217+0000 7fb85fcc86c0 1 -- 10.20.193.78:0/1615274360 --> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial078:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7fb8580f1e20 con 0x7fb8340b5680 2026-02-13T02:18:12.260 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:12 trial060 ceph-mon[14797]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T02:18:12.260 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:12 trial060 ceph-mon[14797]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:18:12.260 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:12 trial060 ceph-mon[14797]: Cluster is now healthy 2026-02-13T02:18:12.260 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:12 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:12.260 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:12 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:12.260 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:12 trial060 ceph-mon[14797]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2026-02-13T02:18:12.261 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:12 trial060 ceph-mon[14797]: from='osd.7 [v2:10.20.193.60:6816/2908560893,v1:10.20.193.60:6817/2908560893]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2026-02-13T02:18:12.261 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:12 trial060 ceph-mon[14797]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T02:18:12.261 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:12 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:18:12.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:12 trial011 ceph-mon[11956]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T02:18:12.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:12 trial011 ceph-mon[11956]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:18:12.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:12 trial011 ceph-mon[11956]: Cluster is now healthy 2026-02-13T02:18:12.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:12 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:12.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:12 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:12.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:12 trial011 ceph-mon[11956]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2026-02-13T02:18:12.453 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:12 trial011 ceph-mon[11956]: from='osd.7 [v2:10.20.193.60:6816/2908560893,v1:10.20.193.60:6817/2908560893]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2026-02-13T02:18:12.453 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:12 trial011 ceph-mon[11956]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T02:18:12.453 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:12 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:18:13.250 INFO:journalctl@ceph.osd.7.trial060.stdout:Feb 13 02:18:12 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-7[32498]: 2026-02-13T02:18:12.872+0000 7feabfe946c0 -1 osd.7 0 waiting for initial osdmap 2026-02-13T02:18:13.250 INFO:journalctl@ceph.osd.7.trial060.stdout:Feb 13 02:18:12 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-7[32498]: 2026-02-13T02:18:12.878+0000 7feab7d616c0 -1 osd.7 41 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T02:18:13.251 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:13 trial060 ceph-mon[14797]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:18:13.251 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:13 trial060 ceph-mon[14797]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2026-02-13T02:18:13.251 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:13 trial060 ceph-mon[14797]: osdmap e40: 8 total, 7 up, 8 in 2026-02-13T02:18:13.251 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:13 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T02:18:13.251 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:13 trial060 ceph-mon[14797]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial060", "root=default"]} : dispatch 2026-02-13T02:18:13.252 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:13 trial060 ceph-mon[14797]: from='osd.7 [v2:10.20.193.60:6816/2908560893,v1:10.20.193.60:6817/2908560893]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial060", "root=default"]} : dispatch 2026-02-13T02:18:13.252 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:13 trial060 ceph-mon[14797]: from='client.24292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial078:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:18:13.252 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:13 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:13.252 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:13 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:13.252 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:13 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:18:13.252 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:13 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:18:13.252 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:13 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:13.252 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:13 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:13.252 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:13 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:13.252 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:13 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T02:18:13.252 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:13 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-13T02:18:13.253 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:13 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2026-02-13T02:18:13.253 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:13 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:13.253 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:13 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:13.253 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:13 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:18:13.253 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:13 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:13.253 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:13 trial060 ceph-mon[14797]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T02:18:13.253 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:13 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:18:13.253 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:13 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:18:13.253 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:13 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:13.253 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:13 trial060 ceph-mon[14797]: from='client.? 10.20.193.78:0/1455121059' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "24098987-9f02-4f06-b93e-8af84291cc82"} : dispatch 2026-02-13T02:18:13.253 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:13 trial060 ceph-mon[14797]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "24098987-9f02-4f06-b93e-8af84291cc82"} : dispatch 2026-02-13T02:18:13.254 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:13 trial060 ceph-mon[14797]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial060", "root=default"]}]': finished 2026-02-13T02:18:13.254 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:13 trial060 ceph-mon[14797]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "24098987-9f02-4f06-b93e-8af84291cc82"}]': finished 2026-02-13T02:18:13.254 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:13 trial060 ceph-mon[14797]: osdmap e41: 9 total, 7 up, 9 in 2026-02-13T02:18:13.254 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:13 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T02:18:13.254 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:13 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T02:18:13.254 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:13 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T02:18:13.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:13 trial078 ceph-mon[14969]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:18:13.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:13 trial078 ceph-mon[14969]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2026-02-13T02:18:13.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:13 trial078 ceph-mon[14969]: osdmap e40: 8 total, 7 up, 8 in 2026-02-13T02:18:13.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:13 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T02:18:13.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:13 trial078 ceph-mon[14969]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial060", "root=default"]} : dispatch 2026-02-13T02:18:13.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:13 trial078 ceph-mon[14969]: from='osd.7 [v2:10.20.193.60:6816/2908560893,v1:10.20.193.60:6817/2908560893]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial060", "root=default"]} : dispatch 2026-02-13T02:18:13.293 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:13 trial078 ceph-mon[14969]: from='client.24292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial078:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:18:13.293 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:13 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:13.293 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:13 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:13.293 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:13 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:18:13.293 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:13 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:18:13.293 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:13 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:13.293 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:13 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:13.293 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:13 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:13.293 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:13 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T02:18:13.293 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:13 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-13T02:18:13.293 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:13 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2026-02-13T02:18:13.294 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:13 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:13.294 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:13 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:13.294 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:13 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:18:13.294 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:13 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:13.294 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:13 trial078 ceph-mon[14969]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T02:18:13.294 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:13 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:18:13.294 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:13 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:18:13.294 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:13 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:13.294 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:13 trial078 ceph-mon[14969]: from='client.? 10.20.193.78:0/1455121059' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "24098987-9f02-4f06-b93e-8af84291cc82"} : dispatch 2026-02-13T02:18:13.294 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:13 trial078 ceph-mon[14969]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "24098987-9f02-4f06-b93e-8af84291cc82"} : dispatch 2026-02-13T02:18:13.294 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:13 trial078 ceph-mon[14969]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial060", "root=default"]}]': finished 2026-02-13T02:18:13.294 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:13 trial078 ceph-mon[14969]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "24098987-9f02-4f06-b93e-8af84291cc82"}]': finished 2026-02-13T02:18:13.295 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:13 trial078 ceph-mon[14969]: osdmap e41: 9 total, 7 up, 9 in 2026-02-13T02:18:13.295 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:13 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T02:18:13.295 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:13 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T02:18:13.295 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:13 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T02:18:13.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:13 trial011 ceph-mon[11956]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:18:13.453 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:13 trial011 ceph-mon[11956]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2026-02-13T02:18:13.453 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:13 trial011 ceph-mon[11956]: osdmap e40: 8 total, 7 up, 8 in 2026-02-13T02:18:13.453 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:13 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T02:18:13.453 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:13 trial011 ceph-mon[11956]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial060", "root=default"]} : dispatch 2026-02-13T02:18:13.453 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:13 trial011 ceph-mon[11956]: from='osd.7 [v2:10.20.193.60:6816/2908560893,v1:10.20.193.60:6817/2908560893]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial060", "root=default"]} : dispatch 2026-02-13T02:18:13.453 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:13 trial011 ceph-mon[11956]: from='client.24292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial078:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:18:13.453 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:13 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:13.453 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:13 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:13.453 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:13 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:18:13.454 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:13 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:18:13.454 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:13 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:13.454 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:13 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:13.454 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:13 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:13.454 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:13 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T02:18:13.454 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:13 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-13T02:18:13.454 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:13 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2026-02-13T02:18:13.454 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:13 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:13.454 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:13 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:13.454 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:13 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:18:13.454 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:13 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:13.455 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:13 trial011 ceph-mon[11956]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T02:18:13.455 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:13 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:18:13.455 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:13 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:18:13.455 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:13 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:13.455 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:13 trial011 ceph-mon[11956]: from='client.? 10.20.193.78:0/1455121059' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "24098987-9f02-4f06-b93e-8af84291cc82"} : dispatch 2026-02-13T02:18:13.455 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:13 trial011 ceph-mon[11956]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "24098987-9f02-4f06-b93e-8af84291cc82"} : dispatch 2026-02-13T02:18:13.455 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:13 trial011 ceph-mon[11956]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial060", "root=default"]}]': finished 2026-02-13T02:18:13.455 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:13 trial011 ceph-mon[11956]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "24098987-9f02-4f06-b93e-8af84291cc82"}]': finished 2026-02-13T02:18:13.455 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:13 trial011 ceph-mon[11956]: osdmap e41: 9 total, 7 up, 9 in 2026-02-13T02:18:13.455 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:13 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T02:18:13.455 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:13 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T02:18:13.456 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:13 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T02:18:14.291 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:14 trial078 ceph-mon[14969]: from='client.? 10.20.193.78:0/1420474045' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T02:18:14.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:14 trial078 ceph-mon[14969]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:18:14.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:14 trial078 ceph-mon[14969]: Cluster is now healthy 2026-02-13T02:18:14.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:14 trial078 ceph-mon[14969]: osd.7 [v2:10.20.193.60:6816/2908560893,v1:10.20.193.60:6817/2908560893] boot 2026-02-13T02:18:14.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:14 trial078 ceph-mon[14969]: osdmap e42: 9 total, 8 up, 9 in 2026-02-13T02:18:14.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:14 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T02:18:14.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:14 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T02:18:14.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:14 trial011 ceph-mon[11956]: from='client.? 10.20.193.78:0/1420474045' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T02:18:14.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:14 trial011 ceph-mon[11956]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:18:14.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:14 trial011 ceph-mon[11956]: Cluster is now healthy 2026-02-13T02:18:14.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:14 trial011 ceph-mon[11956]: osd.7 [v2:10.20.193.60:6816/2908560893,v1:10.20.193.60:6817/2908560893] boot 2026-02-13T02:18:14.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:14 trial011 ceph-mon[11956]: osdmap e42: 9 total, 8 up, 9 in 2026-02-13T02:18:14.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:14 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T02:18:14.453 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:14 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T02:18:14.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:14 trial060 ceph-mon[14797]: from='client.? 10.20.193.78:0/1420474045' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T02:18:14.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:14 trial060 ceph-mon[14797]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:18:14.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:14 trial060 ceph-mon[14797]: Cluster is now healthy 2026-02-13T02:18:14.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:14 trial060 ceph-mon[14797]: osd.7 [v2:10.20.193.60:6816/2908560893,v1:10.20.193.60:6817/2908560893] boot 2026-02-13T02:18:14.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:14 trial060 ceph-mon[14797]: osdmap e42: 9 total, 8 up, 9 in 2026-02-13T02:18:14.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:14 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T02:18:14.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:14 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T02:18:15.027 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:15 trial078 ceph-mon[14969]: purged_snaps scrub starts 2026-02-13T02:18:15.027 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:15 trial078 ceph-mon[14969]: purged_snaps scrub ok 2026-02-13T02:18:15.028 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:15 trial078 ceph-mon[14969]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T02:18:15.028 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:15 trial078 ceph-mon[14969]: osdmap e43: 9 total, 8 up, 9 in 2026-02-13T02:18:15.028 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:15 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T02:18:15.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:15 trial011 ceph-mon[11956]: purged_snaps scrub starts 2026-02-13T02:18:15.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:15 trial011 ceph-mon[11956]: purged_snaps scrub ok 2026-02-13T02:18:15.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:15 trial011 ceph-mon[11956]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T02:18:15.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:15 trial011 ceph-mon[11956]: osdmap e43: 9 total, 8 up, 9 in 2026-02-13T02:18:15.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:15 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T02:18:15.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:15 trial060 ceph-mon[14797]: purged_snaps scrub starts 2026-02-13T02:18:15.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:15 trial060 ceph-mon[14797]: purged_snaps scrub ok 2026-02-13T02:18:15.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:15 trial060 ceph-mon[14797]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T02:18:15.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:15 trial060 ceph-mon[14797]: osdmap e43: 9 total, 8 up, 9 in 2026-02-13T02:18:15.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:15 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T02:18:16.136 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:16 trial078 ceph-mon[14969]: pgmap v113: 1 pgs: 1 remapped; 577 KiB data, 215 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T02:18:16.137 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:16 trial078 ceph-mon[14969]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:18:16.137 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:16 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:18:16.137 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:16 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:16.137 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:16 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:16.137 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:16 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:16.137 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:16 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:18:16.137 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:16 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:16.137 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:16 trial078 ceph-mon[14969]: pgmap v114: 1 pgs: 1 remapped; 577 KiB data, 215 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T02:18:16.137 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:16 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:18:16.137 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:16 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:18:16.137 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:16 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:16.137 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:16 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2026-02-13T02:18:16.137 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:16 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:16.137 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:16 trial078 ceph-mon[14969]: pgmap v115: 1 pgs: 1 remapped; 577 KiB data, 215 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T02:18:16.137 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:16 trial078 ceph-mon[14969]: osdmap e44: 9 total, 8 up, 9 in 2026-02-13T02:18:16.137 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:16 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T02:18:16.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:16 trial011 ceph-mon[11956]: pgmap v113: 1 pgs: 1 remapped; 577 KiB data, 215 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T02:18:16.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:16 trial011 ceph-mon[11956]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:18:16.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:16 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:18:16.453 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:16 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:16.453 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:16 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:16.453 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:16 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:16.453 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:16 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:18:16.453 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:16 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:16.453 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:16 trial011 ceph-mon[11956]: pgmap v114: 1 pgs: 1 remapped; 577 KiB data, 215 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T02:18:16.453 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:16 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:18:16.453 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:16 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:18:16.453 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:16 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:16.453 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:16 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2026-02-13T02:18:16.454 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:16 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:16.454 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:16 trial011 ceph-mon[11956]: pgmap v115: 1 pgs: 1 remapped; 577 KiB data, 215 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T02:18:16.454 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:16 trial011 ceph-mon[11956]: osdmap e44: 9 total, 8 up, 9 in 2026-02-13T02:18:16.454 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:16 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T02:18:16.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:16 trial060 ceph-mon[14797]: pgmap v113: 1 pgs: 1 remapped; 577 KiB data, 215 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T02:18:16.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:16 trial060 ceph-mon[14797]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:18:16.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:16 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:18:16.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:16 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:16.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:16 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:16.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:16 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:16.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:16 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:18:16.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:16 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:16.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:16 trial060 ceph-mon[14797]: pgmap v114: 1 pgs: 1 remapped; 577 KiB data, 215 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T02:18:16.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:16 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:18:16.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:16 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:18:16.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:16 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:16.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:16 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2026-02-13T02:18:16.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:16 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:16.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:16 trial060 ceph-mon[14797]: pgmap v115: 1 pgs: 1 remapped; 577 KiB data, 215 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T02:18:16.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:16 trial060 ceph-mon[14797]: osdmap e44: 9 total, 8 up, 9 in 2026-02-13T02:18:16.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:16 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T02:18:18.291 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:18 trial078 ceph-mon[14969]: osdmap e45: 9 total, 8 up, 9 in 2026-02-13T02:18:18.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:18 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T02:18:18.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:18 trial078 ceph-mon[14969]: pgmap v118: 1 pgs: 1 remapped; 577 KiB data, 215 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T02:18:18.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:18 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:18:18.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:18 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:18.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:18 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:18.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:18 trial011 ceph-mon[11956]: osdmap e45: 9 total, 8 up, 9 in 2026-02-13T02:18:18.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:18 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T02:18:18.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:18 trial011 ceph-mon[11956]: pgmap v118: 1 pgs: 1 remapped; 577 KiB data, 215 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T02:18:18.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:18 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:18:18.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:18 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:18.453 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:18 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:18.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:18 trial060 ceph-mon[14797]: osdmap e45: 9 total, 8 up, 9 in 2026-02-13T02:18:18.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:18 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T02:18:18.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:18 trial060 ceph-mon[14797]: pgmap v118: 1 pgs: 1 remapped; 577 KiB data, 215 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T02:18:18.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:18 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:18:18.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:18 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:18.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:18 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:18.609 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:18.606+0000 7fb846ffd6c0 1 -- 10.20.193.78:0/1615274360 <== mgr.14116 v2:10.20.193.11:6800/861334768 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7fb8580f1e20 con 0x7fb8340b5680 2026-02-13T02:18:18.609 INFO:teuthology.orchestra.run.trial078.stdout:Created osd(s) 8 on host 'trial078' 2026-02-13T02:18:18.611 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:18.608+0000 7fb85fcc86c0 1 -- 10.20.193.78:0/1615274360 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fb8340b5680 msgr2=0x7fb8340d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:18.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:18.608+0000 7fb85fcc86c0 1 --2- 10.20.193.78:0/1615274360 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fb8340b5680 0x7fb8340d5b30 secure :-1 s=READY pgs=116 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb84c005980 tx=0x7fb84c005910 comp rx=0 tx=0).stop 2026-02-13T02:18:18.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:18.608+0000 7fb85fcc86c0 1 -- 10.20.193.78:0/1615274360 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb85810eec0 msgr2=0x7fb8580f8f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:18.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:18.608+0000 7fb85fcc86c0 1 --2- 10.20.193.78:0/1615274360 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb85810eec0 0x7fb8580f8f60 secure :-1 s=READY pgs=30 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb84800b6c0 tx=0x7fb84800bb90 comp rx=0 tx=0).stop 2026-02-13T02:18:18.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:18.608+0000 7fb85fcc86c0 1 -- 10.20.193.78:0/1615274360 shutdown_connections 2026-02-13T02:18:18.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:18.608+0000 7fb85fcc86c0 1 --2- 10.20.193.78:0/1615274360 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fb8340b5680 0x7fb8340d5b30 unknown :-1 s=CLOSED pgs=116 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:18.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:18.608+0000 7fb85fcc86c0 1 --2- 10.20.193.78:0/1615274360 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fb8581109f0 0x7fb8580f97c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:18.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:18.608+0000 7fb85fcc86c0 1 --2- 10.20.193.78:0/1615274360 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fb858110040 0x7fb858171380 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:18.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:18.608+0000 7fb85fcc86c0 1 --2- 10.20.193.78:0/1615274360 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb85810eec0 0x7fb8580f8f60 unknown :-1 s=CLOSED pgs=30 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:18.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:18.608+0000 7fb85fcc86c0 1 -- 10.20.193.78:0/1615274360 >> 10.20.193.78:0/1615274360 conn(0x7fb8580ec5c0 msgr2=0x7fb8580ef510 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:18:18.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:18.608+0000 7fb85fcc86c0 1 -- 10.20.193.78:0/1615274360 shutdown_connections 2026-02-13T02:18:18.612 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:18.608+0000 7fb85fcc86c0 1 -- 10.20.193.78:0/1615274360 wait complete. 2026-02-13T02:18:18.652 DEBUG:teuthology.orchestra.run.trial078:osd.8> sudo journalctl -f -n 0 -u ceph-fc631695-0881-11f1-899c-d404e6e7d460@osd.8.service 2026-02-13T02:18:18.654 INFO:tasks.cephadm:Deploying osd.9 on trial011 with /dev/vg_nvme/lv_1... 2026-02-13T02:18:18.655 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_1 2026-02-13T02:18:18.783 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:18:19.127 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:19 trial078 ceph-mon[14969]: osdmap e46: 9 total, 8 up, 9 in 2026-02-13T02:18:19.127 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:19 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T02:18:19.127 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:19 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:19.127 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:19 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:19.127 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:19 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:19.127 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:19 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:18:19.127 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:19 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:19.128 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:19 trial078 ceph-mon[14969]: pgmap v120: 1 pgs: 1 remapped; 577 KiB data, 215 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T02:18:19.128 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:19 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:18:19.128 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:19 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:18:19.128 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:19 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:19.128 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:19 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:19.128 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:19 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:19.128 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:19 trial078 ceph-mon[14969]: from='osd.8 [v2:10.20.193.78:6816/242640323,v1:10.20.193.78:6817/242640323]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2026-02-13T02:18:19.128 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:19 trial078 ceph-mon[14969]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2026-02-13T02:18:19.128 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:19 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:18:19.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:19 trial011 ceph-mon[11956]: osdmap e46: 9 total, 8 up, 9 in 2026-02-13T02:18:19.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:19 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T02:18:19.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:19 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:19.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:19 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:19.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:19 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:19.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:19 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:18:19.203 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:19 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:19.203 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:19 trial011 ceph-mon[11956]: pgmap v120: 1 pgs: 1 remapped; 577 KiB data, 215 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T02:18:19.203 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:19 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:18:19.203 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:19 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:18:19.203 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:19 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:19.203 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:19 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:19.203 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:19 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:19.203 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:19 trial011 ceph-mon[11956]: from='osd.8 [v2:10.20.193.78:6816/242640323,v1:10.20.193.78:6817/242640323]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2026-02-13T02:18:19.203 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:19 trial011 ceph-mon[11956]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2026-02-13T02:18:19.203 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:19 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:18:19.248 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:18:19.263 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph orch daemon add osd trial011:vg_nvme/lv_1 --skip-validation 2026-02-13T02:18:19.387 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:18:19.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:19 trial060 ceph-mon[14797]: osdmap e46: 9 total, 8 up, 9 in 2026-02-13T02:18:19.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:19 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T02:18:19.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:19 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:19.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:19 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:19.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:19 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:19.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:19 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:18:19.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:19 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:19.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:19 trial060 ceph-mon[14797]: pgmap v120: 1 pgs: 1 remapped; 577 KiB data, 215 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T02:18:19.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:19 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:18:19.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:19 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:18:19.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:19 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:19.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:19 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:19.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:19 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:19.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:19 trial060 ceph-mon[14797]: from='osd.8 [v2:10.20.193.78:6816/242640323,v1:10.20.193.78:6817/242640323]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2026-02-13T02:18:19.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:19 trial060 ceph-mon[14797]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2026-02-13T02:18:19.502 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:19 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:18:19.505 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:19.498+0000 7efe0aa116c0 1 -- 10.20.193.11:0/2948709303 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7efe04110a00 msgr2=0x7efe04171390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:19.505 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:19.498+0000 7efe0aa116c0 1 --2- 10.20.193.11:0/2948709303 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7efe04110a00 0x7efe04171390 secure :-1 s=READY pgs=170 gs=1 cs=0 l=1 c_cookie=7282787287535942605 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efdf800aa40 tx=0x7efdf802fde0 comp rx=0 tx=0).stop 2026-02-13T02:18:19.505 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:19.498+0000 7efe0aa116c0 1 -- 10.20.193.11:0/2948709303 shutdown_connections 2026-02-13T02:18:19.505 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:19.498+0000 7efe0aa116c0 1 --2- 10.20.193.11:0/2948709303 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7efe04110050 0x7efe041104c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:19.505 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:19.498+0000 7efe0aa116c0 1 --2- 10.20.193.11:0/2948709303 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7efe04110a00 0x7efe04171390 unknown :-1 s=CLOSED pgs=170 gs=1 cs=0 l=1 c_cookie=7282787287535942605 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:19.505 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:19.498+0000 7efe0aa116c0 1 --2- 10.20.193.11:0/2948709303 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7efe0410eed0 0x7efe0410f2c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:19.505 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:19.498+0000 7efe0aa116c0 1 -- 10.20.193.11:0/2948709303 >> 10.20.193.11:0/2948709303 conn(0x7efe040ec5f0 msgr2=0x7efe0410ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:18:19.505 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:19.498+0000 7efe0aa116c0 1 -- 10.20.193.11:0/2948709303 shutdown_connections 2026-02-13T02:18:19.505 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:19.498+0000 7efe0aa116c0 1 -- 10.20.193.11:0/2948709303 wait complete. 2026-02-13T02:18:19.506 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:19.499+0000 7efe0aa116c0 1 Processor -- start 2026-02-13T02:18:19.506 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:19.499+0000 7efe0aa116c0 1 -- start start 2026-02-13T02:18:19.506 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:19.499+0000 7efe0aa116c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7efe0410eed0 0x7efe040f84a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:18:19.506 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:19.499+0000 7efe0aa116c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7efe04110050 0x7efe04171390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:18:19.506 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:19.499+0000 7efe0aa116c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7efe04110a00 0x7efe040f8d00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:18:19.506 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:19.499+0000 7efe0aa116c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7efe040f9930 con 0x7efe04110050 2026-02-13T02:18:19.506 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:19.499+0000 7efe0aa116c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7efe040f9aa0 con 0x7efe04110a00 2026-02-13T02:18:19.506 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:19.499+0000 7efe0aa116c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7efe040f9c60 con 0x7efe0410eed0 2026-02-13T02:18:19.506 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:19.499+0000 7efe037fe6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7efe04110050 0x7efe04171390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:18:19.506 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:19.499+0000 7efe037fe6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7efe04110050 0x7efe04171390 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:52018/0 (socket says 10.20.193.11:52018) 2026-02-13T02:18:19.506 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:19.499+0000 7efe037fe6c0 1 -- 10.20.193.11:0/2951356254 learned_addr learned my addr 10.20.193.11:0/2951356254 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:18:19.506 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:19.499+0000 7efe08f836c0 1 --2- 10.20.193.11:0/2951356254 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7efe04110a00 0x7efe040f8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:18:19.507 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:19.499+0000 7efe037fe6c0 1 -- 10.20.193.11:0/2951356254 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7efe0410eed0 msgr2=0x7efe040f84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:19.507 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:19.499+0000 7efe037fe6c0 1 --2- 10.20.193.11:0/2951356254 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7efe0410eed0 0x7efe040f84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:19.507 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:19.499+0000 7efe037fe6c0 1 -- 10.20.193.11:0/2951356254 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7efe04110a00 msgr2=0x7efe040f8d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:19.507 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:19.499+0000 7efe037fe6c0 1 --2- 10.20.193.11:0/2951356254 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7efe04110a00 0x7efe040f8d00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:19.507 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:19.499+0000 7efe037fe6c0 1 -- 10.20.193.11:0/2951356254 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdf800a660 con 0x7efe04110050 2026-02-13T02:18:19.507 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:19.499+0000 7efe037fe6c0 1 --2- 10.20.193.11:0/2951356254 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7efe04110050 0x7efe04171390 secure :-1 s=READY pgs=171 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efdf400b710 tx=0x7efdf400bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:18:19.507 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:19.499+0000 7efe017fa6c0 1 -- 10.20.193.11:0/2951356254 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efdf4004250 con 0x7efe04110050 2026-02-13T02:18:19.507 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:19.499+0000 7efe0aa116c0 1 -- 10.20.193.11:0/2951356254 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe040f9f40 con 0x7efe04110050 2026-02-13T02:18:19.507 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:19.499+0000 7efe0aa116c0 1 -- 10.20.193.11:0/2951356254 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe040fa470 con 0x7efe04110050 2026-02-13T02:18:19.507 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:19.499+0000 7efe017fa6c0 1 -- 10.20.193.11:0/2951356254 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7efdf4002da0 con 0x7efe04110050 2026-02-13T02:18:19.507 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:19.499+0000 7efe017fa6c0 1 -- 10.20.193.11:0/2951356254 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efdf400ce40 con 0x7efe04110050 2026-02-13T02:18:19.507 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:19.500+0000 7efe0aa116c0 1 -- 10.20.193.11:0/2951356254 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe041753f0 con 0x7efe04110050 2026-02-13T02:18:19.508 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:19.501+0000 7efe017fa6c0 1 -- 10.20.193.11:0/2951356254 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 10) ==== 157066+0+0 (secure 0 0 0) 0x7efdf400c410 con 0x7efe04110050 2026-02-13T02:18:19.508 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:19.502+0000 7efe017fa6c0 1 --2- 10.20.193.11:0/2951356254 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7efdd80b5680 0x7efdd80d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:18:19.508 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:19.502+0000 7efe017fa6c0 1 -- 10.20.193.11:0/2951356254 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5289+0+0 (secure 0 0 0) 0x7efdf40e3150 con 0x7efe04110050 2026-02-13T02:18:19.508 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:19.502+0000 7efe03fff6c0 1 --2- 10.20.193.11:0/2951356254 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7efdd80b5680 0x7efdd80d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:18:19.508 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:19.502+0000 7efe017fa6c0 1 -- 10.20.193.11:0/2951356254 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7efdf40a6680 con 0x7efe04110050 2026-02-13T02:18:19.508 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:19.502+0000 7efe03fff6c0 1 --2- 10.20.193.11:0/2951356254 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7efdd80b5680 0x7efdd80d5b30 secure :-1 s=READY pgs=121 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efdf0005980 tx=0x7efdf0005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:18:19.599 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:19.598+0000 7efe0aa116c0 1 -- 10.20.193.11:0/2951356254 --> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial011:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7efe040efd60 con 0x7efdd80b5680 2026-02-13T02:18:20.542 INFO:journalctl@ceph.osd.8.trial078.stdout:Feb 13 02:18:20 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-8[32377]: 2026-02-13T02:18:20.264+0000 7f39afb5b6c0 -1 osd.8 0 waiting for initial osdmap 2026-02-13T02:18:20.542 INFO:journalctl@ceph.osd.8.trial078.stdout:Feb 13 02:18:20 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-8[32377]: 2026-02-13T02:18:20.271+0000 7f39aba306c0 -1 osd.8 48 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T02:18:20.604 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:20 trial011 ceph-mon[11956]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T02:18:20.604 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:20 trial011 ceph-mon[11956]: from='client.14592 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial011:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:18:20.604 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:20 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:20.604 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:20 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:20.605 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:20 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:18:20.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:20 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:18:20.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:20 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:20.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:20 trial011 ceph-mon[11956]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2026-02-13T02:18:20.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:20 trial011 ceph-mon[11956]: osdmap e47: 9 total, 8 up, 9 in 2026-02-13T02:18:20.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:20 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T02:18:20.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:20 trial011 ceph-mon[11956]: from='osd.8 [v2:10.20.193.78:6816/242640323,v1:10.20.193.78:6817/242640323]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial078", "root=default"]} : dispatch 2026-02-13T02:18:20.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:20 trial011 ceph-mon[11956]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial078", "root=default"]} : dispatch 2026-02-13T02:18:20.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:20 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:20.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:20 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:20.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:20 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T02:18:20.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:20 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-13T02:18:20.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:20 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2026-02-13T02:18:20.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:20 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:20.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:20 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:20.954 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:20 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:18:20.954 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:20 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:20.954 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:20 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:18:20.954 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:20 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:18:20.954 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:20 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:20.954 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:20 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/3635855777' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "25cd90dd-8e86-4ac1-a693-a4080b035da1"} : dispatch 2026-02-13T02:18:20.954 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:20 trial011 ceph-mon[11956]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial078", "root=default"]}]': finished 2026-02-13T02:18:20.954 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:20 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/3635855777' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "25cd90dd-8e86-4ac1-a693-a4080b035da1"}]': finished 2026-02-13T02:18:20.954 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:20 trial011 ceph-mon[11956]: osdmap e48: 10 total, 8 up, 10 in 2026-02-13T02:18:20.954 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:20 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T02:18:20.954 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:20 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T02:18:20.955 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:20 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T02:18:20.955 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:20 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/1332472568' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T02:18:21.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:20 trial060 ceph-mon[14797]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T02:18:21.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:20 trial060 ceph-mon[14797]: from='client.14592 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial011:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:18:21.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:20 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:21.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:20 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:21.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:20 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:18:21.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:20 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:18:21.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:20 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:21.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:20 trial060 ceph-mon[14797]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2026-02-13T02:18:21.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:20 trial060 ceph-mon[14797]: osdmap e47: 9 total, 8 up, 9 in 2026-02-13T02:18:21.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:20 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T02:18:21.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:20 trial060 ceph-mon[14797]: from='osd.8 [v2:10.20.193.78:6816/242640323,v1:10.20.193.78:6817/242640323]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial078", "root=default"]} : dispatch 2026-02-13T02:18:21.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:20 trial060 ceph-mon[14797]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial078", "root=default"]} : dispatch 2026-02-13T02:18:21.002 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:20 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:21.002 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:20 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:21.002 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:20 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T02:18:21.002 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:20 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-13T02:18:21.002 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:20 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2026-02-13T02:18:21.002 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:20 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:21.002 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:20 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:21.002 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:20 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:18:21.002 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:20 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:21.002 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:20 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:18:21.002 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:20 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:18:21.002 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:20 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:21.003 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:20 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/3635855777' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "25cd90dd-8e86-4ac1-a693-a4080b035da1"} : dispatch 2026-02-13T02:18:21.003 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:20 trial060 ceph-mon[14797]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial078", "root=default"]}]': finished 2026-02-13T02:18:21.003 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:20 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/3635855777' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "25cd90dd-8e86-4ac1-a693-a4080b035da1"}]': finished 2026-02-13T02:18:21.003 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:20 trial060 ceph-mon[14797]: osdmap e48: 10 total, 8 up, 10 in 2026-02-13T02:18:21.003 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:20 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T02:18:21.003 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:20 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T02:18:21.003 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:20 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T02:18:21.003 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:20 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/1332472568' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T02:18:21.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:20 trial078 ceph-mon[14969]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T02:18:21.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:20 trial078 ceph-mon[14969]: from='client.14592 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial011:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:18:21.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:20 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:21.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:20 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:21.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:20 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:18:21.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:20 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:18:21.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:20 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:21.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:20 trial078 ceph-mon[14969]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2026-02-13T02:18:21.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:20 trial078 ceph-mon[14969]: osdmap e47: 9 total, 8 up, 9 in 2026-02-13T02:18:21.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:20 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T02:18:21.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:20 trial078 ceph-mon[14969]: from='osd.8 [v2:10.20.193.78:6816/242640323,v1:10.20.193.78:6817/242640323]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial078", "root=default"]} : dispatch 2026-02-13T02:18:21.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:20 trial078 ceph-mon[14969]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial078", "root=default"]} : dispatch 2026-02-13T02:18:21.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:20 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:21.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:20 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:21.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:20 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T02:18:21.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:20 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-13T02:18:21.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:20 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2026-02-13T02:18:21.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:20 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:21.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:20 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:21.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:20 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:18:21.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:20 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:21.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:20 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:18:21.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:20 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:18:21.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:20 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:21.043 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:20 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/3635855777' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "25cd90dd-8e86-4ac1-a693-a4080b035da1"} : dispatch 2026-02-13T02:18:21.043 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:20 trial078 ceph-mon[14969]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial078", "root=default"]}]': finished 2026-02-13T02:18:21.043 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:20 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/3635855777' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "25cd90dd-8e86-4ac1-a693-a4080b035da1"}]': finished 2026-02-13T02:18:21.043 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:20 trial078 ceph-mon[14969]: osdmap e48: 10 total, 8 up, 10 in 2026-02-13T02:18:21.043 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:20 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T02:18:21.043 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:20 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T02:18:21.043 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:20 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T02:18:21.043 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:20 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/1332472568' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T02:18:21.907 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:21 trial011 ceph-mon[11956]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T02:18:21.907 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:21 trial011 ceph-mon[11956]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:18:21.907 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:21 trial011 ceph-mon[11956]: Cluster is now healthy 2026-02-13T02:18:21.907 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:21 trial011 ceph-mon[11956]: osd.8 [v2:10.20.193.78:6816/242640323,v1:10.20.193.78:6817/242640323] boot 2026-02-13T02:18:21.907 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:21 trial011 ceph-mon[11956]: osdmap e49: 10 total, 9 up, 10 in 2026-02-13T02:18:21.908 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:21 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T02:18:21.908 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:21 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T02:18:22.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:21 trial060 ceph-mon[14797]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T02:18:22.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:21 trial060 ceph-mon[14797]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:18:22.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:21 trial060 ceph-mon[14797]: Cluster is now healthy 2026-02-13T02:18:22.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:21 trial060 ceph-mon[14797]: osd.8 [v2:10.20.193.78:6816/242640323,v1:10.20.193.78:6817/242640323] boot 2026-02-13T02:18:22.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:21 trial060 ceph-mon[14797]: osdmap e49: 10 total, 9 up, 10 in 2026-02-13T02:18:22.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:21 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T02:18:22.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:21 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T02:18:22.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:21 trial078 ceph-mon[14969]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T02:18:22.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:21 trial078 ceph-mon[14969]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:18:22.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:21 trial078 ceph-mon[14969]: Cluster is now healthy 2026-02-13T02:18:22.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:21 trial078 ceph-mon[14969]: osd.8 [v2:10.20.193.78:6816/242640323,v1:10.20.193.78:6817/242640323] boot 2026-02-13T02:18:22.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:21 trial078 ceph-mon[14969]: osdmap e49: 10 total, 9 up, 10 in 2026-02-13T02:18:22.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:21 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T02:18:22.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:21 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T02:18:22.801 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:22 trial011 ceph-mon[11956]: purged_snaps scrub starts 2026-02-13T02:18:22.801 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:22 trial011 ceph-mon[11956]: purged_snaps scrub ok 2026-02-13T02:18:22.801 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:22 trial011 ceph-mon[11956]: osdmap e50: 10 total, 9 up, 10 in 2026-02-13T02:18:22.801 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:22 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T02:18:22.801 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:22 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:18:22.801 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:22 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:22.801 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:22 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:22.802 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:22 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:22.802 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:22 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:18:22.802 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:22 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:22.802 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:22 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:18:22.802 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:22 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:18:22.802 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:22 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:23.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:22 trial060 ceph-mon[14797]: purged_snaps scrub starts 2026-02-13T02:18:23.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:22 trial060 ceph-mon[14797]: purged_snaps scrub ok 2026-02-13T02:18:23.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:22 trial060 ceph-mon[14797]: osdmap e50: 10 total, 9 up, 10 in 2026-02-13T02:18:23.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:22 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T02:18:23.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:22 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:18:23.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:22 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:23.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:22 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:23.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:22 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:23.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:22 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:18:23.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:22 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:23.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:22 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:18:23.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:22 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:18:23.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:22 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:23.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:22 trial078 ceph-mon[14969]: purged_snaps scrub starts 2026-02-13T02:18:23.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:22 trial078 ceph-mon[14969]: purged_snaps scrub ok 2026-02-13T02:18:23.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:22 trial078 ceph-mon[14969]: osdmap e50: 10 total, 9 up, 10 in 2026-02-13T02:18:23.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:22 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T02:18:23.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:22 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:18:23.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:22 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:23.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:22 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:23.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:22 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:23.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:22 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:18:23.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:22 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:23.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:22 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:18:23.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:22 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:18:23.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:22 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:23.749 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:23 trial011 ceph-mon[11956]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-13T02:18:23.749 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:23 trial011 ceph-mon[11956]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-13T02:18:23.749 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:23 trial011 ceph-mon[11956]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-13T02:18:23.749 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:23 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2026-02-13T02:18:23.749 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:23 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:23.750 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:23 trial011 ceph-mon[11956]: osdmap e51: 10 total, 9 up, 10 in 2026-02-13T02:18:23.750 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:23 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T02:18:24.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:23 trial060 ceph-mon[14797]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-13T02:18:24.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:23 trial060 ceph-mon[14797]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-13T02:18:24.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:23 trial060 ceph-mon[14797]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-13T02:18:24.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:23 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2026-02-13T02:18:24.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:23 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:24.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:23 trial060 ceph-mon[14797]: osdmap e51: 10 total, 9 up, 10 in 2026-02-13T02:18:24.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:23 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T02:18:24.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:23 trial078 ceph-mon[14969]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-13T02:18:24.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:23 trial078 ceph-mon[14969]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-13T02:18:24.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:23 trial078 ceph-mon[14969]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-13T02:18:24.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:23 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2026-02-13T02:18:24.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:23 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:24.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:23 trial078 ceph-mon[14969]: osdmap e51: 10 total, 9 up, 10 in 2026-02-13T02:18:24.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:23 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T02:18:24.868 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:24 trial011 ceph-mon[11956]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-13T02:18:24.868 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:24 trial011 ceph-mon[11956]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:18:24.868 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:24 trial011 ceph-mon[11956]: osdmap e52: 10 total, 9 up, 10 in 2026-02-13T02:18:24.868 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:24 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T02:18:25.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:24 trial060 ceph-mon[14797]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-13T02:18:25.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:24 trial060 ceph-mon[14797]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:18:25.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:24 trial060 ceph-mon[14797]: osdmap e52: 10 total, 9 up, 10 in 2026-02-13T02:18:25.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:24 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T02:18:25.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:24 trial078 ceph-mon[14969]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-13T02:18:25.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:24 trial078 ceph-mon[14969]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:18:25.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:24 trial078 ceph-mon[14969]: osdmap e52: 10 total, 9 up, 10 in 2026-02-13T02:18:25.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:24 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T02:18:25.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:25 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:18:25.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:25 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:25.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:25 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:25.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:25 trial011 ceph-mon[11956]: osdmap e53: 10 total, 9 up, 10 in 2026-02-13T02:18:25.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:25 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T02:18:26.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:25 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:18:26.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:25 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:26.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:25 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:26.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:25 trial060 ceph-mon[14797]: osdmap e53: 10 total, 9 up, 10 in 2026-02-13T02:18:26.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:25 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T02:18:26.016 INFO:teuthology.orchestra.run.trial011.stdout:Created osd(s) 9 on host 'trial011' 2026-02-13T02:18:26.017 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:26.014+0000 7efe017fa6c0 1 -- 10.20.193.11:0/2951356254 <== mgr.14116 v2:10.20.193.11:6800/861334768 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7efe040efd60 con 0x7efdd80b5680 2026-02-13T02:18:26.019 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:26.016+0000 7efe0aa116c0 1 -- 10.20.193.11:0/2951356254 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7efdd80b5680 msgr2=0x7efdd80d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:26.019 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:26.016+0000 7efe0aa116c0 1 --2- 10.20.193.11:0/2951356254 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7efdd80b5680 0x7efdd80d5b30 secure :-1 s=READY pgs=121 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efdf0005980 tx=0x7efdf0005910 comp rx=0 tx=0).stop 2026-02-13T02:18:26.019 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:26.016+0000 7efe0aa116c0 1 -- 10.20.193.11:0/2951356254 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7efe04110050 msgr2=0x7efe04171390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:26.019 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:26.016+0000 7efe0aa116c0 1 --2- 10.20.193.11:0/2951356254 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7efe04110050 0x7efe04171390 secure :-1 s=READY pgs=171 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efdf400b710 tx=0x7efdf400bbe0 comp rx=0 tx=0).stop 2026-02-13T02:18:26.020 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:26.016+0000 7efe0aa116c0 1 -- 10.20.193.11:0/2951356254 shutdown_connections 2026-02-13T02:18:26.020 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:26.016+0000 7efe0aa116c0 1 --2- 10.20.193.11:0/2951356254 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7efdd80b5680 0x7efdd80d5b30 unknown :-1 s=CLOSED pgs=121 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:26.020 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:26.016+0000 7efe0aa116c0 1 --2- 10.20.193.11:0/2951356254 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7efe04110a00 0x7efe040f8d00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:26.020 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:26.016+0000 7efe0aa116c0 1 --2- 10.20.193.11:0/2951356254 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7efe04110050 0x7efe04171390 unknown :-1 s=CLOSED pgs=171 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:26.020 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:26.016+0000 7efe0aa116c0 1 --2- 10.20.193.11:0/2951356254 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7efe0410eed0 0x7efe040f84a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:26.020 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:26.016+0000 7efe0aa116c0 1 -- 10.20.193.11:0/2951356254 >> 10.20.193.11:0/2951356254 conn(0x7efe040ec5f0 msgr2=0x7efe040ee520 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:18:26.020 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:26.016+0000 7efe0aa116c0 1 -- 10.20.193.11:0/2951356254 shutdown_connections 2026-02-13T02:18:26.020 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:26.016+0000 7efe0aa116c0 1 -- 10.20.193.11:0/2951356254 wait complete. 2026-02-13T02:18:26.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:25 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:18:26.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:25 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:26.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:25 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:26.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:25 trial078 ceph-mon[14969]: osdmap e53: 10 total, 9 up, 10 in 2026-02-13T02:18:26.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:25 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T02:18:26.060 DEBUG:teuthology.orchestra.run.trial011:osd.9> sudo journalctl -f -n 0 -u ceph-fc631695-0881-11f1-899c-d404e6e7d460@osd.9.service 2026-02-13T02:18:26.062 INFO:tasks.cephadm:Deploying osd.10 on trial060 with /dev/vg_nvme/lv_1... 2026-02-13T02:18:26.062 DEBUG:teuthology.orchestra.run.trial060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_1 2026-02-13T02:18:26.190 INFO:teuthology.orchestra.run.trial060.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.b/config 2026-02-13T02:18:26.295 INFO:journalctl@ceph.osd.9.trial011.stdout:Feb 13 02:18:26 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-9[43169]: 2026-02-13T02:18:26.098+0000 7fb6c0aa9780 -1 osd.9 0 log_to_monitors true 2026-02-13T02:18:26.622 INFO:teuthology.orchestra.run.trial060.stdout: 2026-02-13T02:18:26.638 DEBUG:teuthology.orchestra.run.trial060:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph orch daemon add osd trial060:vg_nvme/lv_1 --skip-validation 2026-02-13T02:18:26.760 INFO:teuthology.orchestra.run.trial060.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.b/config 2026-02-13T02:18:26.873 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:26 trial060 ceph-mon[14797]: pgmap v133: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 243 MiB used, 6.2 TiB / 6.2 TiB avail; 214 KiB/s, 0 objects/s recovering 2026-02-13T02:18:26.873 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:26 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:26.873 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:26 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:26.873 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:26 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:26.873 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:26 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:18:26.873 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:26 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:26.873 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:26 trial060 ceph-mon[14797]: pgmap v135: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 243 MiB used, 6.2 TiB / 6.2 TiB avail; 179 KiB/s, 0 objects/s recovering 2026-02-13T02:18:26.873 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:26 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:18:26.873 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:26 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:18:26.873 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:26 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:26.873 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:26 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:26.873 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:26 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:26.874 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:26 trial060 ceph-mon[14797]: from='osd.9 [v2:10.20.193.11:6826/132317204,v1:10.20.193.11:6827/132317204]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2026-02-13T02:18:26.874 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:26 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:18:26.878 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:26.879+0000 7fd40ad336c0 1 -- 10.20.193.60:0/3358217974 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fd40410b8b0 msgr2=0x7fd40410bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:26.878 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:26.879+0000 7fd40ad336c0 1 --2- 10.20.193.60:0/3358217974 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fd40410b8b0 0x7fd40410bd20 secure :-1 s=READY pgs=33 gs=1 cs=0 l=1 c_cookie=10142077105163016312 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd3ec009970 tx=0x7fd3ec02ed20 comp rx=0 tx=0).stop 2026-02-13T02:18:26.878 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:26.879+0000 7fd40ad336c0 1 -- 10.20.193.60:0/3358217974 shutdown_connections 2026-02-13T02:18:26.878 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:26.879+0000 7fd40ad336c0 1 --2- 10.20.193.60:0/3358217974 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fd40410b8b0 0x7fd40410bd20 unknown :-1 s=CLOSED pgs=33 gs=1 cs=0 l=1 c_cookie=10142077105163016312 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:26.878 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:26.879+0000 7fd40ad336c0 1 --2- 10.20.193.60:0/3358217974 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fd40410c460 0x7fd40410cf20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:26.878 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:26.879+0000 7fd40ad336c0 1 --2- 10.20.193.60:0/3358217974 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd40410ae80 0x7fd40410b270 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:26.878 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:26.879+0000 7fd40ad336c0 1 -- 10.20.193.60:0/3358217974 >> 10.20.193.60:0/3358217974 conn(0x7fd4040e8990 msgr2=0x7fd404108da0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:18:26.878 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:26.879+0000 7fd40ad336c0 1 -- 10.20.193.60:0/3358217974 shutdown_connections 2026-02-13T02:18:26.878 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:26.879+0000 7fd40ad336c0 1 -- 10.20.193.60:0/3358217974 wait complete. 2026-02-13T02:18:26.878 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:26.879+0000 7fd40ad336c0 1 Processor -- start 2026-02-13T02:18:26.879 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:26.879+0000 7fd40ad336c0 1 -- start start 2026-02-13T02:18:26.879 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:26.879+0000 7fd40ad336c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fd40410ae80 0x7fd4040f38c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:18:26.879 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:26.879+0000 7fd40ad336c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd40410b8b0 0x7fd4040f3f10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:18:26.879 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:26.879+0000 7fd40ad336c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fd40410c460 0x7fd4040f4b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:18:26.879 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:26.879+0000 7fd40ad336c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7fd4040f5200 con 0x7fd40410ae80 2026-02-13T02:18:26.879 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:26.879+0000 7fd40ad336c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd4040f5370 con 0x7fd40410c460 2026-02-13T02:18:26.880 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:26.879+0000 7fd40ad336c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fd4040f5530 con 0x7fd40410b8b0 2026-02-13T02:18:26.880 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:26.879+0000 7fd4092a56c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fd40410c460 0x7fd4040f4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:18:26.880 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:26.879+0000 7fd4092a56c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fd40410c460 0x7fd4040f4b00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.60:3300/0 says I am v2:10.20.193.60:39048/0 (socket says 10.20.193.60:39048) 2026-02-13T02:18:26.880 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:26.879+0000 7fd4092a56c0 1 -- 10.20.193.60:0/4200874149 learned_addr learned my addr 10.20.193.60:0/4200874149 (peer_addr_for_me v2:10.20.193.60:0/0) 2026-02-13T02:18:26.880 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:26.879+0000 7fd408aa46c0 1 --2- 10.20.193.60:0/4200874149 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fd40410ae80 0x7fd4040f38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:18:26.880 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:26.879+0000 7fd3fbfff6c0 1 --2- 10.20.193.60:0/4200874149 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd40410b8b0 0x7fd4040f3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:18:26.880 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:26.879+0000 7fd4092a56c0 1 -- 10.20.193.60:0/4200874149 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd40410b8b0 msgr2=0x7fd4040f3f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:26.880 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:26.879+0000 7fd4092a56c0 1 --2- 10.20.193.60:0/4200874149 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd40410b8b0 0x7fd4040f3f10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:26.880 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:26.879+0000 7fd4092a56c0 1 -- 10.20.193.60:0/4200874149 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fd40410ae80 msgr2=0x7fd4040f38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:26.880 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:26.879+0000 7fd4092a56c0 1 --2- 10.20.193.60:0/4200874149 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fd40410ae80 0x7fd4040f38c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:26.880 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:26.879+0000 7fd4092a56c0 1 -- 10.20.193.60:0/4200874149 --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3ec009590 con 0x7fd40410c460 2026-02-13T02:18:26.880 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:26.879+0000 7fd3fbfff6c0 1 --2- 10.20.193.60:0/4200874149 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd40410b8b0 0x7fd4040f3f10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:18:26.880 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:26.879+0000 7fd4092a56c0 1 --2- 10.20.193.60:0/4200874149 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fd40410c460 0x7fd4040f4b00 secure :-1 s=READY pgs=34 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd40000c730 tx=0x7fd40000cc00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:18:26.880 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:26.880+0000 7fd3f9ffb6c0 1 -- 10.20.193.60:0/4200874149 <== mon.2 v2:10.20.193.60:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd400003c40 con 0x7fd40410c460 2026-02-13T02:18:26.880 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:26.880+0000 7fd3f9ffb6c0 1 -- 10.20.193.60:0/4200874149 <== mon.2 v2:10.20.193.60:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd40000a070 con 0x7fd40410c460 2026-02-13T02:18:26.880 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:26.880+0000 7fd3f9ffb6c0 1 -- 10.20.193.60:0/4200874149 <== mon.2 v2:10.20.193.60:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd40000dd40 con 0x7fd40410c460 2026-02-13T02:18:26.880 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:26.880+0000 7fd40ad336c0 1 -- 10.20.193.60:0/4200874149 --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4040f5810 con 0x7fd40410c460 2026-02-13T02:18:26.880 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:26.880+0000 7fd40ad336c0 1 -- 10.20.193.60:0/4200874149 --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4040f5d20 con 0x7fd40410c460 2026-02-13T02:18:26.880 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:26.880+0000 7fd40ad336c0 1 -- 10.20.193.60:0/4200874149 --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd404110e80 con 0x7fd40410c460 2026-02-13T02:18:26.880 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:26.881+0000 7fd3f9ffb6c0 1 -- 10.20.193.60:0/4200874149 <== mon.2 v2:10.20.193.60:3300/0 4 ==== mgrmap(e 10) ==== 157066+0+0 (secure 0 0 0) 0x7fd400005030 con 0x7fd40410c460 2026-02-13T02:18:26.881 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:26.882+0000 7fd3f9ffb6c0 1 --2- 10.20.193.60:0/4200874149 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fd3e00b5680 0x7fd3e00d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:18:26.881 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:26.882+0000 7fd3f9ffb6c0 1 -- 10.20.193.60:0/4200874149 <== mon.2 v2:10.20.193.60:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5721+0+0 (secure 0 0 0) 0x7fd4000e41b0 con 0x7fd40410c460 2026-02-13T02:18:26.881 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:26.882+0000 7fd408aa46c0 1 --2- 10.20.193.60:0/4200874149 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fd3e00b5680 0x7fd3e00d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:18:26.881 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:26.882+0000 7fd408aa46c0 1 --2- 10.20.193.60:0/4200874149 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fd3e00b5680 0x7fd3e00d5b30 secure :-1 s=READY pgs=126 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd3f4004750 tx=0x7fd3f4009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:18:26.882 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:26.883+0000 7fd3f9ffb6c0 1 -- 10.20.193.60:0/4200874149 <== mon.2 v2:10.20.193.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fd4000a7570 con 0x7fd40410c460 2026-02-13T02:18:26.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:26 trial011 ceph-mon[11956]: pgmap v133: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 243 MiB used, 6.2 TiB / 6.2 TiB avail; 214 KiB/s, 0 objects/s recovering 2026-02-13T02:18:26.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:26 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:26.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:26 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:26.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:26 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:26.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:26 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:18:26.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:26 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:26.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:26 trial011 ceph-mon[11956]: pgmap v135: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 243 MiB used, 6.2 TiB / 6.2 TiB avail; 179 KiB/s, 0 objects/s recovering 2026-02-13T02:18:26.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:26 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:18:26.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:26 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:18:26.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:26 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:26.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:26 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:26.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:26 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:26.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:26 trial011 ceph-mon[11956]: from='osd.9 [v2:10.20.193.11:6826/132317204,v1:10.20.193.11:6827/132317204]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2026-02-13T02:18:26.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:26 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:18:26.979 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:26.980+0000 7fd40ad336c0 1 -- 10.20.193.60:0/4200874149 --> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial060:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7fd4040ec760 con 0x7fd3e00b5680 2026-02-13T02:18:27.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:26 trial078 ceph-mon[14969]: pgmap v133: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 243 MiB used, 6.2 TiB / 6.2 TiB avail; 214 KiB/s, 0 objects/s recovering 2026-02-13T02:18:27.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:26 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:27.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:26 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:27.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:26 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:27.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:26 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:18:27.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:26 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:27.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:26 trial078 ceph-mon[14969]: pgmap v135: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 243 MiB used, 6.2 TiB / 6.2 TiB avail; 179 KiB/s, 0 objects/s recovering 2026-02-13T02:18:27.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:26 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:18:27.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:26 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:18:27.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:26 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:27.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:26 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:27.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:26 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:27.043 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:26 trial078 ceph-mon[14969]: from='osd.9 [v2:10.20.193.11:6826/132317204,v1:10.20.193.11:6827/132317204]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2026-02-13T02:18:27.043 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:26 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:18:27.737 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:27 trial060 ceph-mon[14797]: pgmap v136: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 244 MiB used, 6.2 TiB / 6.2 TiB avail; 170 KiB/s, 0 objects/s recovering 2026-02-13T02:18:27.737 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:27 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:27.737 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:27 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:27.737 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:27 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:18:27.737 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:27 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:18:27.737 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:27 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:27.738 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:27 trial060 ceph-mon[14797]: from='osd.9 [v2:10.20.193.11:6826/132317204,v1:10.20.193.11:6827/132317204]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2026-02-13T02:18:27.738 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:27 trial060 ceph-mon[14797]: osdmap e54: 10 total, 9 up, 10 in 2026-02-13T02:18:27.738 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:27 trial060 ceph-mon[14797]: from='osd.9 [v2:10.20.193.11:6826/132317204,v1:10.20.193.11:6827/132317204]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.6836, "args": ["host=trial011", "root=default"]} : dispatch 2026-02-13T02:18:27.738 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:27 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T02:18:27.738 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:27 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:27.738 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:27 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:27.738 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:27 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T02:18:27.738 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:27 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-13T02:18:27.738 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:27 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2026-02-13T02:18:27.739 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:27 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2026-02-13T02:18:27.739 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:27 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:27.739 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:27 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:27.739 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:27 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:18:27.739 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:27 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:27.739 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:27 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:18:27.739 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:27 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:18:27.739 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:27 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:27.952 INFO:journalctl@ceph.osd.9.trial011.stdout:Feb 13 02:18:27 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-9[43169]: 2026-02-13T02:18:27.646+0000 7fb6bc9ca6c0 -1 osd.9 0 waiting for initial osdmap 2026-02-13T02:18:27.952 INFO:journalctl@ceph.osd.9.trial011.stdout:Feb 13 02:18:27 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-9[43169]: 2026-02-13T02:18:27.653+0000 7fb6b889f6c0 -1 osd.9 55 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T02:18:27.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:27 trial011 ceph-mon[11956]: pgmap v136: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 244 MiB used, 6.2 TiB / 6.2 TiB avail; 170 KiB/s, 0 objects/s recovering 2026-02-13T02:18:27.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:27 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:27.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:27 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:27.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:27 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:18:27.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:27 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:18:27.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:27 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:27.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:27 trial011 ceph-mon[11956]: from='osd.9 [v2:10.20.193.11:6826/132317204,v1:10.20.193.11:6827/132317204]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2026-02-13T02:18:27.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:27 trial011 ceph-mon[11956]: osdmap e54: 10 total, 9 up, 10 in 2026-02-13T02:18:27.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:27 trial011 ceph-mon[11956]: from='osd.9 [v2:10.20.193.11:6826/132317204,v1:10.20.193.11:6827/132317204]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.6836, "args": ["host=trial011", "root=default"]} : dispatch 2026-02-13T02:18:27.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:27 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T02:18:27.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:27 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:27.954 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:27 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:27.954 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:27 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T02:18:27.954 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:27 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-13T02:18:27.954 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:27 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2026-02-13T02:18:27.954 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:27 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2026-02-13T02:18:27.954 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:27 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:27.954 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:27 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:27.954 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:27 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:18:27.954 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:27 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:27.954 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:27 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:18:27.954 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:27 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:18:27.954 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:27 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:28.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:27 trial078 ceph-mon[14969]: pgmap v136: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 244 MiB used, 6.2 TiB / 6.2 TiB avail; 170 KiB/s, 0 objects/s recovering 2026-02-13T02:18:28.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:27 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:28.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:27 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:28.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:27 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:18:28.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:27 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:18:28.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:27 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:28.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:27 trial078 ceph-mon[14969]: from='osd.9 [v2:10.20.193.11:6826/132317204,v1:10.20.193.11:6827/132317204]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2026-02-13T02:18:28.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:27 trial078 ceph-mon[14969]: osdmap e54: 10 total, 9 up, 10 in 2026-02-13T02:18:28.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:27 trial078 ceph-mon[14969]: from='osd.9 [v2:10.20.193.11:6826/132317204,v1:10.20.193.11:6827/132317204]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.6836, "args": ["host=trial011", "root=default"]} : dispatch 2026-02-13T02:18:28.043 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:27 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T02:18:28.043 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:27 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:28.043 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:27 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:28.043 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:27 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T02:18:28.043 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:27 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-13T02:18:28.043 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:27 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2026-02-13T02:18:28.043 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:27 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2026-02-13T02:18:28.043 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:27 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:28.043 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:27 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:28.043 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:27 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:18:28.043 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:27 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:28.044 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:27 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:18:28.044 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:27 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:18:28.044 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:27 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:28.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:28 trial011 ceph-mon[11956]: from='client.24356 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial060:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:18:28.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:28 trial011 ceph-mon[11956]: pgmap v138: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 244 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-13T02:18:28.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:28 trial011 ceph-mon[11956]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "727f51ff-9428-44ae-a69a-0f555f1397ac"} : dispatch 2026-02-13T02:18:28.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:28 trial011 ceph-mon[11956]: from='osd.9 [v2:10.20.193.11:6826/132317204,v1:10.20.193.11:6827/132317204]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.6836, "args": ["host=trial011", "root=default"]}]': finished 2026-02-13T02:18:28.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:28 trial011 ceph-mon[11956]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "727f51ff-9428-44ae-a69a-0f555f1397ac"}]': finished 2026-02-13T02:18:28.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:28 trial011 ceph-mon[11956]: from='client.? 10.20.193.60:0/525624880' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "727f51ff-9428-44ae-a69a-0f555f1397ac"} : dispatch 2026-02-13T02:18:28.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:28 trial011 ceph-mon[11956]: osdmap e55: 11 total, 9 up, 11 in 2026-02-13T02:18:28.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:28 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T02:18:28.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:28 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T02:18:28.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:28 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T02:18:28.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:28 trial011 ceph-mon[11956]: from='client.? 10.20.193.60:0/3443931810' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T02:18:28.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:28 trial011 ceph-mon[11956]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:18:28.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:28 trial011 ceph-mon[11956]: Cluster is now healthy 2026-02-13T02:18:29.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:28 trial060 ceph-mon[14797]: from='client.24356 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial060:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:18:29.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:28 trial060 ceph-mon[14797]: pgmap v138: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 244 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-13T02:18:29.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:28 trial060 ceph-mon[14797]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "727f51ff-9428-44ae-a69a-0f555f1397ac"} : dispatch 2026-02-13T02:18:29.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:28 trial060 ceph-mon[14797]: from='osd.9 [v2:10.20.193.11:6826/132317204,v1:10.20.193.11:6827/132317204]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.6836, "args": ["host=trial011", "root=default"]}]': finished 2026-02-13T02:18:29.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:28 trial060 ceph-mon[14797]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "727f51ff-9428-44ae-a69a-0f555f1397ac"}]': finished 2026-02-13T02:18:29.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:28 trial060 ceph-mon[14797]: from='client.? 10.20.193.60:0/525624880' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "727f51ff-9428-44ae-a69a-0f555f1397ac"} : dispatch 2026-02-13T02:18:29.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:28 trial060 ceph-mon[14797]: osdmap e55: 11 total, 9 up, 11 in 2026-02-13T02:18:29.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:28 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T02:18:29.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:28 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T02:18:29.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:28 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T02:18:29.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:28 trial060 ceph-mon[14797]: from='client.? 10.20.193.60:0/3443931810' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T02:18:29.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:28 trial060 ceph-mon[14797]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:18:29.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:28 trial060 ceph-mon[14797]: Cluster is now healthy 2026-02-13T02:18:29.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:28 trial078 ceph-mon[14969]: from='client.24356 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial060:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:18:29.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:28 trial078 ceph-mon[14969]: pgmap v138: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 244 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-13T02:18:29.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:28 trial078 ceph-mon[14969]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "727f51ff-9428-44ae-a69a-0f555f1397ac"} : dispatch 2026-02-13T02:18:29.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:28 trial078 ceph-mon[14969]: from='osd.9 [v2:10.20.193.11:6826/132317204,v1:10.20.193.11:6827/132317204]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.6836, "args": ["host=trial011", "root=default"]}]': finished 2026-02-13T02:18:29.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:28 trial078 ceph-mon[14969]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "727f51ff-9428-44ae-a69a-0f555f1397ac"}]': finished 2026-02-13T02:18:29.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:28 trial078 ceph-mon[14969]: from='client.? 10.20.193.60:0/525624880' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "727f51ff-9428-44ae-a69a-0f555f1397ac"} : dispatch 2026-02-13T02:18:29.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:28 trial078 ceph-mon[14969]: osdmap e55: 11 total, 9 up, 11 in 2026-02-13T02:18:29.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:28 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T02:18:29.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:28 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T02:18:29.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:28 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T02:18:29.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:28 trial078 ceph-mon[14969]: from='client.? 10.20.193.60:0/3443931810' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T02:18:29.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:28 trial078 ceph-mon[14969]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:18:29.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:28 trial078 ceph-mon[14969]: Cluster is now healthy 2026-02-13T02:18:29.823 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:29 trial060 ceph-mon[14797]: purged_snaps scrub starts 2026-02-13T02:18:29.823 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:29 trial060 ceph-mon[14797]: purged_snaps scrub ok 2026-02-13T02:18:29.823 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:29 trial060 ceph-mon[14797]: osd.9 [v2:10.20.193.11:6826/132317204,v1:10.20.193.11:6827/132317204] boot 2026-02-13T02:18:29.823 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:29 trial060 ceph-mon[14797]: osdmap e56: 11 total, 10 up, 11 in 2026-02-13T02:18:29.823 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:29 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T02:18:29.823 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:29 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T02:18:29.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:29 trial011 ceph-mon[11956]: purged_snaps scrub starts 2026-02-13T02:18:29.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:29 trial011 ceph-mon[11956]: purged_snaps scrub ok 2026-02-13T02:18:29.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:29 trial011 ceph-mon[11956]: osd.9 [v2:10.20.193.11:6826/132317204,v1:10.20.193.11:6827/132317204] boot 2026-02-13T02:18:29.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:29 trial011 ceph-mon[11956]: osdmap e56: 11 total, 10 up, 11 in 2026-02-13T02:18:29.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:29 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T02:18:29.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:29 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T02:18:30.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:29 trial078 ceph-mon[14969]: purged_snaps scrub starts 2026-02-13T02:18:30.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:29 trial078 ceph-mon[14969]: purged_snaps scrub ok 2026-02-13T02:18:30.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:29 trial078 ceph-mon[14969]: osd.9 [v2:10.20.193.11:6826/132317204,v1:10.20.193.11:6827/132317204] boot 2026-02-13T02:18:30.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:29 trial078 ceph-mon[14969]: osdmap e56: 11 total, 10 up, 11 in 2026-02-13T02:18:30.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:29 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T02:18:30.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:29 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T02:18:30.927 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:30 trial060 ceph-mon[14797]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T02:18:30.927 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:30 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:18:30.927 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:30 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:30.927 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:30 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:30.928 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:30 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:30.928 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:30 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:18:30.928 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:30 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:30.928 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:30 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:18:30.928 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:30 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:18:30.928 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:30 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:30.928 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:30 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2026-02-13T02:18:30.928 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:30 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:30.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:30 trial011 ceph-mon[11956]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T02:18:30.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:30 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:18:30.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:30 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:30.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:30 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:30.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:30 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:30.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:30 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:18:30.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:30 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:30.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:30 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:18:30.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:30 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:18:30.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:30 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:30.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:30 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2026-02-13T02:18:30.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:30 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:31.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:30 trial078 ceph-mon[14969]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T02:18:31.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:30 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:18:31.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:30 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:31.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:30 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:31.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:30 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:31.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:30 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:18:31.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:30 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:31.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:30 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:18:31.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:30 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:18:31.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:30 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:31.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:30 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2026-02-13T02:18:31.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:30 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:31.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:31 trial011 ceph-mon[11956]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T02:18:31.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:31 trial011 ceph-mon[11956]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T02:18:31.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:31 trial011 ceph-mon[11956]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T02:18:31.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:31 trial011 ceph-mon[11956]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:18:32.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:31 trial060 ceph-mon[14797]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T02:18:32.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:31 trial060 ceph-mon[14797]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T02:18:32.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:31 trial060 ceph-mon[14797]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T02:18:32.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:31 trial060 ceph-mon[14797]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:18:32.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:31 trial078 ceph-mon[14969]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T02:18:32.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:31 trial078 ceph-mon[14969]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T02:18:32.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:31 trial078 ceph-mon[14969]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T02:18:32.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:31 trial078 ceph-mon[14969]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:18:32.750 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:32 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:18:32.750 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:32 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:32.750 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:32 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:32.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:32 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:18:32.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:32 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:32.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:32 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:33.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:32 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:18:33.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:32 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:33.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:32 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:33.373 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:33.373+0000 7fd3f9ffb6c0 1 -- 10.20.193.60:0/4200874149 <== mgr.14116 v2:10.20.193.11:6800/861334768 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fd4040ec760 con 0x7fd3e00b5680 2026-02-13T02:18:33.374 INFO:teuthology.orchestra.run.trial060.stdout:Created osd(s) 10 on host 'trial060' 2026-02-13T02:18:33.376 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:33.375+0000 7fd40ad336c0 1 -- 10.20.193.60:0/4200874149 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fd3e00b5680 msgr2=0x7fd3e00d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:33.376 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:33.375+0000 7fd40ad336c0 1 --2- 10.20.193.60:0/4200874149 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fd3e00b5680 0x7fd3e00d5b30 secure :-1 s=READY pgs=126 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd3f4004750 tx=0x7fd3f4009260 comp rx=0 tx=0).stop 2026-02-13T02:18:33.376 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:33.375+0000 7fd40ad336c0 1 -- 10.20.193.60:0/4200874149 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fd40410c460 msgr2=0x7fd4040f4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:33.376 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:33.375+0000 7fd40ad336c0 1 --2- 10.20.193.60:0/4200874149 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fd40410c460 0x7fd4040f4b00 secure :-1 s=READY pgs=34 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd40000c730 tx=0x7fd40000cc00 comp rx=0 tx=0).stop 2026-02-13T02:18:33.376 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:33.375+0000 7fd40ad336c0 1 -- 10.20.193.60:0/4200874149 shutdown_connections 2026-02-13T02:18:33.376 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:33.375+0000 7fd40ad336c0 1 --2- 10.20.193.60:0/4200874149 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fd3e00b5680 0x7fd3e00d5b30 unknown :-1 s=CLOSED pgs=126 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:33.377 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:33.375+0000 7fd40ad336c0 1 --2- 10.20.193.60:0/4200874149 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fd40410c460 0x7fd4040f4b00 unknown :-1 s=CLOSED pgs=34 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:33.377 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:33.375+0000 7fd40ad336c0 1 --2- 10.20.193.60:0/4200874149 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd40410b8b0 0x7fd4040f3f10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:33.377 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:33.375+0000 7fd40ad336c0 1 --2- 10.20.193.60:0/4200874149 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fd40410ae80 0x7fd4040f38c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:33.377 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:33.375+0000 7fd40ad336c0 1 -- 10.20.193.60:0/4200874149 >> 10.20.193.60:0/4200874149 conn(0x7fd4040e8990 msgr2=0x7fd4040e9e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:18:33.377 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:33.375+0000 7fd40ad336c0 1 -- 10.20.193.60:0/4200874149 shutdown_connections 2026-02-13T02:18:33.377 INFO:teuthology.orchestra.run.trial060.stderr:2026-02-13T02:18:33.375+0000 7fd40ad336c0 1 -- 10.20.193.60:0/4200874149 wait complete. 2026-02-13T02:18:33.424 DEBUG:teuthology.orchestra.run.trial060:osd.10> sudo journalctl -f -n 0 -u ceph-fc631695-0881-11f1-899c-d404e6e7d460@osd.10.service 2026-02-13T02:18:33.427 INFO:tasks.cephadm:Deploying osd.11 on trial078 with /dev/vg_nvme/lv_1... 2026-02-13T02:18:33.427 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_1 2026-02-13T02:18:33.554 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.c/config 2026-02-13T02:18:33.707 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:33 trial078 ceph-mon[14969]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T02:18:33.707 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:33 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:33.707 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:33 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:33.707 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:33 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:33.708 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:33 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:18:33.708 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:33 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:33.708 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:33 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:18:33.708 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:33 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:18:33.708 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:33 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:33.708 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:33 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:33.708 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:33 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:33.708 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:33 trial078 ceph-mon[14969]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2026-02-13T02:18:33.708 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:33 trial078 ceph-mon[14969]: from='osd.10 [v2:10.20.193.60:6824/3534951144,v1:10.20.193.60:6825/3534951144]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2026-02-13T02:18:33.750 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:33 trial060 ceph-mon[14797]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T02:18:33.750 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:33 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:33.750 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:33 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:33.750 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:33 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:33.751 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:33 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:18:33.751 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:33 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:33.751 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:33 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:18:33.751 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:33 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:18:33.751 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:33 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:33.751 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:33 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:33.751 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:33 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:33.751 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:33 trial060 ceph-mon[14797]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2026-02-13T02:18:33.751 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:33 trial060 ceph-mon[14797]: from='osd.10 [v2:10.20.193.60:6824/3534951144,v1:10.20.193.60:6825/3534951144]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2026-02-13T02:18:33.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:33 trial011 ceph-mon[11956]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T02:18:33.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:33 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:33.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:33 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:33.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:33 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:33.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:33 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:18:33.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:33 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:33.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:33 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:18:33.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:33 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:18:33.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:33 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:33.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:33 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:33.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:33 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:33.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:33 trial011 ceph-mon[11956]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2026-02-13T02:18:33.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:33 trial011 ceph-mon[11956]: from='osd.10 [v2:10.20.193.60:6824/3534951144,v1:10.20.193.60:6825/3534951144]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2026-02-13T02:18:34.001 INFO:teuthology.orchestra.run.trial078.stdout: 2026-02-13T02:18:34.017 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph orch daemon add osd trial078:vg_nvme/lv_1 --skip-validation 2026-02-13T02:18:34.144 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.c/config 2026-02-13T02:18:34.261 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:34.257+0000 7f13c0af46c0 1 -- 10.20.193.78:0/663206920 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f13bc110a00 msgr2=0x7f13bc171390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:34.261 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:34.257+0000 7f13c0af46c0 1 --2- 10.20.193.78:0/663206920 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f13bc110a00 0x7f13bc171390 secure :-1 s=READY pgs=38 gs=1 cs=0 l=1 c_cookie=8728094894266855709 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f13ac00aa40 tx=0x7f13ac02fde0 comp rx=0 tx=0).stop 2026-02-13T02:18:34.261 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:34.257+0000 7f13c0af46c0 1 -- 10.20.193.78:0/663206920 shutdown_connections 2026-02-13T02:18:34.261 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:34.257+0000 7f13c0af46c0 1 --2- 10.20.193.78:0/663206920 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f13bc110a00 0x7f13bc171390 unknown :-1 s=CLOSED pgs=38 gs=1 cs=0 l=1 c_cookie=8728094894266855709 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:34.261 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:34.257+0000 7f13c0af46c0 1 --2- 10.20.193.78:0/663206920 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f13bc110050 0x7f13bc1104c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:34.262 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:34.257+0000 7f13c0af46c0 1 --2- 10.20.193.78:0/663206920 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f13bc10eed0 0x7f13bc10f2c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:34.262 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:34.257+0000 7f13c0af46c0 1 -- 10.20.193.78:0/663206920 >> 10.20.193.78:0/663206920 conn(0x7f13bc0ec5f0 msgr2=0x7f13bc10ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:18:34.262 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:34.257+0000 7f13c0af46c0 1 -- 10.20.193.78:0/663206920 shutdown_connections 2026-02-13T02:18:34.262 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:34.257+0000 7f13c0af46c0 1 -- 10.20.193.78:0/663206920 wait complete. 2026-02-13T02:18:34.262 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:34.257+0000 7f13c0af46c0 1 Processor -- start 2026-02-13T02:18:34.262 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:34.257+0000 7f13c0af46c0 1 -- start start 2026-02-13T02:18:34.262 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:34.257+0000 7f13c0af46c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f13bc10eed0 0x7f13bc0f8f30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:18:34.262 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:34.257+0000 7f13c0af46c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f13bc110050 0x7f13bc171370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:18:34.262 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:34.257+0000 7f13c0af46c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f13bc110a00 0x7f13bc0f9770 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:18:34.262 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:34.257+0000 7f13c0af46c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f13bc0fa3c0 con 0x7f13bc110a00 2026-02-13T02:18:34.262 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:34.257+0000 7f13c0af46c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f13bc0fa530 con 0x7f13bc110050 2026-02-13T02:18:34.262 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:34.257+0000 7f13c0af46c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f13bc0fa6f0 con 0x7f13bc10eed0 2026-02-13T02:18:34.263 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:34.257+0000 7f13ba5756c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f13bc10eed0 0x7f13bc0f8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:18:34.263 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:34.257+0000 7f13ba5756c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f13bc10eed0 0x7f13bc0f8f30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.78:3300/0 says I am v2:10.20.193.78:47312/0 (socket says 10.20.193.78:47312) 2026-02-13T02:18:34.263 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:34.257+0000 7f13ba5756c0 1 -- 10.20.193.78:0/1531092077 learned_addr learned my addr 10.20.193.78:0/1531092077 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:18:34.263 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:34.258+0000 7f13b9d746c0 1 --2- 10.20.193.78:0/1531092077 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f13bc110050 0x7f13bc171370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:18:34.263 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:34.258+0000 7f13bad766c0 1 --2- 10.20.193.78:0/1531092077 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f13bc110a00 0x7f13bc0f9770 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:18:34.263 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:34.258+0000 7f13ba5756c0 1 -- 10.20.193.78:0/1531092077 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f13bc110050 msgr2=0x7f13bc171370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:34.263 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:34.258+0000 7f13ba5756c0 1 --2- 10.20.193.78:0/1531092077 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f13bc110050 0x7f13bc171370 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:34.263 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:34.258+0000 7f13ba5756c0 1 -- 10.20.193.78:0/1531092077 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f13bc110a00 msgr2=0x7f13bc0f9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:34.263 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:34.258+0000 7f13ba5756c0 1 --2- 10.20.193.78:0/1531092077 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f13bc110a00 0x7f13bc0f9770 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:34.263 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:34.258+0000 7f13ba5756c0 1 -- 10.20.193.78:0/1531092077 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13ac00a660 con 0x7f13bc10eed0 2026-02-13T02:18:34.263 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:34.258+0000 7f13bad766c0 1 --2- 10.20.193.78:0/1531092077 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f13bc110a00 0x7f13bc0f9770 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T02:18:34.263 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:34.258+0000 7f13ba5756c0 1 --2- 10.20.193.78:0/1531092077 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f13bc10eed0 0x7f13bc0f8f30 secure :-1 s=READY pgs=39 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f13b0005dc0 tx=0x7f13b000bbb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:18:34.264 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:34.258+0000 7f13a37fe6c0 1 -- 10.20.193.78:0/1531092077 <== mon.1 v2:10.20.193.78:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f13b0004250 con 0x7f13bc10eed0 2026-02-13T02:18:34.264 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:34.258+0000 7f13a37fe6c0 1 -- 10.20.193.78:0/1531092077 <== mon.1 v2:10.20.193.78:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f13b0009070 con 0x7f13bc10eed0 2026-02-13T02:18:34.264 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:34.258+0000 7f13c0af46c0 1 -- 10.20.193.78:0/1531092077 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13bc0fa970 con 0x7f13bc10eed0 2026-02-13T02:18:34.264 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:34.258+0000 7f13a37fe6c0 1 -- 10.20.193.78:0/1531092077 <== mon.1 v2:10.20.193.78:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f13b000cde0 con 0x7f13bc10eed0 2026-02-13T02:18:34.264 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:34.258+0000 7f13c0af46c0 1 -- 10.20.193.78:0/1531092077 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13bc0fae50 con 0x7f13bc10eed0 2026-02-13T02:18:34.264 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:34.258+0000 7f13c0af46c0 1 -- 10.20.193.78:0/1531092077 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13bc1753c0 con 0x7f13bc10eed0 2026-02-13T02:18:34.265 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:34.260+0000 7f13a37fe6c0 1 -- 10.20.193.78:0/1531092077 <== mon.1 v2:10.20.193.78:3300/0 4 ==== mgrmap(e 10) ==== 157066+0+0 (secure 0 0 0) 0x7f13b00028c0 con 0x7f13bc10eed0 2026-02-13T02:18:34.265 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:34.260+0000 7f13a37fe6c0 1 --2- 10.20.193.78:0/1531092077 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f13940b5680 0x7f13940d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:18:34.265 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:34.261+0000 7f13b9d746c0 1 --2- 10.20.193.78:0/1531092077 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f13940b5680 0x7f13940d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:18:34.265 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:34.261+0000 7f13a37fe6c0 1 -- 10.20.193.78:0/1531092077 <== mon.1 v2:10.20.193.78:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6153+0+0 (secure 0 0 0) 0x7f13b00e3220 con 0x7f13bc10eed0 2026-02-13T02:18:34.265 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:34.261+0000 7f13a37fe6c0 1 -- 10.20.193.78:0/1531092077 <== mon.1 v2:10.20.193.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f13b00a63f0 con 0x7f13bc10eed0 2026-02-13T02:18:34.266 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:34.261+0000 7f13b9d746c0 1 --2- 10.20.193.78:0/1531092077 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f13940b5680 0x7f13940d5b30 secure :-1 s=READY pgs=131 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f13a4004750 tx=0x7f13a4009390 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:18:34.358 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:34.356+0000 7f13c0af46c0 1 -- 10.20.193.78:0/1531092077 --> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial078:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7f13bc04ca20 con 0x7f13940b5680 2026-02-13T02:18:34.792 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:34 trial078 ceph-mon[14969]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T02:18:34.792 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:34 trial078 ceph-mon[14969]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T02:18:34.792 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:34 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:18:34.792 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:34 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:34.792 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:34 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:34.792 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:34 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:18:34.792 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:34 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:18:34.792 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:34 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:34.793 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:34 trial078 ceph-mon[14969]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2026-02-13T02:18:34.793 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:34 trial078 ceph-mon[14969]: osdmap e57: 11 total, 10 up, 11 in 2026-02-13T02:18:34.793 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:34 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T02:18:34.793 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:34 trial078 ceph-mon[14969]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial060", "root=default"]} : dispatch 2026-02-13T02:18:34.793 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:34 trial078 ceph-mon[14969]: from='osd.10 [v2:10.20.193.60:6824/3534951144,v1:10.20.193.60:6825/3534951144]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial060", "root=default"]} : dispatch 2026-02-13T02:18:34.793 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:34 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:34.793 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:34 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:34.793 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:34 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T02:18:34.793 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:34 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-13T02:18:34.793 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:34 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2026-02-13T02:18:34.793 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:34 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2026-02-13T02:18:34.794 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:34 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:34.794 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:34 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:34.794 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:34 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:18:34.794 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:34 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:34.794 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:34 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:18:34.794 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:34 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:18:34.794 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:34 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:34.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:34 trial011 ceph-mon[11956]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T02:18:34.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:34 trial011 ceph-mon[11956]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T02:18:34.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:34 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:18:34.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:34 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:34.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:34 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:34.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:34 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:18:34.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:34 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:18:34.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:34 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:34.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:34 trial011 ceph-mon[11956]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2026-02-13T02:18:34.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:34 trial011 ceph-mon[11956]: osdmap e57: 11 total, 10 up, 11 in 2026-02-13T02:18:34.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:34 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T02:18:34.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:34 trial011 ceph-mon[11956]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial060", "root=default"]} : dispatch 2026-02-13T02:18:34.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:34 trial011 ceph-mon[11956]: from='osd.10 [v2:10.20.193.60:6824/3534951144,v1:10.20.193.60:6825/3534951144]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial060", "root=default"]} : dispatch 2026-02-13T02:18:34.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:34 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:34.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:34 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:34.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:34 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T02:18:34.954 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:34 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-13T02:18:34.954 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:34 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2026-02-13T02:18:34.954 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:34 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2026-02-13T02:18:34.954 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:34 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:34.954 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:34 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:34.954 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:34 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:18:34.954 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:34 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:34.954 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:34 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:18:34.954 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:34 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:18:34.954 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:34 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:35.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:34 trial060 ceph-mon[14797]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T02:18:35.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:34 trial060 ceph-mon[14797]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T02:18:35.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:34 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:18:35.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:34 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:35.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:34 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:35.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:34 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:18:35.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:34 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:18:35.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:34 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:35.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:34 trial060 ceph-mon[14797]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2026-02-13T02:18:35.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:34 trial060 ceph-mon[14797]: osdmap e57: 11 total, 10 up, 11 in 2026-02-13T02:18:35.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:34 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T02:18:35.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:34 trial060 ceph-mon[14797]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial060", "root=default"]} : dispatch 2026-02-13T02:18:35.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:34 trial060 ceph-mon[14797]: from='osd.10 [v2:10.20.193.60:6824/3534951144,v1:10.20.193.60:6825/3534951144]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial060", "root=default"]} : dispatch 2026-02-13T02:18:35.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:34 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:35.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:34 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:35.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:34 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T02:18:35.002 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:34 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-13T02:18:35.002 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:34 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2026-02-13T02:18:35.002 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:34 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2026-02-13T02:18:35.002 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:34 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:35.002 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:34 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:35.002 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:34 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:18:35.002 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:34 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:35.002 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:34 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:18:35.002 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:34 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:18:35.002 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:34 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:35.500 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:18:35 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:18:35.021+0000 7fe05e98d6c0 -1 osd.10 0 waiting for initial osdmap 2026-02-13T02:18:35.501 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:18:35 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:18:35.027+0000 7fe05a8626c0 -1 osd.10 58 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T02:18:35.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:35 trial011 ceph-mon[11956]: from='client.24358 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial078:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:18:35.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:35 trial011 ceph-mon[11956]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T02:18:35.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:35 trial011 ceph-mon[11956]: from='client.? 10.20.193.78:0/2826309290' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "03e11d54-a857-418b-8ac1-c8d7a9a23305"} : dispatch 2026-02-13T02:18:35.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:35 trial011 ceph-mon[11956]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "03e11d54-a857-418b-8ac1-c8d7a9a23305"} : dispatch 2026-02-13T02:18:35.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:35 trial011 ceph-mon[11956]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial060", "root=default"]}]': finished 2026-02-13T02:18:35.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:35 trial011 ceph-mon[11956]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "03e11d54-a857-418b-8ac1-c8d7a9a23305"}]': finished 2026-02-13T02:18:35.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:35 trial011 ceph-mon[11956]: osdmap e58: 12 total, 10 up, 12 in 2026-02-13T02:18:35.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:35 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T02:18:35.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:35 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T02:18:35.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:35 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T02:18:35.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:35 trial011 ceph-mon[11956]: from='client.? 10.20.193.78:0/1467925360' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T02:18:35.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:35 trial011 ceph-mon[11956]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:18:35.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:35 trial011 ceph-mon[11956]: Cluster is now healthy 2026-02-13T02:18:36.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:35 trial060 ceph-mon[14797]: from='client.24358 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial078:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:18:36.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:35 trial060 ceph-mon[14797]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T02:18:36.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:35 trial060 ceph-mon[14797]: from='client.? 10.20.193.78:0/2826309290' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "03e11d54-a857-418b-8ac1-c8d7a9a23305"} : dispatch 2026-02-13T02:18:36.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:35 trial060 ceph-mon[14797]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "03e11d54-a857-418b-8ac1-c8d7a9a23305"} : dispatch 2026-02-13T02:18:36.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:35 trial060 ceph-mon[14797]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial060", "root=default"]}]': finished 2026-02-13T02:18:36.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:35 trial060 ceph-mon[14797]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "03e11d54-a857-418b-8ac1-c8d7a9a23305"}]': finished 2026-02-13T02:18:36.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:35 trial060 ceph-mon[14797]: osdmap e58: 12 total, 10 up, 12 in 2026-02-13T02:18:36.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:35 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T02:18:36.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:35 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T02:18:36.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:35 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T02:18:36.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:35 trial060 ceph-mon[14797]: from='client.? 10.20.193.78:0/1467925360' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T02:18:36.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:35 trial060 ceph-mon[14797]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:18:36.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:35 trial060 ceph-mon[14797]: Cluster is now healthy 2026-02-13T02:18:36.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:35 trial078 ceph-mon[14969]: from='client.24358 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial078:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:18:36.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:35 trial078 ceph-mon[14969]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T02:18:36.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:35 trial078 ceph-mon[14969]: from='client.? 10.20.193.78:0/2826309290' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "03e11d54-a857-418b-8ac1-c8d7a9a23305"} : dispatch 2026-02-13T02:18:36.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:35 trial078 ceph-mon[14969]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "03e11d54-a857-418b-8ac1-c8d7a9a23305"} : dispatch 2026-02-13T02:18:36.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:35 trial078 ceph-mon[14969]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial060", "root=default"]}]': finished 2026-02-13T02:18:36.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:35 trial078 ceph-mon[14969]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "03e11d54-a857-418b-8ac1-c8d7a9a23305"}]': finished 2026-02-13T02:18:36.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:35 trial078 ceph-mon[14969]: osdmap e58: 12 total, 10 up, 12 in 2026-02-13T02:18:36.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:35 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T02:18:36.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:35 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T02:18:36.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:35 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T02:18:36.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:35 trial078 ceph-mon[14969]: from='client.? 10.20.193.78:0/1467925360' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T02:18:36.043 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:35 trial078 ceph-mon[14969]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T02:18:36.043 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:35 trial078 ceph-mon[14969]: Cluster is now healthy 2026-02-13T02:18:37.258 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:37 trial078 ceph-mon[14969]: purged_snaps scrub starts 2026-02-13T02:18:37.258 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:37 trial078 ceph-mon[14969]: purged_snaps scrub ok 2026-02-13T02:18:37.258 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:37 trial078 ceph-mon[14969]: osd.10 [v2:10.20.193.60:6824/3534951144,v1:10.20.193.60:6825/3534951144] boot 2026-02-13T02:18:37.258 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:37 trial078 ceph-mon[14969]: osdmap e59: 12 total, 11 up, 12 in 2026-02-13T02:18:37.259 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:37 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T02:18:37.259 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:37 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T02:18:37.259 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:37 trial078 ceph-mon[14969]: osdmap e60: 12 total, 11 up, 12 in 2026-02-13T02:18:37.259 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:37 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T02:18:37.259 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:37 trial078 ceph-mon[14969]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T02:18:37.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:37 trial011 ceph-mon[11956]: purged_snaps scrub starts 2026-02-13T02:18:37.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:37 trial011 ceph-mon[11956]: purged_snaps scrub ok 2026-02-13T02:18:37.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:37 trial011 ceph-mon[11956]: osd.10 [v2:10.20.193.60:6824/3534951144,v1:10.20.193.60:6825/3534951144] boot 2026-02-13T02:18:37.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:37 trial011 ceph-mon[11956]: osdmap e59: 12 total, 11 up, 12 in 2026-02-13T02:18:37.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:37 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T02:18:37.453 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:37 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T02:18:37.453 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:37 trial011 ceph-mon[11956]: osdmap e60: 12 total, 11 up, 12 in 2026-02-13T02:18:37.453 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:37 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T02:18:37.453 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:37 trial011 ceph-mon[11956]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T02:18:37.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:37 trial060 ceph-mon[14797]: purged_snaps scrub starts 2026-02-13T02:18:37.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:37 trial060 ceph-mon[14797]: purged_snaps scrub ok 2026-02-13T02:18:37.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:37 trial060 ceph-mon[14797]: osd.10 [v2:10.20.193.60:6824/3534951144,v1:10.20.193.60:6825/3534951144] boot 2026-02-13T02:18:37.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:37 trial060 ceph-mon[14797]: osdmap e59: 12 total, 11 up, 12 in 2026-02-13T02:18:37.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:37 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T02:18:37.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:37 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T02:18:37.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:37 trial060 ceph-mon[14797]: osdmap e60: 12 total, 11 up, 12 in 2026-02-13T02:18:37.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:37 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T02:18:37.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:37 trial060 ceph-mon[14797]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T02:18:38.196 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:38 trial078 ceph-mon[14969]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T02:18:38.196 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:38 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:18:38.197 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:38 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:38.197 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:38 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:38.197 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:38 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:38.197 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:38 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:18:38.197 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:38 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:38.197 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:38 trial078 ceph-mon[14969]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T02:18:38.197 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:38 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:18:38.197 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:38 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:18:38.197 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:38 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:38.197 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:38 trial078 ceph-mon[14969]: osdmap e61: 12 total, 11 up, 12 in 2026-02-13T02:18:38.198 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:38 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T02:18:38.198 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:38 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2026-02-13T02:18:38.198 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:38 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:38.198 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:38 trial078 ceph-mon[14969]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T02:18:38.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:38 trial011 ceph-mon[11956]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T02:18:38.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:38 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:18:38.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:38 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:38.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:38 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:38.453 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:38 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:38.453 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:38 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:18:38.453 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:38 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:38.453 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:38 trial011 ceph-mon[11956]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T02:18:38.453 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:38 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:18:38.453 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:38 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:18:38.453 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:38 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:38.453 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:38 trial011 ceph-mon[11956]: osdmap e61: 12 total, 11 up, 12 in 2026-02-13T02:18:38.453 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:38 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T02:18:38.453 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:38 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2026-02-13T02:18:38.453 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:38 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:38.454 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:38 trial011 ceph-mon[11956]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T02:18:38.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:38 trial060 ceph-mon[14797]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T02:18:38.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:38 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:18:38.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:38 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:38.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:38 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:38.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:38 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:38.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:38 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:18:38.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:38 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:38.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:38 trial060 ceph-mon[14797]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T02:18:38.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:38 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:18:38.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:38 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:18:38.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:38 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:38.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:38 trial060 ceph-mon[14797]: osdmap e61: 12 total, 11 up, 12 in 2026-02-13T02:18:38.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:38 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T02:18:38.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:38 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2026-02-13T02:18:38.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:38 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:38.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:38 trial060 ceph-mon[14797]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T02:18:39.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:39 trial078 ceph-mon[14969]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:18:39.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:39 trial078 ceph-mon[14969]: osdmap e62: 12 total, 11 up, 12 in 2026-02-13T02:18:39.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:39 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T02:18:39.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:39 trial011 ceph-mon[11956]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:18:39.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:39 trial011 ceph-mon[11956]: osdmap e62: 12 total, 11 up, 12 in 2026-02-13T02:18:39.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:39 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T02:18:39.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:39 trial060 ceph-mon[14797]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:18:39.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:39 trial060 ceph-mon[14797]: osdmap e62: 12 total, 11 up, 12 in 2026-02-13T02:18:39.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:39 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T02:18:40.490 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:40 trial078 ceph-mon[14969]: osdmap e63: 12 total, 11 up, 12 in 2026-02-13T02:18:40.490 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:40 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T02:18:40.491 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:40 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:18:40.491 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:40 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:40.491 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:40 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:40.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:40 trial060 ceph-mon[14797]: osdmap e63: 12 total, 11 up, 12 in 2026-02-13T02:18:40.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:40 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T02:18:40.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:40 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:18:40.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:40 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:40.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:40 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:40.665 INFO:teuthology.orchestra.run.trial078.stdout:Created osd(s) 11 on host 'trial078' 2026-02-13T02:18:40.666 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:40.662+0000 7f13a37fe6c0 1 -- 10.20.193.78:0/1531092077 <== mgr.14116 v2:10.20.193.11:6800/861334768 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f13bc04ca20 con 0x7f13940b5680 2026-02-13T02:18:40.667 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:40.664+0000 7f13c0af46c0 1 -- 10.20.193.78:0/1531092077 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f13940b5680 msgr2=0x7f13940d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:40.668 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:40.664+0000 7f13c0af46c0 1 --2- 10.20.193.78:0/1531092077 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f13940b5680 0x7f13940d5b30 secure :-1 s=READY pgs=131 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f13a4004750 tx=0x7f13a4009390 comp rx=0 tx=0).stop 2026-02-13T02:18:40.668 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:40.664+0000 7f13c0af46c0 1 -- 10.20.193.78:0/1531092077 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f13bc10eed0 msgr2=0x7f13bc0f8f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:40.668 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:40.664+0000 7f13c0af46c0 1 --2- 10.20.193.78:0/1531092077 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f13bc10eed0 0x7f13bc0f8f30 secure :-1 s=READY pgs=39 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f13b0005dc0 tx=0x7f13b000bbb0 comp rx=0 tx=0).stop 2026-02-13T02:18:40.668 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:40.664+0000 7f13c0af46c0 1 -- 10.20.193.78:0/1531092077 shutdown_connections 2026-02-13T02:18:40.668 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:40.664+0000 7f13c0af46c0 1 --2- 10.20.193.78:0/1531092077 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f13940b5680 0x7f13940d5b30 unknown :-1 s=CLOSED pgs=131 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:40.668 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:40.664+0000 7f13c0af46c0 1 --2- 10.20.193.78:0/1531092077 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f13bc110050 0x7f13bc171370 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:40.668 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:40.664+0000 7f13c0af46c0 1 --2- 10.20.193.78:0/1531092077 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f13bc110a00 0x7f13bc0f9770 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:40.668 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:40.664+0000 7f13c0af46c0 1 --2- 10.20.193.78:0/1531092077 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f13bc10eed0 0x7f13bc0f8f30 unknown :-1 s=CLOSED pgs=39 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:40.668 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:40.664+0000 7f13c0af46c0 1 -- 10.20.193.78:0/1531092077 >> 10.20.193.78:0/1531092077 conn(0x7f13bc0ec5f0 msgr2=0x7f13bc0ef4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:18:40.668 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:40.664+0000 7f13c0af46c0 1 -- 10.20.193.78:0/1531092077 shutdown_connections 2026-02-13T02:18:40.669 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:40.664+0000 7f13c0af46c0 1 -- 10.20.193.78:0/1531092077 wait complete. 2026-02-13T02:18:40.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:40 trial011 ceph-mon[11956]: osdmap e63: 12 total, 11 up, 12 in 2026-02-13T02:18:40.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:40 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T02:18:40.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:40 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:18:40.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:40 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:40.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:40 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:40.707 DEBUG:teuthology.orchestra.run.trial078:osd.11> sudo journalctl -f -n 0 -u ceph-fc631695-0881-11f1-899c-d404e6e7d460@osd.11.service 2026-02-13T02:18:40.710 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2026-02-13T02:18:40.710 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph osd stat -f json 2026-02-13T02:18:40.834 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:18:40.952 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:40.946+0000 7f65a1ac56c0 1 -- 10.20.193.11:0/3154171005 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f659c110040 msgr2=0x7f659c1104b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:40.953 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:40.946+0000 7f65a1ac56c0 1 --2- 10.20.193.11:0/3154171005 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f659c110040 0x7f659c1104b0 secure :-1 s=READY pgs=179 gs=1 cs=0 l=1 c_cookie=7791136273972199846 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f658c009970 tx=0x7f658c02ed20 comp rx=0 tx=0).stop 2026-02-13T02:18:40.953 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:40.946+0000 7f65a1ac56c0 1 -- 10.20.193.11:0/3154171005 shutdown_connections 2026-02-13T02:18:40.953 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:40.946+0000 7f65a1ac56c0 1 --2- 10.20.193.11:0/3154171005 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f659c1109f0 0x7f659c171380 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:40.953 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:40.946+0000 7f65a1ac56c0 1 --2- 10.20.193.11:0/3154171005 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f659c110040 0x7f659c1104b0 unknown :-1 s=CLOSED pgs=179 gs=1 cs=0 l=1 c_cookie=7791136273972199846 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:40.953 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:40.946+0000 7f65a1ac56c0 1 --2- 10.20.193.11:0/3154171005 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f659c10eec0 0x7f659c10f2b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:40.953 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:40.946+0000 7f65a1ac56c0 1 -- 10.20.193.11:0/3154171005 >> 10.20.193.11:0/3154171005 conn(0x7f659c0ec5c0 msgr2=0x7f659c10c9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:18:40.953 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:40.946+0000 7f65a1ac56c0 1 -- 10.20.193.11:0/3154171005 shutdown_connections 2026-02-13T02:18:40.954 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:40.946+0000 7f65a1ac56c0 1 -- 10.20.193.11:0/3154171005 wait complete. 2026-02-13T02:18:40.954 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:40.947+0000 7f65a1ac56c0 1 Processor -- start 2026-02-13T02:18:40.954 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:40.947+0000 7f65a1ac56c0 1 -- start start 2026-02-13T02:18:40.954 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:40.947+0000 7f65a1ac56c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f659c10eec0 0x7f659c0f9080 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:18:40.954 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:40.947+0000 7f65a1ac56c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f659c110040 0x7f659c171380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:18:40.954 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:40.947+0000 7f65a1ac56c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f659c1109f0 0x7f659c0f98e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:18:40.954 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:40.947+0000 7f65a1ac56c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f659c0fa510 con 0x7f659c110040 2026-02-13T02:18:40.954 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:40.947+0000 7f65a1ac56c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f659c0fa680 con 0x7f659c10eec0 2026-02-13T02:18:40.954 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:40.947+0000 7f65a1ac56c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f659c0fa840 con 0x7f659c1109f0 2026-02-13T02:18:40.954 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:40.947+0000 7f659affd6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f659c110040 0x7f659c171380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:18:40.955 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:40.947+0000 7f659affd6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f659c110040 0x7f659c171380 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:53138/0 (socket says 10.20.193.11:53138) 2026-02-13T02:18:40.955 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:40.947+0000 7f659affd6c0 1 -- 10.20.193.11:0/2578427929 learned_addr learned my addr 10.20.193.11:0/2578427929 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:18:40.955 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:40.947+0000 7f659b7fe6c0 1 --2- 10.20.193.11:0/2578427929 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f659c10eec0 0x7f659c0f9080 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:18:40.955 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:40.947+0000 7f659bfff6c0 1 --2- 10.20.193.11:0/2578427929 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f659c1109f0 0x7f659c0f98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:18:40.955 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:40.947+0000 7f659affd6c0 1 -- 10.20.193.11:0/2578427929 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f659c1109f0 msgr2=0x7f659c0f98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:40.955 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:40.947+0000 7f659affd6c0 1 --2- 10.20.193.11:0/2578427929 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f659c1109f0 0x7f659c0f98e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:40.955 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:40.947+0000 7f659affd6c0 1 -- 10.20.193.11:0/2578427929 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f659c10eec0 msgr2=0x7f659c0f9080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:40.955 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:40.947+0000 7f659affd6c0 1 --2- 10.20.193.11:0/2578427929 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f659c10eec0 0x7f659c0f9080 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:40.955 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:40.947+0000 7f659affd6c0 1 -- 10.20.193.11:0/2578427929 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f658c009590 con 0x7f659c110040 2026-02-13T02:18:40.956 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:40.947+0000 7f659affd6c0 1 --2- 10.20.193.11:0/2578427929 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f659c110040 0x7f659c171380 secure :-1 s=READY pgs=180 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f658c02ff10 tx=0x7f658c004650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:18:40.956 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:40.947+0000 7f6598ff96c0 1 -- 10.20.193.11:0/2578427929 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f658c002ae0 con 0x7f659c110040 2026-02-13T02:18:40.956 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:40.947+0000 7f6598ff96c0 1 -- 10.20.193.11:0/2578427929 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f658c002c40 con 0x7f659c110040 2026-02-13T02:18:40.956 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:40.947+0000 7f6598ff96c0 1 -- 10.20.193.11:0/2578427929 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f658c036380 con 0x7f659c110040 2026-02-13T02:18:40.956 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:40.947+0000 7f65a1ac56c0 1 -- 10.20.193.11:0/2578427929 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f659c0faac0 con 0x7f659c110040 2026-02-13T02:18:40.956 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:40.947+0000 7f65a1ac56c0 1 -- 10.20.193.11:0/2578427929 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f659c0faf90 con 0x7f659c110040 2026-02-13T02:18:40.956 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:40.948+0000 7f65a1ac56c0 1 -- 10.20.193.11:0/2578427929 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f659c175390 con 0x7f659c110040 2026-02-13T02:18:40.956 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:40.949+0000 7f6598ff96c0 1 -- 10.20.193.11:0/2578427929 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 10) ==== 157066+0+0 (secure 0 0 0) 0x7f658c007990 con 0x7f659c110040 2026-02-13T02:18:40.956 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:40.949+0000 7f6598ff96c0 1 --2- 10.20.193.11:0/2578427929 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f65700b5680 0x7f65700d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:18:40.956 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:40.949+0000 7f659b7fe6c0 1 --2- 10.20.193.11:0/2578427929 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f65700b5680 0x7f65700d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:18:40.956 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:40.950+0000 7f6598ff96c0 1 -- 10.20.193.11:0/2578427929 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6586+0+0 (secure 0 0 0) 0x7f658c107700 con 0x7f659c110040 2026-02-13T02:18:40.957 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:40.950+0000 7f659b7fe6c0 1 --2- 10.20.193.11:0/2578427929 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f65700b5680 0x7f65700d5b30 secure :-1 s=READY pgs=136 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6588005980 tx=0x7f6588005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:18:40.957 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:40.950+0000 7f6598ff96c0 1 -- 10.20.193.11:0/2578427929 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f658c0ca720 con 0x7f659c110040 2026-02-13T02:18:41.041 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:18:40 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:18:40.782+0000 7fa6a7df9780 -1 osd.11 0 log_to_monitors true 2026-02-13T02:18:41.045 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:41.043+0000 7f65a1ac56c0 1 -- 10.20.193.11:0/2578427929 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f659c174d10 con 0x7f659c110040 2026-02-13T02:18:41.046 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:41.043+0000 7f6598ff96c0 1 -- 10.20.193.11:0/2578427929 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v63) ==== 74+0+133 (secure 0 0 0) 0x7f659c174d10 con 0x7f659c110040 2026-02-13T02:18:41.046 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:18:41.047 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:41.044+0000 7f65a1ac56c0 1 -- 10.20.193.11:0/2578427929 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f65700b5680 msgr2=0x7f65700d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:41.047 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:41.044+0000 7f65a1ac56c0 1 --2- 10.20.193.11:0/2578427929 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f65700b5680 0x7f65700d5b30 secure :-1 s=READY pgs=136 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6588005980 tx=0x7f6588005910 comp rx=0 tx=0).stop 2026-02-13T02:18:41.047 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:41.045+0000 7f65a1ac56c0 1 -- 10.20.193.11:0/2578427929 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f659c110040 msgr2=0x7f659c171380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:41.047 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:41.045+0000 7f65a1ac56c0 1 --2- 10.20.193.11:0/2578427929 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f659c110040 0x7f659c171380 secure :-1 s=READY pgs=180 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f658c02ff10 tx=0x7f658c004650 comp rx=0 tx=0).stop 2026-02-13T02:18:41.047 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:41.045+0000 7f65a1ac56c0 1 -- 10.20.193.11:0/2578427929 shutdown_connections 2026-02-13T02:18:41.047 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:41.045+0000 7f65a1ac56c0 1 --2- 10.20.193.11:0/2578427929 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f65700b5680 0x7f65700d5b30 unknown :-1 s=CLOSED pgs=136 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:41.047 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:41.045+0000 7f65a1ac56c0 1 --2- 10.20.193.11:0/2578427929 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f659c1109f0 0x7f659c0f98e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:41.047 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:41.045+0000 7f65a1ac56c0 1 --2- 10.20.193.11:0/2578427929 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f659c110040 0x7f659c171380 unknown :-1 s=CLOSED pgs=180 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:41.047 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:41.045+0000 7f65a1ac56c0 1 --2- 10.20.193.11:0/2578427929 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f659c10eec0 0x7f659c0f9080 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:41.047 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:41.045+0000 7f65a1ac56c0 1 -- 10.20.193.11:0/2578427929 >> 10.20.193.11:0/2578427929 conn(0x7f659c0ec5c0 msgr2=0x7f659c0ef590 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:18:41.047 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:41.045+0000 7f65a1ac56c0 1 -- 10.20.193.11:0/2578427929 shutdown_connections 2026-02-13T02:18:41.047 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:41.045+0000 7f65a1ac56c0 1 -- 10.20.193.11:0/2578427929 wait complete. 2026-02-13T02:18:41.084 INFO:teuthology.orchestra.run.trial011.stdout:{"epoch":63,"num_osds":12,"num_up_osds":11,"osd_up_since":1770949116,"num_in_osds":12,"osd_in_since":1770949115,"num_remapped_pgs":0} 2026-02-13T02:18:41.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:41 trial078 ceph-mon[14969]: pgmap v160: 1 pgs: 1 peering; 577 KiB data, 298 MiB used, 7.5 TiB / 7.5 TiB avail; 223 KiB/s, 0 objects/s recovering 2026-02-13T02:18:41.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:41 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:41.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:41 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:41.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:41 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:41.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:41 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:18:41.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:41 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:41.543 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:41 trial078 ceph-mon[14969]: pgmap v161: 1 pgs: 1 peering; 577 KiB data, 298 MiB used, 7.5 TiB / 7.5 TiB avail; 181 KiB/s, 0 objects/s recovering 2026-02-13T02:18:41.543 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:41 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:18:41.543 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:41 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:18:41.543 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:41 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:41.543 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:41 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:41.543 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:41 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:41.543 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:41 trial078 ceph-mon[14969]: from='osd.11 [v2:10.20.193.78:6824/537170494,v1:10.20.193.78:6825/537170494]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2026-02-13T02:18:41.543 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:41 trial078 ceph-mon[14969]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2026-02-13T02:18:41.543 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:41 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:18:41.543 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:41 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/2578427929' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-13T02:18:41.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:41 trial011 ceph-mon[11956]: pgmap v160: 1 pgs: 1 peering; 577 KiB data, 298 MiB used, 7.5 TiB / 7.5 TiB avail; 223 KiB/s, 0 objects/s recovering 2026-02-13T02:18:41.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:41 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:41.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:41 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:41.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:41 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:41.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:41 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:18:41.703 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:41 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:41.703 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:41 trial011 ceph-mon[11956]: pgmap v161: 1 pgs: 1 peering; 577 KiB data, 298 MiB used, 7.5 TiB / 7.5 TiB avail; 181 KiB/s, 0 objects/s recovering 2026-02-13T02:18:41.703 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:41 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:18:41.703 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:41 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:18:41.703 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:41 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:41.703 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:41 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:41.703 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:41 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:41.703 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:41 trial011 ceph-mon[11956]: from='osd.11 [v2:10.20.193.78:6824/537170494,v1:10.20.193.78:6825/537170494]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2026-02-13T02:18:41.703 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:41 trial011 ceph-mon[11956]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2026-02-13T02:18:41.703 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:41 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:18:41.703 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:41 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/2578427929' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-13T02:18:41.750 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:41 trial060 ceph-mon[14797]: pgmap v160: 1 pgs: 1 peering; 577 KiB data, 298 MiB used, 7.5 TiB / 7.5 TiB avail; 223 KiB/s, 0 objects/s recovering 2026-02-13T02:18:41.750 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:41 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:41.750 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:41 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:41.750 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:41 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:41.750 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:41 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:18:41.750 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:41 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:41.751 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:41 trial060 ceph-mon[14797]: pgmap v161: 1 pgs: 1 peering; 577 KiB data, 298 MiB used, 7.5 TiB / 7.5 TiB avail; 181 KiB/s, 0 objects/s recovering 2026-02-13T02:18:41.751 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:41 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:18:41.751 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:41 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:18:41.751 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:41 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:41.751 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:41 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:41.751 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:41 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:41.751 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:41 trial060 ceph-mon[14797]: from='osd.11 [v2:10.20.193.78:6824/537170494,v1:10.20.193.78:6825/537170494]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2026-02-13T02:18:41.751 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:41 trial060 ceph-mon[14797]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2026-02-13T02:18:41.751 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:41 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:18:41.751 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:41 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/2578427929' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-13T02:18:42.086 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph osd stat -f json 2026-02-13T02:18:42.212 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:18:42.333 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:42.328+0000 7f69ba00d6c0 1 -- 10.20.193.11:0/435907771 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f69b410cc50 msgr2=0x7f69b410d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:42.334 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:42.328+0000 7f69ba00d6c0 1 --2- 10.20.193.11:0/435907771 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f69b410cc50 0x7f69b410d040 secure :-1 s=READY pgs=181 gs=1 cs=0 l=1 c_cookie=5861892390793713380 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f69a0009970 tx=0x7f69a002ed20 comp rx=0 tx=0).stop 2026-02-13T02:18:42.334 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:42.328+0000 7f69ba00d6c0 1 -- 10.20.193.11:0/435907771 shutdown_connections 2026-02-13T02:18:42.334 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:42.328+0000 7f69ba00d6c0 1 --2- 10.20.193.11:0/435907771 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f69b410e780 0x7f69b416f110 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:42.334 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:42.328+0000 7f69ba00d6c0 1 --2- 10.20.193.11:0/435907771 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f69b410ddd0 0x7f69b410e240 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:42.334 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:42.328+0000 7f69ba00d6c0 1 --2- 10.20.193.11:0/435907771 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f69b410cc50 0x7f69b410d040 unknown :-1 s=CLOSED pgs=181 gs=1 cs=0 l=1 c_cookie=5861892390793713380 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:42.334 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:42.328+0000 7f69ba00d6c0 1 -- 10.20.193.11:0/435907771 >> 10.20.193.11:0/435907771 conn(0x7f69b40ea370 msgr2=0x7f69b410a780 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:18:42.334 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:42.328+0000 7f69ba00d6c0 1 -- 10.20.193.11:0/435907771 shutdown_connections 2026-02-13T02:18:42.334 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:42.328+0000 7f69ba00d6c0 1 -- 10.20.193.11:0/435907771 wait complete. 2026-02-13T02:18:42.335 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:42.328+0000 7f69ba00d6c0 1 Processor -- start 2026-02-13T02:18:42.335 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:42.328+0000 7f69ba00d6c0 1 -- start start 2026-02-13T02:18:42.335 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:42.328+0000 7f69ba00d6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f69b410cc50 0x7f69b4061ea0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:18:42.335 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:42.328+0000 7f69ba00d6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f69b410ddd0 0x7f69b416f110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:18:42.335 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:42.328+0000 7f69ba00d6c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f69b410e780 0x7f69b40607a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:18:42.335 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:42.328+0000 7f69ba00d6c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f69b4060dc0 con 0x7f69b410cc50 2026-02-13T02:18:42.335 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:42.328+0000 7f69ba00d6c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f69b4060f30 con 0x7f69b410e780 2026-02-13T02:18:42.335 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:42.328+0000 7f69ba00d6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f69b40610f0 con 0x7f69b410ddd0 2026-02-13T02:18:42.335 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:42.328+0000 7f69b37fe6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f69b410cc50 0x7f69b4061ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:18:42.335 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:42.328+0000 7f69b37fe6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f69b410cc50 0x7f69b4061ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:53162/0 (socket says 10.20.193.11:53162) 2026-02-13T02:18:42.336 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:42.328+0000 7f69b37fe6c0 1 -- 10.20.193.11:0/3048769510 learned_addr learned my addr 10.20.193.11:0/3048769510 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:18:42.336 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:42.328+0000 7f69b3fff6c0 1 --2- 10.20.193.11:0/3048769510 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f69b410e780 0x7f69b40607a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:18:42.336 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:42.328+0000 7f69b2ffd6c0 1 --2- 10.20.193.11:0/3048769510 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f69b410ddd0 0x7f69b416f110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:18:42.336 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:42.328+0000 7f69b37fe6c0 1 -- 10.20.193.11:0/3048769510 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f69b410ddd0 msgr2=0x7f69b416f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:42.336 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:42.328+0000 7f69b37fe6c0 1 --2- 10.20.193.11:0/3048769510 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f69b410ddd0 0x7f69b416f110 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:42.336 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:42.328+0000 7f69b37fe6c0 1 -- 10.20.193.11:0/3048769510 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f69b410e780 msgr2=0x7f69b40607a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:42.336 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:42.328+0000 7f69b37fe6c0 1 --2- 10.20.193.11:0/3048769510 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f69b410e780 0x7f69b40607a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:42.336 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:42.328+0000 7f69b37fe6c0 1 -- 10.20.193.11:0/3048769510 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69a0009590 con 0x7f69b410cc50 2026-02-13T02:18:42.336 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:42.328+0000 7f69b2ffd6c0 1 --2- 10.20.193.11:0/3048769510 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f69b410ddd0 0x7f69b416f110 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:18:42.336 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:42.329+0000 7f69b37fe6c0 1 --2- 10.20.193.11:0/3048769510 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f69b410cc50 0x7f69b4061ea0 secure :-1 s=READY pgs=182 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f69a0009290 tx=0x7f69a0004650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:18:42.337 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:42.329+0000 7f69b0ff96c0 1 -- 10.20.193.11:0/3048769510 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f69a0002ae0 con 0x7f69b410cc50 2026-02-13T02:18:42.337 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:42.329+0000 7f69ba00d6c0 1 -- 10.20.193.11:0/3048769510 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69b4061370 con 0x7f69b410cc50 2026-02-13T02:18:42.337 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:42.329+0000 7f69b0ff96c0 1 -- 10.20.193.11:0/3048769510 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f69a0002c40 con 0x7f69b410cc50 2026-02-13T02:18:42.337 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:42.329+0000 7f69b0ff96c0 1 -- 10.20.193.11:0/3048769510 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f69a00373a0 con 0x7f69b410cc50 2026-02-13T02:18:42.337 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:42.329+0000 7f69ba00d6c0 1 -- 10.20.193.11:0/3048769510 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69b40fa5f0 con 0x7f69b410cc50 2026-02-13T02:18:42.337 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:42.329+0000 7f69ba00d6c0 1 -- 10.20.193.11:0/3048769510 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69b4061640 con 0x7f69b410cc50 2026-02-13T02:18:42.337 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:42.330+0000 7f69b0ff96c0 1 -- 10.20.193.11:0/3048769510 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 10) ==== 157066+0+0 (secure 0 0 0) 0x7f69a0007990 con 0x7f69b410cc50 2026-02-13T02:18:42.338 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:42.331+0000 7f69b0ff96c0 1 --2- 10.20.193.11:0/3048769510 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f69880b5600 0x7f69880d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:18:42.338 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:42.331+0000 7f69b0ff96c0 1 -- 10.20.193.11:0/3048769510 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6608+0+0 (secure 0 0 0) 0x7f69a01077f0 con 0x7f69b410cc50 2026-02-13T02:18:42.338 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:42.331+0000 7f69b2ffd6c0 1 --2- 10.20.193.11:0/3048769510 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f69880b5600 0x7f69880d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:18:42.339 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:42.331+0000 7f69b0ff96c0 1 -- 10.20.193.11:0/3048769510 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f69a00ca860 con 0x7f69b410cc50 2026-02-13T02:18:42.339 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:42.331+0000 7f69b2ffd6c0 1 --2- 10.20.193.11:0/3048769510 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f69880b5600 0x7f69880d5ab0 secure :-1 s=READY pgs=137 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f69a4005dc0 tx=0x7f69a4005f90 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:18:42.424 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:42.421+0000 7f69ba00d6c0 1 -- 10.20.193.11:0/3048769510 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f69b4172a50 con 0x7f69b410cc50 2026-02-13T02:18:42.425 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:42.421+0000 7f69b0ff96c0 1 -- 10.20.193.11:0/3048769510 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v64) ==== 74+0+133 (secure 0 0 0) 0x7f69a0002db0 con 0x7f69b410cc50 2026-02-13T02:18:42.425 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:18:42.426 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:42 trial011 ceph-mon[11956]: pgmap v162: 1 pgs: 1 peering; 577 KiB data, 298 MiB used, 7.5 TiB / 7.5 TiB avail; 154 KiB/s, 0 objects/s recovering 2026-02-13T02:18:42.426 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:42 trial011 ceph-mon[11956]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2026-02-13T02:18:42.426 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:42 trial011 ceph-mon[11956]: osdmap e64: 12 total, 11 up, 12 in 2026-02-13T02:18:42.426 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:42 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T02:18:42.426 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:42 trial011 ceph-mon[11956]: from='osd.11 [v2:10.20.193.78:6824/537170494,v1:10.20.193.78:6825/537170494]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial078", "root=default"]} : dispatch 2026-02-13T02:18:42.426 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:42 trial011 ceph-mon[11956]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial078", "root=default"]} : dispatch 2026-02-13T02:18:42.426 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:42 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:42.426 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:42 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:42.426 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:42 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T02:18:42.427 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:42 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-13T02:18:42.427 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:42 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2026-02-13T02:18:42.427 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:42 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2026-02-13T02:18:42.427 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:42 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:42.427 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:42 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:42.427 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:42 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:18:42.427 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:42 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:42.427 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:42 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:18:42.427 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:42 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:18:42.427 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:42 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:42.428 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:42.422+0000 7f69ba00d6c0 1 -- 10.20.193.11:0/3048769510 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f69880b5600 msgr2=0x7f69880d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:42.429 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:42.422+0000 7f69ba00d6c0 1 --2- 10.20.193.11:0/3048769510 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f69880b5600 0x7f69880d5ab0 secure :-1 s=READY pgs=137 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f69a4005dc0 tx=0x7f69a4005f90 comp rx=0 tx=0).stop 2026-02-13T02:18:42.429 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:42.422+0000 7f69ba00d6c0 1 -- 10.20.193.11:0/3048769510 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f69b410cc50 msgr2=0x7f69b4061ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:42.429 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:42.422+0000 7f69ba00d6c0 1 --2- 10.20.193.11:0/3048769510 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f69b410cc50 0x7f69b4061ea0 secure :-1 s=READY pgs=182 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f69a0009290 tx=0x7f69a0004650 comp rx=0 tx=0).stop 2026-02-13T02:18:42.429 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:42.422+0000 7f69ba00d6c0 1 -- 10.20.193.11:0/3048769510 shutdown_connections 2026-02-13T02:18:42.429 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:42.422+0000 7f69ba00d6c0 1 --2- 10.20.193.11:0/3048769510 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f69880b5600 0x7f69880d5ab0 unknown :-1 s=CLOSED pgs=137 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:42.429 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:42.422+0000 7f69ba00d6c0 1 --2- 10.20.193.11:0/3048769510 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f69b410e780 0x7f69b40607a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:42.429 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:42.422+0000 7f69ba00d6c0 1 --2- 10.20.193.11:0/3048769510 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f69b410ddd0 0x7f69b416f110 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:42.429 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:42.422+0000 7f69ba00d6c0 1 --2- 10.20.193.11:0/3048769510 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f69b410cc50 0x7f69b4061ea0 unknown :-1 s=CLOSED pgs=182 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:42.429 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:42.422+0000 7f69ba00d6c0 1 -- 10.20.193.11:0/3048769510 >> 10.20.193.11:0/3048769510 conn(0x7f69b40ea370 msgr2=0x7f69b40ec8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:18:42.429 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:42.422+0000 7f69ba00d6c0 1 -- 10.20.193.11:0/3048769510 shutdown_connections 2026-02-13T02:18:42.430 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:42.422+0000 7f69ba00d6c0 1 -- 10.20.193.11:0/3048769510 wait complete. 2026-02-13T02:18:42.462 INFO:teuthology.orchestra.run.trial011.stdout:{"epoch":64,"num_osds":12,"num_up_osds":11,"osd_up_since":1770949116,"num_in_osds":12,"osd_in_since":1770949115,"num_remapped_pgs":0} 2026-02-13T02:18:42.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:42 trial078 ceph-mon[14969]: pgmap v162: 1 pgs: 1 peering; 577 KiB data, 298 MiB used, 7.5 TiB / 7.5 TiB avail; 154 KiB/s, 0 objects/s recovering 2026-02-13T02:18:42.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:42 trial078 ceph-mon[14969]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2026-02-13T02:18:42.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:42 trial078 ceph-mon[14969]: osdmap e64: 12 total, 11 up, 12 in 2026-02-13T02:18:42.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:42 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T02:18:42.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:42 trial078 ceph-mon[14969]: from='osd.11 [v2:10.20.193.78:6824/537170494,v1:10.20.193.78:6825/537170494]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial078", "root=default"]} : dispatch 2026-02-13T02:18:42.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:42 trial078 ceph-mon[14969]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial078", "root=default"]} : dispatch 2026-02-13T02:18:42.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:42 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:42.543 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:42 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:42.543 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:42 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T02:18:42.543 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:42 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-13T02:18:42.543 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:42 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2026-02-13T02:18:42.543 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:42 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2026-02-13T02:18:42.543 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:42 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:42.543 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:42 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:42.543 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:42 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:18:42.543 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:42 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:42.543 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:42 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:18:42.543 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:42 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:18:42.544 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:42 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:42.750 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:42 trial060 ceph-mon[14797]: pgmap v162: 1 pgs: 1 peering; 577 KiB data, 298 MiB used, 7.5 TiB / 7.5 TiB avail; 154 KiB/s, 0 objects/s recovering 2026-02-13T02:18:42.750 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:42 trial060 ceph-mon[14797]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2026-02-13T02:18:42.750 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:42 trial060 ceph-mon[14797]: osdmap e64: 12 total, 11 up, 12 in 2026-02-13T02:18:42.751 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:42 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T02:18:42.751 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:42 trial060 ceph-mon[14797]: from='osd.11 [v2:10.20.193.78:6824/537170494,v1:10.20.193.78:6825/537170494]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial078", "root=default"]} : dispatch 2026-02-13T02:18:42.751 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:42 trial060 ceph-mon[14797]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial078", "root=default"]} : dispatch 2026-02-13T02:18:42.751 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:42 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:42.751 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:42 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:42.751 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:42 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T02:18:42.751 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:42 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-13T02:18:42.751 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:42 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2026-02-13T02:18:42.751 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:42 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2026-02-13T02:18:42.751 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:42 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:42.752 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:42 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:42.752 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:42 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:18:42.752 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:42 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:42.752 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:42 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:18:42.752 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:42 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:18:42.752 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:42 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:43.041 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:18:42 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:18:42.669+0000 7fa6a3d1a6c0 -1 osd.11 0 waiting for initial osdmap 2026-02-13T02:18:43.042 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:18:42 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:18:42.677+0000 7fa69fbef6c0 -1 osd.11 65 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T02:18:43.464 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph osd stat -f json 2026-02-13T02:18:43.588 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:18:43.609 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:43 trial011 ceph-mon[11956]: pgmap v164: 1 pgs: 1 peering; 577 KiB data, 298 MiB used, 7.5 TiB / 7.5 TiB avail; 162 KiB/s, 0 objects/s recovering 2026-02-13T02:18:43.609 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:43 trial011 ceph-mon[11956]: pgmap v165: 1 pgs: 1 peering; 577 KiB data, 298 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T02:18:43.609 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:43 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/3048769510' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-13T02:18:43.609 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:43 trial011 ceph-mon[11956]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial078", "root=default"]}]': finished 2026-02-13T02:18:43.609 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:43 trial011 ceph-mon[11956]: osdmap e65: 12 total, 11 up, 12 in 2026-02-13T02:18:43.609 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:43 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T02:18:43.609 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:43 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T02:18:43.712 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:43.706+0000 7f70907b96c0 1 -- 10.20.193.11:0/1652537817 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f7088110050 msgr2=0x7f70881104c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:43.713 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:43.706+0000 7f70907b96c0 1 --2- 10.20.193.11:0/1652537817 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f7088110050 0x7f70881104c0 secure :-1 s=READY pgs=183 gs=1 cs=0 l=1 c_cookie=9954141392610297649 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f707c009970 tx=0x7f707c02ed20 comp rx=0 tx=0).stop 2026-02-13T02:18:43.713 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:43.706+0000 7f70907b96c0 1 -- 10.20.193.11:0/1652537817 shutdown_connections 2026-02-13T02:18:43.713 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:43.706+0000 7f70907b96c0 1 --2- 10.20.193.11:0/1652537817 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f7088110a00 0x7f7088171390 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:43.713 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:43.706+0000 7f70907b96c0 1 --2- 10.20.193.11:0/1652537817 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f7088110050 0x7f70881104c0 unknown :-1 s=CLOSED pgs=183 gs=1 cs=0 l=1 c_cookie=9954141392610297649 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:43.713 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:43.706+0000 7f70907b96c0 1 --2- 10.20.193.11:0/1652537817 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f708810eed0 0x7f708810f2c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:43.714 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:43.706+0000 7f70907b96c0 1 -- 10.20.193.11:0/1652537817 >> 10.20.193.11:0/1652537817 conn(0x7f70880ec5f0 msgr2=0x7f708810ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:18:43.714 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:43.706+0000 7f70907b96c0 1 -- 10.20.193.11:0/1652537817 shutdown_connections 2026-02-13T02:18:43.714 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:43.706+0000 7f70907b96c0 1 -- 10.20.193.11:0/1652537817 wait complete. 2026-02-13T02:18:43.714 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:43.707+0000 7f70907b96c0 1 Processor -- start 2026-02-13T02:18:43.714 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:43.707+0000 7f70907b96c0 1 -- start start 2026-02-13T02:18:43.714 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:43.707+0000 7f70907b96c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f708810eed0 0x7f70880f9010 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:18:43.714 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:43.707+0000 7f70907b96c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f7088110050 0x7f7088171390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:18:43.714 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:43.707+0000 7f70907b96c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f7088110a00 0x7f70880f9870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:18:43.714 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:43.707+0000 7f70907b96c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f70880fa4a0 con 0x7f7088110050 2026-02-13T02:18:43.714 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:43.707+0000 7f70907b96c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f70880fa610 con 0x7f7088110a00 2026-02-13T02:18:43.714 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:43.707+0000 7f70907b96c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f70880fa7d0 con 0x7f708810eed0 2026-02-13T02:18:43.715 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:43.707+0000 7f708dd296c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f7088110050 0x7f7088171390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:18:43.715 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:43.707+0000 7f708dd296c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f7088110050 0x7f7088171390 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:53176/0 (socket says 10.20.193.11:53176) 2026-02-13T02:18:43.715 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:43.707+0000 7f708dd296c0 1 -- 10.20.193.11:0/209827708 learned_addr learned my addr 10.20.193.11:0/209827708 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:18:43.715 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:43.707+0000 7f708e52a6c0 1 --2- 10.20.193.11:0/209827708 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f708810eed0 0x7f70880f9010 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:18:43.715 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:43.707+0000 7f708ed2b6c0 1 --2- 10.20.193.11:0/209827708 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f7088110a00 0x7f70880f9870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:18:43.715 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:43.707+0000 7f708dd296c0 1 -- 10.20.193.11:0/209827708 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f708810eed0 msgr2=0x7f70880f9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:43.715 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:43.707+0000 7f708dd296c0 1 --2- 10.20.193.11:0/209827708 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f708810eed0 0x7f70880f9010 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:43.715 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:43.707+0000 7f708dd296c0 1 -- 10.20.193.11:0/209827708 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f7088110a00 msgr2=0x7f70880f9870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:43.715 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:43.707+0000 7f708dd296c0 1 --2- 10.20.193.11:0/209827708 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f7088110a00 0x7f70880f9870 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:43.716 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:43.707+0000 7f708dd296c0 1 -- 10.20.193.11:0/209827708 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f707c009590 con 0x7f7088110050 2026-02-13T02:18:43.716 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:43.707+0000 7f708dd296c0 1 --2- 10.20.193.11:0/209827708 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f7088110050 0x7f7088171390 secure :-1 s=READY pgs=184 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f707c009290 tx=0x7f707c004650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:18:43.716 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:43.707+0000 7f706f7fe6c0 1 -- 10.20.193.11:0/209827708 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f707c002ae0 con 0x7f7088110050 2026-02-13T02:18:43.716 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:43.707+0000 7f706f7fe6c0 1 -- 10.20.193.11:0/209827708 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f707c002c40 con 0x7f7088110050 2026-02-13T02:18:43.716 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:43.707+0000 7f706f7fe6c0 1 -- 10.20.193.11:0/209827708 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f707c0373a0 con 0x7f7088110050 2026-02-13T02:18:43.716 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:43.707+0000 7f70907b96c0 1 -- 10.20.193.11:0/209827708 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70880faa50 con 0x7f7088110050 2026-02-13T02:18:43.716 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:43.707+0000 7f70907b96c0 1 -- 10.20.193.11:0/209827708 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70880fae80 con 0x7f7088110050 2026-02-13T02:18:43.716 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:43.708+0000 7f70907b96c0 1 -- 10.20.193.11:0/209827708 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70880fb0a0 con 0x7f7088110050 2026-02-13T02:18:43.716 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:43.709+0000 7f706f7fe6c0 1 -- 10.20.193.11:0/209827708 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 10) ==== 157066+0+0 (secure 0 0 0) 0x7f707c007990 con 0x7f7088110050 2026-02-13T02:18:43.716 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:43.710+0000 7f706f7fe6c0 1 --2- 10.20.193.11:0/209827708 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f70640b5680 0x7f70640d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:18:43.717 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:43.710+0000 7f708e52a6c0 1 --2- 10.20.193.11:0/209827708 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f70640b5680 0x7f70640d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:18:43.717 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:43.710+0000 7f706f7fe6c0 1 -- 10.20.193.11:0/209827708 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6904+0+0 (secure 0 0 0) 0x7f707c1078c0 con 0x7f7088110050 2026-02-13T02:18:43.717 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:43.710+0000 7f708e52a6c0 1 --2- 10.20.193.11:0/209827708 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f70640b5680 0x7f70640d5b30 secure :-1 s=READY pgs=140 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7078005980 tx=0x7f7078005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:18:43.717 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:43.710+0000 7f706f7fe6c0 1 -- 10.20.193.11:0/209827708 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f707c0ca7a0 con 0x7f7088110050 2026-02-13T02:18:43.750 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:43 trial060 ceph-mon[14797]: pgmap v164: 1 pgs: 1 peering; 577 KiB data, 298 MiB used, 7.5 TiB / 7.5 TiB avail; 162 KiB/s, 0 objects/s recovering 2026-02-13T02:18:43.750 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:43 trial060 ceph-mon[14797]: pgmap v165: 1 pgs: 1 peering; 577 KiB data, 298 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T02:18:43.750 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:43 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/3048769510' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-13T02:18:43.750 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:43 trial060 ceph-mon[14797]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial078", "root=default"]}]': finished 2026-02-13T02:18:43.750 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:43 trial060 ceph-mon[14797]: osdmap e65: 12 total, 11 up, 12 in 2026-02-13T02:18:43.750 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:43 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T02:18:43.751 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:43 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T02:18:43.791 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:43 trial078 ceph-mon[14969]: pgmap v164: 1 pgs: 1 peering; 577 KiB data, 298 MiB used, 7.5 TiB / 7.5 TiB avail; 162 KiB/s, 0 objects/s recovering 2026-02-13T02:18:43.791 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:43 trial078 ceph-mon[14969]: pgmap v165: 1 pgs: 1 peering; 577 KiB data, 298 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T02:18:43.792 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:43 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/3048769510' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-13T02:18:43.792 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:43 trial078 ceph-mon[14969]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial078", "root=default"]}]': finished 2026-02-13T02:18:43.792 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:43 trial078 ceph-mon[14969]: osdmap e65: 12 total, 11 up, 12 in 2026-02-13T02:18:43.792 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:43 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T02:18:43.792 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:43 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T02:18:43.803 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:43.800+0000 7f70907b96c0 1 -- 10.20.193.11:0/209827708 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f7088174d20 con 0x7f7088110050 2026-02-13T02:18:43.803 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:43.800+0000 7f706f7fe6c0 1 -- 10.20.193.11:0/209827708 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v66) ==== 74+0+133 (secure 0 0 0) 0x7f707c002db0 con 0x7f7088110050 2026-02-13T02:18:43.803 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:18:43.804 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:43.801+0000 7f70907b96c0 1 -- 10.20.193.11:0/209827708 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f70640b5680 msgr2=0x7f70640d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:43.805 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:43.801+0000 7f70907b96c0 1 --2- 10.20.193.11:0/209827708 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f70640b5680 0x7f70640d5b30 secure :-1 s=READY pgs=140 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7078005980 tx=0x7f7078005910 comp rx=0 tx=0).stop 2026-02-13T02:18:43.805 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:43.801+0000 7f70907b96c0 1 -- 10.20.193.11:0/209827708 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f7088110050 msgr2=0x7f7088171390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:43.805 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:43.801+0000 7f70907b96c0 1 --2- 10.20.193.11:0/209827708 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f7088110050 0x7f7088171390 secure :-1 s=READY pgs=184 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f707c009290 tx=0x7f707c004650 comp rx=0 tx=0).stop 2026-02-13T02:18:43.805 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:43.801+0000 7f70907b96c0 1 -- 10.20.193.11:0/209827708 shutdown_connections 2026-02-13T02:18:43.805 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:43.801+0000 7f70907b96c0 1 --2- 10.20.193.11:0/209827708 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f70640b5680 0x7f70640d5b30 unknown :-1 s=CLOSED pgs=140 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:43.805 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:43.801+0000 7f70907b96c0 1 --2- 10.20.193.11:0/209827708 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f7088110a00 0x7f70880f9870 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:43.805 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:43.801+0000 7f70907b96c0 1 --2- 10.20.193.11:0/209827708 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f7088110050 0x7f7088171390 unknown :-1 s=CLOSED pgs=184 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:43.805 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:43.801+0000 7f70907b96c0 1 --2- 10.20.193.11:0/209827708 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f708810eed0 0x7f70880f9010 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:43.805 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:43.801+0000 7f70907b96c0 1 -- 10.20.193.11:0/209827708 >> 10.20.193.11:0/209827708 conn(0x7f70880ec5f0 msgr2=0x7f70880ef520 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:18:43.805 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:43.801+0000 7f70907b96c0 1 -- 10.20.193.11:0/209827708 shutdown_connections 2026-02-13T02:18:43.806 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:43.801+0000 7f70907b96c0 1 -- 10.20.193.11:0/209827708 wait complete. 2026-02-13T02:18:43.842 INFO:teuthology.orchestra.run.trial011.stdout:{"epoch":66,"num_osds":12,"num_up_osds":12,"osd_up_since":1770949123,"num_in_osds":12,"osd_in_since":1770949115,"num_remapped_pgs":0} 2026-02-13T02:18:43.843 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph osd dump --format=json 2026-02-13T02:18:43.965 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:18:44.083 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.078+0000 7f2ddabd86c0 1 -- 10.20.193.11:0/1947071587 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f2dd41131c0 msgr2=0x7f2dd4173b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:44.084 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.078+0000 7f2ddabd86c0 1 --2- 10.20.193.11:0/1947071587 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f2dd41131c0 0x7f2dd4173b60 secure :-1 s=READY pgs=185 gs=1 cs=0 l=1 c_cookie=2306551971054578458 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2dd000aa70 tx=0x7f2dd002fde0 comp rx=0 tx=0).stop 2026-02-13T02:18:44.084 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.078+0000 7f2ddabd86c0 1 -- 10.20.193.11:0/1947071587 shutdown_connections 2026-02-13T02:18:44.084 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.078+0000 7f2ddabd86c0 1 --2- 10.20.193.11:0/1947071587 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f2dd41131c0 0x7f2dd4173b60 unknown :-1 s=CLOSED pgs=185 gs=1 cs=0 l=1 c_cookie=2306551971054578458 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:44.084 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.078+0000 7f2ddabd86c0 1 --2- 10.20.193.11:0/1947071587 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f2dd410d9a0 0x7f2dd41129e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:44.084 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.078+0000 7f2ddabd86c0 1 --2- 10.20.193.11:0/1947071587 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f2dd410cfb0 0x7f2dd410d380 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:44.084 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.078+0000 7f2ddabd86c0 1 -- 10.20.193.11:0/1947071587 >> 10.20.193.11:0/1947071587 conn(0x7f2dd40ea8b0 msgr2=0x7f2dd410acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:18:44.084 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.078+0000 7f2ddabd86c0 1 -- 10.20.193.11:0/1947071587 shutdown_connections 2026-02-13T02:18:44.084 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.078+0000 7f2ddabd86c0 1 -- 10.20.193.11:0/1947071587 wait complete. 2026-02-13T02:18:44.084 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.078+0000 7f2ddabd86c0 1 Processor -- start 2026-02-13T02:18:44.084 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.078+0000 7f2ddabd86c0 1 -- start start 2026-02-13T02:18:44.085 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.078+0000 7f2ddabd86c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f2dd410cfb0 0x7f2dd411af70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:18:44.085 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.078+0000 7f2ddabd86c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f2dd41131c0 0x7f2dd411b4b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:18:44.085 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.078+0000 7f2ddabd86c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f2dd4120870 0x7f2dd4120d10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:18:44.085 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.078+0000 7f2ddabd86c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f2dd4121280 con 0x7f2dd4120870 2026-02-13T02:18:44.085 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.078+0000 7f2ddabd86c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f2dd41213f0 con 0x7f2dd41131c0 2026-02-13T02:18:44.085 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.078+0000 7f2ddabd86c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f2dd41215b0 con 0x7f2dd410cfb0 2026-02-13T02:18:44.085 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.078+0000 7f2dd914a6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f2dd4120870 0x7f2dd4120d10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:18:44.085 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.078+0000 7f2dd914a6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f2dd4120870 0x7f2dd4120d10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:53194/0 (socket says 10.20.193.11:53194) 2026-02-13T02:18:44.085 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.078+0000 7f2dd914a6c0 1 -- 10.20.193.11:0/2836222519 learned_addr learned my addr 10.20.193.11:0/2836222519 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:18:44.086 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.079+0000 7f2dd89496c0 1 --2- 10.20.193.11:0/2836222519 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f2dd410cfb0 0x7f2dd411af70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:18:44.086 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.079+0000 7f2dcbfff6c0 1 --2- 10.20.193.11:0/2836222519 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f2dd41131c0 0x7f2dd411b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:18:44.086 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.079+0000 7f2dd914a6c0 1 -- 10.20.193.11:0/2836222519 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f2dd410cfb0 msgr2=0x7f2dd411af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:44.086 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.079+0000 7f2dd914a6c0 1 --2- 10.20.193.11:0/2836222519 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f2dd410cfb0 0x7f2dd411af70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:44.086 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.079+0000 7f2dd914a6c0 1 -- 10.20.193.11:0/2836222519 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f2dd41131c0 msgr2=0x7f2dd411b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:44.086 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.079+0000 7f2dd914a6c0 1 --2- 10.20.193.11:0/2836222519 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f2dd41131c0 0x7f2dd411b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:44.086 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.079+0000 7f2dd914a6c0 1 -- 10.20.193.11:0/2836222519 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dd000a660 con 0x7f2dd4120870 2026-02-13T02:18:44.086 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.079+0000 7f2dd89496c0 1 --2- 10.20.193.11:0/2836222519 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f2dd410cfb0 0x7f2dd411af70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T02:18:44.086 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.079+0000 7f2dd914a6c0 1 --2- 10.20.193.11:0/2836222519 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f2dd4120870 0x7f2dd4120d10 secure :-1 s=READY pgs=186 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2dd00054b0 tx=0x7f2dd00054e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:18:44.087 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.079+0000 7f2dc9ffb6c0 1 -- 10.20.193.11:0/2836222519 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2dd0003a30 con 0x7f2dd4120870 2026-02-13T02:18:44.087 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.079+0000 7f2dc9ffb6c0 1 -- 10.20.193.11:0/2836222519 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2dd0003b90 con 0x7f2dd4120870 2026-02-13T02:18:44.087 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.079+0000 7f2dc9ffb6c0 1 -- 10.20.193.11:0/2836222519 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2dd00382f0 con 0x7f2dd4120870 2026-02-13T02:18:44.087 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.079+0000 7f2ddabd86c0 1 -- 10.20.193.11:0/2836222519 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2dd40605e0 con 0x7f2dd4120870 2026-02-13T02:18:44.087 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.079+0000 7f2ddabd86c0 1 -- 10.20.193.11:0/2836222519 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2dd4060a10 con 0x7f2dd4120870 2026-02-13T02:18:44.087 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.079+0000 7f2ddabd86c0 1 -- 10.20.193.11:0/2836222519 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2dd410e280 con 0x7f2dd4120870 2026-02-13T02:18:44.087 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.081+0000 7f2dc9ffb6c0 1 -- 10.20.193.11:0/2836222519 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 10) ==== 157066+0+0 (secure 0 0 0) 0x7f2dd0008350 con 0x7f2dd4120870 2026-02-13T02:18:44.088 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.081+0000 7f2dc9ffb6c0 1 --2- 10.20.193.11:0/2836222519 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f2db00b5600 0x7f2db00d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:18:44.088 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.081+0000 7f2dc9ffb6c0 1 -- 10.20.193.11:0/2836222519 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6904+0+0 (secure 0 0 0) 0x7f2dd0108940 con 0x7f2dd4120870 2026-02-13T02:18:44.089 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.081+0000 7f2dd89496c0 1 --2- 10.20.193.11:0/2836222519 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f2db00b5600 0x7f2db00d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:18:44.089 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.081+0000 7f2dd89496c0 1 --2- 10.20.193.11:0/2836222519 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f2db00b5600 0x7f2db00d5ab0 secure :-1 s=READY pgs=141 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2dc4004750 tx=0x7f2dc4009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:18:44.089 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.082+0000 7f2dc9ffb6c0 1 -- 10.20.193.11:0/2836222519 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f2dd00cb860 con 0x7f2dd4120870 2026-02-13T02:18:44.177 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.174+0000 7f2ddabd86c0 1 -- 10.20.193.11:0/2836222519 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2dd411c0c0 con 0x7f2dd4120870 2026-02-13T02:18:44.178 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.175+0000 7f2dc9ffb6c0 1 -- 10.20.193.11:0/2836222519 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) ==== 74+0+17978 (secure 0 0 0) 0x7f2dd00cea10 con 0x7f2dd4120870 2026-02-13T02:18:44.178 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:18:44.179 INFO:teuthology.orchestra.run.trial011.stdout:{"epoch":66,"fsid":"fc631695-0881-11f1-899c-d404e6e7d460","created":"2026-02-13T02:16:35.175761+0000","modified":"2026-02-13T02:18:43.665240+0000","last_up_change":"2026-02-13T02:18:43.665240+0000","last_in_change":"2026-02-13T02:18:35.014003+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-13T02:17:39.931888+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb9a005b-9a16-4fda-95c0-d23831f0cffc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6802","nonce":1061379396},{"type":"v1","addr":"10.20.193.11:6803","nonce":1061379396}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6804","nonce":1061379396},{"type":"v1","addr":"10.20.193.11:6805","nonce":1061379396}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6808","nonce":1061379396},{"type":"v1","addr":"10.20.193.11:6809","nonce":1061379396}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6806","nonce":1061379396},{"type":"v1","addr":"10.20.193.11:6807","nonce":1061379396}]},"public_addr":"10.20.193.11:6803/1061379396","cluster_addr":"10.20.193.11:6805/1061379396","heartbeat_back_addr":"10.20.193.11:6809/1061379396","heartbeat_front_addr":"10.20.193.11:6807/1061379396","state":["exists","up"]},{"osd":1,"uuid":"c1786ae4-a736-47b0-8302-b06423efd012","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6800","nonce":2198425396},{"type":"v1","addr":"10.20.193.60:6801","nonce":2198425396}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6802","nonce":2198425396},{"type":"v1","addr":"10.20.193.60:6803","nonce":2198425396}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6806","nonce":2198425396},{"type":"v1","addr":"10.20.193.60:6807","nonce":2198425396}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6804","nonce":2198425396},{"type":"v1","addr":"10.20.193.60:6805","nonce":2198425396}]},"public_addr":"10.20.193.60:6801/2198425396","cluster_addr":"10.20.193.60:6803/2198425396","heartbeat_back_addr":"10.20.193.60:6807/2198425396","heartbeat_front_addr":"10.20.193.60:6805/2198425396","state":["exists","up"]},{"osd":2,"uuid":"516f1aa0-bc7c-4808-8ac8-4ff406c71890","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6800","nonce":3723638526},{"type":"v1","addr":"10.20.193.78:6801","nonce":3723638526}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6802","nonce":3723638526},{"type":"v1","addr":"10.20.193.78:6803","nonce":3723638526}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6806","nonce":3723638526},{"type":"v1","addr":"10.20.193.78:6807","nonce":3723638526}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6804","nonce":3723638526},{"type":"v1","addr":"10.20.193.78:6805","nonce":3723638526}]},"public_addr":"10.20.193.78:6801/3723638526","cluster_addr":"10.20.193.78:6803/3723638526","heartbeat_back_addr":"10.20.193.78:6807/3723638526","heartbeat_front_addr":"10.20.193.78:6805/3723638526","state":["exists","up"]},{"osd":3,"uuid":"8cf508c2-b05d-42be-92e3-db0a57d22a85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6810","nonce":4224399876},{"type":"v1","addr":"10.20.193.11:6811","nonce":4224399876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6812","nonce":4224399876},{"type":"v1","addr":"10.20.193.11:6813","nonce":4224399876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6816","nonce":4224399876},{"type":"v1","addr":"10.20.193.11:6817","nonce":4224399876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6814","nonce":4224399876},{"type":"v1","addr":"10.20.193.11:6815","nonce":4224399876}]},"public_addr":"10.20.193.11:6811/4224399876","cluster_addr":"10.20.193.11:6813/4224399876","heartbeat_back_addr":"10.20.193.11:6817/4224399876","heartbeat_front_addr":"10.20.193.11:6815/4224399876","state":["exists","up"]},{"osd":4,"uuid":"abf31616-2588-43c1-b15a-7f703ae8e1c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":28,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6808","nonce":3289387254},{"type":"v1","addr":"10.20.193.60:6809","nonce":3289387254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6810","nonce":3289387254},{"type":"v1","addr":"10.20.193.60:6811","nonce":3289387254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6814","nonce":3289387254},{"type":"v1","addr":"10.20.193.60:6815","nonce":3289387254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6812","nonce":3289387254},{"type":"v1","addr":"10.20.193.60:6813","nonce":3289387254}]},"public_addr":"10.20.193.60:6809/3289387254","cluster_addr":"10.20.193.60:6811/3289387254","heartbeat_back_addr":"10.20.193.60:6815/3289387254","heartbeat_front_addr":"10.20.193.60:6813/3289387254","state":["exists","up"]},{"osd":5,"uuid":"70c3d0b0-8e3d-4432-87e2-bb5391cf0167","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6808","nonce":3975711592},{"type":"v1","addr":"10.20.193.78:6809","nonce":3975711592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6810","nonce":3975711592},{"type":"v1","addr":"10.20.193.78:6811","nonce":3975711592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6814","nonce":3975711592},{"type":"v1","addr":"10.20.193.78:6815","nonce":3975711592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6812","nonce":3975711592},{"type":"v1","addr":"10.20.193.78:6813","nonce":3975711592}]},"public_addr":"10.20.193.78:6809/3975711592","cluster_addr":"10.20.193.78:6811/3975711592","heartbeat_back_addr":"10.20.193.78:6815/3975711592","heartbeat_front_addr":"10.20.193.78:6813/3975711592","state":["exists","up"]},{"osd":6,"uuid":"bc1293b8-53e6-4386-b02b-31ca7030976d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6818","nonce":2393344644},{"type":"v1","addr":"10.20.193.11:6819","nonce":2393344644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6820","nonce":2393344644},{"type":"v1","addr":"10.20.193.11:6821","nonce":2393344644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6824","nonce":2393344644},{"type":"v1","addr":"10.20.193.11:6825","nonce":2393344644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6822","nonce":2393344644},{"type":"v1","addr":"10.20.193.11:6823","nonce":2393344644}]},"public_addr":"10.20.193.11:6819/2393344644","cluster_addr":"10.20.193.11:6821/2393344644","heartbeat_back_addr":"10.20.193.11:6825/2393344644","heartbeat_front_addr":"10.20.193.11:6823/2393344644","state":["exists","up"]},{"osd":7,"uuid":"da596d81-14dc-403b-9a20-90a7587da04c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6816","nonce":2908560893},{"type":"v1","addr":"10.20.193.60:6817","nonce":2908560893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6818","nonce":2908560893},{"type":"v1","addr":"10.20.193.60:6819","nonce":2908560893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6822","nonce":2908560893},{"type":"v1","addr":"10.20.193.60:6823","nonce":2908560893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6820","nonce":2908560893},{"type":"v1","addr":"10.20.193.60:6821","nonce":2908560893}]},"public_addr":"10.20.193.60:6817/2908560893","cluster_addr":"10.20.193.60:6819/2908560893","heartbeat_back_addr":"10.20.193.60:6823/2908560893","heartbeat_front_addr":"10.20.193.60:6821/2908560893","state":["exists","up"]},{"osd":8,"uuid":"24098987-9f02-4f06-b93e-8af84291cc82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6816","nonce":242640323},{"type":"v1","addr":"10.20.193.78:6817","nonce":242640323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6818","nonce":242640323},{"type":"v1","addr":"10.20.193.78:6819","nonce":242640323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6822","nonce":242640323},{"type":"v1","addr":"10.20.193.78:6823","nonce":242640323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6820","nonce":242640323},{"type":"v1","addr":"10.20.193.78:6821","nonce":242640323}]},"public_addr":"10.20.193.78:6817/242640323","cluster_addr":"10.20.193.78:6819/242640323","heartbeat_back_addr":"10.20.193.78:6823/242640323","heartbeat_front_addr":"10.20.193.78:6821/242640323","state":["exists","up"]},{"osd":9,"uuid":"25cd90dd-8e86-4ac1-a693-a4080b035da1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6826","nonce":132317204},{"type":"v1","addr":"10.20.193.11:6827","nonce":132317204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6828","nonce":132317204},{"type":"v1","addr":"10.20.193.11:6829","nonce":132317204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6832","nonce":132317204},{"type":"v1","addr":"10.20.193.11:6833","nonce":132317204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6830","nonce":132317204},{"type":"v1","addr":"10.20.193.11:6831","nonce":132317204}]},"public_addr":"10.20.193.11:6827/132317204","cluster_addr":"10.20.193.11:6829/132317204","heartbeat_back_addr":"10.20.193.11:6833/132317204","heartbeat_front_addr":"10.20.193.11:6831/132317204","state":["exists","up"]},{"osd":10,"uuid":"727f51ff-9428-44ae-a69a-0f555f1397ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6824","nonce":3534951144},{"type":"v1","addr":"10.20.193.60:6825","nonce":3534951144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6826","nonce":3534951144},{"type":"v1","addr":"10.20.193.60:6827","nonce":3534951144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6830","nonce":3534951144},{"type":"v1","addr":"10.20.193.60:6831","nonce":3534951144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6828","nonce":3534951144},{"type":"v1","addr":"10.20.193.60:6829","nonce":3534951144}]},"public_addr":"10.20.193.60:6825/3534951144","cluster_addr":"10.20.193.60:6827/3534951144","heartbeat_back_addr":"10.20.193.60:6831/3534951144","heartbeat_front_addr":"10.20.193.60:6829/3534951144","state":["exists","up"]},{"osd":11,"uuid":"03e11d54-a857-418b-8ac1-c8d7a9a23305","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6824","nonce":537170494},{"type":"v1","addr":"10.20.193.78:6825","nonce":537170494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6826","nonce":537170494},{"type":"v1","addr":"10.20.193.78:6827","nonce":537170494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6830","nonce":537170494},{"type":"v1","addr":"10.20.193.78:6831","nonce":537170494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6828","nonce":537170494},{"type":"v1","addr":"10.20.193.78:6829","nonce":537170494}]},"public_addr":"10.20.193.78:6825/537170494","cluster_addr":"10.20.193.78:6827/537170494","heartbeat_back_addr":"10.20.193.78:6831/537170494","heartbeat_front_addr":"10.20.193.78:6829/537170494","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:17:29.302695+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:17:36.305494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:17:51.095807+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:17:58.083703+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:18:12.357395+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:18:19.659255+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:18:34.465790+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.11:0/1644541112":"2026-02-14T02:16:41.426146+0000","10.20.193.11:0/1423851105":"2026-02-14T02:16:41.426146+0000","10.20.193.11:0/1602612884":"2026-02-14T02:16:41.426146+0000","10.20.193.11:6801/2469571860":"2026-02-14T02:16:41.426146+0000","10.20.193.11:6800/2469571860":"2026-02-14T02:16:41.426146+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-13T02:18:44.180 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.176+0000 7f2ddabd86c0 1 -- 10.20.193.11:0/2836222519 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f2db00b5600 msgr2=0x7f2db00d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:44.180 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.176+0000 7f2ddabd86c0 1 --2- 10.20.193.11:0/2836222519 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f2db00b5600 0x7f2db00d5ab0 secure :-1 s=READY pgs=141 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2dc4004750 tx=0x7f2dc4009260 comp rx=0 tx=0).stop 2026-02-13T02:18:44.180 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.176+0000 7f2ddabd86c0 1 -- 10.20.193.11:0/2836222519 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f2dd4120870 msgr2=0x7f2dd4120d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:44.180 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.176+0000 7f2ddabd86c0 1 --2- 10.20.193.11:0/2836222519 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f2dd4120870 0x7f2dd4120d10 secure :-1 s=READY pgs=186 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2dd00054b0 tx=0x7f2dd00054e0 comp rx=0 tx=0).stop 2026-02-13T02:18:44.180 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.176+0000 7f2ddabd86c0 1 -- 10.20.193.11:0/2836222519 shutdown_connections 2026-02-13T02:18:44.180 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.176+0000 7f2ddabd86c0 1 --2- 10.20.193.11:0/2836222519 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f2db00b5600 0x7f2db00d5ab0 unknown :-1 s=CLOSED pgs=141 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:44.180 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.176+0000 7f2ddabd86c0 1 --2- 10.20.193.11:0/2836222519 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f2dd41131c0 0x7f2dd411b4b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:44.181 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.176+0000 7f2ddabd86c0 1 --2- 10.20.193.11:0/2836222519 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f2dd4120870 0x7f2dd4120d10 unknown :-1 s=CLOSED pgs=186 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:44.181 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.176+0000 7f2ddabd86c0 1 --2- 10.20.193.11:0/2836222519 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f2dd410cfb0 0x7f2dd411af70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:44.181 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.176+0000 7f2ddabd86c0 1 -- 10.20.193.11:0/2836222519 >> 10.20.193.11:0/2836222519 conn(0x7f2dd40ea8b0 msgr2=0x7f2dd410ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:18:44.181 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.176+0000 7f2ddabd86c0 1 -- 10.20.193.11:0/2836222519 shutdown_connections 2026-02-13T02:18:44.181 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.176+0000 7f2ddabd86c0 1 -- 10.20.193.11:0/2836222519 wait complete. 2026-02-13T02:18:44.217 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2026-02-13T02:17:39.931888+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'nonprimary_shards': '{}', 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2026-02-13T02:18:44.218 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph osd pool get .mgr pg_num 2026-02-13T02:18:44.339 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:18:44.455 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.451+0000 7fb0ba8a46c0 1 -- 10.20.193.11:0/507033262 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fb0b410fbf0 msgr2=0x7fb0b4114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:44.455 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.451+0000 7fb0ba8a46c0 1 --2- 10.20.193.11:0/507033262 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fb0b410fbf0 0x7fb0b4114c30 secure :-1 s=READY pgs=187 gs=1 cs=0 l=1 c_cookie=10940551845879509070 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb0a40099a0 tx=0x7fb0a402ed20 comp rx=0 tx=0).stop 2026-02-13T02:18:44.455 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.451+0000 7fb0ba8a46c0 1 -- 10.20.193.11:0/507033262 shutdown_connections 2026-02-13T02:18:44.455 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.451+0000 7fb0ba8a46c0 1 --2- 10.20.193.11:0/507033262 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb0b4115410 0x7fb0b4175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:44.455 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.451+0000 7fb0ba8a46c0 1 --2- 10.20.193.11:0/507033262 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fb0b410fbf0 0x7fb0b4114c30 unknown :-1 s=CLOSED pgs=187 gs=1 cs=0 l=1 c_cookie=10940551845879509070 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:44.456 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.451+0000 7fb0ba8a46c0 1 --2- 10.20.193.11:0/507033262 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fb0b410f200 0x7fb0b410f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:44.456 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.451+0000 7fb0ba8a46c0 1 -- 10.20.193.11:0/507033262 >> 10.20.193.11:0/507033262 conn(0x7fb0b40ecb00 msgr2=0x7fb0b410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:18:44.456 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.452+0000 7fb0ba8a46c0 1 -- 10.20.193.11:0/507033262 shutdown_connections 2026-02-13T02:18:44.456 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.452+0000 7fb0ba8a46c0 1 -- 10.20.193.11:0/507033262 wait complete. 2026-02-13T02:18:44.456 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.452+0000 7fb0ba8a46c0 1 Processor -- start 2026-02-13T02:18:44.456 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.452+0000 7fb0ba8a46c0 1 -- start start 2026-02-13T02:18:44.456 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.452+0000 7fb0ba8a46c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fb0b410f200 0x7fb0b40f4bd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:18:44.456 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.452+0000 7fb0ba8a46c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fb0b4115410 0x7fb0b4175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:18:44.456 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.452+0000 7fb0ba8a46c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb0b40f5200 0x7fb0b40fa4d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:18:44.456 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.452+0000 7fb0ba8a46c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7fb0b40f58f0 con 0x7fb0b4115410 2026-02-13T02:18:44.456 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.452+0000 7fb0ba8a46c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb0b40faa10 con 0x7fb0b410f200 2026-02-13T02:18:44.456 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.452+0000 7fb0ba8a46c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fb0b40fabd0 con 0x7fb0b40f5200 2026-02-13T02:18:44.456 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.452+0000 7fb0b37fe6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fb0b4115410 0x7fb0b4175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:18:44.456 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.452+0000 7fb0b37fe6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fb0b4115410 0x7fb0b4175cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:53222/0 (socket says 10.20.193.11:53222) 2026-02-13T02:18:44.456 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.452+0000 7fb0b37fe6c0 1 -- 10.20.193.11:0/3214054594 learned_addr learned my addr 10.20.193.11:0/3214054594 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:18:44.456 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.452+0000 7fb0b3fff6c0 1 --2- 10.20.193.11:0/3214054594 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fb0b410f200 0x7fb0b40f4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:18:44.456 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.452+0000 7fb0b37fe6c0 1 -- 10.20.193.11:0/3214054594 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb0b40f5200 msgr2=0x7fb0b40fa4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:44.456 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.452+0000 7fb0b37fe6c0 1 --2- 10.20.193.11:0/3214054594 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb0b40f5200 0x7fb0b40fa4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:44.456 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.452+0000 7fb0b37fe6c0 1 -- 10.20.193.11:0/3214054594 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fb0b410f200 msgr2=0x7fb0b40f4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:44.456 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.452+0000 7fb0b37fe6c0 1 --2- 10.20.193.11:0/3214054594 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fb0b410f200 0x7fb0b40f4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:44.456 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.452+0000 7fb0b37fe6c0 1 -- 10.20.193.11:0/3214054594 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0a4009590 con 0x7fb0b4115410 2026-02-13T02:18:44.456 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.452+0000 7fb0b37fe6c0 1 --2- 10.20.193.11:0/3214054594 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fb0b4115410 0x7fb0b4175cb0 secure :-1 s=READY pgs=188 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb0a4031f90 tx=0x7fb0a40047f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:18:44.456 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.452+0000 7fb0b17fa6c0 1 -- 10.20.193.11:0/3214054594 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb0a4002ae0 con 0x7fb0b4115410 2026-02-13T02:18:44.456 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.452+0000 7fb0ba8a46c0 1 -- 10.20.193.11:0/3214054594 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0b40fae50 con 0x7fb0b4115410 2026-02-13T02:18:44.457 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.452+0000 7fb0b17fa6c0 1 -- 10.20.193.11:0/3214054594 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb0a4007740 con 0x7fb0b4115410 2026-02-13T02:18:44.457 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.452+0000 7fb0b17fa6c0 1 -- 10.20.193.11:0/3214054594 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb0a4031560 con 0x7fb0b4115410 2026-02-13T02:18:44.457 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.452+0000 7fb0ba8a46c0 1 -- 10.20.193.11:0/3214054594 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0b40fb2d0 con 0x7fb0b4115410 2026-02-13T02:18:44.457 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.453+0000 7fb0ba8a46c0 1 -- 10.20.193.11:0/3214054594 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0b41104d0 con 0x7fb0b4115410 2026-02-13T02:18:44.457 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.454+0000 7fb0b17fa6c0 1 -- 10.20.193.11:0/3214054594 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 10) ==== 157066+0+0 (secure 0 0 0) 0x7fb0a4002c40 con 0x7fb0b4115410 2026-02-13T02:18:44.457 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.455+0000 7fb0b17fa6c0 1 --2- 10.20.193.11:0/3214054594 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fb0880b5600 0x7fb0880d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:18:44.457 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.455+0000 7fb0b17fa6c0 1 -- 10.20.193.11:0/3214054594 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6904+0+0 (secure 0 0 0) 0x7fb0a41078d0 con 0x7fb0b4115410 2026-02-13T02:18:44.457 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.455+0000 7fb0b3fff6c0 1 --2- 10.20.193.11:0/3214054594 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fb0880b5600 0x7fb0880d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:18:44.458 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.455+0000 7fb0b3fff6c0 1 --2- 10.20.193.11:0/3214054594 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fb0880b5600 0x7fb0880d5ab0 secure :-1 s=READY pgs=142 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb0a0005980 tx=0x7fb0a0005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:18:44.458 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.455+0000 7fb0b17fa6c0 1 -- 10.20.193.11:0/3214054594 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fb0a40ca7b0 con 0x7fb0b4115410 2026-02-13T02:18:44.551 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.547+0000 7fb0ba8a46c0 1 -- 10.20.193.11:0/3214054594 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fb0b410fbf0 con 0x7fb0b4115410 2026-02-13T02:18:44.551 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.548+0000 7fb0b17fa6c0 1 -- 10.20.193.11:0/3214054594 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v66) ==== 93+0+10 (secure 0 0 0) 0x7fb0a40cd960 con 0x7fb0b4115410 2026-02-13T02:18:44.551 INFO:teuthology.orchestra.run.trial011.stdout:pg_num: 1 2026-02-13T02:18:44.552 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.549+0000 7fb0ba8a46c0 1 -- 10.20.193.11:0/3214054594 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fb0880b5600 msgr2=0x7fb0880d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:44.552 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.549+0000 7fb0ba8a46c0 1 --2- 10.20.193.11:0/3214054594 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fb0880b5600 0x7fb0880d5ab0 secure :-1 s=READY pgs=142 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb0a0005980 tx=0x7fb0a0005910 comp rx=0 tx=0).stop 2026-02-13T02:18:44.553 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.549+0000 7fb0ba8a46c0 1 -- 10.20.193.11:0/3214054594 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fb0b4115410 msgr2=0x7fb0b4175cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:44.553 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.549+0000 7fb0ba8a46c0 1 --2- 10.20.193.11:0/3214054594 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fb0b4115410 0x7fb0b4175cb0 secure :-1 s=READY pgs=188 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb0a4031f90 tx=0x7fb0a40047f0 comp rx=0 tx=0).stop 2026-02-13T02:18:44.553 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.549+0000 7fb0ba8a46c0 1 -- 10.20.193.11:0/3214054594 shutdown_connections 2026-02-13T02:18:44.553 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.549+0000 7fb0ba8a46c0 1 --2- 10.20.193.11:0/3214054594 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fb0880b5600 0x7fb0880d5ab0 unknown :-1 s=CLOSED pgs=142 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:44.553 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.549+0000 7fb0ba8a46c0 1 --2- 10.20.193.11:0/3214054594 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb0b40f5200 0x7fb0b40fa4d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:44.553 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.549+0000 7fb0ba8a46c0 1 --2- 10.20.193.11:0/3214054594 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fb0b4115410 0x7fb0b4175cb0 unknown :-1 s=CLOSED pgs=188 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:44.553 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.549+0000 7fb0ba8a46c0 1 --2- 10.20.193.11:0/3214054594 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fb0b410f200 0x7fb0b40f4bd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:44.553 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.549+0000 7fb0ba8a46c0 1 -- 10.20.193.11:0/3214054594 >> 10.20.193.11:0/3214054594 conn(0x7fb0b40ecb00 msgr2=0x7fb0b410d800 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:18:44.553 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.549+0000 7fb0ba8a46c0 1 -- 10.20.193.11:0/3214054594 shutdown_connections 2026-02-13T02:18:44.553 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:44.549+0000 7fb0ba8a46c0 1 -- 10.20.193.11:0/3214054594 wait complete. 2026-02-13T02:18:44.589 INFO:tasks.cephadm:Adding mds.a on trial011 2026-02-13T02:18:44.589 INFO:tasks.cephadm:Adding mds.d on trial011 2026-02-13T02:18:44.589 INFO:tasks.cephadm:Adding mds.g on trial011 2026-02-13T02:18:44.589 INFO:tasks.cephadm:Adding mds.j on trial011 2026-02-13T02:18:44.590 INFO:tasks.cephadm:Adding mds.b on trial060 2026-02-13T02:18:44.590 INFO:tasks.cephadm:Adding mds.e on trial060 2026-02-13T02:18:44.590 INFO:tasks.cephadm:Adding mds.h on trial060 2026-02-13T02:18:44.590 INFO:tasks.cephadm:Adding mds.k on trial060 2026-02-13T02:18:44.590 INFO:tasks.cephadm:Adding mds.c on trial078 2026-02-13T02:18:44.590 INFO:tasks.cephadm:Adding mds.f on trial078 2026-02-13T02:18:44.590 INFO:tasks.cephadm:Adding mds.i on trial078 2026-02-13T02:18:44.590 INFO:tasks.cephadm:Adding mds.l on trial078 2026-02-13T02:18:44.590 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph orch apply mds all '12;trial011=a;trial011=d;trial011=g;trial011=j;trial060=b;trial060=e;trial060=h;trial060=k;trial078=c;trial078=f;trial078=i;trial078=l' 2026-02-13T02:18:44.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:44 trial011 ceph-mon[11956]: purged_snaps scrub starts 2026-02-13T02:18:44.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:44 trial011 ceph-mon[11956]: purged_snaps scrub ok 2026-02-13T02:18:44.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:44 trial011 ceph-mon[11956]: osd.11 [v2:10.20.193.78:6824/537170494,v1:10.20.193.78:6825/537170494] boot 2026-02-13T02:18:44.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:44 trial011 ceph-mon[11956]: osdmap e66: 12 total, 12 up, 12 in 2026-02-13T02:18:44.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:44 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T02:18:44.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:44 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/209827708' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-13T02:18:44.703 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:44 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/2836222519' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T02:18:44.703 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:44 trial011 ceph-mon[11956]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T02:18:44.703 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:44 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/3214054594' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2026-02-13T02:18:44.718 INFO:teuthology.orchestra.run.trial078.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.c/config 2026-02-13T02:18:44.839 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:44.834+0000 7f3f6bb1c6c0 1 -- 10.20.193.78:0/1876431304 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f3f6410ddd0 msgr2=0x7f3f6410e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:44.839 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:44.834+0000 7f3f6bb1c6c0 1 --2- 10.20.193.78:0/1876431304 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f3f6410ddd0 0x7f3f6410e240 secure :-1 s=READY pgs=47 gs=1 cs=0 l=1 c_cookie=15631789533935198817 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3f58009970 tx=0x7f3f5802ed20 comp rx=0 tx=0).stop 2026-02-13T02:18:44.839 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:44.834+0000 7f3f6bb1c6c0 1 -- 10.20.193.78:0/1876431304 shutdown_connections 2026-02-13T02:18:44.839 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:44.834+0000 7f3f6bb1c6c0 1 --2- 10.20.193.78:0/1876431304 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f3f6410e780 0x7f3f6416f110 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:44.839 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:44.834+0000 7f3f6bb1c6c0 1 --2- 10.20.193.78:0/1876431304 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f3f6410ddd0 0x7f3f6410e240 unknown :-1 s=CLOSED pgs=47 gs=1 cs=0 l=1 c_cookie=15631789533935198817 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:44.839 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:44.834+0000 7f3f6bb1c6c0 1 --2- 10.20.193.78:0/1876431304 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f3f6410cc50 0x7f3f6410d040 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:44.839 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:44.834+0000 7f3f6bb1c6c0 1 -- 10.20.193.78:0/1876431304 >> 10.20.193.78:0/1876431304 conn(0x7f3f640ea370 msgr2=0x7f3f6410a780 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:18:44.839 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:44.834+0000 7f3f6bb1c6c0 1 -- 10.20.193.78:0/1876431304 shutdown_connections 2026-02-13T02:18:44.840 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:44.834+0000 7f3f6bb1c6c0 1 -- 10.20.193.78:0/1876431304 wait complete. 2026-02-13T02:18:44.840 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:44.834+0000 7f3f6bb1c6c0 1 Processor -- start 2026-02-13T02:18:44.840 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:44.834+0000 7f3f6bb1c6c0 1 -- start start 2026-02-13T02:18:44.840 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:44.834+0000 7f3f6bb1c6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f3f6410cc50 0x7f3f640f6340 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:18:44.840 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:44.834+0000 7f3f6bb1c6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f3f6410ddd0 0x7f3f6416f110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:18:44.840 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:44.834+0000 7f3f6bb1c6c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f3f6410e780 0x7f3f640f6ba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:18:44.840 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:44.834+0000 7f3f6bb1c6c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f3f640f7780 con 0x7f3f6410ddd0 2026-02-13T02:18:44.840 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:44.834+0000 7f3f6bb1c6c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f3f640f78f0 con 0x7f3f6410e780 2026-02-13T02:18:44.840 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:44.834+0000 7f3f6bb1c6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f3f640f7ab0 con 0x7f3f6410cc50 2026-02-13T02:18:44.840 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:44.834+0000 7f3f698916c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f3f6410cc50 0x7f3f640f6340 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:18:44.840 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:44.834+0000 7f3f698916c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f3f6410cc50 0x7f3f640f6340 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.78:3300/0 says I am v2:10.20.193.78:43512/0 (socket says 10.20.193.78:43512) 2026-02-13T02:18:44.841 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:44.834+0000 7f3f698916c0 1 -- 10.20.193.78:0/1078325431 learned_addr learned my addr 10.20.193.78:0/1078325431 (peer_addr_for_me v2:10.20.193.78:0/0) 2026-02-13T02:18:44.841 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:44.834+0000 7f3f6a0926c0 1 --2- 10.20.193.78:0/1078325431 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f3f6410e780 0x7f3f640f6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:18:44.841 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:44.835+0000 7f3f690906c0 1 --2- 10.20.193.78:0/1078325431 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f3f6410ddd0 0x7f3f6416f110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:18:44.841 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:44.835+0000 7f3f698916c0 1 -- 10.20.193.78:0/1078325431 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f3f6410e780 msgr2=0x7f3f640f6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:44.841 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:44.835+0000 7f3f698916c0 1 --2- 10.20.193.78:0/1078325431 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f3f6410e780 0x7f3f640f6ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:44.841 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:44.835+0000 7f3f698916c0 1 -- 10.20.193.78:0/1078325431 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f3f6410ddd0 msgr2=0x7f3f6416f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:44.841 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:44.835+0000 7f3f698916c0 1 --2- 10.20.193.78:0/1078325431 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f3f6410ddd0 0x7f3f6416f110 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:44.841 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:44.835+0000 7f3f698916c0 1 -- 10.20.193.78:0/1078325431 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f58009590 con 0x7f3f6410cc50 2026-02-13T02:18:44.841 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:44.835+0000 7f3f698916c0 1 --2- 10.20.193.78:0/1078325431 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f3f6410cc50 0x7f3f640f6340 secure :-1 s=READY pgs=48 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3f5400b710 tx=0x7f3f5400bbe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:18:44.841 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:44.835+0000 7f3f52ffd6c0 1 -- 10.20.193.78:0/1078325431 <== mon.1 v2:10.20.193.78:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3f54004250 con 0x7f3f6410cc50 2026-02-13T02:18:44.841 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:44.835+0000 7f3f52ffd6c0 1 -- 10.20.193.78:0/1078325431 <== mon.1 v2:10.20.193.78:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3f54002da0 con 0x7f3f6410cc50 2026-02-13T02:18:44.841 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:44.835+0000 7f3f6bb1c6c0 1 -- 10.20.193.78:0/1078325431 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f640f7d90 con 0x7f3f6410cc50 2026-02-13T02:18:44.842 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:44.835+0000 7f3f52ffd6c0 1 -- 10.20.193.78:0/1078325431 <== mon.1 v2:10.20.193.78:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3f5400ce40 con 0x7f3f6410cc50 2026-02-13T02:18:44.842 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:44.835+0000 7f3f6bb1c6c0 1 -- 10.20.193.78:0/1078325431 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f640f82c0 con 0x7f3f6410cc50 2026-02-13T02:18:44.842 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:44.835+0000 7f3f6bb1c6c0 1 -- 10.20.193.78:0/1078325431 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f64173140 con 0x7f3f6410cc50 2026-02-13T02:18:44.843 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:44.837+0000 7f3f52ffd6c0 1 -- 10.20.193.78:0/1078325431 <== mon.1 v2:10.20.193.78:3300/0 4 ==== mgrmap(e 10) ==== 157066+0+0 (secure 0 0 0) 0x7f3f5400c410 con 0x7f3f6410cc50 2026-02-13T02:18:44.843 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:44.837+0000 7f3f52ffd6c0 1 --2- 10.20.193.78:0/1078325431 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f3f400b5680 0x7f3f400d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:18:44.843 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:44.837+0000 7f3f52ffd6c0 1 -- 10.20.193.78:0/1078325431 <== mon.1 v2:10.20.193.78:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6904+0+0 (secure 0 0 0) 0x7f3f540e36c0 con 0x7f3f6410cc50 2026-02-13T02:18:44.843 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:44.838+0000 7f3f690906c0 1 --2- 10.20.193.78:0/1078325431 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f3f400b5680 0x7f3f400d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:18:44.843 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:44.838+0000 7f3f52ffd6c0 1 -- 10.20.193.78:0/1078325431 <== mon.1 v2:10.20.193.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f3f540a65a0 con 0x7f3f6410cc50 2026-02-13T02:18:44.843 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:44.838+0000 7f3f690906c0 1 --2- 10.20.193.78:0/1078325431 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f3f400b5680 0x7f3f400d5b30 secure :-1 s=READY pgs=143 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3f580023e0 tx=0x7f3f58031f90 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:18:44.937 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:44.934+0000 7f3f6bb1c6c0 1 -- 10.20.193.78:0/1078325431 --> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;trial011=a;trial011=d;trial011=g;trial011=j;trial060=b;trial060=e;trial060=h;trial060=k;trial078=c;trial078=f;trial078=i;trial078=l", "target": ["mon-mgr", ""]}) -- 0x7f3f640ecb10 con 0x7f3f400b5680 2026-02-13T02:18:44.938 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:44 trial078 ceph-mon[14969]: purged_snaps scrub starts 2026-02-13T02:18:44.938 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:44 trial078 ceph-mon[14969]: purged_snaps scrub ok 2026-02-13T02:18:44.938 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:44 trial078 ceph-mon[14969]: osd.11 [v2:10.20.193.78:6824/537170494,v1:10.20.193.78:6825/537170494] boot 2026-02-13T02:18:44.938 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:44 trial078 ceph-mon[14969]: osdmap e66: 12 total, 12 up, 12 in 2026-02-13T02:18:44.938 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:44 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T02:18:44.938 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:44 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/209827708' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-13T02:18:44.939 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:44 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/2836222519' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T02:18:44.939 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:44 trial078 ceph-mon[14969]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T02:18:44.939 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:44 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/3214054594' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2026-02-13T02:18:44.941 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:44.938+0000 7f3f52ffd6c0 1 -- 10.20.193.78:0/1078325431 <== mgr.14116 v2:10.20.193.11:6800/861334768 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f3f640ecb10 con 0x7f3f400b5680 2026-02-13T02:18:44.941 INFO:teuthology.orchestra.run.trial078.stdout:Scheduled mds.all update... 2026-02-13T02:18:44.942 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:44.939+0000 7f3f6bb1c6c0 1 -- 10.20.193.78:0/1078325431 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f3f400b5680 msgr2=0x7f3f400d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:44.942 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:44.939+0000 7f3f6bb1c6c0 1 --2- 10.20.193.78:0/1078325431 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f3f400b5680 0x7f3f400d5b30 secure :-1 s=READY pgs=143 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3f580023e0 tx=0x7f3f58031f90 comp rx=0 tx=0).stop 2026-02-13T02:18:44.942 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:44.939+0000 7f3f6bb1c6c0 1 -- 10.20.193.78:0/1078325431 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f3f6410cc50 msgr2=0x7f3f640f6340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:44.942 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:44.939+0000 7f3f6bb1c6c0 1 --2- 10.20.193.78:0/1078325431 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f3f6410cc50 0x7f3f640f6340 secure :-1 s=READY pgs=48 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3f5400b710 tx=0x7f3f5400bbe0 comp rx=0 tx=0).stop 2026-02-13T02:18:44.943 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:44.939+0000 7f3f6bb1c6c0 1 -- 10.20.193.78:0/1078325431 shutdown_connections 2026-02-13T02:18:44.943 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:44.939+0000 7f3f6bb1c6c0 1 --2- 10.20.193.78:0/1078325431 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f3f400b5680 0x7f3f400d5b30 unknown :-1 s=CLOSED pgs=143 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:44.943 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:44.939+0000 7f3f6bb1c6c0 1 --2- 10.20.193.78:0/1078325431 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f3f6410e780 0x7f3f640f6ba0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:44.943 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:44.939+0000 7f3f6bb1c6c0 1 --2- 10.20.193.78:0/1078325431 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f3f6410ddd0 0x7f3f6416f110 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:44.943 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:44.939+0000 7f3f6bb1c6c0 1 --2- 10.20.193.78:0/1078325431 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f3f6410cc50 0x7f3f640f6340 unknown :-1 s=CLOSED pgs=48 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:44.943 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:44.939+0000 7f3f6bb1c6c0 1 -- 10.20.193.78:0/1078325431 >> 10.20.193.78:0/1078325431 conn(0x7f3f640ea370 msgr2=0x7f3f640ec300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:18:44.943 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:44.939+0000 7f3f6bb1c6c0 1 -- 10.20.193.78:0/1078325431 shutdown_connections 2026-02-13T02:18:44.943 INFO:teuthology.orchestra.run.trial078.stderr:2026-02-13T02:18:44.939+0000 7f3f6bb1c6c0 1 -- 10.20.193.78:0/1078325431 wait complete. 2026-02-13T02:18:44.980 DEBUG:teuthology.orchestra.run.trial011:mds.a> sudo journalctl -f -n 0 -u ceph-fc631695-0881-11f1-899c-d404e6e7d460@mds.a.service 2026-02-13T02:18:44.982 DEBUG:teuthology.orchestra.run.trial011:mds.d> sudo journalctl -f -n 0 -u ceph-fc631695-0881-11f1-899c-d404e6e7d460@mds.d.service 2026-02-13T02:18:45.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:44 trial060 ceph-mon[14797]: purged_snaps scrub starts 2026-02-13T02:18:45.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:44 trial060 ceph-mon[14797]: purged_snaps scrub ok 2026-02-13T02:18:45.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:44 trial060 ceph-mon[14797]: osd.11 [v2:10.20.193.78:6824/537170494,v1:10.20.193.78:6825/537170494] boot 2026-02-13T02:18:45.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:44 trial060 ceph-mon[14797]: osdmap e66: 12 total, 12 up, 12 in 2026-02-13T02:18:45.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:44 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T02:18:45.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:44 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/209827708' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-13T02:18:45.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:44 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/2836222519' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T02:18:45.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:44 trial060 ceph-mon[14797]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T02:18:45.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:44 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/3214054594' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2026-02-13T02:18:45.026 DEBUG:teuthology.orchestra.run.trial011:mds.g> sudo journalctl -f -n 0 -u ceph-fc631695-0881-11f1-899c-d404e6e7d460@mds.g.service 2026-02-13T02:18:45.068 DEBUG:teuthology.orchestra.run.trial011:mds.j> sudo journalctl -f -n 0 -u ceph-fc631695-0881-11f1-899c-d404e6e7d460@mds.j.service 2026-02-13T02:18:45.113 DEBUG:teuthology.orchestra.run.trial060:mds.b> sudo journalctl -f -n 0 -u ceph-fc631695-0881-11f1-899c-d404e6e7d460@mds.b.service 2026-02-13T02:18:45.116 DEBUG:teuthology.orchestra.run.trial060:mds.e> sudo journalctl -f -n 0 -u ceph-fc631695-0881-11f1-899c-d404e6e7d460@mds.e.service 2026-02-13T02:18:45.159 DEBUG:teuthology.orchestra.run.trial060:mds.h> sudo journalctl -f -n 0 -u ceph-fc631695-0881-11f1-899c-d404e6e7d460@mds.h.service 2026-02-13T02:18:45.203 DEBUG:teuthology.orchestra.run.trial060:mds.k> sudo journalctl -f -n 0 -u ceph-fc631695-0881-11f1-899c-d404e6e7d460@mds.k.service 2026-02-13T02:18:45.247 DEBUG:teuthology.orchestra.run.trial078:mds.c> sudo journalctl -f -n 0 -u ceph-fc631695-0881-11f1-899c-d404e6e7d460@mds.c.service 2026-02-13T02:18:45.250 DEBUG:teuthology.orchestra.run.trial078:mds.f> sudo journalctl -f -n 0 -u ceph-fc631695-0881-11f1-899c-d404e6e7d460@mds.f.service 2026-02-13T02:18:45.293 DEBUG:teuthology.orchestra.run.trial078:mds.i> sudo journalctl -f -n 0 -u ceph-fc631695-0881-11f1-899c-d404e6e7d460@mds.i.service 2026-02-13T02:18:45.336 DEBUG:teuthology.orchestra.run.trial078:mds.l> sudo journalctl -f -n 0 -u ceph-fc631695-0881-11f1-899c-d404e6e7d460@mds.l.service 2026-02-13T02:18:45.380 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2026-02-13T02:18:45.380 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph fs dump --format=json 2026-02-13T02:18:45.501 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:18:45.613 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:45.608+0000 7f65968696c0 1 -- 10.20.193.11:0/653803607 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f6590115410 msgr2=0x7f6590175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:45.613 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:45.608+0000 7f65968696c0 1 --2- 10.20.193.11:0/653803607 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f6590115410 0x7f6590175db0 secure :-1 s=READY pgs=189 gs=1 cs=0 l=1 c_cookie=9584120643509371885 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f658400aa70 tx=0x7f658402fde0 comp rx=0 tx=0).stop 2026-02-13T02:18:45.614 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:45.608+0000 7f65968696c0 1 -- 10.20.193.11:0/653803607 shutdown_connections 2026-02-13T02:18:45.614 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:45.608+0000 7f65968696c0 1 --2- 10.20.193.11:0/653803607 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f6590115410 0x7f6590175db0 unknown :-1 s=CLOSED pgs=189 gs=1 cs=0 l=1 c_cookie=9584120643509371885 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:45.614 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:45.608+0000 7f65968696c0 1 --2- 10.20.193.11:0/653803607 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f659010fbf0 0x7f6590114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:45.614 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:45.608+0000 7f65968696c0 1 --2- 10.20.193.11:0/653803607 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f659010f200 0x7f659010f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:45.614 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:45.608+0000 7f65968696c0 1 -- 10.20.193.11:0/653803607 >> 10.20.193.11:0/653803607 conn(0x7f65900ecb00 msgr2=0x7f659010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:18:45.614 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:45.608+0000 7f65968696c0 1 -- 10.20.193.11:0/653803607 shutdown_connections 2026-02-13T02:18:45.614 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:45.608+0000 7f65968696c0 1 -- 10.20.193.11:0/653803607 wait complete. 2026-02-13T02:18:45.614 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:45.609+0000 7f65968696c0 1 Processor -- start 2026-02-13T02:18:45.614 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:45.609+0000 7f65968696c0 1 -- start start 2026-02-13T02:18:45.614 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:45.609+0000 7f65968696c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f659010f200 0x7f659011d170 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:18:45.614 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:45.609+0000 7f65968696c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f6590115410 0x7f659011d6b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:18:45.615 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:45.609+0000 7f65968696c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f6590122a70 0x7f6590122f10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:18:45.615 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:45.609+0000 7f65968696c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f6590123480 con 0x7f6590122a70 2026-02-13T02:18:45.615 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:45.609+0000 7f65968696c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f65901235f0 con 0x7f6590115410 2026-02-13T02:18:45.615 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:45.609+0000 7f65968696c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f65901237b0 con 0x7f659010f200 2026-02-13T02:18:45.615 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:45.609+0000 7f6594ddb6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f6590122a70 0x7f6590122f10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:18:45.615 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:45.609+0000 7f6594ddb6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f6590122a70 0x7f6590122f10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:53242/0 (socket says 10.20.193.11:53242) 2026-02-13T02:18:45.615 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:45.609+0000 7f6594ddb6c0 1 -- 10.20.193.11:0/3405646967 learned_addr learned my addr 10.20.193.11:0/3405646967 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:18:45.615 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:45.609+0000 7f658ffff6c0 1 --2- 10.20.193.11:0/3405646967 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f659010f200 0x7f659011d170 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:18:45.615 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:45.609+0000 7f658f7fe6c0 1 --2- 10.20.193.11:0/3405646967 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f6590115410 0x7f659011d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:18:45.615 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:45.609+0000 7f6594ddb6c0 1 -- 10.20.193.11:0/3405646967 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f659010f200 msgr2=0x7f659011d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:45.616 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:45.609+0000 7f6594ddb6c0 1 --2- 10.20.193.11:0/3405646967 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f659010f200 0x7f659011d170 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:45.616 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:45.609+0000 7f6594ddb6c0 1 -- 10.20.193.11:0/3405646967 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f6590115410 msgr2=0x7f659011d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:45.616 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:45.609+0000 7f6594ddb6c0 1 --2- 10.20.193.11:0/3405646967 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f6590115410 0x7f659011d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:45.616 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:45.609+0000 7f6594ddb6c0 1 -- 10.20.193.11:0/3405646967 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f658400a660 con 0x7f6590122a70 2026-02-13T02:18:45.616 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:45.609+0000 7f6594ddb6c0 1 --2- 10.20.193.11:0/3405646967 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f6590122a70 0x7f6590122f10 secure :-1 s=READY pgs=190 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6584030af0 tx=0x7f65840054b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:18:45.616 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:45.609+0000 7f658d7fa6c0 1 -- 10.20.193.11:0/3405646967 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6584003a30 con 0x7f6590122a70 2026-02-13T02:18:45.616 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:45.609+0000 7f658d7fa6c0 1 -- 10.20.193.11:0/3405646967 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6584003b90 con 0x7f6590122a70 2026-02-13T02:18:45.616 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:45.609+0000 7f65968696c0 1 -- 10.20.193.11:0/3405646967 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6590163c00 con 0x7f6590122a70 2026-02-13T02:18:45.616 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:45.609+0000 7f658d7fa6c0 1 -- 10.20.193.11:0/3405646967 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6584038360 con 0x7f6590122a70 2026-02-13T02:18:45.616 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:45.609+0000 7f65968696c0 1 -- 10.20.193.11:0/3405646967 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6590164030 con 0x7f6590122a70 2026-02-13T02:18:45.616 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:45.610+0000 7f65968696c0 1 -- 10.20.193.11:0/3405646967 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65901104d0 con 0x7f6590122a70 2026-02-13T02:18:45.617 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:45.611+0000 7f658d7fa6c0 1 -- 10.20.193.11:0/3405646967 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 10) ==== 157066+0+0 (secure 0 0 0) 0x7f6584008350 con 0x7f6590122a70 2026-02-13T02:18:45.617 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:45.612+0000 7f658d7fa6c0 1 --2- 10.20.193.11:0/3405646967 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f65640b5680 0x7f65640d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:18:45.618 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:45.612+0000 7f658d7fa6c0 1 -- 10.20.193.11:0/3405646967 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6904+0+0 (secure 0 0 0) 0x7f6584108a20 con 0x7f6590122a70 2026-02-13T02:18:45.618 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:45.612+0000 7f658ffff6c0 1 --2- 10.20.193.11:0/3405646967 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f65640b5680 0x7f65640d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:18:45.618 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:45.612+0000 7f658ffff6c0 1 --2- 10.20.193.11:0/3405646967 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f65640b5680 0x7f65640d5b30 secure :-1 s=READY pgs=144 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f657c004750 tx=0x7f657c009390 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:18:45.618 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:45.612+0000 7f658d7fa6c0 1 -- 10.20.193.11:0/3405646967 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f65840cb900 con 0x7f6590122a70 2026-02-13T02:18:45.730 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:45.728+0000 7f65968696c0 1 -- 10.20.193.11:0/3405646967 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f659010f5d0 con 0x7f6590122a70 2026-02-13T02:18:45.731 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:45.728+0000 7f658d7fa6c0 1 -- 10.20.193.11:0/3405646967 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7f65840ceab0 con 0x7f6590122a70 2026-02-13T02:18:45.731 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:18:45.731 INFO:teuthology.orchestra.run.trial011.stdout:{"epoch":1,"btime":"2026-02-13T02:16:35:175644+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2026-02-13T02:18:45.733 INFO:teuthology.orchestra.run.trial011.stderr:dumped fsmap epoch 1 2026-02-13T02:18:45.733 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:45.730+0000 7f65968696c0 1 -- 10.20.193.11:0/3405646967 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f65640b5680 msgr2=0x7f65640d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:45.733 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:45.730+0000 7f65968696c0 1 --2- 10.20.193.11:0/3405646967 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f65640b5680 0x7f65640d5b30 secure :-1 s=READY pgs=144 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f657c004750 tx=0x7f657c009390 comp rx=0 tx=0).stop 2026-02-13T02:18:45.733 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:45.730+0000 7f65968696c0 1 -- 10.20.193.11:0/3405646967 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f6590122a70 msgr2=0x7f6590122f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:45.733 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:45.730+0000 7f65968696c0 1 --2- 10.20.193.11:0/3405646967 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f6590122a70 0x7f6590122f10 secure :-1 s=READY pgs=190 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6584030af0 tx=0x7f65840054b0 comp rx=0 tx=0).stop 2026-02-13T02:18:45.733 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:45.730+0000 7f65968696c0 1 -- 10.20.193.11:0/3405646967 shutdown_connections 2026-02-13T02:18:45.733 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:45.730+0000 7f65968696c0 1 --2- 10.20.193.11:0/3405646967 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f65640b5680 0x7f65640d5b30 unknown :-1 s=CLOSED pgs=144 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:45.733 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:45.730+0000 7f65968696c0 1 --2- 10.20.193.11:0/3405646967 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f6590115410 0x7f659011d6b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:45.734 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:45.730+0000 7f65968696c0 1 --2- 10.20.193.11:0/3405646967 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f6590122a70 0x7f6590122f10 unknown :-1 s=CLOSED pgs=190 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:45.734 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:45.730+0000 7f65968696c0 1 --2- 10.20.193.11:0/3405646967 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f659010f200 0x7f659011d170 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:45.734 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:45.730+0000 7f65968696c0 1 -- 10.20.193.11:0/3405646967 >> 10.20.193.11:0/3405646967 conn(0x7f65900ecb00 msgr2=0x7f659010cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:18:45.734 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:45.730+0000 7f65968696c0 1 -- 10.20.193.11:0/3405646967 shutdown_connections 2026-02-13T02:18:45.734 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:45.730+0000 7f65968696c0 1 -- 10.20.193.11:0/3405646967 wait complete. 2026-02-13T02:18:45.899 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:45 trial078 ceph-mon[14969]: osdmap e67: 12 total, 12 up, 12 in 2026-02-13T02:18:45.900 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:45 trial078 ceph-mon[14969]: from='client.24409 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;trial011=a;trial011=d;trial011=g;trial011=j;trial060=b;trial060=e;trial060=h;trial060=k;trial078=c;trial078=f;trial078=i;trial078=l", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:18:45.900 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:45 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:45.900 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:45 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:18:45.900 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:45 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:45.900 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:45 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:18:45.900 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:45 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:45.901 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:45 trial078 ceph-mon[14969]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T02:18:45.901 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:45 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:18:45.901 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:45 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:18:45.901 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:45 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:45.901 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:45 trial078 ceph-mon[14969]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T02:18:45.901 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:45 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T02:18:45.901 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:45 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T02:18:45.901 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:45 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:45.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:45 trial011 ceph-mon[11956]: osdmap e67: 12 total, 12 up, 12 in 2026-02-13T02:18:45.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:45 trial011 ceph-mon[11956]: from='client.24409 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;trial011=a;trial011=d;trial011=g;trial011=j;trial060=b;trial060=e;trial060=h;trial060=k;trial078=c;trial078=f;trial078=i;trial078=l", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:18:45.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:45 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:45.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:45 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:18:45.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:45 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:45.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:45 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:18:45.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:45 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:45.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:45 trial011 ceph-mon[11956]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T02:18:45.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:45 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:18:45.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:45 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:18:45.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:45 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:45.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:45 trial011 ceph-mon[11956]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T02:18:45.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:45 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T02:18:45.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:45 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T02:18:45.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:45 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:46.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:45 trial060 ceph-mon[14797]: osdmap e67: 12 total, 12 up, 12 in 2026-02-13T02:18:46.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:45 trial060 ceph-mon[14797]: from='client.24409 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;trial011=a;trial011=d;trial011=g;trial011=j;trial060=b;trial060=e;trial060=h;trial060=k;trial078=c;trial078=f;trial078=i;trial078=l", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:18:46.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:45 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:46.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:45 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:18:46.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:45 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:46.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:45 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:18:46.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:45 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:46.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:45 trial060 ceph-mon[14797]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T02:18:46.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:45 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:18:46.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:45 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:18:46.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:45 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:46.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:45 trial060 ceph-mon[14797]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T02:18:46.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:45 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T02:18:46.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:45 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T02:18:46.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:45 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:46.292 INFO:journalctl@ceph.mds.l.trial078.stdout:Feb 13 02:18:46 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mds-l[42874]: starting mds.l at 2026-02-13T02:18:46.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:46 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/3405646967' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T02:18:46.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:46 trial011 ceph-mon[11956]: mds.? [v2:10.20.193.78:6832/3863251566,v1:10.20.193.78:6833/3863251566] up:boot 2026-02-13T02:18:46.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:46 trial011 ceph-mon[11956]: fsmap 1 up:standby 2026-02-13T02:18:46.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:46 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2026-02-13T02:18:46.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:46 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:46.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:46 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:46.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:46 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:46.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:46 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T02:18:46.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:46 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T02:18:46.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:46 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:47.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:46 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/3405646967' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T02:18:47.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:46 trial060 ceph-mon[14797]: mds.? [v2:10.20.193.78:6832/3863251566,v1:10.20.193.78:6833/3863251566] up:boot 2026-02-13T02:18:47.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:46 trial060 ceph-mon[14797]: fsmap 1 up:standby 2026-02-13T02:18:47.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:46 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2026-02-13T02:18:47.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:46 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:47.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:46 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:47.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:46 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:47.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:46 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T02:18:47.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:46 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T02:18:47.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:46 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:47.002 INFO:journalctl@ceph.mds.k.trial060.stdout:Feb 13 02:18:46 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mds-k[42611]: starting mds.k at 2026-02-13T02:18:47.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:46 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/3405646967' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T02:18:47.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:46 trial078 ceph-mon[14969]: mds.? [v2:10.20.193.78:6832/3863251566,v1:10.20.193.78:6833/3863251566] up:boot 2026-02-13T02:18:47.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:46 trial078 ceph-mon[14969]: fsmap 1 up:standby 2026-02-13T02:18:47.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:46 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2026-02-13T02:18:47.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:46 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:47.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:46 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:47.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:46 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:47.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:46 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T02:18:47.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:46 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T02:18:47.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:46 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:47.702 INFO:journalctl@ceph.mds.j.trial011.stdout:Feb 13 02:18:47 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mds-j[47704]: starting mds.j at 2026-02-13T02:18:47.770 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph fs dump --format=json 2026-02-13T02:18:47.895 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:18:48.075 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:47 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:48.075 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:47 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:48.075 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:47 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:48.075 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:47 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T02:18:48.075 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:47 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T02:18:48.075 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:47 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:48.075 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:47 trial011 ceph-mon[11956]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T02:18:48.075 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:47 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:48.075 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:47 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:48.075 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:47 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:48.075 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:47 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T02:18:48.075 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:47 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T02:18:48.075 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:47 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:48.075 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:47 trial011 ceph-mon[11956]: mds.? [v2:10.20.193.60:6832/2039450283,v1:10.20.193.60:6833/2039450283] up:boot 2026-02-13T02:18:48.075 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:47 trial011 ceph-mon[11956]: mds.? [v2:10.20.193.11:6834/50369882,v1:10.20.193.11:6835/50369882] up:boot 2026-02-13T02:18:48.075 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:47 trial011 ceph-mon[11956]: fsmap 3 up:standby 2026-02-13T02:18:48.075 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:47 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2026-02-13T02:18:48.075 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:47 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2026-02-13T02:18:48.146 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:48.142+0000 7f358032b6c0 1 -- 10.20.193.11:0/477703887 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f3578060720 msgr2=0x7f3578060af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:48.146 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:48.142+0000 7f358032b6c0 1 --2- 10.20.193.11:0/477703887 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f3578060720 0x7f3578060af0 secure :-1 s=READY pgs=193 gs=1 cs=0 l=1 c_cookie=2682636967227567087 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3568009970 tx=0x7f356802ed20 comp rx=0 tx=0).stop 2026-02-13T02:18:48.146 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:48.142+0000 7f358032b6c0 1 -- 10.20.193.11:0/477703887 shutdown_connections 2026-02-13T02:18:48.146 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:48.142+0000 7f358032b6c0 1 --2- 10.20.193.11:0/477703887 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f3578061030 0x7f35781551a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:48.146 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:48.142+0000 7f358032b6c0 1 --2- 10.20.193.11:0/477703887 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f35781556e0 0x7f3578175ac0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:48.147 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:48.142+0000 7f358032b6c0 1 --2- 10.20.193.11:0/477703887 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f3578060720 0x7f3578060af0 unknown :-1 s=CLOSED pgs=193 gs=1 cs=0 l=1 c_cookie=2682636967227567087 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:48.147 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:48.142+0000 7f358032b6c0 1 -- 10.20.193.11:0/477703887 >> 10.20.193.11:0/477703887 conn(0x7f35780ea8b0 msgr2=0x7f357810acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:18:48.147 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:48.142+0000 7f358032b6c0 1 -- 10.20.193.11:0/477703887 shutdown_connections 2026-02-13T02:18:48.147 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:48.142+0000 7f358032b6c0 1 -- 10.20.193.11:0/477703887 wait complete. 2026-02-13T02:18:48.147 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:48.143+0000 7f358032b6c0 1 Processor -- start 2026-02-13T02:18:48.147 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:48.143+0000 7f358032b6c0 1 -- start start 2026-02-13T02:18:48.147 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:48.143+0000 7f358032b6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f3578060720 0x7f35781614a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:18:48.147 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:48.143+0000 7f358032b6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f3578061030 0x7f35781619e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:18:48.147 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:48.143+0000 7f358032b6c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f35781556e0 0x7f3578166da0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:18:48.147 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:48.143+0000 7f358032b6c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f35781673f0 con 0x7f3578061030 2026-02-13T02:18:48.147 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:48.143+0000 7f358032b6c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f3578167560 con 0x7f35781556e0 2026-02-13T02:18:48.147 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:48.143+0000 7f358032b6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f3578167720 con 0x7f3578060720 2026-02-13T02:18:48.148 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:48.143+0000 7f357d89b6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f3578061030 0x7f35781619e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:18:48.148 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:48.143+0000 7f357d89b6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f3578061030 0x7f35781619e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:53280/0 (socket says 10.20.193.11:53280) 2026-02-13T02:18:48.148 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:48.143+0000 7f357d89b6c0 1 -- 10.20.193.11:0/4020046952 learned_addr learned my addr 10.20.193.11:0/4020046952 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:18:48.148 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:48.143+0000 7f357e09c6c0 1 --2- 10.20.193.11:0/4020046952 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f3578060720 0x7f35781614a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:18:48.148 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:48.143+0000 7f357e89d6c0 1 --2- 10.20.193.11:0/4020046952 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f35781556e0 0x7f3578166da0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:18:48.148 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:48.143+0000 7f357d89b6c0 1 -- 10.20.193.11:0/4020046952 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f3578060720 msgr2=0x7f35781614a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:48.148 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:48.143+0000 7f357d89b6c0 1 --2- 10.20.193.11:0/4020046952 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f3578060720 0x7f35781614a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:48.148 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:48.143+0000 7f357d89b6c0 1 -- 10.20.193.11:0/4020046952 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f35781556e0 msgr2=0x7f3578166da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:48.148 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:48.143+0000 7f357d89b6c0 1 --2- 10.20.193.11:0/4020046952 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f35781556e0 0x7f3578166da0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:48.148 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:48.143+0000 7f357d89b6c0 1 -- 10.20.193.11:0/4020046952 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3568009590 con 0x7f3578061030 2026-02-13T02:18:48.148 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:48.143+0000 7f357d89b6c0 1 --2- 10.20.193.11:0/4020046952 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f3578061030 0x7f35781619e0 secure :-1 s=READY pgs=194 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f356c005dc0 tx=0x7f356c00bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:18:48.149 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:48.143+0000 7f355f7fe6c0 1 -- 10.20.193.11:0/4020046952 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f356c004250 con 0x7f3578061030 2026-02-13T02:18:48.149 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:48.143+0000 7f358032b6c0 1 -- 10.20.193.11:0/4020046952 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3578167a00 con 0x7f3578061030 2026-02-13T02:18:48.149 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:48.143+0000 7f355f7fe6c0 1 -- 10.20.193.11:0/4020046952 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f356c009070 con 0x7f3578061030 2026-02-13T02:18:48.149 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:48.143+0000 7f355f7fe6c0 1 -- 10.20.193.11:0/4020046952 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f356c00cde0 con 0x7f3578061030 2026-02-13T02:18:48.149 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:48.143+0000 7f358032b6c0 1 -- 10.20.193.11:0/4020046952 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3578151310 con 0x7f3578061030 2026-02-13T02:18:48.149 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:48.144+0000 7f358032b6c0 1 -- 10.20.193.11:0/4020046952 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3578061c30 con 0x7f3578061030 2026-02-13T02:18:48.150 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:48.145+0000 7f355f7fe6c0 1 -- 10.20.193.11:0/4020046952 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 10) ==== 157066+0+0 (secure 0 0 0) 0x7f356c0028c0 con 0x7f3578061030 2026-02-13T02:18:48.150 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:48.146+0000 7f355f7fe6c0 1 --2- 10.20.193.11:0/4020046952 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f35480b5600 0x7f35480d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:18:48.150 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:48.146+0000 7f357e09c6c0 1 --2- 10.20.193.11:0/4020046952 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f35480b5600 0x7f35480d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:18:48.151 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:48.146+0000 7f355f7fe6c0 1 -- 10.20.193.11:0/4020046952 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6904+0+0 (secure 0 0 0) 0x7f356c0e35e0 con 0x7f3578061030 2026-02-13T02:18:48.151 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:48.146+0000 7f355f7fe6c0 1 -- 10.20.193.11:0/4020046952 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f356c0a94d0 con 0x7f3578061030 2026-02-13T02:18:48.151 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:48.146+0000 7f357e09c6c0 1 --2- 10.20.193.11:0/4020046952 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f35480b5600 0x7f35480d5ab0 secure :-1 s=READY pgs=148 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f35680023e0 tx=0x7f3568031f90 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:18:48.250 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:47 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:48.251 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:47 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:48.251 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:47 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:48.251 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:47 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T02:18:48.251 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:47 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T02:18:48.251 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:47 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:48.251 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:47 trial060 ceph-mon[14797]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T02:18:48.251 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:47 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:48.251 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:47 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:48.251 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:47 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:48.251 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:47 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T02:18:48.251 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:47 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T02:18:48.252 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:47 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:48.252 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:47 trial060 ceph-mon[14797]: mds.? [v2:10.20.193.60:6832/2039450283,v1:10.20.193.60:6833/2039450283] up:boot 2026-02-13T02:18:48.252 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:47 trial060 ceph-mon[14797]: mds.? [v2:10.20.193.11:6834/50369882,v1:10.20.193.11:6835/50369882] up:boot 2026-02-13T02:18:48.252 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:47 trial060 ceph-mon[14797]: fsmap 3 up:standby 2026-02-13T02:18:48.252 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:47 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2026-02-13T02:18:48.252 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:47 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2026-02-13T02:18:48.262 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:48.259+0000 7f358032b6c0 1 -- 10.20.193.11:0/4020046952 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3578060af0 con 0x7f3578061030 2026-02-13T02:18:48.262 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:48.260+0000 7f355f7fe6c0 1 -- 10.20.193.11:0/4020046952 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3079 (secure 0 0 0) 0x7f356c0a96b0 con 0x7f3578061030 2026-02-13T02:18:48.262 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:18:48.263 INFO:teuthology.orchestra.run.trial011.stdout:{"epoch":3,"btime":"2026-02-13T02:18:47:671272+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14718,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.11:6835/50369882","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6834","nonce":50369882},{"type":"v1","addr":"10.20.193.11:6835","nonce":50369882}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.78:6833/3863251566","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6832","nonce":3863251566},{"type":"v1","addr":"10.20.193.78:6833","nonce":3863251566}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24452,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.60:6833/2039450283","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6832","nonce":2039450283},{"type":"v1","addr":"10.20.193.60:6833","nonce":2039450283}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2026-02-13T02:18:48.263 INFO:teuthology.orchestra.run.trial011.stderr:dumped fsmap epoch 3 2026-02-13T02:18:48.264 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:48.261+0000 7f358032b6c0 1 -- 10.20.193.11:0/4020046952 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f35480b5600 msgr2=0x7f35480d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:48.264 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:48.261+0000 7f358032b6c0 1 --2- 10.20.193.11:0/4020046952 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f35480b5600 0x7f35480d5ab0 secure :-1 s=READY pgs=148 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f35680023e0 tx=0x7f3568031f90 comp rx=0 tx=0).stop 2026-02-13T02:18:48.264 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:48.261+0000 7f358032b6c0 1 -- 10.20.193.11:0/4020046952 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f3578061030 msgr2=0x7f35781619e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:48.264 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:48.261+0000 7f358032b6c0 1 --2- 10.20.193.11:0/4020046952 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f3578061030 0x7f35781619e0 secure :-1 s=READY pgs=194 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f356c005dc0 tx=0x7f356c00bbb0 comp rx=0 tx=0).stop 2026-02-13T02:18:48.264 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:48.261+0000 7f358032b6c0 1 -- 10.20.193.11:0/4020046952 shutdown_connections 2026-02-13T02:18:48.264 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:48.261+0000 7f358032b6c0 1 --2- 10.20.193.11:0/4020046952 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f35480b5600 0x7f35480d5ab0 unknown :-1 s=CLOSED pgs=148 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:48.264 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:48.261+0000 7f358032b6c0 1 --2- 10.20.193.11:0/4020046952 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f35781556e0 0x7f3578166da0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:48.264 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:48.261+0000 7f358032b6c0 1 --2- 10.20.193.11:0/4020046952 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f3578061030 0x7f35781619e0 unknown :-1 s=CLOSED pgs=194 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:48.264 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:48.261+0000 7f358032b6c0 1 --2- 10.20.193.11:0/4020046952 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f3578060720 0x7f35781614a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:48.264 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:48.261+0000 7f358032b6c0 1 -- 10.20.193.11:0/4020046952 >> 10.20.193.11:0/4020046952 conn(0x7f35780ea8b0 msgr2=0x7f357810ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:18:48.265 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:48.261+0000 7f358032b6c0 1 -- 10.20.193.11:0/4020046952 shutdown_connections 2026-02-13T02:18:48.265 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:48.261+0000 7f358032b6c0 1 -- 10.20.193.11:0/4020046952 wait complete. 2026-02-13T02:18:48.291 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:47 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:48.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:47 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:48.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:47 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:48.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:47 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T02:18:48.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:47 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T02:18:48.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:47 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:48.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:47 trial078 ceph-mon[14969]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T02:18:48.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:47 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:48.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:47 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:48.293 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:47 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:48.293 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:47 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T02:18:48.293 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:47 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T02:18:48.293 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:47 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:48.293 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:47 trial078 ceph-mon[14969]: mds.? [v2:10.20.193.60:6832/2039450283,v1:10.20.193.60:6833/2039450283] up:boot 2026-02-13T02:18:48.293 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:47 trial078 ceph-mon[14969]: mds.? [v2:10.20.193.11:6834/50369882,v1:10.20.193.11:6835/50369882] up:boot 2026-02-13T02:18:48.293 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:47 trial078 ceph-mon[14969]: fsmap 3 up:standby 2026-02-13T02:18:48.293 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:47 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2026-02-13T02:18:48.293 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:47 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2026-02-13T02:18:48.343 INFO:journalctl@ceph.mds.d.trial011.stdout:Feb 13 02:18:48 trial011 systemd[1]: Starting ceph-fc631695-0881-11f1-899c-d404e6e7d460@mds.d.service - Ceph mds.d for fc631695-0881-11f1-899c-d404e6e7d460... 2026-02-13T02:18:48.703 INFO:journalctl@ceph.mds.d.trial011.stdout:Feb 13 02:18:48 trial011 podman[48143]: 2026-02-13 02:18:48.341751396 +0000 UTC m=+0.015295342 container create 2dc1b9a33f044a56a78f9842c1bd33b6bf8a7ee8952012cd74509279b6aa079f (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-fc631695-0881-11f1-899c-d404e6e7d460-mds-d, name=rockylinux, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.33.7, summary=Rocky Linux Base image, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_REF=wip-pdonnell-testing-20260210.171210, OSD_FLAVOR=default, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.title=rockylinux, license=BSD-3-Clause, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.version=10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, ceph=True, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, vendor=Rocky Enterprise Software Foundation, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, version=10) 2026-02-13T02:18:48.703 INFO:journalctl@ceph.mds.d.trial011.stdout:Feb 13 02:18:48 trial011 podman[48143]: 2026-02-13 02:18:48.368633328 +0000 UTC m=+0.042177284 container init 2dc1b9a33f044a56a78f9842c1bd33b6bf8a7ee8952012cd74509279b6aa079f (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-fc631695-0881-11f1-899c-d404e6e7d460-mds-d, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.licenses=BSD-3-Clause, version=10, vendor=Rocky Enterprise Software Foundation, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.version=10, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, name=rockylinux, license=BSD-3-Clause, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.title=rockylinux, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, io.buildah.version=1.33.7, summary=Rocky Linux Base image) 2026-02-13T02:18:48.703 INFO:journalctl@ceph.mds.d.trial011.stdout:Feb 13 02:18:48 trial011 podman[48143]: 2026-02-13 02:18:48.370266493 +0000 UTC m=+0.043810439 container start 2dc1b9a33f044a56a78f9842c1bd33b6bf8a7ee8952012cd74509279b6aa079f (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-fc631695-0881-11f1-899c-d404e6e7d460-mds-d, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.version=10, OSD_FLAVOR=default, org.opencontainers.image.title=rockylinux, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, license=BSD-3-Clause, version=10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, summary=Rocky Linux Base image, name=rockylinux, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.33.7) 2026-02-13T02:18:48.703 INFO:journalctl@ceph.mds.d.trial011.stdout:Feb 13 02:18:48 trial011 bash[48143]: 2dc1b9a33f044a56a78f9842c1bd33b6bf8a7ee8952012cd74509279b6aa079f 2026-02-13T02:18:48.703 INFO:journalctl@ceph.mds.d.trial011.stdout:Feb 13 02:18:48 trial011 podman[48143]: 2026-02-13 02:18:48.334793167 +0000 UTC m=+0.008337113 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T02:18:48.703 INFO:journalctl@ceph.mds.d.trial011.stdout:Feb 13 02:18:48 trial011 systemd[1]: Started ceph-fc631695-0881-11f1-899c-d404e6e7d460@mds.d.service - Ceph mds.d for fc631695-0881-11f1-899c-d404e6e7d460. 2026-02-13T02:18:48.704 INFO:journalctl@ceph.mds.d.trial011.stdout:Feb 13 02:18:48 trial011 ceph-mds[48169]: -- 10.20.193.11:0/439368987 <== mon.0 v2:10.20.193.11:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e42f8e7860 con 0x55e42f99d000 2026-02-13T02:18:48.704 INFO:journalctl@ceph.mds.d.trial011.stdout:Feb 13 02:18:48 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mds-d[48165]: starting mds.d at 2026-02-13T02:18:49.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:48 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/4020046952' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T02:18:49.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:48 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:49.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:48 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:49.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:48 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:49.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:48 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T02:18:49.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:48 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T02:18:49.203 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:48 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:49.250 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:48 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/4020046952' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T02:18:49.251 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:48 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:49.251 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:48 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:49.251 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:48 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:49.251 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:48 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T02:18:49.251 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:48 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T02:18:49.251 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:48 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:49.251 INFO:journalctl@ceph.mds.e.trial060.stdout:Feb 13 02:18:49 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mds-e[42979]: starting mds.e at 2026-02-13T02:18:49.291 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:48 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/4020046952' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T02:18:49.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:48 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:49.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:48 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:49.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:48 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:49.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:48 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T02:18:49.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:48 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T02:18:49.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:48 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:50.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:49 trial078 ceph-mon[14969]: mds.? [v2:10.20.193.11:6836/2639332668,v1:10.20.193.11:6837/2639332668] up:boot 2026-02-13T02:18:50.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:49 trial078 ceph-mon[14969]: fsmap 4 up:standby 2026-02-13T02:18:50.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:49 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2026-02-13T02:18:50.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:49 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:50.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:49 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:50.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:49 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:50.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:49 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T02:18:50.043 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:49 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T02:18:50.043 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:49 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:50.043 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:49 trial078 ceph-mon[14969]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T02:18:50.043 INFO:journalctl@ceph.mds.f.trial078.stdout:Feb 13 02:18:49 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mds-f[43241]: starting mds.f at 2026-02-13T02:18:50.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:49 trial011 ceph-mon[11956]: mds.? [v2:10.20.193.11:6836/2639332668,v1:10.20.193.11:6837/2639332668] up:boot 2026-02-13T02:18:50.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:49 trial011 ceph-mon[11956]: fsmap 4 up:standby 2026-02-13T02:18:50.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:49 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2026-02-13T02:18:50.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:49 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:50.203 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:49 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:50.203 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:49 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:50.203 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:49 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T02:18:50.203 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:49 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T02:18:50.203 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:49 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:50.203 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:49 trial011 ceph-mon[11956]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T02:18:50.250 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:49 trial060 ceph-mon[14797]: mds.? [v2:10.20.193.11:6836/2639332668,v1:10.20.193.11:6837/2639332668] up:boot 2026-02-13T02:18:50.250 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:49 trial060 ceph-mon[14797]: fsmap 4 up:standby 2026-02-13T02:18:50.250 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:49 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2026-02-13T02:18:50.250 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:49 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:50.250 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:49 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:50.251 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:49 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:50.251 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:49 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T02:18:50.251 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:49 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T02:18:50.251 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:49 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:50.251 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:49 trial060 ceph-mon[14797]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T02:18:50.306 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph fs dump --format=json 2026-02-13T02:18:50.431 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:18:50.566 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:50.562+0000 7f5c558946c0 1 -- 10.20.193.11:0/1666419645 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f5c5010f200 msgr2=0x7f5c5010f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:50.566 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:50.562+0000 7f5c558946c0 1 --2- 10.20.193.11:0/1666419645 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f5c5010f200 0x7f5c5010f5d0 secure :-1 s=READY pgs=197 gs=1 cs=0 l=1 c_cookie=9965181832027372334 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5c440099a0 tx=0x7f5c4402ed20 comp rx=0 tx=0).stop 2026-02-13T02:18:50.566 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:50.562+0000 7f5c558946c0 1 -- 10.20.193.11:0/1666419645 shutdown_connections 2026-02-13T02:18:50.566 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:50.562+0000 7f5c558946c0 1 --2- 10.20.193.11:0/1666419645 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f5c5010fbf0 0x7f5c50114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:50.567 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:50.562+0000 7f5c558946c0 1 --2- 10.20.193.11:0/1666419645 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f5c50115410 0x7f5c50175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:50.567 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:50.562+0000 7f5c558946c0 1 --2- 10.20.193.11:0/1666419645 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f5c5010f200 0x7f5c5010f5d0 unknown :-1 s=CLOSED pgs=197 gs=1 cs=0 l=1 c_cookie=9965181832027372334 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:50.567 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:50.562+0000 7f5c558946c0 1 -- 10.20.193.11:0/1666419645 >> 10.20.193.11:0/1666419645 conn(0x7f5c500ecb00 msgr2=0x7f5c5010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:18:50.567 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:50.562+0000 7f5c558946c0 1 -- 10.20.193.11:0/1666419645 shutdown_connections 2026-02-13T02:18:50.567 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:50.562+0000 7f5c558946c0 1 -- 10.20.193.11:0/1666419645 wait complete. 2026-02-13T02:18:50.567 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:50.562+0000 7f5c558946c0 1 Processor -- start 2026-02-13T02:18:50.567 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:50.562+0000 7f5c558946c0 1 -- start start 2026-02-13T02:18:50.567 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:50.562+0000 7f5c558946c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f5c5010f200 0x7f5c5011d290 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:18:50.567 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:50.562+0000 7f5c558946c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f5c50115410 0x7f5c5011d7d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:18:50.567 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:50.562+0000 7f5c558946c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f5c50122b90 0x7f5c50123030 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:18:50.567 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:50.562+0000 7f5c558946c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f5c50123570 con 0x7f5c50122b90 2026-02-13T02:18:50.567 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:50.562+0000 7f5c558946c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f5c501236e0 con 0x7f5c5010f200 2026-02-13T02:18:50.568 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:50.562+0000 7f5c558946c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f5c501238a0 con 0x7f5c50115410 2026-02-13T02:18:50.568 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:50.562+0000 7f5c4f7fe6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f5c50122b90 0x7f5c50123030 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:18:50.568 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:50.562+0000 7f5c4f7fe6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f5c50122b90 0x7f5c50123030 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:53308/0 (socket says 10.20.193.11:53308) 2026-02-13T02:18:50.568 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:50.562+0000 7f5c4f7fe6c0 1 -- 10.20.193.11:0/512660093 learned_addr learned my addr 10.20.193.11:0/512660093 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:18:50.568 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:50.562+0000 7f5c4effd6c0 1 --2- 10.20.193.11:0/512660093 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f5c5010f200 0x7f5c5011d290 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:18:50.568 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:50.562+0000 7f5c4e7fc6c0 1 --2- 10.20.193.11:0/512660093 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f5c50115410 0x7f5c5011d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:18:50.568 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:50.563+0000 7f5c4f7fe6c0 1 -- 10.20.193.11:0/512660093 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f5c50115410 msgr2=0x7f5c5011d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:50.568 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:50.563+0000 7f5c4f7fe6c0 1 --2- 10.20.193.11:0/512660093 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f5c50115410 0x7f5c5011d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:50.568 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:50.563+0000 7f5c4f7fe6c0 1 -- 10.20.193.11:0/512660093 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f5c5010f200 msgr2=0x7f5c5011d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:50.568 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:50.563+0000 7f5c4f7fe6c0 1 --2- 10.20.193.11:0/512660093 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f5c5010f200 0x7f5c5011d290 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:50.568 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:50.563+0000 7f5c4f7fe6c0 1 -- 10.20.193.11:0/512660093 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c44009590 con 0x7f5c50122b90 2026-02-13T02:18:50.569 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:50.563+0000 7f5c4e7fc6c0 1 --2- 10.20.193.11:0/512660093 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f5c50115410 0x7f5c5011d7d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T02:18:50.569 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:50.563+0000 7f5c4f7fe6c0 1 --2- 10.20.193.11:0/512660093 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f5c50122b90 0x7f5c50123030 secure :-1 s=READY pgs=198 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5c4000c730 tx=0x7f5c4000cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:18:50.569 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:50.563+0000 7f5c5488e6c0 1 -- 10.20.193.11:0/512660093 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5c40003c40 con 0x7f5c50122b90 2026-02-13T02:18:50.569 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:50.563+0000 7f5c5488e6c0 1 -- 10.20.193.11:0/512660093 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f5c4000a070 con 0x7f5c50122b90 2026-02-13T02:18:50.569 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:50.563+0000 7f5c5488e6c0 1 -- 10.20.193.11:0/512660093 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5c4000dd40 con 0x7f5c50122b90 2026-02-13T02:18:50.569 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:50.563+0000 7f5c558946c0 1 -- 10.20.193.11:0/512660093 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c50163d20 con 0x7f5c50122b90 2026-02-13T02:18:50.569 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:50.563+0000 7f5c558946c0 1 -- 10.20.193.11:0/512660093 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c501641b0 con 0x7f5c50122b90 2026-02-13T02:18:50.569 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:50.563+0000 7f5c558946c0 1 -- 10.20.193.11:0/512660093 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c501104d0 con 0x7f5c50122b90 2026-02-13T02:18:50.570 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:50.565+0000 7f5c5488e6c0 1 -- 10.20.193.11:0/512660093 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 10) ==== 157066+0+0 (secure 0 0 0) 0x7f5c40005030 con 0x7f5c50122b90 2026-02-13T02:18:50.570 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:50.565+0000 7f5c5488e6c0 1 --2- 10.20.193.11:0/512660093 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f5c240b5680 0x7f5c240d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:18:50.570 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:50.565+0000 7f5c5488e6c0 1 -- 10.20.193.11:0/512660093 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6904+0+0 (secure 0 0 0) 0x7f5c400e4560 con 0x7f5c50122b90 2026-02-13T02:18:50.570 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:50.565+0000 7f5c4effd6c0 1 --2- 10.20.193.11:0/512660093 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f5c240b5680 0x7f5c240d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:18:50.571 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:50.566+0000 7f5c4effd6c0 1 --2- 10.20.193.11:0/512660093 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f5c240b5680 0x7f5c240d5b30 secure :-1 s=READY pgs=151 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5c440098c0 tx=0x7f5c440023a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:18:50.571 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:50.566+0000 7f5c5488e6c0 1 -- 10.20.193.11:0/512660093 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f5c400a7440 con 0x7f5c50122b90 2026-02-13T02:18:50.683 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:50.681+0000 7f5c558946c0 1 -- 10.20.193.11:0/512660093 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5c5011e3e0 con 0x7f5c50122b90 2026-02-13T02:18:50.684 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:50.682+0000 7f5c5488e6c0 1 -- 10.20.193.11:0/512660093 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+4726 (secure 0 0 0) 0x7f5c400aa5f0 con 0x7f5c50122b90 2026-02-13T02:18:50.684 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:18:50.684 INFO:teuthology.orchestra.run.trial011.stdout:{"epoch":5,"btime":"2026-02-13T02:18:49:908953+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14718,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.11:6835/50369882","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6834","nonce":50369882},{"type":"v1","addr":"10.20.193.11:6835","nonce":50369882}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.11:6837/2639332668","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6836","nonce":2639332668},{"type":"v1","addr":"10.20.193.11:6837","nonce":2639332668}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.78:6833/3863251566","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6832","nonce":3863251566},{"type":"v1","addr":"10.20.193.78:6833","nonce":3863251566}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24452,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.60:6833/2039450283","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6832","nonce":2039450283},{"type":"v1","addr":"10.20.193.60:6833","nonce":2039450283}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24473,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.60:6835/937612650","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6834","nonce":937612650},{"type":"v1","addr":"10.20.193.60:6835","nonce":937612650}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[]} 2026-02-13T02:18:50.685 INFO:teuthology.orchestra.run.trial011.stderr:dumped fsmap epoch 5 2026-02-13T02:18:50.686 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:50.684+0000 7f5c558946c0 1 -- 10.20.193.11:0/512660093 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f5c240b5680 msgr2=0x7f5c240d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:50.686 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:50.684+0000 7f5c558946c0 1 --2- 10.20.193.11:0/512660093 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f5c240b5680 0x7f5c240d5b30 secure :-1 s=READY pgs=151 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5c440098c0 tx=0x7f5c440023a0 comp rx=0 tx=0).stop 2026-02-13T02:18:50.686 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:50.684+0000 7f5c558946c0 1 -- 10.20.193.11:0/512660093 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f5c50122b90 msgr2=0x7f5c50123030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:50.686 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:50.684+0000 7f5c558946c0 1 --2- 10.20.193.11:0/512660093 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f5c50122b90 0x7f5c50123030 secure :-1 s=READY pgs=198 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5c4000c730 tx=0x7f5c4000cc00 comp rx=0 tx=0).stop 2026-02-13T02:18:50.686 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:50.684+0000 7f5c558946c0 1 -- 10.20.193.11:0/512660093 shutdown_connections 2026-02-13T02:18:50.687 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:50.684+0000 7f5c558946c0 1 --2- 10.20.193.11:0/512660093 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f5c240b5680 0x7f5c240d5b30 unknown :-1 s=CLOSED pgs=151 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:50.687 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:50.684+0000 7f5c558946c0 1 --2- 10.20.193.11:0/512660093 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f5c50122b90 0x7f5c50123030 unknown :-1 s=CLOSED pgs=198 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:50.687 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:50.684+0000 7f5c558946c0 1 --2- 10.20.193.11:0/512660093 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f5c50115410 0x7f5c5011d7d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:50.687 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:50.684+0000 7f5c558946c0 1 --2- 10.20.193.11:0/512660093 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f5c5010f200 0x7f5c5011d290 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:50.687 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:50.684+0000 7f5c558946c0 1 -- 10.20.193.11:0/512660093 >> 10.20.193.11:0/512660093 conn(0x7f5c500ecb00 msgr2=0x7f5c5010cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:18:50.687 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:50.684+0000 7f5c558946c0 1 -- 10.20.193.11:0/512660093 shutdown_connections 2026-02-13T02:18:50.687 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:50.684+0000 7f5c558946c0 1 -- 10.20.193.11:0/512660093 wait complete. 2026-02-13T02:18:50.792 INFO:journalctl@ceph.mds.c.trial078.stdout:Feb 13 02:18:50 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mds-c[43602]: starting mds.c at 2026-02-13T02:18:50.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:50 trial011 ceph-mon[11956]: mds.? [v2:10.20.193.60:6834/937612650,v1:10.20.193.60:6835/937612650] up:boot 2026-02-13T02:18:50.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:50 trial011 ceph-mon[11956]: fsmap 5 up:standby 2026-02-13T02:18:50.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:50 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2026-02-13T02:18:50.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:50 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:50.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:50 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:50.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:50 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:50.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:50 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T02:18:50.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:50 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T02:18:50.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:50 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:50.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:50 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/512660093' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T02:18:50.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:50 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:50.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:50 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:50.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:50 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:50.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:50 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T02:18:50.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:50 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T02:18:50.954 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:50 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:51.189 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:50 trial060 ceph-mon[14797]: mds.? [v2:10.20.193.60:6834/937612650,v1:10.20.193.60:6835/937612650] up:boot 2026-02-13T02:18:51.190 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:50 trial060 ceph-mon[14797]: fsmap 5 up:standby 2026-02-13T02:18:51.190 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:50 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2026-02-13T02:18:51.190 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:50 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:51.190 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:50 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:51.190 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:50 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:51.190 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:50 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T02:18:51.190 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:50 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T02:18:51.190 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:50 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:51.190 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:50 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/512660093' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T02:18:51.190 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:50 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:51.190 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:50 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:51.190 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:50 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:51.190 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:50 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T02:18:51.190 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:50 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T02:18:51.190 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:50 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:51.291 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:50 trial078 ceph-mon[14969]: mds.? [v2:10.20.193.60:6834/937612650,v1:10.20.193.60:6835/937612650] up:boot 2026-02-13T02:18:51.291 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:50 trial078 ceph-mon[14969]: fsmap 5 up:standby 2026-02-13T02:18:51.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:50 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2026-02-13T02:18:51.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:50 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:51.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:50 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:51.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:50 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:51.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:50 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T02:18:51.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:50 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T02:18:51.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:50 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:51.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:50 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/512660093' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T02:18:51.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:50 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:51.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:50 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:51.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:50 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:51.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:50 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T02:18:51.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:50 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T02:18:51.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:50 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:51.750 INFO:journalctl@ceph.mds.h.trial060.stdout:Feb 13 02:18:51 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mds-h[43348]: starting mds.h at 2026-02-13T02:18:51.955 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:51 trial078 ceph-mon[14969]: mds.? [v2:10.20.193.78:6834/3989291038,v1:10.20.193.78:6835/3989291038] up:boot 2026-02-13T02:18:51.955 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:51 trial078 ceph-mon[14969]: mds.? [v2:10.20.193.78:6836/35592594,v1:10.20.193.78:6837/35592594] up:boot 2026-02-13T02:18:51.955 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:51 trial078 ceph-mon[14969]: fsmap 7 up:standby 2026-02-13T02:18:51.956 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:51 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2026-02-13T02:18:51.956 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:51 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2026-02-13T02:18:51.956 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:51 trial078 ceph-mon[14969]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T02:18:51.956 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:51 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:51.956 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:51 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:51.956 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:51 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:51.956 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:51 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T02:18:51.956 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:51 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T02:18:51.956 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:51 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:52.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:51 trial011 ceph-mon[11956]: mds.? [v2:10.20.193.78:6834/3989291038,v1:10.20.193.78:6835/3989291038] up:boot 2026-02-13T02:18:52.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:51 trial011 ceph-mon[11956]: mds.? [v2:10.20.193.78:6836/35592594,v1:10.20.193.78:6837/35592594] up:boot 2026-02-13T02:18:52.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:51 trial011 ceph-mon[11956]: fsmap 7 up:standby 2026-02-13T02:18:52.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:51 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2026-02-13T02:18:52.203 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:51 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2026-02-13T02:18:52.203 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:51 trial011 ceph-mon[11956]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T02:18:52.203 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:51 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:52.203 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:51 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:52.203 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:51 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:52.203 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:51 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T02:18:52.203 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:51 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T02:18:52.203 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:51 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:52.250 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:51 trial060 ceph-mon[14797]: mds.? [v2:10.20.193.78:6834/3989291038,v1:10.20.193.78:6835/3989291038] up:boot 2026-02-13T02:18:52.250 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:51 trial060 ceph-mon[14797]: mds.? [v2:10.20.193.78:6836/35592594,v1:10.20.193.78:6837/35592594] up:boot 2026-02-13T02:18:52.250 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:51 trial060 ceph-mon[14797]: fsmap 7 up:standby 2026-02-13T02:18:52.250 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:51 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2026-02-13T02:18:52.251 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:51 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2026-02-13T02:18:52.251 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:51 trial060 ceph-mon[14797]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T02:18:52.251 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:51 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:52.251 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:51 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:52.251 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:51 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:52.251 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:51 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T02:18:52.251 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:51 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T02:18:52.251 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:51 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:52.542 INFO:journalctl@ceph.mds.i.trial078.stdout:Feb 13 02:18:52 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mds-i[43965]: starting mds.i at 2026-02-13T02:18:52.726 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph fs dump --format=json 2026-02-13T02:18:52.923 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:18:53.037 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:52 trial011 ceph-mon[11956]: mds.? [v2:10.20.193.60:6836/1730049678,v1:10.20.193.60:6837/1730049678] up:boot 2026-02-13T02:18:53.037 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:52 trial011 ceph-mon[11956]: fsmap 8 up:standby 2026-02-13T02:18:53.037 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:52 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2026-02-13T02:18:53.038 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:52 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:53.038 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:52 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:53.038 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:52 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:53.038 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:52 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T02:18:53.038 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:52 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T02:18:53.038 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:52 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:53.038 INFO:journalctl@ceph.mds.g.trial011.stdout:Feb 13 02:18:52 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mds-g[48673]: starting mds.g at 2026-02-13T02:18:53.048 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:53.044+0000 7f4d0ef486c0 1 -- 10.20.193.11:0/2505276265 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f4d0810f230 msgr2=0x7f4d0810f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:53.048 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:53.044+0000 7f4d0ef486c0 1 --2- 10.20.193.11:0/2505276265 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f4d0810f230 0x7f4d0810f600 secure :-1 s=READY pgs=201 gs=1 cs=0 l=1 c_cookie=7925176678757774541 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4cf80099a0 tx=0x7f4cf802ed20 comp rx=0 tx=0).stop 2026-02-13T02:18:53.048 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:53.044+0000 7f4d0ef486c0 1 -- 10.20.193.11:0/2505276265 shutdown_connections 2026-02-13T02:18:53.048 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:53.044+0000 7f4d0ef486c0 1 --2- 10.20.193.11:0/2505276265 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f4d08115440 0x7f4d08175de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:53.049 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:53.044+0000 7f4d0ef486c0 1 --2- 10.20.193.11:0/2505276265 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f4d0810fc20 0x7f4d08114c60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:53.049 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:53.044+0000 7f4d0ef486c0 1 --2- 10.20.193.11:0/2505276265 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f4d0810f230 0x7f4d0810f600 unknown :-1 s=CLOSED pgs=201 gs=1 cs=0 l=1 c_cookie=7925176678757774541 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:53.049 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:53.044+0000 7f4d0ef486c0 1 -- 10.20.193.11:0/2505276265 >> 10.20.193.11:0/2505276265 conn(0x7f4d080ecb30 msgr2=0x7f4d0810cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:18:53.049 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:53.044+0000 7f4d0ef486c0 1 -- 10.20.193.11:0/2505276265 shutdown_connections 2026-02-13T02:18:53.049 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:53.044+0000 7f4d0ef486c0 1 -- 10.20.193.11:0/2505276265 wait complete. 2026-02-13T02:18:53.049 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:53.044+0000 7f4d0ef486c0 1 Processor -- start 2026-02-13T02:18:53.049 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:53.045+0000 7f4d0ef486c0 1 -- start start 2026-02-13T02:18:53.049 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:53.045+0000 7f4d0ef486c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f4d0810f230 0x7f4d0811d1e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:18:53.049 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:53.045+0000 7f4d0ef486c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f4d08115440 0x7f4d0811d720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:18:53.049 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:53.045+0000 7f4d0ef486c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f4d08122ae0 0x7f4d08122f80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:18:53.049 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:53.045+0000 7f4d0ef486c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f4d081234f0 con 0x7f4d08122ae0 2026-02-13T02:18:53.049 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:53.045+0000 7f4d0ef486c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f4d08123660 con 0x7f4d08115440 2026-02-13T02:18:53.050 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:53.045+0000 7f4d0ef486c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f4d08123820 con 0x7f4d0810f230 2026-02-13T02:18:53.050 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:53.045+0000 7f4d0d4be6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f4d08122ae0 0x7f4d08122f80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:18:53.050 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:53.045+0000 7f4d0d4be6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f4d08122ae0 0x7f4d08122f80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:59862/0 (socket says 10.20.193.11:59862) 2026-02-13T02:18:53.050 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:53.045+0000 7f4d0d4be6c0 1 -- 10.20.193.11:0/1713451359 learned_addr learned my addr 10.20.193.11:0/1713451359 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:18:53.050 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:53.045+0000 7f4d0ccbd6c0 1 --2- 10.20.193.11:0/1713451359 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f4d0810f230 0x7f4d0811d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:18:53.050 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:53.045+0000 7f4cfffff6c0 1 --2- 10.20.193.11:0/1713451359 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f4d08115440 0x7f4d0811d720 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:18:53.050 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:53.045+0000 7f4d0d4be6c0 1 -- 10.20.193.11:0/1713451359 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f4d0810f230 msgr2=0x7f4d0811d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:53.050 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:53.045+0000 7f4d0d4be6c0 1 --2- 10.20.193.11:0/1713451359 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f4d0810f230 0x7f4d0811d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:53.050 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:53.045+0000 7f4d0d4be6c0 1 -- 10.20.193.11:0/1713451359 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f4d08115440 msgr2=0x7f4d0811d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:53.050 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:53.045+0000 7f4d0d4be6c0 1 --2- 10.20.193.11:0/1713451359 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f4d08115440 0x7f4d0811d720 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:53.050 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:53.045+0000 7f4d0d4be6c0 1 -- 10.20.193.11:0/1713451359 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cf8009590 con 0x7f4d08122ae0 2026-02-13T02:18:53.051 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:53.045+0000 7f4cfffff6c0 1 --2- 10.20.193.11:0/1713451359 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f4d08115440 0x7f4d0811d720 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:18:53.051 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:53.045+0000 7f4d0ccbd6c0 1 --2- 10.20.193.11:0/1713451359 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f4d0810f230 0x7f4d0811d1e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T02:18:53.051 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:53.045+0000 7f4d0d4be6c0 1 --2- 10.20.193.11:0/1713451359 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f4d08122ae0 0x7f4d08122f80 secure :-1 s=READY pgs=202 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4d04006ea0 tx=0x7f4d0400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:18:53.051 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:53.045+0000 7f4cfdffb6c0 1 -- 10.20.193.11:0/1713451359 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4d04003a30 con 0x7f4d08122ae0 2026-02-13T02:18:53.051 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:53.045+0000 7f4cfdffb6c0 1 -- 10.20.193.11:0/1713451359 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4d04005510 con 0x7f4d08122ae0 2026-02-13T02:18:53.051 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:53.045+0000 7f4d0ef486c0 1 -- 10.20.193.11:0/1713451359 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d08163cd0 con 0x7f4d08122ae0 2026-02-13T02:18:53.051 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:53.045+0000 7f4cfdffb6c0 1 -- 10.20.193.11:0/1713451359 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4d0400dd70 con 0x7f4d08122ae0 2026-02-13T02:18:53.051 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:53.045+0000 7f4d0ef486c0 1 -- 10.20.193.11:0/1713451359 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d081641b0 con 0x7f4d08122ae0 2026-02-13T02:18:53.051 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:53.046+0000 7f4d0ef486c0 1 -- 10.20.193.11:0/1713451359 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d08110500 con 0x7f4d08122ae0 2026-02-13T02:18:53.052 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:53.047+0000 7f4cfdffb6c0 1 -- 10.20.193.11:0/1713451359 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 10) ==== 157066+0+0 (secure 0 0 0) 0x7f4d04003b90 con 0x7f4d08122ae0 2026-02-13T02:18:53.052 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:53.048+0000 7f4cfdffb6c0 1 --2- 10.20.193.11:0/1713451359 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f4ce40b5680 0x7f4ce40d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:18:53.052 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:53.048+0000 7f4d0ccbd6c0 1 --2- 10.20.193.11:0/1713451359 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f4ce40b5680 0x7f4ce40d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:18:53.052 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:53.048+0000 7f4cfdffb6c0 1 -- 10.20.193.11:0/1713451359 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6904+0+0 (secure 0 0 0) 0x7f4d040e46b0 con 0x7f4d08122ae0 2026-02-13T02:18:53.053 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:53.048+0000 7f4cfdffb6c0 1 -- 10.20.193.11:0/1713451359 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f4d040a75d0 con 0x7f4d08122ae0 2026-02-13T02:18:53.053 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:53.048+0000 7f4d0ccbd6c0 1 --2- 10.20.193.11:0/1713451359 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f4ce40b5680 0x7f4ce40d5b30 secure :-1 s=READY pgs=156 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4cf80023e0 tx=0x7f4cf8031f90 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:18:53.164 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:53.162+0000 7f4d0ef486c0 1 -- 10.20.193.11:0/1713451359 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4d0810f600 con 0x7f4d08122ae0 2026-02-13T02:18:53.164 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:53.163+0000 7f4cfdffb6c0 1 -- 10.20.193.11:0/1713451359 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+8020 (secure 0 0 0) 0x7f4d040aa780 con 0x7f4d08122ae0 2026-02-13T02:18:53.164 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:18:53.165 INFO:teuthology.orchestra.run.trial011.stdout:{"epoch":8,"btime":"2026-02-13T02:18:52:919771+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14718,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.11:6835/50369882","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6834","nonce":50369882},{"type":"v1","addr":"10.20.193.11:6835","nonce":50369882}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.11:6837/2639332668","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6836","nonce":2639332668},{"type":"v1","addr":"10.20.193.11:6837","nonce":2639332668}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.78:6833/3863251566","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6832","nonce":3863251566},{"type":"v1","addr":"10.20.193.78:6833","nonce":3863251566}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24448,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.78:6835/3989291038","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6834","nonce":3989291038},{"type":"v1","addr":"10.20.193.78:6835","nonce":3989291038}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24452,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.60:6833/2039450283","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6832","nonce":2039450283},{"type":"v1","addr":"10.20.193.60:6833","nonce":2039450283}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24457,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.78:6837/35592594","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6836","nonce":35592594},{"type":"v1","addr":"10.20.193.78:6837","nonce":35592594}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.78:6839/2341862516","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6838","nonce":2341862516},{"type":"v1","addr":"10.20.193.78:6839","nonce":2341862516}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24473,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.60:6835/937612650","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6834","nonce":937612650},{"type":"v1","addr":"10.20.193.60:6835","nonce":937612650}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24497,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.60:6837/1730049678","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6836","nonce":1730049678},{"type":"v1","addr":"10.20.193.60:6837","nonce":1730049678}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[]} 2026-02-13T02:18:53.165 INFO:teuthology.orchestra.run.trial011.stderr:dumped fsmap epoch 8 2026-02-13T02:18:53.166 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:53.164+0000 7f4d0ef486c0 1 -- 10.20.193.11:0/1713451359 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f4ce40b5680 msgr2=0x7f4ce40d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:53.166 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:53.164+0000 7f4d0ef486c0 1 --2- 10.20.193.11:0/1713451359 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f4ce40b5680 0x7f4ce40d5b30 secure :-1 s=READY pgs=156 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4cf80023e0 tx=0x7f4cf8031f90 comp rx=0 tx=0).stop 2026-02-13T02:18:53.166 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:53.165+0000 7f4d0ef486c0 1 -- 10.20.193.11:0/1713451359 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f4d08122ae0 msgr2=0x7f4d08122f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:53.166 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:53.165+0000 7f4d0ef486c0 1 --2- 10.20.193.11:0/1713451359 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f4d08122ae0 0x7f4d08122f80 secure :-1 s=READY pgs=202 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4d04006ea0 tx=0x7f4d0400cca0 comp rx=0 tx=0).stop 2026-02-13T02:18:53.166 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:53.165+0000 7f4d0ef486c0 1 -- 10.20.193.11:0/1713451359 shutdown_connections 2026-02-13T02:18:53.166 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:53.165+0000 7f4d0ef486c0 1 --2- 10.20.193.11:0/1713451359 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f4ce40b5680 0x7f4ce40d5b30 unknown :-1 s=CLOSED pgs=156 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:53.166 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:53.165+0000 7f4d0ef486c0 1 --2- 10.20.193.11:0/1713451359 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f4d08115440 0x7f4d0811d720 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:53.167 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:53.165+0000 7f4d0ef486c0 1 --2- 10.20.193.11:0/1713451359 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f4d08122ae0 0x7f4d08122f80 unknown :-1 s=CLOSED pgs=202 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:53.167 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:53.165+0000 7f4d0ef486c0 1 --2- 10.20.193.11:0/1713451359 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f4d0810f230 0x7f4d0811d1e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:53.167 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:53.165+0000 7f4d0ef486c0 1 -- 10.20.193.11:0/1713451359 >> 10.20.193.11:0/1713451359 conn(0x7f4d080ecb30 msgr2=0x7f4d0810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:18:53.167 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:53.165+0000 7f4d0ef486c0 1 -- 10.20.193.11:0/1713451359 shutdown_connections 2026-02-13T02:18:53.167 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:53.165+0000 7f4d0ef486c0 1 -- 10.20.193.11:0/1713451359 wait complete. 2026-02-13T02:18:53.250 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:52 trial060 ceph-mon[14797]: mds.? [v2:10.20.193.60:6836/1730049678,v1:10.20.193.60:6837/1730049678] up:boot 2026-02-13T02:18:53.250 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:52 trial060 ceph-mon[14797]: fsmap 8 up:standby 2026-02-13T02:18:53.250 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:52 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2026-02-13T02:18:53.250 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:52 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:53.250 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:52 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:53.251 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:52 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:53.251 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:52 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T02:18:53.251 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:52 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T02:18:53.251 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:52 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:53.291 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:52 trial078 ceph-mon[14969]: mds.? [v2:10.20.193.60:6836/1730049678,v1:10.20.193.60:6837/1730049678] up:boot 2026-02-13T02:18:53.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:52 trial078 ceph-mon[14969]: fsmap 8 up:standby 2026-02-13T02:18:53.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:52 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2026-02-13T02:18:53.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:52 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:53.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:52 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:53.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:52 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:53.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:52 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T02:18:53.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:52 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T02:18:53.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:52 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:53.681 INFO:journalctl@ceph.mds.a.trial011.stdout:Feb 13 02:18:53 trial011 systemd[1]: Starting ceph-fc631695-0881-11f1-899c-d404e6e7d460@mds.a.service - Ceph mds.a for fc631695-0881-11f1-899c-d404e6e7d460... 2026-02-13T02:18:53.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:53 trial011 ceph-mon[11956]: mds.? [v2:10.20.193.78:6838/2341862516,v1:10.20.193.78:6839/2341862516] up:boot 2026-02-13T02:18:53.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:53 trial011 ceph-mon[11956]: fsmap 9 up:standby 2026-02-13T02:18:53.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:53 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2026-02-13T02:18:53.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:53 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:53.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:53 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:53.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:53 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:53.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:53 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T02:18:53.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:53 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T02:18:53.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:53 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:53.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:53 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/1713451359' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T02:18:53.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:53 trial011 ceph-mon[11956]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T02:18:53.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:53 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:53.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:53 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:53.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:53 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:53.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:53 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T02:18:53.954 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:53 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T02:18:53.954 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:53 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:53.954 INFO:journalctl@ceph.mds.a.trial011.stdout:Feb 13 02:18:53 trial011 podman[49077]: 2026-02-13 02:18:53.679589816 +0000 UTC m=+0.016542680 container create fb5fa1473bf06a82acdbb3c87fe6ab75311c2366820c6e011d66b22b28f4d7a9 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-fc631695-0881-11f1-899c-d404e6e7d460-mds-a, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_REF=wip-pdonnell-testing-20260210.171210, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, name=rockylinux, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.version=10, io.buildah.version=1.33.7, ceph=True, vendor=Rocky Enterprise Software Foundation, version=10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.title=rockylinux, summary=Rocky Linux Base image, license=BSD-3-Clause, OSD_FLAVOR=default) 2026-02-13T02:18:53.954 INFO:journalctl@ceph.mds.a.trial011.stdout:Feb 13 02:18:53 trial011 podman[49077]: 2026-02-13 02:18:53.703434795 +0000 UTC m=+0.040387679 container init fb5fa1473bf06a82acdbb3c87fe6ab75311c2366820c6e011d66b22b28f4d7a9 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-fc631695-0881-11f1-899c-d404e6e7d460-mds-a, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.authors=Ceph Release Team , summary=Rocky Linux Base image, io.buildah.version=1.33.7, ceph=True, license=BSD-3-Clause, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, vendor=Rocky Enterprise Software Foundation, OSD_FLAVOR=default, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.documentation=https://docs.ceph.com/, name=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.version=10, org.opencontainers.image.title=rockylinux, CEPH_REF=wip-pdonnell-testing-20260210.171210, version=10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f) 2026-02-13T02:18:53.954 INFO:journalctl@ceph.mds.a.trial011.stdout:Feb 13 02:18:53 trial011 podman[49077]: 2026-02-13 02:18:53.704867457 +0000 UTC m=+0.041820321 container start fb5fa1473bf06a82acdbb3c87fe6ab75311c2366820c6e011d66b22b28f4d7a9 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-fc631695-0881-11f1-899c-d404e6e7d460-mds-a, license=BSD-3-Clause, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, summary=Rocky Linux Base image, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, vendor=Rocky Enterprise Software Foundation, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, ceph=True, name=rockylinux, io.buildah.version=1.33.7, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.title=rockylinux, CEPH_REF=wip-pdonnell-testing-20260210.171210, version=10, OSD_FLAVOR=default, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.version=10) 2026-02-13T02:18:53.955 INFO:journalctl@ceph.mds.a.trial011.stdout:Feb 13 02:18:53 trial011 bash[49077]: fb5fa1473bf06a82acdbb3c87fe6ab75311c2366820c6e011d66b22b28f4d7a9 2026-02-13T02:18:53.955 INFO:journalctl@ceph.mds.a.trial011.stdout:Feb 13 02:18:53 trial011 podman[49077]: 2026-02-13 02:18:53.673019096 +0000 UTC m=+0.009971960 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T02:18:53.955 INFO:journalctl@ceph.mds.a.trial011.stdout:Feb 13 02:18:53 trial011 systemd[1]: Started ceph-fc631695-0881-11f1-899c-d404e6e7d460@mds.a.service - Ceph mds.a for fc631695-0881-11f1-899c-d404e6e7d460. 2026-02-13T02:18:53.955 INFO:journalctl@ceph.mds.a.trial011.stdout:Feb 13 02:18:53 trial011 ceph-mds[49104]: -- 10.20.193.11:0/3877165447 <== mon.0 v2:10.20.193.11:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55fd7bbab860 con 0x55fd7bc61000 2026-02-13T02:18:53.955 INFO:journalctl@ceph.mds.a.trial011.stdout:Feb 13 02:18:53 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mds-a[49100]: starting mds.a at 2026-02-13T02:18:54.214 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:53 trial060 ceph-mon[14797]: mds.? [v2:10.20.193.78:6838/2341862516,v1:10.20.193.78:6839/2341862516] up:boot 2026-02-13T02:18:54.215 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:53 trial060 ceph-mon[14797]: fsmap 9 up:standby 2026-02-13T02:18:54.215 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:53 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2026-02-13T02:18:54.215 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:53 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:54.215 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:53 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:54.215 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:53 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:54.215 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:53 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T02:18:54.215 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:53 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T02:18:54.215 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:53 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:54.216 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:53 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/1713451359' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T02:18:54.216 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:53 trial060 ceph-mon[14797]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T02:18:54.216 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:53 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:54.216 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:53 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:54.216 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:53 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:54.216 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:53 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T02:18:54.216 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:53 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T02:18:54.216 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:53 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:54.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:53 trial078 ceph-mon[14969]: mds.? [v2:10.20.193.78:6838/2341862516,v1:10.20.193.78:6839/2341862516] up:boot 2026-02-13T02:18:54.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:53 trial078 ceph-mon[14969]: fsmap 9 up:standby 2026-02-13T02:18:54.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:53 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2026-02-13T02:18:54.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:53 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:54.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:53 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:54.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:53 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:54.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:53 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T02:18:54.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:53 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T02:18:54.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:53 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:54.293 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:53 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/1713451359' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T02:18:54.293 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:53 trial078 ceph-mon[14969]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T02:18:54.293 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:53 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:54.293 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:53 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:54.293 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:53 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:54.293 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:53 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T02:18:54.293 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:53 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T02:18:54.293 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:53 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:54.750 INFO:journalctl@ceph.mds.b.trial060.stdout:Feb 13 02:18:54 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mds-b[43709]: starting mds.b at 2026-02-13T02:18:55.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:54 trial078 ceph-mon[14969]: mds.? [v2:10.20.193.11:6838/1734176453,v1:10.20.193.11:6839/1734176453] up:boot 2026-02-13T02:18:55.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:54 trial078 ceph-mon[14969]: mds.? [v2:10.20.193.11:6840/985131365,v1:10.20.193.11:6841/985131365] up:boot 2026-02-13T02:18:55.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:54 trial078 ceph-mon[14969]: fsmap 11 up:standby 2026-02-13T02:18:55.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:54 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2026-02-13T02:18:55.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:54 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2026-02-13T02:18:55.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:54 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:55.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:54 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:55.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:54 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:55.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:54 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:55.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:54 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:55.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:54 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:18:55.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:54 trial011 ceph-mon[11956]: mds.? [v2:10.20.193.11:6838/1734176453,v1:10.20.193.11:6839/1734176453] up:boot 2026-02-13T02:18:55.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:54 trial011 ceph-mon[11956]: mds.? [v2:10.20.193.11:6840/985131365,v1:10.20.193.11:6841/985131365] up:boot 2026-02-13T02:18:55.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:54 trial011 ceph-mon[11956]: fsmap 11 up:standby 2026-02-13T02:18:55.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:54 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2026-02-13T02:18:55.203 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:54 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2026-02-13T02:18:55.203 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:54 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:55.203 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:54 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:55.203 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:54 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:55.203 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:54 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:55.203 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:54 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:55.203 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:54 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:18:55.205 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph fs dump --format=json 2026-02-13T02:18:55.250 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:54 trial060 ceph-mon[14797]: mds.? [v2:10.20.193.11:6838/1734176453,v1:10.20.193.11:6839/1734176453] up:boot 2026-02-13T02:18:55.250 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:54 trial060 ceph-mon[14797]: mds.? [v2:10.20.193.11:6840/985131365,v1:10.20.193.11:6841/985131365] up:boot 2026-02-13T02:18:55.250 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:54 trial060 ceph-mon[14797]: fsmap 11 up:standby 2026-02-13T02:18:55.250 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:54 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2026-02-13T02:18:55.251 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:54 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2026-02-13T02:18:55.251 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:54 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:55.251 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:54 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:55.251 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:54 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:55.251 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:54 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:55.251 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:54 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:55.251 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:54 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:18:55.329 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:18:55.448 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.444+0000 7f06f938c6c0 1 -- 10.20.193.11:0/337083849 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f06f4155730 msgr2=0x7f06f4175b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:55.448 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.444+0000 7f06f938c6c0 1 --2- 10.20.193.11:0/337083849 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f06f4155730 0x7f06f4175b10 secure :-1 s=READY pgs=205 gs=1 cs=0 l=1 c_cookie=1652846416389976196 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f06e400aa40 tx=0x7f06e402fde0 comp rx=0 tx=0).stop 2026-02-13T02:18:55.449 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.444+0000 7f06f938c6c0 1 -- 10.20.193.11:0/337083849 shutdown_connections 2026-02-13T02:18:55.449 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.444+0000 7f06f938c6c0 1 --2- 10.20.193.11:0/337083849 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f06f4155730 0x7f06f4175b10 unknown :-1 s=CLOSED pgs=205 gs=1 cs=0 l=1 c_cookie=1652846416389976196 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:55.449 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.444+0000 7f06f938c6c0 1 --2- 10.20.193.11:0/337083849 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f06f410c310 0x7f06f41551f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:55.449 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.444+0000 7f06f938c6c0 1 --2- 10.20.193.11:0/337083849 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f06f410ba00 0x7f06f410bdd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:55.449 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.445+0000 7f06f938c6c0 1 -- 10.20.193.11:0/337083849 >> 10.20.193.11:0/337083849 conn(0x7f06f40e9700 msgr2=0x7f06f4109b10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:18:55.449 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.445+0000 7f06f938c6c0 1 -- 10.20.193.11:0/337083849 shutdown_connections 2026-02-13T02:18:55.449 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.445+0000 7f06f938c6c0 1 -- 10.20.193.11:0/337083849 wait complete. 2026-02-13T02:18:55.449 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.445+0000 7f06f938c6c0 1 Processor -- start 2026-02-13T02:18:55.449 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.445+0000 7f06f938c6c0 1 -- start start 2026-02-13T02:18:55.449 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.445+0000 7f06f938c6c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f06f410ba00 0x7f06f4160420 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:18:55.449 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.445+0000 7f06f938c6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f06f410c310 0x7f06f4160960 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:18:55.450 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.445+0000 7f06f938c6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f06f4155730 0x7f06f4165d20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:18:55.450 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.445+0000 7f06f938c6c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f06f4166370 con 0x7f06f4155730 2026-02-13T02:18:55.450 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.445+0000 7f06f938c6c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f06f41664e0 con 0x7f06f410ba00 2026-02-13T02:18:55.450 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.445+0000 7f06f938c6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f06f41666a0 con 0x7f06f410c310 2026-02-13T02:18:55.450 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.445+0000 7f06f37fe6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f06f4155730 0x7f06f4165d20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:18:55.450 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.445+0000 7f06f37fe6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f06f4155730 0x7f06f4165d20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:59880/0 (socket says 10.20.193.11:59880) 2026-02-13T02:18:55.450 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.445+0000 7f06f37fe6c0 1 -- 10.20.193.11:0/1186184764 learned_addr learned my addr 10.20.193.11:0/1186184764 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:18:55.450 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.445+0000 7f06f27fc6c0 1 --2- 10.20.193.11:0/1186184764 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f06f410c310 0x7f06f4160960 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:18:55.450 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.445+0000 7f06f2ffd6c0 1 --2- 10.20.193.11:0/1186184764 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f06f410ba00 0x7f06f4160420 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:18:55.450 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.445+0000 7f06f37fe6c0 1 -- 10.20.193.11:0/1186184764 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f06f410c310 msgr2=0x7f06f4160960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:55.450 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.445+0000 7f06f37fe6c0 1 --2- 10.20.193.11:0/1186184764 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f06f410c310 0x7f06f4160960 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:55.450 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.445+0000 7f06f37fe6c0 1 -- 10.20.193.11:0/1186184764 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f06f410ba00 msgr2=0x7f06f4160420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:55.450 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.445+0000 7f06f37fe6c0 1 --2- 10.20.193.11:0/1186184764 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f06f410ba00 0x7f06f4160420 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:55.450 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.445+0000 7f06f37fe6c0 1 -- 10.20.193.11:0/1186184764 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06e400a660 con 0x7f06f4155730 2026-02-13T02:18:55.451 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.445+0000 7f06f37fe6c0 1 --2- 10.20.193.11:0/1186184764 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f06f4155730 0x7f06f4165d20 secure :-1 s=READY pgs=206 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f06e400a390 tx=0x7f06e4005530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:18:55.451 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.445+0000 7f06d3fff6c0 1 -- 10.20.193.11:0/1186184764 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f06e4003a30 con 0x7f06f4155730 2026-02-13T02:18:55.451 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.445+0000 7f06d3fff6c0 1 -- 10.20.193.11:0/1186184764 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f06e4003b90 con 0x7f06f4155730 2026-02-13T02:18:55.451 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.445+0000 7f06f938c6c0 1 -- 10.20.193.11:0/1186184764 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06f4166920 con 0x7f06f4155730 2026-02-13T02:18:55.451 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.445+0000 7f06d3fff6c0 1 -- 10.20.193.11:0/1186184764 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f06e4035380 con 0x7f06f4155730 2026-02-13T02:18:55.451 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.445+0000 7f06f938c6c0 1 -- 10.20.193.11:0/1186184764 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06f4166ba0 con 0x7f06f4155730 2026-02-13T02:18:55.451 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.446+0000 7f06f938c6c0 1 -- 10.20.193.11:0/1186184764 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06f405fb90 con 0x7f06f4155730 2026-02-13T02:18:55.452 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.447+0000 7f06d3fff6c0 1 -- 10.20.193.11:0/1186184764 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 10) ==== 157066+0+0 (secure 0 0 0) 0x7f06e4008350 con 0x7f06f4155730 2026-02-13T02:18:55.452 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.448+0000 7f06d3fff6c0 1 --2- 10.20.193.11:0/1186184764 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f06c80b5600 0x7f06c80d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:18:55.452 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.448+0000 7f06f2ffd6c0 1 --2- 10.20.193.11:0/1186184764 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f06c80b5600 0x7f06c80d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:18:55.452 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.448+0000 7f06d3fff6c0 1 -- 10.20.193.11:0/1186184764 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6904+0+0 (secure 0 0 0) 0x7f06e4108c10 con 0x7f06f4155730 2026-02-13T02:18:55.452 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.448+0000 7f06f2ffd6c0 1 --2- 10.20.193.11:0/1186184764 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f06c80b5600 0x7f06c80d5ab0 secure :-1 s=READY pgs=160 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f06e8005980 tx=0x7f06e80094b0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:18:55.453 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.449+0000 7f06d3fff6c0 1 -- 10.20.193.11:0/1186184764 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f06e40cbb30 con 0x7f06f4155730 2026-02-13T02:18:55.565 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.562+0000 7f06f938c6c0 1 -- 10.20.193.11:0/1186184764 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f06f4161570 con 0x7f06f4155730 2026-02-13T02:18:55.565 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.563+0000 7f06d3fff6c0 1 -- 10.20.193.11:0/1186184764 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+10494 (secure 0 0 0) 0x7f06e40cece0 con 0x7f06f4155730 2026-02-13T02:18:55.566 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:18:55.566 INFO:teuthology.orchestra.run.trial011.stdout:{"epoch":10,"btime":"2026-02-13T02:18:55:000231+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14718,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.11:6835/50369882","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6834","nonce":50369882},{"type":"v1","addr":"10.20.193.11:6835","nonce":50369882}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.11:6837/2639332668","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6836","nonce":2639332668},{"type":"v1","addr":"10.20.193.11:6837","nonce":2639332668}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14763,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.11:6839/1734176453","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6838","nonce":1734176453},{"type":"v1","addr":"10.20.193.11:6839","nonce":1734176453}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":14775,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.11:6841/985131365","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6840","nonce":985131365},{"type":"v1","addr":"10.20.193.11:6841","nonce":985131365}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.78:6833/3863251566","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6832","nonce":3863251566},{"type":"v1","addr":"10.20.193.78:6833","nonce":3863251566}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24448,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.78:6835/3989291038","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6834","nonce":3989291038},{"type":"v1","addr":"10.20.193.78:6835","nonce":3989291038}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24452,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.60:6833/2039450283","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6832","nonce":2039450283},{"type":"v1","addr":"10.20.193.60:6833","nonce":2039450283}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24457,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.78:6837/35592594","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6836","nonce":35592594},{"type":"v1","addr":"10.20.193.78:6837","nonce":35592594}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24466,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.78:6839/2341862516","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6838","nonce":2341862516},{"type":"v1","addr":"10.20.193.78:6839","nonce":2341862516}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24473,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.60:6835/937612650","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6834","nonce":937612650},{"type":"v1","addr":"10.20.193.60:6835","nonce":937612650}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24497,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.60:6837/1730049678","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6836","nonce":1730049678},{"type":"v1","addr":"10.20.193.60:6837","nonce":1730049678}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24524,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.60:6839/1675549162","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6838","nonce":1675549162},{"type":"v1","addr":"10.20.193.60:6839","nonce":1675549162}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2026-02-13T02:18:55.568 INFO:teuthology.orchestra.run.trial011.stderr:dumped fsmap epoch 10 2026-02-13T02:18:55.568 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.564+0000 7f06f938c6c0 1 -- 10.20.193.11:0/1186184764 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f06c80b5600 msgr2=0x7f06c80d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:55.568 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.564+0000 7f06f938c6c0 1 --2- 10.20.193.11:0/1186184764 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f06c80b5600 0x7f06c80d5ab0 secure :-1 s=READY pgs=160 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f06e8005980 tx=0x7f06e80094b0 comp rx=0 tx=0).stop 2026-02-13T02:18:55.568 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.564+0000 7f06f938c6c0 1 -- 10.20.193.11:0/1186184764 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f06f4155730 msgr2=0x7f06f4165d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:55.568 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.564+0000 7f06f938c6c0 1 --2- 10.20.193.11:0/1186184764 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f06f4155730 0x7f06f4165d20 secure :-1 s=READY pgs=206 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f06e400a390 tx=0x7f06e4005530 comp rx=0 tx=0).stop 2026-02-13T02:18:55.568 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.564+0000 7f06f938c6c0 1 -- 10.20.193.11:0/1186184764 shutdown_connections 2026-02-13T02:18:55.569 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.564+0000 7f06f938c6c0 1 --2- 10.20.193.11:0/1186184764 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f06c80b5600 0x7f06c80d5ab0 unknown :-1 s=CLOSED pgs=160 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:55.569 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.564+0000 7f06f938c6c0 1 --2- 10.20.193.11:0/1186184764 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f06f4155730 0x7f06f4165d20 unknown :-1 s=CLOSED pgs=206 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:55.569 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.564+0000 7f06f938c6c0 1 --2- 10.20.193.11:0/1186184764 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f06f410c310 0x7f06f4160960 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:55.569 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.564+0000 7f06f938c6c0 1 --2- 10.20.193.11:0/1186184764 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f06f410ba00 0x7f06f4160420 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:55.569 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.564+0000 7f06f938c6c0 1 -- 10.20.193.11:0/1186184764 >> 10.20.193.11:0/1186184764 conn(0x7f06f40e9700 msgr2=0x7f06f4109ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:18:55.569 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.564+0000 7f06f938c6c0 1 -- 10.20.193.11:0/1186184764 shutdown_connections 2026-02-13T02:18:55.570 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.564+0000 7f06f938c6c0 1 -- 10.20.193.11:0/1186184764 wait complete. 2026-02-13T02:18:55.604 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph --format=json-pretty osd lspools 2026-02-13T02:18:55.726 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:18:55.845 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.841+0000 7f8421fa16c0 1 -- 10.20.193.11:0/1305176117 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f841c10cfb0 msgr2=0x7f841c10d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:55.845 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.841+0000 7f8421fa16c0 1 --2- 10.20.193.11:0/1305176117 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f841c10cfb0 0x7f841c10d380 secure :-1 s=READY pgs=207 gs=1 cs=0 l=1 c_cookie=13634640735085966977 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f84080099a0 tx=0x7f840802ed50 comp rx=0 tx=0).stop 2026-02-13T02:18:55.845 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.841+0000 7f8421fa16c0 1 -- 10.20.193.11:0/1305176117 shutdown_connections 2026-02-13T02:18:55.846 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.841+0000 7f8421fa16c0 1 --2- 10.20.193.11:0/1305176117 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f841c1131c0 0x7f841c173b60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:55.846 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.841+0000 7f8421fa16c0 1 --2- 10.20.193.11:0/1305176117 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f841c10d9a0 0x7f841c1129e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:55.846 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.841+0000 7f8421fa16c0 1 --2- 10.20.193.11:0/1305176117 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f841c10cfb0 0x7f841c10d380 unknown :-1 s=CLOSED pgs=207 gs=1 cs=0 l=1 c_cookie=13634640735085966977 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:55.846 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.841+0000 7f8421fa16c0 1 -- 10.20.193.11:0/1305176117 >> 10.20.193.11:0/1305176117 conn(0x7f841c0ea8b0 msgr2=0x7f841c10acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:18:55.846 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.841+0000 7f8421fa16c0 1 -- 10.20.193.11:0/1305176117 shutdown_connections 2026-02-13T02:18:55.846 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.841+0000 7f8421fa16c0 1 -- 10.20.193.11:0/1305176117 wait complete. 2026-02-13T02:18:55.847 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.842+0000 7f8421fa16c0 1 Processor -- start 2026-02-13T02:18:55.847 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.842+0000 7f8421fa16c0 1 -- start start 2026-02-13T02:18:55.847 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.842+0000 7f8421fa16c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f841c10cfb0 0x7f841c11af40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:18:55.847 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.842+0000 7f8421fa16c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f841c1131c0 0x7f841c11b480 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:18:55.847 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.842+0000 7f8421fa16c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f841c120840 0x7f841c120ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:18:55.847 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.842+0000 7f8421fa16c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f841c121220 con 0x7f841c1131c0 2026-02-13T02:18:55.847 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.842+0000 7f8421fa16c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f841c121390 con 0x7f841c10cfb0 2026-02-13T02:18:55.847 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.842+0000 7f8421fa16c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f841c121550 con 0x7f841c120840 2026-02-13T02:18:55.847 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.842+0000 7f841affd6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f841c1131c0 0x7f841c11b480 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:18:55.847 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.842+0000 7f841affd6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f841c1131c0 0x7f841c11b480 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:59898/0 (socket says 10.20.193.11:59898) 2026-02-13T02:18:55.848 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.842+0000 7f841affd6c0 1 -- 10.20.193.11:0/4071278407 learned_addr learned my addr 10.20.193.11:0/4071278407 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:18:55.848 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.842+0000 7f841b7fe6c0 1 --2- 10.20.193.11:0/4071278407 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f841c10cfb0 0x7f841c11af40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:18:55.848 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.842+0000 7f841affd6c0 1 -- 10.20.193.11:0/4071278407 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f841c120840 msgr2=0x7f841c120ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:55.848 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.842+0000 7f841affd6c0 1 --2- 10.20.193.11:0/4071278407 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f841c120840 0x7f841c120ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:55.848 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.842+0000 7f841affd6c0 1 -- 10.20.193.11:0/4071278407 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f841c10cfb0 msgr2=0x7f841c11af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:55.848 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.842+0000 7f841affd6c0 1 --2- 10.20.193.11:0/4071278407 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f841c10cfb0 0x7f841c11af40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:55.848 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.842+0000 7f841affd6c0 1 -- 10.20.193.11:0/4071278407 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8408009590 con 0x7f841c1131c0 2026-02-13T02:18:55.848 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.842+0000 7f841affd6c0 1 --2- 10.20.193.11:0/4071278407 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f841c1131c0 0x7f841c11b480 secure :-1 s=READY pgs=208 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f840c00b650 tx=0x7f840c00bb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:18:55.848 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.842+0000 7f8418ff96c0 1 -- 10.20.193.11:0/4071278407 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f840c0044a0 con 0x7f841c1131c0 2026-02-13T02:18:55.848 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.842+0000 7f8418ff96c0 1 -- 10.20.193.11:0/4071278407 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f840c009030 con 0x7f841c1131c0 2026-02-13T02:18:55.848 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.842+0000 7f8421fa16c0 1 -- 10.20.193.11:0/4071278407 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f841c1619d0 con 0x7f841c1131c0 2026-02-13T02:18:55.848 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.842+0000 7f8418ff96c0 1 -- 10.20.193.11:0/4071278407 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f840c00ccb0 con 0x7f841c1131c0 2026-02-13T02:18:55.849 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.842+0000 7f8421fa16c0 1 -- 10.20.193.11:0/4071278407 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f841c161f00 con 0x7f841c1131c0 2026-02-13T02:18:55.849 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.843+0000 7f8421fa16c0 1 -- 10.20.193.11:0/4071278407 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f841c10e280 con 0x7f841c1131c0 2026-02-13T02:18:55.850 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.844+0000 7f8418ff96c0 1 -- 10.20.193.11:0/4071278407 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 10) ==== 157066+0+0 (secure 0 0 0) 0x7f840c0026b0 con 0x7f841c1131c0 2026-02-13T02:18:55.850 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.844+0000 7f8418ff96c0 1 --2- 10.20.193.11:0/4071278407 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f83f00b5680 0x7f83f00d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:18:55.850 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.844+0000 7f841b7fe6c0 1 --2- 10.20.193.11:0/4071278407 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f83f00b5680 0x7f83f00d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:18:55.850 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.845+0000 7f8418ff96c0 1 -- 10.20.193.11:0/4071278407 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6904+0+0 (secure 0 0 0) 0x7f840c0e34d0 con 0x7f841c1131c0 2026-02-13T02:18:55.850 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.845+0000 7f841b7fe6c0 1 --2- 10.20.193.11:0/4071278407 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f83f00b5680 0x7f83f00d5b30 secure :-1 s=READY pgs=161 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f84080023e0 tx=0x7f8408009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:18:55.850 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.845+0000 7f8418ff96c0 1 -- 10.20.193.11:0/4071278407 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f840c0a63f0 con 0x7f841c1131c0 2026-02-13T02:18:55.939 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.937+0000 7f8421fa16c0 1 -- 10.20.193.11:0/4071278407 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f841c11c090 con 0x7f841c1131c0 2026-02-13T02:18:55.939 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.937+0000 7f8418ff96c0 1 -- 10.20.193.11:0/4071278407 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v67) ==== 84+0+65 (secure 0 0 0) 0x7f840c0a95a0 con 0x7f841c1131c0 2026-02-13T02:18:55.939 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:18:55.940 INFO:teuthology.orchestra.run.trial011.stdout:[ 2026-02-13T02:18:55.940 INFO:teuthology.orchestra.run.trial011.stdout: { 2026-02-13T02:18:55.940 INFO:teuthology.orchestra.run.trial011.stdout: "poolnum": 1, 2026-02-13T02:18:55.940 INFO:teuthology.orchestra.run.trial011.stdout: "poolname": ".mgr" 2026-02-13T02:18:55.940 INFO:teuthology.orchestra.run.trial011.stdout: } 2026-02-13T02:18:55.940 INFO:teuthology.orchestra.run.trial011.stdout:] 2026-02-13T02:18:55.941 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.938+0000 7f8421fa16c0 1 -- 10.20.193.11:0/4071278407 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f83f00b5680 msgr2=0x7f83f00d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:55.941 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.938+0000 7f8421fa16c0 1 --2- 10.20.193.11:0/4071278407 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f83f00b5680 0x7f83f00d5b30 secure :-1 s=READY pgs=161 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f84080023e0 tx=0x7f8408009260 comp rx=0 tx=0).stop 2026-02-13T02:18:55.942 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.938+0000 7f8421fa16c0 1 -- 10.20.193.11:0/4071278407 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f841c1131c0 msgr2=0x7f841c11b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:55.942 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.938+0000 7f8421fa16c0 1 --2- 10.20.193.11:0/4071278407 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f841c1131c0 0x7f841c11b480 secure :-1 s=READY pgs=208 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f840c00b650 tx=0x7f840c00bb20 comp rx=0 tx=0).stop 2026-02-13T02:18:55.942 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.938+0000 7f8421fa16c0 1 -- 10.20.193.11:0/4071278407 shutdown_connections 2026-02-13T02:18:55.942 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.938+0000 7f8421fa16c0 1 --2- 10.20.193.11:0/4071278407 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f83f00b5680 0x7f83f00d5b30 unknown :-1 s=CLOSED pgs=161 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:55.942 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.938+0000 7f8421fa16c0 1 --2- 10.20.193.11:0/4071278407 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f841c120840 0x7f841c120ce0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:55.942 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.938+0000 7f8421fa16c0 1 --2- 10.20.193.11:0/4071278407 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f841c1131c0 0x7f841c11b480 unknown :-1 s=CLOSED pgs=208 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:55.942 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.938+0000 7f8421fa16c0 1 --2- 10.20.193.11:0/4071278407 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f841c10cfb0 0x7f841c11af40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:55.942 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.938+0000 7f8421fa16c0 1 -- 10.20.193.11:0/4071278407 >> 10.20.193.11:0/4071278407 conn(0x7f841c0ea8b0 msgr2=0x7f841c10ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:18:55.942 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.938+0000 7f8421fa16c0 1 -- 10.20.193.11:0/4071278407 shutdown_connections 2026-02-13T02:18:55.942 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:55.938+0000 7f8421fa16c0 1 -- 10.20.193.11:0/4071278407 wait complete. 2026-02-13T02:18:55.979 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2026-02-13T02:18:55.979 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2026-02-13T02:18:56.009 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:56 trial078 ceph-mon[14969]: mds.? [v2:10.20.193.60:6838/1675549162,v1:10.20.193.60:6839/1675549162] up:boot 2026-02-13T02:18:56.009 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:56 trial078 ceph-mon[14969]: fsmap 12 up:standby 2026-02-13T02:18:56.009 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:56 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2026-02-13T02:18:56.010 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:56 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:56.010 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:56 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:56.010 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:56 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:56.102 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:18:56.118 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:56 trial011 ceph-mon[11956]: mds.? [v2:10.20.193.60:6838/1675549162,v1:10.20.193.60:6839/1675549162] up:boot 2026-02-13T02:18:56.118 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:56 trial011 ceph-mon[11956]: fsmap 12 up:standby 2026-02-13T02:18:56.119 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:56 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2026-02-13T02:18:56.119 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:56 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:56.119 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:56 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:56.119 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:56 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:56.119 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:56 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:56.119 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:56 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:56.119 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:56 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:56.119 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:56 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:56.119 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:56 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:18:56.119 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:56 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:56.119 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:56 trial011 ceph-mon[11956]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T02:18:56.119 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:56 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:18:56.120 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:56 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:18:56.120 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:56 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:56.120 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:56 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/1186184764' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T02:18:56.120 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:56 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:18:56.120 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:56 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/4071278407' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2026-02-13T02:18:56.120 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:56 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:56.120 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:56 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:56.121 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:56 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:56.121 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:56 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:56.121 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:56 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:18:56.121 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:56 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:56.121 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:56 trial078 ceph-mon[14969]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T02:18:56.121 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:56 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:18:56.121 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:56 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:18:56.121 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:56 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:56.121 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:56 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/1186184764' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T02:18:56.121 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:56 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:18:56.121 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:56 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/4071278407' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2026-02-13T02:18:56.225 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:56.220+0000 7fc2e5f9c6c0 1 -- 10.20.193.11:0/657312318 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fc2e010fc20 msgr2=0x7fc2e0114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:56.225 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:56.220+0000 7fc2e5f9c6c0 1 --2- 10.20.193.11:0/657312318 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fc2e010fc20 0x7fc2e0114c60 secure :-1 s=READY pgs=209 gs=1 cs=0 l=1 c_cookie=3991032542304488101 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc2d00099a0 tx=0x7fc2d002ed20 comp rx=0 tx=0).stop 2026-02-13T02:18:56.225 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:56.220+0000 7fc2e5f9c6c0 1 -- 10.20.193.11:0/657312318 shutdown_connections 2026-02-13T02:18:56.225 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:56.220+0000 7fc2e5f9c6c0 1 --2- 10.20.193.11:0/657312318 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fc2e0115440 0x7fc2e0175de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:56.225 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:56.220+0000 7fc2e5f9c6c0 1 --2- 10.20.193.11:0/657312318 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fc2e010fc20 0x7fc2e0114c60 unknown :-1 s=CLOSED pgs=209 gs=1 cs=0 l=1 c_cookie=3991032542304488101 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:56.225 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:56.220+0000 7fc2e5f9c6c0 1 --2- 10.20.193.11:0/657312318 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fc2e010f230 0x7fc2e010f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:56.226 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:56.220+0000 7fc2e5f9c6c0 1 -- 10.20.193.11:0/657312318 >> 10.20.193.11:0/657312318 conn(0x7fc2e00ecb30 msgr2=0x7fc2e010cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:18:56.226 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:56.220+0000 7fc2e5f9c6c0 1 -- 10.20.193.11:0/657312318 shutdown_connections 2026-02-13T02:18:56.226 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:56.220+0000 7fc2e5f9c6c0 1 -- 10.20.193.11:0/657312318 wait complete. 2026-02-13T02:18:56.226 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:56.220+0000 7fc2e5f9c6c0 1 Processor -- start 2026-02-13T02:18:56.226 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:56.220+0000 7fc2e5f9c6c0 1 -- start start 2026-02-13T02:18:56.226 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:56.220+0000 7fc2e5f9c6c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fc2e010f230 0x7fc2e00f4b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:18:56.226 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:56.220+0000 7fc2e5f9c6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fc2e0115440 0x7fc2e0175ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:18:56.226 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:56.220+0000 7fc2e5f9c6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fc2e00f5170 0x7fc2e00fa440 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:18:56.226 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:56.220+0000 7fc2e5f9c6c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e00f5860 con 0x7fc2e00f5170 2026-02-13T02:18:56.226 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:56.220+0000 7fc2e5f9c6c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e00fa980 con 0x7fc2e010f230 2026-02-13T02:18:56.226 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:56.220+0000 7fc2e5f9c6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e00fab40 con 0x7fc2e0115440 2026-02-13T02:18:56.227 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:56.220+0000 7fc2dffff6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fc2e00f5170 0x7fc2e00fa440 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:18:56.227 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:56.220+0000 7fc2dffff6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fc2e00f5170 0x7fc2e00fa440 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:59902/0 (socket says 10.20.193.11:59902) 2026-02-13T02:18:56.227 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:56.220+0000 7fc2dffff6c0 1 -- 10.20.193.11:0/2152390546 learned_addr learned my addr 10.20.193.11:0/2152390546 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:18:56.227 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:56.221+0000 7fc2df7fe6c0 1 --2- 10.20.193.11:0/2152390546 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fc2e010f230 0x7fc2e00f4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:18:56.227 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:56.221+0000 7fc2deffd6c0 1 --2- 10.20.193.11:0/2152390546 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fc2e0115440 0x7fc2e0175ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:18:56.227 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:56.221+0000 7fc2dffff6c0 1 -- 10.20.193.11:0/2152390546 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fc2e0115440 msgr2=0x7fc2e0175ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:56.227 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:56.221+0000 7fc2dffff6c0 1 --2- 10.20.193.11:0/2152390546 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fc2e0115440 0x7fc2e0175ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:56.227 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:56.221+0000 7fc2dffff6c0 1 -- 10.20.193.11:0/2152390546 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fc2e010f230 msgr2=0x7fc2e00f4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:56.227 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:56.221+0000 7fc2dffff6c0 1 --2- 10.20.193.11:0/2152390546 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fc2e010f230 0x7fc2e00f4b40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:56.227 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:56.221+0000 7fc2dffff6c0 1 -- 10.20.193.11:0/2152390546 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2d0009590 con 0x7fc2e00f5170 2026-02-13T02:18:56.227 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:56.221+0000 7fc2df7fe6c0 1 --2- 10.20.193.11:0/2152390546 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fc2e010f230 0x7fc2e00f4b40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T02:18:56.227 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:56.221+0000 7fc2deffd6c0 1 --2- 10.20.193.11:0/2152390546 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fc2e0115440 0x7fc2e0175ce0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T02:18:56.228 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:56.221+0000 7fc2dffff6c0 1 --2- 10.20.193.11:0/2152390546 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fc2e00f5170 0x7fc2e00fa440 secure :-1 s=READY pgs=210 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc2d400c6c0 tx=0x7fc2d400cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:18:56.228 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:56.221+0000 7fc2dcff96c0 1 -- 10.20.193.11:0/2152390546 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc2d4003a30 con 0x7fc2e00f5170 2026-02-13T02:18:56.228 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:56.221+0000 7fc2dcff96c0 1 -- 10.20.193.11:0/2152390546 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fc2d4005500 con 0x7fc2e00f5170 2026-02-13T02:18:56.228 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:56.221+0000 7fc2e5f9c6c0 1 -- 10.20.193.11:0/2152390546 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2e00fae20 con 0x7fc2e00f5170 2026-02-13T02:18:56.228 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:56.221+0000 7fc2dcff96c0 1 -- 10.20.193.11:0/2152390546 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc2d400dd80 con 0x7fc2e00f5170 2026-02-13T02:18:56.228 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:56.221+0000 7fc2e5f9c6c0 1 -- 10.20.193.11:0/2152390546 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2e00fb5b0 con 0x7fc2e00f5170 2026-02-13T02:18:56.228 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:56.222+0000 7fc2e5f9c6c0 1 -- 10.20.193.11:0/2152390546 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2e0110500 con 0x7fc2e00f5170 2026-02-13T02:18:56.228 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:56.223+0000 7fc2dcff96c0 1 -- 10.20.193.11:0/2152390546 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 10) ==== 157066+0+0 (secure 0 0 0) 0x7fc2d4005080 con 0x7fc2e00f5170 2026-02-13T02:18:56.229 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:56.223+0000 7fc2dcff96c0 1 --2- 10.20.193.11:0/2152390546 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fc2b40b5680 0x7fc2b40d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:18:56.229 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:56.224+0000 7fc2dcff96c0 1 -- 10.20.193.11:0/2152390546 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6904+0+0 (secure 0 0 0) 0x7fc2d40e4410 con 0x7fc2e00f5170 2026-02-13T02:18:56.229 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:56.224+0000 7fc2df7fe6c0 1 --2- 10.20.193.11:0/2152390546 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fc2b40b5680 0x7fc2b40d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:18:56.229 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:56.224+0000 7fc2df7fe6c0 1 --2- 10.20.193.11:0/2152390546 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fc2b40b5680 0x7fc2b40d5b30 secure :-1 s=READY pgs=162 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc2cc004750 tx=0x7fc2cc009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:18:56.229 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:56.224+0000 7fc2dcff96c0 1 -- 10.20.193.11:0/2152390546 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fc2d40a72f0 con 0x7fc2e00f5170 2026-02-13T02:18:56.319 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:56.317+0000 7fc2e5f9c6c0 1 -- 10.20.193.11:0/2152390546 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fc2e00f5c90 con 0x7fc2e00f5170 2026-02-13T02:18:56.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:56 trial060 ceph-mon[14797]: mds.? [v2:10.20.193.60:6838/1675549162,v1:10.20.193.60:6839/1675549162] up:boot 2026-02-13T02:18:56.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:56 trial060 ceph-mon[14797]: fsmap 12 up:standby 2026-02-13T02:18:56.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:56 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2026-02-13T02:18:56.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:56 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:56.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:56 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:56.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:56 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:56.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:56 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:56.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:56 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:56.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:56 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:56.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:56 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:56.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:56 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:18:56.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:56 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:56.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:56 trial060 ceph-mon[14797]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T02:18:56.502 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:56 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:18:56.502 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:56 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:18:56.502 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:56 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:56.502 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:56 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/1186184764' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T02:18:56.502 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:56 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:18:56.502 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:56 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/4071278407' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2026-02-13T02:18:57.008 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:57.006+0000 7fc2dcff96c0 1 -- 10.20.193.11:0/2152390546 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v68) ==== 138+0+0 (secure 0 0 0) 0x7fc2d4005360 con 0x7fc2e00f5170 2026-02-13T02:18:57.008 INFO:teuthology.orchestra.run.trial011.stderr:pool 'cephfs_metadata' created 2026-02-13T02:18:57.013 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:57.009+0000 7fc2e5f9c6c0 1 -- 10.20.193.11:0/2152390546 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fc2b40b5680 msgr2=0x7fc2b40d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:57.013 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:57.009+0000 7fc2e5f9c6c0 1 --2- 10.20.193.11:0/2152390546 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fc2b40b5680 0x7fc2b40d5b30 secure :-1 s=READY pgs=162 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc2cc004750 tx=0x7fc2cc009260 comp rx=0 tx=0).stop 2026-02-13T02:18:57.013 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:57.009+0000 7fc2e5f9c6c0 1 -- 10.20.193.11:0/2152390546 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fc2e00f5170 msgr2=0x7fc2e00fa440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:57.013 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:57.009+0000 7fc2e5f9c6c0 1 --2- 10.20.193.11:0/2152390546 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fc2e00f5170 0x7fc2e00fa440 secure :-1 s=READY pgs=210 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc2d400c6c0 tx=0x7fc2d400cb90 comp rx=0 tx=0).stop 2026-02-13T02:18:57.013 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:57.009+0000 7fc2e5f9c6c0 1 -- 10.20.193.11:0/2152390546 shutdown_connections 2026-02-13T02:18:57.014 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:57.009+0000 7fc2e5f9c6c0 1 --2- 10.20.193.11:0/2152390546 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fc2b40b5680 0x7fc2b40d5b30 unknown :-1 s=CLOSED pgs=162 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:57.014 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:57.009+0000 7fc2e5f9c6c0 1 --2- 10.20.193.11:0/2152390546 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fc2e00f5170 0x7fc2e00fa440 unknown :-1 s=CLOSED pgs=210 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:57.014 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:57.009+0000 7fc2e5f9c6c0 1 --2- 10.20.193.11:0/2152390546 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fc2e0115440 0x7fc2e0175ce0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:57.014 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:57.009+0000 7fc2e5f9c6c0 1 --2- 10.20.193.11:0/2152390546 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fc2e010f230 0x7fc2e00f4b40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:57.014 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:57.009+0000 7fc2e5f9c6c0 1 -- 10.20.193.11:0/2152390546 >> 10.20.193.11:0/2152390546 conn(0x7fc2e00ecb30 msgr2=0x7fc2e010d790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:18:57.014 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:57.009+0000 7fc2e5f9c6c0 1 -- 10.20.193.11:0/2152390546 shutdown_connections 2026-02-13T02:18:57.014 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:57.009+0000 7fc2e5f9c6c0 1 -- 10.20.193.11:0/2152390546 wait complete. 2026-02-13T02:18:57.050 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2026-02-13T02:18:57.172 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:18:57.285 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:57 trial011 ceph-mon[11956]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T02:18:57.286 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:57 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/2152390546' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2026-02-13T02:18:57.286 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:57 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:57.286 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:57 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:57.286 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:57 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:57.286 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:57 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:57.286 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:57 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:57.286 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:57 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:57.286 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:57 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:57.286 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:57 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:18:57.287 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:57 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:57.287 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:57 trial011 ceph-mon[11956]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T02:18:57.287 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:57 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:18:57.287 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:57 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:18:57.287 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:57 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:57.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:57 trial078 ceph-mon[14969]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T02:18:57.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:57 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/2152390546' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2026-02-13T02:18:57.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:57 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:57.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:57 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:57.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:57 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:57.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:57 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:57.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:57 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:57.293 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:57 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:57.293 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:57 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:57.293 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:57 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:18:57.293 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:57 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:57.293 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:57 trial078 ceph-mon[14969]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T02:18:57.293 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:57 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:18:57.293 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:57 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:18:57.293 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:57 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:57.299 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:57.295+0000 7fdde5b7d6c0 1 -- 10.20.193.11:0/2437292009 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fdde010fbf0 msgr2=0x7fdde0114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:57.300 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:57.295+0000 7fdde5b7d6c0 1 --2- 10.20.193.11:0/2437292009 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fdde010fbf0 0x7fdde0114c30 secure :-1 s=READY pgs=211 gs=1 cs=0 l=1 c_cookie=4073187813564585285 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fddd00099a0 tx=0x7fddd002ed20 comp rx=0 tx=0).stop 2026-02-13T02:18:57.300 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:57.295+0000 7fdde5b7d6c0 1 -- 10.20.193.11:0/2437292009 shutdown_connections 2026-02-13T02:18:57.300 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:57.295+0000 7fdde5b7d6c0 1 --2- 10.20.193.11:0/2437292009 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fdde0115410 0x7fdde0175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:57.300 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:57.295+0000 7fdde5b7d6c0 1 --2- 10.20.193.11:0/2437292009 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fdde010fbf0 0x7fdde0114c30 unknown :-1 s=CLOSED pgs=211 gs=1 cs=0 l=1 c_cookie=4073187813564585285 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:57.300 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:57.295+0000 7fdde5b7d6c0 1 --2- 10.20.193.11:0/2437292009 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fdde010f200 0x7fdde010f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:57.300 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:57.295+0000 7fdde5b7d6c0 1 -- 10.20.193.11:0/2437292009 >> 10.20.193.11:0/2437292009 conn(0x7fdde00ecb00 msgr2=0x7fdde010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:18:57.300 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:57.296+0000 7fdde5b7d6c0 1 -- 10.20.193.11:0/2437292009 shutdown_connections 2026-02-13T02:18:57.300 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:57.296+0000 7fdde5b7d6c0 1 -- 10.20.193.11:0/2437292009 wait complete. 2026-02-13T02:18:57.300 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:57.296+0000 7fdde5b7d6c0 1 Processor -- start 2026-02-13T02:18:57.300 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:57.296+0000 7fdde5b7d6c0 1 -- start start 2026-02-13T02:18:57.301 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:57.296+0000 7fdde5b7d6c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fdde010f200 0x7fdde00f4c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:18:57.301 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:57.296+0000 7fdde5b7d6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fdde0115410 0x7fdde0175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:18:57.301 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:57.296+0000 7fdde5b7d6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fdde00f5270 0x7fdde00fa4f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:18:57.301 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:57.296+0000 7fdde5b7d6c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7fdde00f5960 con 0x7fdde00f5270 2026-02-13T02:18:57.301 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:57.296+0000 7fdde5b7d6c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7fdde00faa30 con 0x7fdde010f200 2026-02-13T02:18:57.301 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:57.296+0000 7fdde5b7d6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fdde00fabf0 con 0x7fdde0115410 2026-02-13T02:18:57.301 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:57.296+0000 7fdddffff6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fdde00f5270 0x7fdde00fa4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:18:57.301 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:57.296+0000 7fdddffff6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fdde00f5270 0x7fdde00fa4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:59916/0 (socket says 10.20.193.11:59916) 2026-02-13T02:18:57.301 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:57.296+0000 7fdddffff6c0 1 -- 10.20.193.11:0/451385805 learned_addr learned my addr 10.20.193.11:0/451385805 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:18:57.301 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:57.296+0000 7fdddeffd6c0 1 --2- 10.20.193.11:0/451385805 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fdde0115410 0x7fdde0175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:18:57.301 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:57.296+0000 7fdddf7fe6c0 1 --2- 10.20.193.11:0/451385805 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fdde010f200 0x7fdde00f4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:18:57.301 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:57.296+0000 7fdddffff6c0 1 -- 10.20.193.11:0/451385805 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fdde0115410 msgr2=0x7fdde0175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:57.302 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:57.296+0000 7fdddffff6c0 1 --2- 10.20.193.11:0/451385805 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fdde0115410 0x7fdde0175cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:57.302 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:57.296+0000 7fdddffff6c0 1 -- 10.20.193.11:0/451385805 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fdde010f200 msgr2=0x7fdde00f4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:57.302 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:57.296+0000 7fdddffff6c0 1 --2- 10.20.193.11:0/451385805 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fdde010f200 0x7fdde00f4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:57.302 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:57.296+0000 7fdddffff6c0 1 -- 10.20.193.11:0/451385805 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddd0009590 con 0x7fdde00f5270 2026-02-13T02:18:57.302 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:57.296+0000 7fdddeffd6c0 1 --2- 10.20.193.11:0/451385805 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fdde0115410 0x7fdde0175cb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T02:18:57.302 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:57.297+0000 7fdddffff6c0 1 --2- 10.20.193.11:0/451385805 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fdde00f5270 0x7fdde00fa4f0 secure :-1 s=READY pgs=212 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fddd4006ea0 tx=0x7fddd400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:18:57.302 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:57.297+0000 7fdddcff96c0 1 -- 10.20.193.11:0/451385805 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fddd4003a30 con 0x7fdde00f5270 2026-02-13T02:18:57.302 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:57.297+0000 7fdddcff96c0 1 -- 10.20.193.11:0/451385805 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fddd4005510 con 0x7fdde00f5270 2026-02-13T02:18:57.302 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:57.297+0000 7fdde5b7d6c0 1 -- 10.20.193.11:0/451385805 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdde00faed0 con 0x7fdde00f5270 2026-02-13T02:18:57.302 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:57.297+0000 7fdddcff96c0 1 -- 10.20.193.11:0/451385805 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fddd400dd70 con 0x7fdde00f5270 2026-02-13T02:18:57.302 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:57.297+0000 7fdde5b7d6c0 1 -- 10.20.193.11:0/451385805 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdde00fb660 con 0x7fdde00f5270 2026-02-13T02:18:57.302 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:57.297+0000 7fdde5b7d6c0 1 -- 10.20.193.11:0/451385805 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdde01104d0 con 0x7fdde00f5270 2026-02-13T02:18:57.303 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:57.298+0000 7fdddcff96c0 1 -- 10.20.193.11:0/451385805 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 10) ==== 157066+0+0 (secure 0 0 0) 0x7fddd4003b90 con 0x7fdde00f5270 2026-02-13T02:18:57.304 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:57.299+0000 7fdddcff96c0 1 --2- 10.20.193.11:0/451385805 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fddb40b5680 0x7fddb40d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:18:57.304 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:57.299+0000 7fdddf7fe6c0 1 --2- 10.20.193.11:0/451385805 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fddb40b5680 0x7fddb40d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:18:57.304 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:57.299+0000 7fdddcff96c0 1 -- 10.20.193.11:0/451385805 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7277+0+0 (secure 0 0 0) 0x7fddd40e4700 con 0x7fdde00f5270 2026-02-13T02:18:57.304 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:57.300+0000 7fdddf7fe6c0 1 --2- 10.20.193.11:0/451385805 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fddb40b5680 0x7fddb40d5b30 secure :-1 s=READY pgs=163 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fddcc005980 tx=0x7fddcc005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:18:57.304 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:57.300+0000 7fdddcff96c0 1 -- 10.20.193.11:0/451385805 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fddd40a7470 con 0x7fdde00f5270 2026-02-13T02:18:57.394 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:57.392+0000 7fdde5b7d6c0 1 -- 10.20.193.11:0/451385805 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fdde00f5d40 con 0x7fdde00f5270 2026-02-13T02:18:57.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:57 trial060 ceph-mon[14797]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T02:18:57.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:57 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/2152390546' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2026-02-13T02:18:57.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:57 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:57.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:57 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:57.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:57 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:57.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:57 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:57.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:57 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:57.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:57 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:57.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:57 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:57.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:57 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:18:57.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:57 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:57.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:57 trial060 ceph-mon[14797]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T02:18:57.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:57 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:18:57.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:57 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:18:57.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:57 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:18:58.012 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:58.010+0000 7fdddcff96c0 1 -- 10.20.193.11:0/451385805 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v69) ==== 170+0+0 (secure 0 0 0) 0x7fddd40aa620 con 0x7fdde00f5270 2026-02-13T02:18:58.012 INFO:teuthology.orchestra.run.trial011.stderr:pool 'cephfs_data' created 2026-02-13T02:18:58.016 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:58.014+0000 7fdde5b7d6c0 1 -- 10.20.193.11:0/451385805 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fddb40b5680 msgr2=0x7fddb40d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:58.016 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:58.014+0000 7fdde5b7d6c0 1 --2- 10.20.193.11:0/451385805 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fddb40b5680 0x7fddb40d5b30 secure :-1 s=READY pgs=163 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fddcc005980 tx=0x7fddcc005910 comp rx=0 tx=0).stop 2026-02-13T02:18:58.017 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:58.014+0000 7fdde5b7d6c0 1 -- 10.20.193.11:0/451385805 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fdde00f5270 msgr2=0x7fdde00fa4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:58.017 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:58.014+0000 7fdde5b7d6c0 1 --2- 10.20.193.11:0/451385805 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fdde00f5270 0x7fdde00fa4f0 secure :-1 s=READY pgs=212 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fddd4006ea0 tx=0x7fddd400cca0 comp rx=0 tx=0).stop 2026-02-13T02:18:58.017 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:58.014+0000 7fdde5b7d6c0 1 -- 10.20.193.11:0/451385805 shutdown_connections 2026-02-13T02:18:58.017 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:58.014+0000 7fdde5b7d6c0 1 --2- 10.20.193.11:0/451385805 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fddb40b5680 0x7fddb40d5b30 unknown :-1 s=CLOSED pgs=163 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:58.017 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:58.014+0000 7fdde5b7d6c0 1 --2- 10.20.193.11:0/451385805 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fdde00f5270 0x7fdde00fa4f0 unknown :-1 s=CLOSED pgs=212 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:58.017 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:58.014+0000 7fdde5b7d6c0 1 --2- 10.20.193.11:0/451385805 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fdde0115410 0x7fdde0175cb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:58.017 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:58.014+0000 7fdde5b7d6c0 1 --2- 10.20.193.11:0/451385805 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fdde010f200 0x7fdde00f4c40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:58.017 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:58.014+0000 7fdde5b7d6c0 1 -- 10.20.193.11:0/451385805 >> 10.20.193.11:0/451385805 conn(0x7fdde00ecb00 msgr2=0x7fdde010d860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:18:58.017 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:58.014+0000 7fdde5b7d6c0 1 -- 10.20.193.11:0/451385805 shutdown_connections 2026-02-13T02:18:58.017 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:58.014+0000 7fdde5b7d6c0 1 -- 10.20.193.11:0/451385805 wait complete. 2026-02-13T02:18:58.056 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph fs new cephfs cephfs_metadata cephfs_data 2026-02-13T02:18:58.182 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:18:58.291 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:58 trial078 ceph-mon[14969]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T02:18:58.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:58 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/2152390546' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2026-02-13T02:18:58.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:58 trial078 ceph-mon[14969]: osdmap e68: 12 total, 12 up, 12 in 2026-02-13T02:18:58.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:58 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:58.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:58 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/451385805' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2026-02-13T02:18:58.295 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:58 trial011 ceph-mon[11956]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T02:18:58.295 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:58 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/2152390546' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2026-02-13T02:18:58.295 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:58 trial011 ceph-mon[11956]: osdmap e68: 12 total, 12 up, 12 in 2026-02-13T02:18:58.296 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:58 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:58.296 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:58 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/451385805' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2026-02-13T02:18:58.304 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:58.299+0000 7feba33756c0 1 -- 10.20.193.11:0/2102167078 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7feb9c1556e0 msgr2=0x7feb9c175ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:58.305 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:58.299+0000 7feba33756c0 1 --2- 10.20.193.11:0/2102167078 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7feb9c1556e0 0x7feb9c175ac0 secure :-1 s=READY pgs=213 gs=1 cs=0 l=1 c_cookie=17508971428335884604 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb9800aa40 tx=0x7feb9802fde0 comp rx=0 tx=0).stop 2026-02-13T02:18:58.305 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:58.299+0000 7feba33756c0 1 -- 10.20.193.11:0/2102167078 shutdown_connections 2026-02-13T02:18:58.305 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:58.299+0000 7feba33756c0 1 --2- 10.20.193.11:0/2102167078 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7feb9c1556e0 0x7feb9c175ac0 unknown :-1 s=CLOSED pgs=213 gs=1 cs=0 l=1 c_cookie=17508971428335884604 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:58.305 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:58.299+0000 7feba33756c0 1 --2- 10.20.193.11:0/2102167078 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7feb9c061030 0x7feb9c1551a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:58.305 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:58.299+0000 7feba33756c0 1 --2- 10.20.193.11:0/2102167078 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7feb9c060720 0x7feb9c060af0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:58.305 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:58.299+0000 7feba33756c0 1 -- 10.20.193.11:0/2102167078 >> 10.20.193.11:0/2102167078 conn(0x7feb9c0ea8b0 msgr2=0x7feb9c10acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:18:58.305 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:58.299+0000 7feba33756c0 1 -- 10.20.193.11:0/2102167078 shutdown_connections 2026-02-13T02:18:58.305 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:58.299+0000 7feba33756c0 1 -- 10.20.193.11:0/2102167078 wait complete. 2026-02-13T02:18:58.305 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:58.300+0000 7feba33756c0 1 Processor -- start 2026-02-13T02:18:58.306 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:58.300+0000 7feba33756c0 1 -- start start 2026-02-13T02:18:58.306 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:58.300+0000 7feba33756c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7feb9c060720 0x7feb9c1613b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:18:58.306 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:58.300+0000 7feba33756c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7feb9c061030 0x7feb9c1618f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:18:58.306 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:58.300+0000 7feba33756c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7feb9c1556e0 0x7feb9c166cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:18:58.306 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:58.300+0000 7feba33756c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7feb9c167300 con 0x7feb9c060720 2026-02-13T02:18:58.306 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:58.300+0000 7feba33756c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7feb9c167470 con 0x7feb9c1556e0 2026-02-13T02:18:58.306 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:58.300+0000 7feba33756c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7feb9c167630 con 0x7feb9c061030 2026-02-13T02:18:58.306 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:58.300+0000 7feba10e66c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7feb9c060720 0x7feb9c1613b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:18:58.306 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:58.300+0000 7feba10e66c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7feb9c060720 0x7feb9c1613b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:59946/0 (socket says 10.20.193.11:59946) 2026-02-13T02:18:58.306 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:58.300+0000 7feba10e66c0 1 -- 10.20.193.11:0/1599044448 learned_addr learned my addr 10.20.193.11:0/1599044448 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:18:58.306 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:58.300+0000 7feba18e76c0 1 --2- 10.20.193.11:0/1599044448 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7feb9c1556e0 0x7feb9c166cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:18:58.306 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:58.300+0000 7feba08e56c0 1 --2- 10.20.193.11:0/1599044448 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7feb9c061030 0x7feb9c1618f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:18:58.306 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:58.300+0000 7feba10e66c0 1 -- 10.20.193.11:0/1599044448 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7feb9c061030 msgr2=0x7feb9c1618f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:58.307 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:58.300+0000 7feba10e66c0 1 --2- 10.20.193.11:0/1599044448 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7feb9c061030 0x7feb9c1618f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:58.307 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:58.300+0000 7feba10e66c0 1 -- 10.20.193.11:0/1599044448 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7feb9c1556e0 msgr2=0x7feb9c166cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:58.307 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:58.300+0000 7feba10e66c0 1 --2- 10.20.193.11:0/1599044448 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7feb9c1556e0 0x7feb9c166cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:58.307 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:58.300+0000 7feba10e66c0 1 -- 10.20.193.11:0/1599044448 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb9800a660 con 0x7feb9c060720 2026-02-13T02:18:58.307 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:58.300+0000 7feba08e56c0 1 --2- 10.20.193.11:0/1599044448 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7feb9c061030 0x7feb9c1618f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:18:58.307 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:58.300+0000 7feba10e66c0 1 --2- 10.20.193.11:0/1599044448 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7feb9c060720 0x7feb9c1613b0 secure :-1 s=READY pgs=214 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb8c009490 tx=0x7feb8c00bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:18:58.307 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:58.300+0000 7feb8a7fc6c0 1 -- 10.20.193.11:0/1599044448 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feb8c004a80 con 0x7feb9c060720 2026-02-13T02:18:58.307 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:58.300+0000 7feb8a7fc6c0 1 -- 10.20.193.11:0/1599044448 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7feb8c009030 con 0x7feb9c060720 2026-02-13T02:18:58.307 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:58.300+0000 7feba33756c0 1 -- 10.20.193.11:0/1599044448 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb9c167910 con 0x7feb9c060720 2026-02-13T02:18:58.307 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:58.300+0000 7feb8a7fc6c0 1 -- 10.20.193.11:0/1599044448 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feb8c0071c0 con 0x7feb9c060720 2026-02-13T02:18:58.307 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:58.300+0000 7feba33756c0 1 -- 10.20.193.11:0/1599044448 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb9c151310 con 0x7feb9c060720 2026-02-13T02:18:58.307 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:58.301+0000 7feba33756c0 1 -- 10.20.193.11:0/1599044448 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb9c061c30 con 0x7feb9c060720 2026-02-13T02:18:58.308 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:58.302+0000 7feb8a7fc6c0 1 -- 10.20.193.11:0/1599044448 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 10) ==== 157066+0+0 (secure 0 0 0) 0x7feb8c004060 con 0x7feb9c060720 2026-02-13T02:18:58.309 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:58.303+0000 7feb8a7fc6c0 1 --2- 10.20.193.11:0/1599044448 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7feb780b5680 0x7feb780d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:18:58.309 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:58.303+0000 7feba08e56c0 1 --2- 10.20.193.11:0/1599044448 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7feb780b5680 0x7feb780d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:18:58.309 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:58.303+0000 7feb8a7fc6c0 1 -- 10.20.193.11:0/1599044448 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7662+0+0 (secure 0 0 0) 0x7feb8c0e3950 con 0x7feb9c060720 2026-02-13T02:18:58.309 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:58.303+0000 7feb8a7fc6c0 1 -- 10.20.193.11:0/1599044448 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7feb8c0e3e40 con 0x7feb9c060720 2026-02-13T02:18:58.309 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:58.303+0000 7feba08e56c0 1 --2- 10.20.193.11:0/1599044448 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7feb780b5680 0x7feb780d5b30 secure :-1 s=READY pgs=164 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb9c167d40 tx=0x7feb90009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:18:58.420 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:58.419+0000 7feba33756c0 1 -- 10.20.193.11:0/1599044448 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7feb9c060af0 con 0x7feb9c060720 2026-02-13T02:18:58.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:58 trial060 ceph-mon[14797]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T02:18:58.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:58 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/2152390546' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2026-02-13T02:18:58.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:58 trial060 ceph-mon[14797]: osdmap e68: 12 total, 12 up, 12 in 2026-02-13T02:18:58.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:58 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:18:58.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:58 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/451385805' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2026-02-13T02:18:59.018 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.016+0000 7feb8a7fc6c0 1 -- 10.20.193.11:0/1599044448 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v11) ==== 172+0+0 (secure 0 0 0) 0x7feb8c0a6580 con 0x7feb9c060720 2026-02-13T02:18:59.019 INFO:teuthology.orchestra.run.trial011.stderr:new fs with metadata pool 2 and data pool 3 2026-02-13T02:18:59.022 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.021+0000 7feba33756c0 1 -- 10.20.193.11:0/1599044448 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7feb780b5680 msgr2=0x7feb780d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:59.022 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.021+0000 7feba33756c0 1 --2- 10.20.193.11:0/1599044448 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7feb780b5680 0x7feb780d5b30 secure :-1 s=READY pgs=164 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb9c167d40 tx=0x7feb90009260 comp rx=0 tx=0).stop 2026-02-13T02:18:59.023 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.021+0000 7feba33756c0 1 -- 10.20.193.11:0/1599044448 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7feb9c060720 msgr2=0x7feb9c1613b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:59.023 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.021+0000 7feba33756c0 1 --2- 10.20.193.11:0/1599044448 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7feb9c060720 0x7feb9c1613b0 secure :-1 s=READY pgs=214 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb8c009490 tx=0x7feb8c00bca0 comp rx=0 tx=0).stop 2026-02-13T02:18:59.023 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.021+0000 7feba33756c0 1 -- 10.20.193.11:0/1599044448 shutdown_connections 2026-02-13T02:18:59.023 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.021+0000 7feba33756c0 1 --2- 10.20.193.11:0/1599044448 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7feb780b5680 0x7feb780d5b30 unknown :-1 s=CLOSED pgs=164 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:59.024 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.021+0000 7feba33756c0 1 --2- 10.20.193.11:0/1599044448 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7feb9c1556e0 0x7feb9c166cb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:59.024 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.021+0000 7feba33756c0 1 --2- 10.20.193.11:0/1599044448 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7feb9c061030 0x7feb9c1618f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:59.024 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.021+0000 7feba33756c0 1 --2- 10.20.193.11:0/1599044448 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7feb9c060720 0x7feb9c1613b0 unknown :-1 s=CLOSED pgs=214 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:59.024 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.021+0000 7feba33756c0 1 -- 10.20.193.11:0/1599044448 >> 10.20.193.11:0/1599044448 conn(0x7feb9c0ea8b0 msgr2=0x7feb9c10ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:18:59.024 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.021+0000 7feba33756c0 1 -- 10.20.193.11:0/1599044448 shutdown_connections 2026-02-13T02:18:59.024 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.022+0000 7feba33756c0 1 -- 10.20.193.11:0/1599044448 wait complete. 2026-02-13T02:18:59.064 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph osd dump --format=json 2026-02-13T02:18:59.185 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:18:59.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:59 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/451385805' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2026-02-13T02:18:59.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:59 trial078 ceph-mon[14969]: osdmap e69: 12 total, 12 up, 12 in 2026-02-13T02:18:59.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:59 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/1599044448' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2026-02-13T02:18:59.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:18:59 trial078 ceph-mon[14969]: daemon mds.b assigned to filesystem cephfs as rank 0 2026-02-13T02:18:59.299 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:59 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/451385805' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2026-02-13T02:18:59.299 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:59 trial011 ceph-mon[11956]: osdmap e69: 12 total, 12 up, 12 in 2026-02-13T02:18:59.299 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:59 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/1599044448' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2026-02-13T02:18:59.299 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:18:59 trial011 ceph-mon[11956]: daemon mds.b assigned to filesystem cephfs as rank 0 2026-02-13T02:18:59.302 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.300+0000 7f50711486c0 1 -- 10.20.193.11:0/751011139 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f506c10f200 msgr2=0x7f506c10f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:59.302 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.300+0000 7f50711486c0 1 --2- 10.20.193.11:0/751011139 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f506c10f200 0x7f506c10f5d0 secure :-1 s=READY pgs=215 gs=1 cs=0 l=1 c_cookie=8037111310883948690 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f50600099a0 tx=0x7f506002ed20 comp rx=0 tx=0).stop 2026-02-13T02:18:59.302 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.300+0000 7f50711486c0 1 -- 10.20.193.11:0/751011139 shutdown_connections 2026-02-13T02:18:59.303 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.300+0000 7f50711486c0 1 --2- 10.20.193.11:0/751011139 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f506c115410 0x7f506c175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:59.303 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.300+0000 7f50711486c0 1 --2- 10.20.193.11:0/751011139 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f506c10fbf0 0x7f506c114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:59.303 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.300+0000 7f50711486c0 1 --2- 10.20.193.11:0/751011139 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f506c10f200 0x7f506c10f5d0 unknown :-1 s=CLOSED pgs=215 gs=1 cs=0 l=1 c_cookie=8037111310883948690 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:59.303 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.300+0000 7f50711486c0 1 -- 10.20.193.11:0/751011139 >> 10.20.193.11:0/751011139 conn(0x7f506c0ecb00 msgr2=0x7f506c10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:18:59.303 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.300+0000 7f50711486c0 1 -- 10.20.193.11:0/751011139 shutdown_connections 2026-02-13T02:18:59.303 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.300+0000 7f50711486c0 1 -- 10.20.193.11:0/751011139 wait complete. 2026-02-13T02:18:59.306 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.301+0000 7f50711486c0 1 Processor -- start 2026-02-13T02:18:59.306 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.301+0000 7f50711486c0 1 -- start start 2026-02-13T02:18:59.306 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.301+0000 7f50711486c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f506c10f200 0x7f506c11d200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:18:59.306 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.301+0000 7f50711486c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f506c115410 0x7f506c11d740 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:18:59.306 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.301+0000 7f50711486c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f506c122b00 0x7f506c122fa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:18:59.306 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.301+0000 7f50711486c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f506c123510 con 0x7f506c115410 2026-02-13T02:18:59.306 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.301+0000 7f50711486c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f506c123680 con 0x7f506c122b00 2026-02-13T02:18:59.306 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.301+0000 7f50711486c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f506c123840 con 0x7f506c10f200 2026-02-13T02:18:59.306 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.301+0000 7f506a5756c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f506c115410 0x7f506c11d740 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:18:59.306 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.301+0000 7f506a5756c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f506c115410 0x7f506c11d740 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:59964/0 (socket says 10.20.193.11:59964) 2026-02-13T02:18:59.307 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.301+0000 7f506a5756c0 1 -- 10.20.193.11:0/2701597530 learned_addr learned my addr 10.20.193.11:0/2701597530 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:18:59.307 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.301+0000 7f506ad766c0 1 --2- 10.20.193.11:0/2701597530 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f506c10f200 0x7f506c11d200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:18:59.307 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.301+0000 7f506a5756c0 1 -- 10.20.193.11:0/2701597530 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f506c10f200 msgr2=0x7f506c11d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:59.307 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.301+0000 7f506a5756c0 1 --2- 10.20.193.11:0/2701597530 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f506c10f200 0x7f506c11d200 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:59.307 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.301+0000 7f506a5756c0 1 -- 10.20.193.11:0/2701597530 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f506c122b00 msgr2=0x7f506c122fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:59.307 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.301+0000 7f506b5776c0 1 --2- 10.20.193.11:0/2701597530 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f506c122b00 0x7f506c122fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:18:59.307 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.301+0000 7f506a5756c0 1 --2- 10.20.193.11:0/2701597530 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f506c122b00 0x7f506c122fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:59.307 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.301+0000 7f506a5756c0 1 -- 10.20.193.11:0/2701597530 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5060009590 con 0x7f506c115410 2026-02-13T02:18:59.307 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.301+0000 7f506b5776c0 1 --2- 10.20.193.11:0/2701597530 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f506c122b00 0x7f506c122fa0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:18:59.307 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.301+0000 7f506a5756c0 1 --2- 10.20.193.11:0/2701597530 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f506c115410 0x7f506c11d740 secure :-1 s=READY pgs=216 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f505400b6c0 tx=0x7f505400bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:18:59.307 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.301+0000 7f504bfff6c0 1 -- 10.20.193.11:0/2701597530 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5054004250 con 0x7f506c115410 2026-02-13T02:18:59.307 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.301+0000 7f504bfff6c0 1 -- 10.20.193.11:0/2701597530 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f5054009070 con 0x7f506c115410 2026-02-13T02:18:59.308 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.301+0000 7f50711486c0 1 -- 10.20.193.11:0/2701597530 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f506c163cf0 con 0x7f506c115410 2026-02-13T02:18:59.308 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.301+0000 7f504bfff6c0 1 -- 10.20.193.11:0/2701597530 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f505400cd20 con 0x7f506c115410 2026-02-13T02:18:59.308 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.301+0000 7f50711486c0 1 -- 10.20.193.11:0/2701597530 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f506c164180 con 0x7f506c115410 2026-02-13T02:18:59.308 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.302+0000 7f50711486c0 1 -- 10.20.193.11:0/2701597530 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f506c1104d0 con 0x7f506c115410 2026-02-13T02:18:59.308 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.303+0000 7f504bfff6c0 1 -- 10.20.193.11:0/2701597530 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 10) ==== 157066+0+0 (secure 0 0 0) 0x7f50540028c0 con 0x7f506c115410 2026-02-13T02:18:59.308 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.304+0000 7f504bfff6c0 1 --2- 10.20.193.11:0/2701597530 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f50400b5680 0x7f50400d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:18:59.308 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.304+0000 7f506ad766c0 1 --2- 10.20.193.11:0/2701597530 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f50400b5680 0x7f50400d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:18:59.308 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.304+0000 7f504bfff6c0 1 -- 10.20.193.11:0/2701597530 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7762+0+0 (secure 0 0 0) 0x7f50540e3930 con 0x7f506c115410 2026-02-13T02:18:59.308 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.304+0000 7f506ad766c0 1 --2- 10.20.193.11:0/2701597530 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f50400b5680 0x7f50400d5b30 secure :-1 s=READY pgs=165 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f50600023e0 tx=0x7f5060031f90 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:18:59.309 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.304+0000 7f504bfff6c0 1 -- 10.20.193.11:0/2701597530 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f50540a64f0 con 0x7f506c115410 2026-02-13T02:18:59.396 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.394+0000 7f50711486c0 1 -- 10.20.193.11:0/2701597530 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f506c10f5d0 con 0x7f506c115410 2026-02-13T02:18:59.396 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.395+0000 7f504bfff6c0 1 -- 10.20.193.11:0/2701597530 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) ==== 74+0+21875 (secure 0 0 0) 0x7f50540a96a0 con 0x7f506c115410 2026-02-13T02:18:59.397 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:18:59.397 INFO:teuthology.orchestra.run.trial011.stdout:{"epoch":70,"fsid":"fc631695-0881-11f1-899c-d404e6e7d460","created":"2026-02-13T02:16:35.175761+0000","modified":"2026-02-13T02:18:58.420221+0000","last_up_change":"2026-02-13T02:18:43.665240+0000","last_in_change":"2026-02-13T02:18:35.014003+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-13T02:17:39.931888+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-13T02:18:56.323027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-13T02:18:57.399537+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb9a005b-9a16-4fda-95c0-d23831f0cffc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6802","nonce":1061379396},{"type":"v1","addr":"10.20.193.11:6803","nonce":1061379396}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6804","nonce":1061379396},{"type":"v1","addr":"10.20.193.11:6805","nonce":1061379396}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6808","nonce":1061379396},{"type":"v1","addr":"10.20.193.11:6809","nonce":1061379396}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6806","nonce":1061379396},{"type":"v1","addr":"10.20.193.11:6807","nonce":1061379396}]},"public_addr":"10.20.193.11:6803/1061379396","cluster_addr":"10.20.193.11:6805/1061379396","heartbeat_back_addr":"10.20.193.11:6809/1061379396","heartbeat_front_addr":"10.20.193.11:6807/1061379396","state":["exists","up"]},{"osd":1,"uuid":"c1786ae4-a736-47b0-8302-b06423efd012","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6800","nonce":2198425396},{"type":"v1","addr":"10.20.193.60:6801","nonce":2198425396}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6802","nonce":2198425396},{"type":"v1","addr":"10.20.193.60:6803","nonce":2198425396}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6806","nonce":2198425396},{"type":"v1","addr":"10.20.193.60:6807","nonce":2198425396}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6804","nonce":2198425396},{"type":"v1","addr":"10.20.193.60:6805","nonce":2198425396}]},"public_addr":"10.20.193.60:6801/2198425396","cluster_addr":"10.20.193.60:6803/2198425396","heartbeat_back_addr":"10.20.193.60:6807/2198425396","heartbeat_front_addr":"10.20.193.60:6805/2198425396","state":["exists","up"]},{"osd":2,"uuid":"516f1aa0-bc7c-4808-8ac8-4ff406c71890","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6800","nonce":3723638526},{"type":"v1","addr":"10.20.193.78:6801","nonce":3723638526}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6802","nonce":3723638526},{"type":"v1","addr":"10.20.193.78:6803","nonce":3723638526}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6806","nonce":3723638526},{"type":"v1","addr":"10.20.193.78:6807","nonce":3723638526}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6804","nonce":3723638526},{"type":"v1","addr":"10.20.193.78:6805","nonce":3723638526}]},"public_addr":"10.20.193.78:6801/3723638526","cluster_addr":"10.20.193.78:6803/3723638526","heartbeat_back_addr":"10.20.193.78:6807/3723638526","heartbeat_front_addr":"10.20.193.78:6805/3723638526","state":["exists","up"]},{"osd":3,"uuid":"8cf508c2-b05d-42be-92e3-db0a57d22a85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6810","nonce":4224399876},{"type":"v1","addr":"10.20.193.11:6811","nonce":4224399876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6812","nonce":4224399876},{"type":"v1","addr":"10.20.193.11:6813","nonce":4224399876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6816","nonce":4224399876},{"type":"v1","addr":"10.20.193.11:6817","nonce":4224399876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6814","nonce":4224399876},{"type":"v1","addr":"10.20.193.11:6815","nonce":4224399876}]},"public_addr":"10.20.193.11:6811/4224399876","cluster_addr":"10.20.193.11:6813/4224399876","heartbeat_back_addr":"10.20.193.11:6817/4224399876","heartbeat_front_addr":"10.20.193.11:6815/4224399876","state":["exists","up"]},{"osd":4,"uuid":"abf31616-2588-43c1-b15a-7f703ae8e1c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":28,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6808","nonce":3289387254},{"type":"v1","addr":"10.20.193.60:6809","nonce":3289387254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6810","nonce":3289387254},{"type":"v1","addr":"10.20.193.60:6811","nonce":3289387254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6814","nonce":3289387254},{"type":"v1","addr":"10.20.193.60:6815","nonce":3289387254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6812","nonce":3289387254},{"type":"v1","addr":"10.20.193.60:6813","nonce":3289387254}]},"public_addr":"10.20.193.60:6809/3289387254","cluster_addr":"10.20.193.60:6811/3289387254","heartbeat_back_addr":"10.20.193.60:6815/3289387254","heartbeat_front_addr":"10.20.193.60:6813/3289387254","state":["exists","up"]},{"osd":5,"uuid":"70c3d0b0-8e3d-4432-87e2-bb5391cf0167","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6808","nonce":3975711592},{"type":"v1","addr":"10.20.193.78:6809","nonce":3975711592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6810","nonce":3975711592},{"type":"v1","addr":"10.20.193.78:6811","nonce":3975711592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6814","nonce":3975711592},{"type":"v1","addr":"10.20.193.78:6815","nonce":3975711592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6812","nonce":3975711592},{"type":"v1","addr":"10.20.193.78:6813","nonce":3975711592}]},"public_addr":"10.20.193.78:6809/3975711592","cluster_addr":"10.20.193.78:6811/3975711592","heartbeat_back_addr":"10.20.193.78:6815/3975711592","heartbeat_front_addr":"10.20.193.78:6813/3975711592","state":["exists","up"]},{"osd":6,"uuid":"bc1293b8-53e6-4386-b02b-31ca7030976d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6818","nonce":2393344644},{"type":"v1","addr":"10.20.193.11:6819","nonce":2393344644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6820","nonce":2393344644},{"type":"v1","addr":"10.20.193.11:6821","nonce":2393344644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6824","nonce":2393344644},{"type":"v1","addr":"10.20.193.11:6825","nonce":2393344644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6822","nonce":2393344644},{"type":"v1","addr":"10.20.193.11:6823","nonce":2393344644}]},"public_addr":"10.20.193.11:6819/2393344644","cluster_addr":"10.20.193.11:6821/2393344644","heartbeat_back_addr":"10.20.193.11:6825/2393344644","heartbeat_front_addr":"10.20.193.11:6823/2393344644","state":["exists","up"]},{"osd":7,"uuid":"da596d81-14dc-403b-9a20-90a7587da04c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6816","nonce":2908560893},{"type":"v1","addr":"10.20.193.60:6817","nonce":2908560893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6818","nonce":2908560893},{"type":"v1","addr":"10.20.193.60:6819","nonce":2908560893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6822","nonce":2908560893},{"type":"v1","addr":"10.20.193.60:6823","nonce":2908560893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6820","nonce":2908560893},{"type":"v1","addr":"10.20.193.60:6821","nonce":2908560893}]},"public_addr":"10.20.193.60:6817/2908560893","cluster_addr":"10.20.193.60:6819/2908560893","heartbeat_back_addr":"10.20.193.60:6823/2908560893","heartbeat_front_addr":"10.20.193.60:6821/2908560893","state":["exists","up"]},{"osd":8,"uuid":"24098987-9f02-4f06-b93e-8af84291cc82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6816","nonce":242640323},{"type":"v1","addr":"10.20.193.78:6817","nonce":242640323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6818","nonce":242640323},{"type":"v1","addr":"10.20.193.78:6819","nonce":242640323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6822","nonce":242640323},{"type":"v1","addr":"10.20.193.78:6823","nonce":242640323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6820","nonce":242640323},{"type":"v1","addr":"10.20.193.78:6821","nonce":242640323}]},"public_addr":"10.20.193.78:6817/242640323","cluster_addr":"10.20.193.78:6819/242640323","heartbeat_back_addr":"10.20.193.78:6823/242640323","heartbeat_front_addr":"10.20.193.78:6821/242640323","state":["exists","up"]},{"osd":9,"uuid":"25cd90dd-8e86-4ac1-a693-a4080b035da1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6826","nonce":132317204},{"type":"v1","addr":"10.20.193.11:6827","nonce":132317204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6828","nonce":132317204},{"type":"v1","addr":"10.20.193.11:6829","nonce":132317204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6832","nonce":132317204},{"type":"v1","addr":"10.20.193.11:6833","nonce":132317204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6830","nonce":132317204},{"type":"v1","addr":"10.20.193.11:6831","nonce":132317204}]},"public_addr":"10.20.193.11:6827/132317204","cluster_addr":"10.20.193.11:6829/132317204","heartbeat_back_addr":"10.20.193.11:6833/132317204","heartbeat_front_addr":"10.20.193.11:6831/132317204","state":["exists","up"]},{"osd":10,"uuid":"727f51ff-9428-44ae-a69a-0f555f1397ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6824","nonce":3534951144},{"type":"v1","addr":"10.20.193.60:6825","nonce":3534951144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6826","nonce":3534951144},{"type":"v1","addr":"10.20.193.60:6827","nonce":3534951144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6830","nonce":3534951144},{"type":"v1","addr":"10.20.193.60:6831","nonce":3534951144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6828","nonce":3534951144},{"type":"v1","addr":"10.20.193.60:6829","nonce":3534951144}]},"public_addr":"10.20.193.60:6825/3534951144","cluster_addr":"10.20.193.60:6827/3534951144","heartbeat_back_addr":"10.20.193.60:6831/3534951144","heartbeat_front_addr":"10.20.193.60:6829/3534951144","state":["exists","up"]},{"osd":11,"uuid":"03e11d54-a857-418b-8ac1-c8d7a9a23305","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6824","nonce":537170494},{"type":"v1","addr":"10.20.193.78:6825","nonce":537170494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6826","nonce":537170494},{"type":"v1","addr":"10.20.193.78:6827","nonce":537170494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6830","nonce":537170494},{"type":"v1","addr":"10.20.193.78:6831","nonce":537170494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6828","nonce":537170494},{"type":"v1","addr":"10.20.193.78:6829","nonce":537170494}]},"public_addr":"10.20.193.78:6825/537170494","cluster_addr":"10.20.193.78:6827/537170494","heartbeat_back_addr":"10.20.193.78:6831/537170494","heartbeat_front_addr":"10.20.193.78:6829/537170494","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:17:29.302695+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:17:36.305494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:17:51.095807+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:17:58.083703+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:18:12.357395+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:18:19.659255+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:18:34.465790+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:18:41.783401+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.11:0/1644541112":"2026-02-14T02:16:41.426146+0000","10.20.193.11:0/1423851105":"2026-02-14T02:16:41.426146+0000","10.20.193.11:0/1602612884":"2026-02-14T02:16:41.426146+0000","10.20.193.11:6801/2469571860":"2026-02-14T02:16:41.426146+0000","10.20.193.11:6800/2469571860":"2026-02-14T02:16:41.426146+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-13T02:18:59.398 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.396+0000 7f50711486c0 1 -- 10.20.193.11:0/2701597530 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f50400b5680 msgr2=0x7f50400d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:59.399 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.396+0000 7f50711486c0 1 --2- 10.20.193.11:0/2701597530 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f50400b5680 0x7f50400d5b30 secure :-1 s=READY pgs=165 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f50600023e0 tx=0x7f5060031f90 comp rx=0 tx=0).stop 2026-02-13T02:18:59.399 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.396+0000 7f50711486c0 1 -- 10.20.193.11:0/2701597530 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f506c115410 msgr2=0x7f506c11d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:59.399 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.396+0000 7f50711486c0 1 --2- 10.20.193.11:0/2701597530 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f506c115410 0x7f506c11d740 secure :-1 s=READY pgs=216 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f505400b6c0 tx=0x7f505400bb90 comp rx=0 tx=0).stop 2026-02-13T02:18:59.399 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.396+0000 7f50711486c0 1 -- 10.20.193.11:0/2701597530 shutdown_connections 2026-02-13T02:18:59.399 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.396+0000 7f50711486c0 1 --2- 10.20.193.11:0/2701597530 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f50400b5680 0x7f50400d5b30 unknown :-1 s=CLOSED pgs=165 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:59.399 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.396+0000 7f50711486c0 1 --2- 10.20.193.11:0/2701597530 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f506c122b00 0x7f506c122fa0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:59.399 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.396+0000 7f50711486c0 1 --2- 10.20.193.11:0/2701597530 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f506c115410 0x7f506c11d740 unknown :-1 s=CLOSED pgs=216 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:59.399 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.396+0000 7f50711486c0 1 --2- 10.20.193.11:0/2701597530 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f506c10f200 0x7f506c11d200 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:59.399 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.396+0000 7f50711486c0 1 -- 10.20.193.11:0/2701597530 >> 10.20.193.11:0/2701597530 conn(0x7f506c0ecb00 msgr2=0x7f506c10cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:18:59.399 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.396+0000 7f50711486c0 1 -- 10.20.193.11:0/2701597530 shutdown_connections 2026-02-13T02:18:59.400 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.396+0000 7f50711486c0 1 -- 10.20.193.11:0/2701597530 wait complete. 2026-02-13T02:18:59.437 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph osd dump --format=json 2026-02-13T02:18:59.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:59 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/451385805' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2026-02-13T02:18:59.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:59 trial060 ceph-mon[14797]: osdmap e69: 12 total, 12 up, 12 in 2026-02-13T02:18:59.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:59 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/1599044448' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2026-02-13T02:18:59.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:18:59 trial060 ceph-mon[14797]: daemon mds.b assigned to filesystem cephfs as rank 0 2026-02-13T02:18:59.559 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:18:59.680 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.676+0000 7ffbb58306c0 1 -- 10.20.193.11:0/4249445433 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7ffbb0115410 msgr2=0x7ffbb0175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:59.680 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.676+0000 7ffbb58306c0 1 --2- 10.20.193.11:0/4249445433 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7ffbb0115410 0x7ffbb0175db0 secure :-1 s=READY pgs=217 gs=1 cs=0 l=1 c_cookie=17194594284300994568 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffba000aa70 tx=0x7ffba002fde0 comp rx=0 tx=0).stop 2026-02-13T02:18:59.681 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.676+0000 7ffbb58306c0 1 -- 10.20.193.11:0/4249445433 shutdown_connections 2026-02-13T02:18:59.681 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.676+0000 7ffbb58306c0 1 --2- 10.20.193.11:0/4249445433 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7ffbb010fbf0 0x7ffbb0114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:59.681 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.676+0000 7ffbb58306c0 1 --2- 10.20.193.11:0/4249445433 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7ffbb0115410 0x7ffbb0175db0 unknown :-1 s=CLOSED pgs=217 gs=1 cs=0 l=1 c_cookie=17194594284300994568 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:59.681 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.676+0000 7ffbb58306c0 1 --2- 10.20.193.11:0/4249445433 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ffbb010f200 0x7ffbb010f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:59.681 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.676+0000 7ffbb58306c0 1 -- 10.20.193.11:0/4249445433 >> 10.20.193.11:0/4249445433 conn(0x7ffbb00ecb00 msgr2=0x7ffbb010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:18:59.681 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.676+0000 7ffbb58306c0 1 -- 10.20.193.11:0/4249445433 shutdown_connections 2026-02-13T02:18:59.681 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.676+0000 7ffbb58306c0 1 -- 10.20.193.11:0/4249445433 wait complete. 2026-02-13T02:18:59.681 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.677+0000 7ffbb58306c0 1 Processor -- start 2026-02-13T02:18:59.681 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.677+0000 7ffbb58306c0 1 -- start start 2026-02-13T02:18:59.681 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.677+0000 7ffbb58306c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7ffbb010f200 0x7ffbb011d160 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:18:59.681 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.677+0000 7ffbb58306c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7ffbb0115410 0x7ffbb011d6a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:18:59.682 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.677+0000 7ffbb58306c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ffbb0122a60 0x7ffbb0122f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:18:59.682 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.677+0000 7ffbb58306c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7ffbb0123470 con 0x7ffbb010f200 2026-02-13T02:18:59.682 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.677+0000 7ffbb58306c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7ffbb01235e0 con 0x7ffbb0115410 2026-02-13T02:18:59.682 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.677+0000 7ffbb58306c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7ffbb01237a0 con 0x7ffbb0122a60 2026-02-13T02:18:59.682 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.677+0000 7ffbaeffd6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7ffbb010f200 0x7ffbb011d160 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:18:59.682 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.677+0000 7ffbaeffd6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7ffbb010f200 0x7ffbb011d160 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:59980/0 (socket says 10.20.193.11:59980) 2026-02-13T02:18:59.682 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.677+0000 7ffbaeffd6c0 1 -- 10.20.193.11:0/1593648238 learned_addr learned my addr 10.20.193.11:0/1593648238 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:18:59.682 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.677+0000 7ffbae7fc6c0 1 --2- 10.20.193.11:0/1593648238 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7ffbb0115410 0x7ffbb011d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:18:59.682 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.677+0000 7ffbaf7fe6c0 1 --2- 10.20.193.11:0/1593648238 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ffbb0122a60 0x7ffbb0122f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:18:59.682 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.677+0000 7ffbaeffd6c0 1 -- 10.20.193.11:0/1593648238 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ffbb0122a60 msgr2=0x7ffbb0122f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:59.682 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.677+0000 7ffbaeffd6c0 1 --2- 10.20.193.11:0/1593648238 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ffbb0122a60 0x7ffbb0122f00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:59.682 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.677+0000 7ffbaeffd6c0 1 -- 10.20.193.11:0/1593648238 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7ffbb0115410 msgr2=0x7ffbb011d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:59.682 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.677+0000 7ffbaeffd6c0 1 --2- 10.20.193.11:0/1593648238 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7ffbb0115410 0x7ffbb011d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:59.683 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.677+0000 7ffbaeffd6c0 1 -- 10.20.193.11:0/1593648238 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffba000a660 con 0x7ffbb010f200 2026-02-13T02:18:59.683 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.677+0000 7ffbaeffd6c0 1 --2- 10.20.193.11:0/1593648238 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7ffbb010f200 0x7ffbb011d160 secure :-1 s=READY pgs=218 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffba400b710 tx=0x7ffba400bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:18:59.683 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.677+0000 7ffbb482e6c0 1 -- 10.20.193.11:0/1593648238 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ffba4004250 con 0x7ffbb010f200 2026-02-13T02:18:59.683 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.677+0000 7ffbb58306c0 1 -- 10.20.193.11:0/1593648238 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbb0163c50 con 0x7ffbb010f200 2026-02-13T02:18:59.683 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.677+0000 7ffbb482e6c0 1 -- 10.20.193.11:0/1593648238 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ffba4002da0 con 0x7ffbb010f200 2026-02-13T02:18:59.683 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.677+0000 7ffbb482e6c0 1 -- 10.20.193.11:0/1593648238 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ffba400ce40 con 0x7ffbb010f200 2026-02-13T02:18:59.683 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.677+0000 7ffbb58306c0 1 -- 10.20.193.11:0/1593648238 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbb0164130 con 0x7ffbb010f200 2026-02-13T02:18:59.683 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.678+0000 7ffbb58306c0 1 -- 10.20.193.11:0/1593648238 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbb01104d0 con 0x7ffbb010f200 2026-02-13T02:18:59.684 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.679+0000 7ffbb482e6c0 1 -- 10.20.193.11:0/1593648238 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 10) ==== 157066+0+0 (secure 0 0 0) 0x7ffba400c410 con 0x7ffbb010f200 2026-02-13T02:18:59.684 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.680+0000 7ffbb482e6c0 1 --2- 10.20.193.11:0/1593648238 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7ffb840b5600 0x7ffb840d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:18:59.684 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.680+0000 7ffbb482e6c0 1 -- 10.20.193.11:0/1593648238 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7762+0+0 (secure 0 0 0) 0x7ffba40e3bd0 con 0x7ffbb010f200 2026-02-13T02:18:59.684 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.680+0000 7ffbae7fc6c0 1 --2- 10.20.193.11:0/1593648238 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7ffb840b5600 0x7ffb840d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:18:59.685 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.680+0000 7ffbb482e6c0 1 -- 10.20.193.11:0/1593648238 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7ffba40a6790 con 0x7ffbb010f200 2026-02-13T02:18:59.685 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.680+0000 7ffbae7fc6c0 1 --2- 10.20.193.11:0/1593648238 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7ffb840b5600 0x7ffb840d5ab0 secure :-1 s=READY pgs=166 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffb98005980 tx=0x7ffb98005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:18:59.772 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.770+0000 7ffbb58306c0 1 -- 10.20.193.11:0/1593648238 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ffbb010f5d0 con 0x7ffbb010f200 2026-02-13T02:18:59.773 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.771+0000 7ffbb482e6c0 1 -- 10.20.193.11:0/1593648238 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) ==== 74+0+21875 (secure 0 0 0) 0x7ffba40a9940 con 0x7ffbb010f200 2026-02-13T02:18:59.773 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:18:59.774 INFO:teuthology.orchestra.run.trial011.stdout:{"epoch":70,"fsid":"fc631695-0881-11f1-899c-d404e6e7d460","created":"2026-02-13T02:16:35.175761+0000","modified":"2026-02-13T02:18:58.420221+0000","last_up_change":"2026-02-13T02:18:43.665240+0000","last_in_change":"2026-02-13T02:18:35.014003+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-13T02:17:39.931888+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-13T02:18:56.323027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-13T02:18:57.399537+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb9a005b-9a16-4fda-95c0-d23831f0cffc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6802","nonce":1061379396},{"type":"v1","addr":"10.20.193.11:6803","nonce":1061379396}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6804","nonce":1061379396},{"type":"v1","addr":"10.20.193.11:6805","nonce":1061379396}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6808","nonce":1061379396},{"type":"v1","addr":"10.20.193.11:6809","nonce":1061379396}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6806","nonce":1061379396},{"type":"v1","addr":"10.20.193.11:6807","nonce":1061379396}]},"public_addr":"10.20.193.11:6803/1061379396","cluster_addr":"10.20.193.11:6805/1061379396","heartbeat_back_addr":"10.20.193.11:6809/1061379396","heartbeat_front_addr":"10.20.193.11:6807/1061379396","state":["exists","up"]},{"osd":1,"uuid":"c1786ae4-a736-47b0-8302-b06423efd012","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6800","nonce":2198425396},{"type":"v1","addr":"10.20.193.60:6801","nonce":2198425396}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6802","nonce":2198425396},{"type":"v1","addr":"10.20.193.60:6803","nonce":2198425396}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6806","nonce":2198425396},{"type":"v1","addr":"10.20.193.60:6807","nonce":2198425396}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6804","nonce":2198425396},{"type":"v1","addr":"10.20.193.60:6805","nonce":2198425396}]},"public_addr":"10.20.193.60:6801/2198425396","cluster_addr":"10.20.193.60:6803/2198425396","heartbeat_back_addr":"10.20.193.60:6807/2198425396","heartbeat_front_addr":"10.20.193.60:6805/2198425396","state":["exists","up"]},{"osd":2,"uuid":"516f1aa0-bc7c-4808-8ac8-4ff406c71890","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6800","nonce":3723638526},{"type":"v1","addr":"10.20.193.78:6801","nonce":3723638526}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6802","nonce":3723638526},{"type":"v1","addr":"10.20.193.78:6803","nonce":3723638526}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6806","nonce":3723638526},{"type":"v1","addr":"10.20.193.78:6807","nonce":3723638526}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6804","nonce":3723638526},{"type":"v1","addr":"10.20.193.78:6805","nonce":3723638526}]},"public_addr":"10.20.193.78:6801/3723638526","cluster_addr":"10.20.193.78:6803/3723638526","heartbeat_back_addr":"10.20.193.78:6807/3723638526","heartbeat_front_addr":"10.20.193.78:6805/3723638526","state":["exists","up"]},{"osd":3,"uuid":"8cf508c2-b05d-42be-92e3-db0a57d22a85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6810","nonce":4224399876},{"type":"v1","addr":"10.20.193.11:6811","nonce":4224399876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6812","nonce":4224399876},{"type":"v1","addr":"10.20.193.11:6813","nonce":4224399876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6816","nonce":4224399876},{"type":"v1","addr":"10.20.193.11:6817","nonce":4224399876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6814","nonce":4224399876},{"type":"v1","addr":"10.20.193.11:6815","nonce":4224399876}]},"public_addr":"10.20.193.11:6811/4224399876","cluster_addr":"10.20.193.11:6813/4224399876","heartbeat_back_addr":"10.20.193.11:6817/4224399876","heartbeat_front_addr":"10.20.193.11:6815/4224399876","state":["exists","up"]},{"osd":4,"uuid":"abf31616-2588-43c1-b15a-7f703ae8e1c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":28,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6808","nonce":3289387254},{"type":"v1","addr":"10.20.193.60:6809","nonce":3289387254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6810","nonce":3289387254},{"type":"v1","addr":"10.20.193.60:6811","nonce":3289387254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6814","nonce":3289387254},{"type":"v1","addr":"10.20.193.60:6815","nonce":3289387254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6812","nonce":3289387254},{"type":"v1","addr":"10.20.193.60:6813","nonce":3289387254}]},"public_addr":"10.20.193.60:6809/3289387254","cluster_addr":"10.20.193.60:6811/3289387254","heartbeat_back_addr":"10.20.193.60:6815/3289387254","heartbeat_front_addr":"10.20.193.60:6813/3289387254","state":["exists","up"]},{"osd":5,"uuid":"70c3d0b0-8e3d-4432-87e2-bb5391cf0167","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6808","nonce":3975711592},{"type":"v1","addr":"10.20.193.78:6809","nonce":3975711592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6810","nonce":3975711592},{"type":"v1","addr":"10.20.193.78:6811","nonce":3975711592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6814","nonce":3975711592},{"type":"v1","addr":"10.20.193.78:6815","nonce":3975711592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6812","nonce":3975711592},{"type":"v1","addr":"10.20.193.78:6813","nonce":3975711592}]},"public_addr":"10.20.193.78:6809/3975711592","cluster_addr":"10.20.193.78:6811/3975711592","heartbeat_back_addr":"10.20.193.78:6815/3975711592","heartbeat_front_addr":"10.20.193.78:6813/3975711592","state":["exists","up"]},{"osd":6,"uuid":"bc1293b8-53e6-4386-b02b-31ca7030976d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6818","nonce":2393344644},{"type":"v1","addr":"10.20.193.11:6819","nonce":2393344644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6820","nonce":2393344644},{"type":"v1","addr":"10.20.193.11:6821","nonce":2393344644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6824","nonce":2393344644},{"type":"v1","addr":"10.20.193.11:6825","nonce":2393344644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6822","nonce":2393344644},{"type":"v1","addr":"10.20.193.11:6823","nonce":2393344644}]},"public_addr":"10.20.193.11:6819/2393344644","cluster_addr":"10.20.193.11:6821/2393344644","heartbeat_back_addr":"10.20.193.11:6825/2393344644","heartbeat_front_addr":"10.20.193.11:6823/2393344644","state":["exists","up"]},{"osd":7,"uuid":"da596d81-14dc-403b-9a20-90a7587da04c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6816","nonce":2908560893},{"type":"v1","addr":"10.20.193.60:6817","nonce":2908560893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6818","nonce":2908560893},{"type":"v1","addr":"10.20.193.60:6819","nonce":2908560893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6822","nonce":2908560893},{"type":"v1","addr":"10.20.193.60:6823","nonce":2908560893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6820","nonce":2908560893},{"type":"v1","addr":"10.20.193.60:6821","nonce":2908560893}]},"public_addr":"10.20.193.60:6817/2908560893","cluster_addr":"10.20.193.60:6819/2908560893","heartbeat_back_addr":"10.20.193.60:6823/2908560893","heartbeat_front_addr":"10.20.193.60:6821/2908560893","state":["exists","up"]},{"osd":8,"uuid":"24098987-9f02-4f06-b93e-8af84291cc82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6816","nonce":242640323},{"type":"v1","addr":"10.20.193.78:6817","nonce":242640323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6818","nonce":242640323},{"type":"v1","addr":"10.20.193.78:6819","nonce":242640323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6822","nonce":242640323},{"type":"v1","addr":"10.20.193.78:6823","nonce":242640323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6820","nonce":242640323},{"type":"v1","addr":"10.20.193.78:6821","nonce":242640323}]},"public_addr":"10.20.193.78:6817/242640323","cluster_addr":"10.20.193.78:6819/242640323","heartbeat_back_addr":"10.20.193.78:6823/242640323","heartbeat_front_addr":"10.20.193.78:6821/242640323","state":["exists","up"]},{"osd":9,"uuid":"25cd90dd-8e86-4ac1-a693-a4080b035da1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6826","nonce":132317204},{"type":"v1","addr":"10.20.193.11:6827","nonce":132317204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6828","nonce":132317204},{"type":"v1","addr":"10.20.193.11:6829","nonce":132317204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6832","nonce":132317204},{"type":"v1","addr":"10.20.193.11:6833","nonce":132317204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6830","nonce":132317204},{"type":"v1","addr":"10.20.193.11:6831","nonce":132317204}]},"public_addr":"10.20.193.11:6827/132317204","cluster_addr":"10.20.193.11:6829/132317204","heartbeat_back_addr":"10.20.193.11:6833/132317204","heartbeat_front_addr":"10.20.193.11:6831/132317204","state":["exists","up"]},{"osd":10,"uuid":"727f51ff-9428-44ae-a69a-0f555f1397ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6824","nonce":3534951144},{"type":"v1","addr":"10.20.193.60:6825","nonce":3534951144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6826","nonce":3534951144},{"type":"v1","addr":"10.20.193.60:6827","nonce":3534951144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6830","nonce":3534951144},{"type":"v1","addr":"10.20.193.60:6831","nonce":3534951144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6828","nonce":3534951144},{"type":"v1","addr":"10.20.193.60:6829","nonce":3534951144}]},"public_addr":"10.20.193.60:6825/3534951144","cluster_addr":"10.20.193.60:6827/3534951144","heartbeat_back_addr":"10.20.193.60:6831/3534951144","heartbeat_front_addr":"10.20.193.60:6829/3534951144","state":["exists","up"]},{"osd":11,"uuid":"03e11d54-a857-418b-8ac1-c8d7a9a23305","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6824","nonce":537170494},{"type":"v1","addr":"10.20.193.78:6825","nonce":537170494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6826","nonce":537170494},{"type":"v1","addr":"10.20.193.78:6827","nonce":537170494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6830","nonce":537170494},{"type":"v1","addr":"10.20.193.78:6831","nonce":537170494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6828","nonce":537170494},{"type":"v1","addr":"10.20.193.78:6829","nonce":537170494}]},"public_addr":"10.20.193.78:6825/537170494","cluster_addr":"10.20.193.78:6827/537170494","heartbeat_back_addr":"10.20.193.78:6831/537170494","heartbeat_front_addr":"10.20.193.78:6829/537170494","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:17:29.302695+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:17:36.305494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:17:51.095807+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:17:58.083703+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:18:12.357395+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:18:19.659255+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:18:34.465790+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:18:41.783401+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.11:0/1644541112":"2026-02-14T02:16:41.426146+0000","10.20.193.11:0/1423851105":"2026-02-14T02:16:41.426146+0000","10.20.193.11:0/1602612884":"2026-02-14T02:16:41.426146+0000","10.20.193.11:6801/2469571860":"2026-02-14T02:16:41.426146+0000","10.20.193.11:6800/2469571860":"2026-02-14T02:16:41.426146+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-13T02:18:59.774 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.772+0000 7ffbb58306c0 1 -- 10.20.193.11:0/1593648238 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7ffb840b5600 msgr2=0x7ffb840d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:59.775 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.772+0000 7ffbb58306c0 1 --2- 10.20.193.11:0/1593648238 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7ffb840b5600 0x7ffb840d5ab0 secure :-1 s=READY pgs=166 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffb98005980 tx=0x7ffb98005910 comp rx=0 tx=0).stop 2026-02-13T02:18:59.775 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.772+0000 7ffbb58306c0 1 -- 10.20.193.11:0/1593648238 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7ffbb010f200 msgr2=0x7ffbb011d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:18:59.775 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.772+0000 7ffbb58306c0 1 --2- 10.20.193.11:0/1593648238 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7ffbb010f200 0x7ffbb011d160 secure :-1 s=READY pgs=218 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffba400b710 tx=0x7ffba400bbe0 comp rx=0 tx=0).stop 2026-02-13T02:18:59.775 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.772+0000 7ffbb58306c0 1 -- 10.20.193.11:0/1593648238 shutdown_connections 2026-02-13T02:18:59.775 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.772+0000 7ffbb58306c0 1 --2- 10.20.193.11:0/1593648238 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7ffb840b5600 0x7ffb840d5ab0 unknown :-1 s=CLOSED pgs=166 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:59.775 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.772+0000 7ffbb58306c0 1 --2- 10.20.193.11:0/1593648238 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7ffbb0115410 0x7ffbb011d6a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:59.775 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.772+0000 7ffbb58306c0 1 --2- 10.20.193.11:0/1593648238 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ffbb0122a60 0x7ffbb0122f00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:59.775 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.772+0000 7ffbb58306c0 1 --2- 10.20.193.11:0/1593648238 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7ffbb010f200 0x7ffbb011d160 unknown :-1 s=CLOSED pgs=218 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:18:59.775 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.772+0000 7ffbb58306c0 1 -- 10.20.193.11:0/1593648238 >> 10.20.193.11:0/1593648238 conn(0x7ffbb00ecb00 msgr2=0x7ffbb010cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:18:59.775 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.772+0000 7ffbb58306c0 1 -- 10.20.193.11:0/1593648238 shutdown_connections 2026-02-13T02:18:59.775 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:18:59.772+0000 7ffbb58306c0 1 -- 10.20.193.11:0/1593648238 wait complete. 2026-02-13T02:18:59.812 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph fs set cephfs standby_count_wanted 0 2026-02-13T02:18:59.935 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:19:00.061 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:00.059+0000 7f6ead1df6c0 1 -- 10.20.193.11:0/2544375709 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f6ea810fbf0 msgr2=0x7f6ea8114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:00.061 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:00.059+0000 7f6ead1df6c0 1 --2- 10.20.193.11:0/2544375709 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f6ea810fbf0 0x7f6ea8114c30 secure :-1 s=READY pgs=219 gs=1 cs=0 l=1 c_cookie=9495405198602549222 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6e900099a0 tx=0x7f6e9002ed20 comp rx=0 tx=0).stop 2026-02-13T02:19:00.061 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:00.059+0000 7f6ead1df6c0 1 -- 10.20.193.11:0/2544375709 shutdown_connections 2026-02-13T02:19:00.061 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:00.059+0000 7f6ead1df6c0 1 --2- 10.20.193.11:0/2544375709 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6ea8115410 0x7f6ea8175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:00.061 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:00.059+0000 7f6ead1df6c0 1 --2- 10.20.193.11:0/2544375709 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f6ea810fbf0 0x7f6ea8114c30 unknown :-1 s=CLOSED pgs=219 gs=1 cs=0 l=1 c_cookie=9495405198602549222 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:00.061 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:00.059+0000 7f6ead1df6c0 1 --2- 10.20.193.11:0/2544375709 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f6ea810f200 0x7f6ea810f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:00.061 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:00.059+0000 7f6ead1df6c0 1 -- 10.20.193.11:0/2544375709 >> 10.20.193.11:0/2544375709 conn(0x7f6ea80ecb00 msgr2=0x7f6ea810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:00.061 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:00.059+0000 7f6ead1df6c0 1 -- 10.20.193.11:0/2544375709 shutdown_connections 2026-02-13T02:19:00.061 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:00.059+0000 7f6ead1df6c0 1 -- 10.20.193.11:0/2544375709 wait complete. 2026-02-13T02:19:00.062 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:00.059+0000 7f6ead1df6c0 1 Processor -- start 2026-02-13T02:19:00.062 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:00.059+0000 7f6ead1df6c0 1 -- start start 2026-02-13T02:19:00.062 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:00.059+0000 7f6ead1df6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6ea810f200 0x7f6ea80f4c50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:00.062 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:00.059+0000 7f6ead1df6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f6ea8115410 0x7f6ea8175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:00.062 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:00.060+0000 7f6ead1df6c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f6ea80f5280 0x7f6ea80fa550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:00.062 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:00.060+0000 7f6ead1df6c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f6ea80f5970 con 0x7f6ea8115410 2026-02-13T02:19:00.062 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:00.060+0000 7f6ead1df6c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6ea80faa90 con 0x7f6ea80f5280 2026-02-13T02:19:00.062 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:00.060+0000 7f6ead1df6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f6ea80fac50 con 0x7f6ea810f200 2026-02-13T02:19:00.062 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:00.060+0000 7f6ea65756c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f6ea8115410 0x7f6ea8175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:00.062 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:00.060+0000 7f6ea65756c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f6ea8115410 0x7f6ea8175cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:59988/0 (socket says 10.20.193.11:59988) 2026-02-13T02:19:00.062 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:00.060+0000 7f6ea65756c0 1 -- 10.20.193.11:0/3675487336 learned_addr learned my addr 10.20.193.11:0/3675487336 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:19:00.062 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:00.060+0000 7f6ea6d766c0 1 --2- 10.20.193.11:0/3675487336 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6ea810f200 0x7f6ea80f4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:00.062 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:00.060+0000 7f6ea75776c0 1 --2- 10.20.193.11:0/3675487336 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f6ea80f5280 0x7f6ea80fa550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:00.062 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:00.060+0000 7f6ea65756c0 1 -- 10.20.193.11:0/3675487336 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6ea810f200 msgr2=0x7f6ea80f4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:00.062 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:00.060+0000 7f6ea65756c0 1 --2- 10.20.193.11:0/3675487336 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6ea810f200 0x7f6ea80f4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:00.062 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:00.060+0000 7f6ea65756c0 1 -- 10.20.193.11:0/3675487336 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f6ea80f5280 msgr2=0x7f6ea80fa550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:00.062 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:00.060+0000 7f6ea65756c0 1 --2- 10.20.193.11:0/3675487336 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f6ea80f5280 0x7f6ea80fa550 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:00.062 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:00.060+0000 7f6ea65756c0 1 -- 10.20.193.11:0/3675487336 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e90009590 con 0x7f6ea8115410 2026-02-13T02:19:00.062 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:00.060+0000 7f6ea75776c0 1 --2- 10.20.193.11:0/3675487336 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f6ea80f5280 0x7f6ea80fa550 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:19:00.062 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:00.060+0000 7f6ea6d766c0 1 --2- 10.20.193.11:0/3675487336 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6ea810f200 0x7f6ea80f4c50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T02:19:00.062 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:00.060+0000 7f6ea65756c0 1 --2- 10.20.193.11:0/3675487336 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f6ea8115410 0x7f6ea8175cb0 secure :-1 s=READY pgs=220 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6e90031f90 tx=0x7f6e900047f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:00.062 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:00.060+0000 7f6e87fff6c0 1 -- 10.20.193.11:0/3675487336 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6e90002ae0 con 0x7f6ea8115410 2026-02-13T02:19:00.062 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:00.060+0000 7f6e87fff6c0 1 -- 10.20.193.11:0/3675487336 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6e90002c40 con 0x7f6ea8115410 2026-02-13T02:19:00.062 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:00.060+0000 7f6ead1df6c0 1 -- 10.20.193.11:0/3675487336 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ea80faed0 con 0x7f6ea8115410 2026-02-13T02:19:00.062 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:00.060+0000 7f6e87fff6c0 1 -- 10.20.193.11:0/3675487336 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6e900312b0 con 0x7f6ea8115410 2026-02-13T02:19:00.062 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:00.060+0000 7f6ead1df6c0 1 -- 10.20.193.11:0/3675487336 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ea80fb3a0 con 0x7f6ea8115410 2026-02-13T02:19:00.062 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:00.060+0000 7f6ead1df6c0 1 -- 10.20.193.11:0/3675487336 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ea81104d0 con 0x7f6ea8115410 2026-02-13T02:19:00.063 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:00.062+0000 7f6e87fff6c0 1 -- 10.20.193.11:0/3675487336 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 10) ==== 157066+0+0 (secure 0 0 0) 0x7f6e90007260 con 0x7f6ea8115410 2026-02-13T02:19:00.064 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:00.062+0000 7f6e87fff6c0 1 --2- 10.20.193.11:0/3675487336 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f6e7c0b5680 0x7f6e7c0d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:00.064 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:00.062+0000 7f6ea6d766c0 1 --2- 10.20.193.11:0/3675487336 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f6e7c0b5680 0x7f6e7c0d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:00.064 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:00.062+0000 7f6e87fff6c0 1 -- 10.20.193.11:0/3675487336 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7762+0+0 (secure 0 0 0) 0x7f6e90107af0 con 0x7f6ea8115410 2026-02-13T02:19:00.064 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:00.062+0000 7f6ea6d766c0 1 --2- 10.20.193.11:0/3675487336 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f6e7c0b5680 0x7f6e7c0d5b30 secure :-1 s=READY pgs=167 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6e9c005e50 tx=0x7f6e9c005de0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:00.064 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:00.063+0000 7f6e87fff6c0 1 -- 10.20.193.11:0/3675487336 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f6e900ce0d0 con 0x7f6ea8115410 2026-02-13T02:19:00.178 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:00.176+0000 7f6ead1df6c0 1 -- 10.20.193.11:0/3675487336 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f6ea810f5d0 con 0x7f6ea8115410 2026-02-13T02:19:00.178 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:00 trial011 ceph-mon[11956]: pgmap v182: 97 pgs: 10 active+clean, 32 creating+peering, 55 unknown; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T02:19:00.178 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:00 trial011 ceph-mon[11956]: osdmap e70: 12 total, 12 up, 12 in 2026-02-13T02:19:00.178 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:00 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/1599044448' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2026-02-13T02:19:00.178 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:00 trial011 ceph-mon[11956]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2026-02-13T02:19:00.178 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:00 trial011 ceph-mon[11956]: daemon mds.b is now active in filesystem cephfs as rank 0 2026-02-13T02:19:00.178 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:00 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/2701597530' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T02:19:00.178 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:00 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/1593648238' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T02:19:00.291 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:00 trial078 ceph-mon[14969]: pgmap v182: 97 pgs: 10 active+clean, 32 creating+peering, 55 unknown; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T02:19:00.291 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:00 trial078 ceph-mon[14969]: osdmap e70: 12 total, 12 up, 12 in 2026-02-13T02:19:00.291 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:00 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/1599044448' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2026-02-13T02:19:00.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:00 trial078 ceph-mon[14969]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2026-02-13T02:19:00.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:00 trial078 ceph-mon[14969]: daemon mds.b is now active in filesystem cephfs as rank 0 2026-02-13T02:19:00.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:00 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/2701597530' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T02:19:00.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:00 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/1593648238' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T02:19:00.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:00 trial060 ceph-mon[14797]: pgmap v182: 97 pgs: 10 active+clean, 32 creating+peering, 55 unknown; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T02:19:00.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:00 trial060 ceph-mon[14797]: osdmap e70: 12 total, 12 up, 12 in 2026-02-13T02:19:00.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:00 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/1599044448' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2026-02-13T02:19:00.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:00 trial060 ceph-mon[14797]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2026-02-13T02:19:00.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:00 trial060 ceph-mon[14797]: daemon mds.b is now active in filesystem cephfs as rank 0 2026-02-13T02:19:00.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:00 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/2701597530' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T02:19:00.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:00 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/1593648238' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T02:19:01.030 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:01.028+0000 7f6e87fff6c0 1 -- 10.20.193.11:0/3675487336 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v14) ==== 118+0+0 (secure 0 0 0) 0x7f6e900077d0 con 0x7f6ea8115410 2026-02-13T02:19:01.032 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:01.030+0000 7f6ead1df6c0 1 -- 10.20.193.11:0/3675487336 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f6e7c0b5680 msgr2=0x7f6e7c0d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:01.032 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:01.030+0000 7f6ead1df6c0 1 --2- 10.20.193.11:0/3675487336 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f6e7c0b5680 0x7f6e7c0d5b30 secure :-1 s=READY pgs=167 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6e9c005e50 tx=0x7f6e9c005de0 comp rx=0 tx=0).stop 2026-02-13T02:19:01.032 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:01.030+0000 7f6ead1df6c0 1 -- 10.20.193.11:0/3675487336 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f6ea8115410 msgr2=0x7f6ea8175cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:01.032 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:01.030+0000 7f6ead1df6c0 1 --2- 10.20.193.11:0/3675487336 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f6ea8115410 0x7f6ea8175cb0 secure :-1 s=READY pgs=220 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6e90031f90 tx=0x7f6e900047f0 comp rx=0 tx=0).stop 2026-02-13T02:19:01.032 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:01.030+0000 7f6ead1df6c0 1 -- 10.20.193.11:0/3675487336 shutdown_connections 2026-02-13T02:19:01.032 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:01.030+0000 7f6ead1df6c0 1 --2- 10.20.193.11:0/3675487336 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f6e7c0b5680 0x7f6e7c0d5b30 unknown :-1 s=CLOSED pgs=167 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:01.032 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:01.030+0000 7f6ead1df6c0 1 --2- 10.20.193.11:0/3675487336 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f6ea80f5280 0x7f6ea80fa550 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:01.033 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:01.030+0000 7f6ead1df6c0 1 --2- 10.20.193.11:0/3675487336 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f6ea8115410 0x7f6ea8175cb0 unknown :-1 s=CLOSED pgs=220 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:01.033 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:01.030+0000 7f6ead1df6c0 1 --2- 10.20.193.11:0/3675487336 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6ea810f200 0x7f6ea80f4c50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:01.033 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:01.030+0000 7f6ead1df6c0 1 -- 10.20.193.11:0/3675487336 >> 10.20.193.11:0/3675487336 conn(0x7f6ea80ecb00 msgr2=0x7f6ea810d900 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:01.033 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:01.030+0000 7f6ead1df6c0 1 -- 10.20.193.11:0/3675487336 shutdown_connections 2026-02-13T02:19:01.033 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:01.030+0000 7f6ead1df6c0 1 -- 10.20.193.11:0/3675487336 wait complete. 2026-02-13T02:19:01.070 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['disabled'], 'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2026-02-13T02:19:01.070 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph fs set cephfs max_mds 5 --yes-i-really-mean-it 2026-02-13T02:19:01.193 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:19:01.250 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:01 trial060 ceph-mon[14797]: osdmap e71: 12 total, 12 up, 12 in 2026-02-13T02:19:01.250 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:01 trial060 ceph-mon[14797]: mds.? [v2:10.20.193.60:6838/1675549162,v1:10.20.193.60:6839/1675549162] up:active 2026-02-13T02:19:01.251 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:01 trial060 ceph-mon[14797]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-13T02:19:01.251 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:01 trial060 ceph-mon[14797]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-13T02:19:01.251 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:01 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/3675487336' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2026-02-13T02:19:01.291 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:01 trial078 ceph-mon[14969]: osdmap e71: 12 total, 12 up, 12 in 2026-02-13T02:19:01.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:01 trial078 ceph-mon[14969]: mds.? [v2:10.20.193.60:6838/1675549162,v1:10.20.193.60:6839/1675549162] up:active 2026-02-13T02:19:01.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:01 trial078 ceph-mon[14969]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-13T02:19:01.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:01 trial078 ceph-mon[14969]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-13T02:19:01.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:01 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/3675487336' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2026-02-13T02:19:01.307 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:01 trial011 ceph-mon[11956]: osdmap e71: 12 total, 12 up, 12 in 2026-02-13T02:19:01.307 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:01 trial011 ceph-mon[11956]: mds.? [v2:10.20.193.60:6838/1675549162,v1:10.20.193.60:6839/1675549162] up:active 2026-02-13T02:19:01.307 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:01 trial011 ceph-mon[11956]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-13T02:19:01.307 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:01 trial011 ceph-mon[11956]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-13T02:19:01.307 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:01 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/3675487336' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2026-02-13T02:19:01.320 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:01.316+0000 7fcad591f6c0 1 -- 10.20.193.11:0/4288130012 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fcad01556b0 msgr2=0x7fcad0175a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:01.320 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:01.316+0000 7fcad591f6c0 1 --2- 10.20.193.11:0/4288130012 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fcad01556b0 0x7fcad0175a90 secure :-1 s=READY pgs=221 gs=1 cs=0 l=1 c_cookie=7249308953776875047 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcac000aa40 tx=0x7fcac002fde0 comp rx=0 tx=0).stop 2026-02-13T02:19:01.320 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:01.316+0000 7fcad591f6c0 1 -- 10.20.193.11:0/4288130012 shutdown_connections 2026-02-13T02:19:01.320 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:01.316+0000 7fcad591f6c0 1 --2- 10.20.193.11:0/4288130012 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fcad01556b0 0x7fcad0175a90 unknown :-1 s=CLOSED pgs=221 gs=1 cs=0 l=1 c_cookie=7249308953776875047 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:01.320 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:01.316+0000 7fcad591f6c0 1 --2- 10.20.193.11:0/4288130012 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fcad0061030 0x7fcad0155170 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:01.320 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:01.316+0000 7fcad591f6c0 1 --2- 10.20.193.11:0/4288130012 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fcad0060720 0x7fcad0060af0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:01.321 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:01.316+0000 7fcad591f6c0 1 -- 10.20.193.11:0/4288130012 >> 10.20.193.11:0/4288130012 conn(0x7fcad00ea880 msgr2=0x7fcad010ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:01.321 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:01.316+0000 7fcad591f6c0 1 -- 10.20.193.11:0/4288130012 shutdown_connections 2026-02-13T02:19:01.321 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:01.316+0000 7fcad591f6c0 1 -- 10.20.193.11:0/4288130012 wait complete. 2026-02-13T02:19:01.321 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:01.316+0000 7fcad591f6c0 1 Processor -- start 2026-02-13T02:19:01.321 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:01.316+0000 7fcad591f6c0 1 -- start start 2026-02-13T02:19:01.321 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:01.317+0000 7fcad591f6c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fcad0060720 0x7fcad0161400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:01.321 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:01.317+0000 7fcad591f6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fcad0061030 0x7fcad0161940 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:01.321 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:01.317+0000 7fcad591f6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fcad01556b0 0x7fcad0166d00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:01.321 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:01.317+0000 7fcad591f6c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7fcad0167350 con 0x7fcad01556b0 2026-02-13T02:19:01.321 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:01.317+0000 7fcad591f6c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7fcad01674c0 con 0x7fcad0060720 2026-02-13T02:19:01.322 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:01.317+0000 7fcad591f6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fcad0167680 con 0x7fcad0061030 2026-02-13T02:19:01.322 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:01.317+0000 7fcacf7fe6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fcad01556b0 0x7fcad0166d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:01.322 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:01.317+0000 7fcacf7fe6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fcad01556b0 0x7fcad0166d00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:48760/0 (socket says 10.20.193.11:48760) 2026-02-13T02:19:01.322 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:01.317+0000 7fcacf7fe6c0 1 -- 10.20.193.11:0/663637757 learned_addr learned my addr 10.20.193.11:0/663637757 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:19:01.322 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:01.317+0000 7fcace7fc6c0 1 --2- 10.20.193.11:0/663637757 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fcad0061030 0x7fcad0161940 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:01.322 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:01.317+0000 7fcaceffd6c0 1 --2- 10.20.193.11:0/663637757 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fcad0060720 0x7fcad0161400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:01.322 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:01.317+0000 7fcacf7fe6c0 1 -- 10.20.193.11:0/663637757 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fcad0061030 msgr2=0x7fcad0161940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:01.322 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:01.317+0000 7fcacf7fe6c0 1 --2- 10.20.193.11:0/663637757 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fcad0061030 0x7fcad0161940 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:01.322 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:01.317+0000 7fcacf7fe6c0 1 -- 10.20.193.11:0/663637757 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fcad0060720 msgr2=0x7fcad0161400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:01.322 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:01.317+0000 7fcacf7fe6c0 1 --2- 10.20.193.11:0/663637757 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fcad0060720 0x7fcad0161400 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:01.322 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:01.317+0000 7fcacf7fe6c0 1 -- 10.20.193.11:0/663637757 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcac000a660 con 0x7fcad01556b0 2026-02-13T02:19:01.322 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:01.317+0000 7fcacf7fe6c0 1 --2- 10.20.193.11:0/663637757 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fcad01556b0 0x7fcad0166d00 secure :-1 s=READY pgs=222 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcac000a3e0 tx=0x7fcac0005530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:01.323 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:01.317+0000 7fcad49196c0 1 -- 10.20.193.11:0/663637757 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcac0003a30 con 0x7fcad01556b0 2026-02-13T02:19:01.323 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:01.317+0000 7fcad49196c0 1 -- 10.20.193.11:0/663637757 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fcac0030990 con 0x7fcad01556b0 2026-02-13T02:19:01.323 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:01.317+0000 7fcad49196c0 1 -- 10.20.193.11:0/663637757 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcac00382f0 con 0x7fcad01556b0 2026-02-13T02:19:01.323 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:01.317+0000 7fcad591f6c0 1 -- 10.20.193.11:0/663637757 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcad0167900 con 0x7fcad01556b0 2026-02-13T02:19:01.323 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:01.317+0000 7fcad591f6c0 1 -- 10.20.193.11:0/663637757 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcad0167b80 con 0x7fcad01556b0 2026-02-13T02:19:01.323 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:01.318+0000 7fcad591f6c0 1 -- 10.20.193.11:0/663637757 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcad0061c30 con 0x7fcad01556b0 2026-02-13T02:19:01.324 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:01.319+0000 7fcad49196c0 1 -- 10.20.193.11:0/663637757 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 10) ==== 157066+0+0 (secure 0 0 0) 0x7fcac0003b90 con 0x7fcad01556b0 2026-02-13T02:19:01.324 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:01.319+0000 7fcad49196c0 1 --2- 10.20.193.11:0/663637757 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fcaa40b5680 0x7fcaa40d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:01.324 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:01.319+0000 7fcad49196c0 1 -- 10.20.193.11:0/663637757 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7762+0+0 (secure 0 0 0) 0x7fcac0108d00 con 0x7fcad01556b0 2026-02-13T02:19:01.324 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:01.319+0000 7fcaceffd6c0 1 --2- 10.20.193.11:0/663637757 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fcaa40b5680 0x7fcaa40d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:01.324 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:01.320+0000 7fcaceffd6c0 1 --2- 10.20.193.11:0/663637757 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fcaa40b5680 0x7fcaa40d5b30 secure :-1 s=READY pgs=168 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcac4004750 tx=0x7fcac4009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:01.324 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:01.320+0000 7fcad49196c0 1 -- 10.20.193.11:0/663637757 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fcac00cb8c0 con 0x7fcad01556b0 2026-02-13T02:19:01.438 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:01.436+0000 7fcad591f6c0 1 -- 10.20.193.11:0/663637757 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5", "yes_i_really_mean_it": true} v 0) -- 0x7fcad0060af0 con 0x7fcad01556b0 2026-02-13T02:19:02.035 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:02.033+0000 7fcad49196c0 1 -- 10.20.193.11:0/663637757 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5", "yes_i_really_mean_it": true}]=0 v15) ==== 135+0+0 (secure 0 0 0) 0x7fcac00cea70 con 0x7fcad01556b0 2026-02-13T02:19:02.039 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:02.036+0000 7fcad591f6c0 1 -- 10.20.193.11:0/663637757 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fcaa40b5680 msgr2=0x7fcaa40d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:02.039 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:02.036+0000 7fcad591f6c0 1 --2- 10.20.193.11:0/663637757 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fcaa40b5680 0x7fcaa40d5b30 secure :-1 s=READY pgs=168 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcac4004750 tx=0x7fcac4009260 comp rx=0 tx=0).stop 2026-02-13T02:19:02.039 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:02.036+0000 7fcad591f6c0 1 -- 10.20.193.11:0/663637757 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fcad01556b0 msgr2=0x7fcad0166d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:02.039 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:02.036+0000 7fcad591f6c0 1 --2- 10.20.193.11:0/663637757 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fcad01556b0 0x7fcad0166d00 secure :-1 s=READY pgs=222 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcac000a3e0 tx=0x7fcac0005530 comp rx=0 tx=0).stop 2026-02-13T02:19:02.039 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:02.036+0000 7fcad591f6c0 1 -- 10.20.193.11:0/663637757 shutdown_connections 2026-02-13T02:19:02.039 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:02.036+0000 7fcad591f6c0 1 --2- 10.20.193.11:0/663637757 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fcaa40b5680 0x7fcaa40d5b30 unknown :-1 s=CLOSED pgs=168 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:02.039 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:02.036+0000 7fcad591f6c0 1 --2- 10.20.193.11:0/663637757 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fcad01556b0 0x7fcad0166d00 unknown :-1 s=CLOSED pgs=222 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:02.039 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:02.036+0000 7fcad591f6c0 1 --2- 10.20.193.11:0/663637757 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fcad0061030 0x7fcad0161940 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:02.039 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:02.036+0000 7fcad591f6c0 1 --2- 10.20.193.11:0/663637757 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fcad0060720 0x7fcad0161400 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:02.039 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:02.036+0000 7fcad591f6c0 1 -- 10.20.193.11:0/663637757 >> 10.20.193.11:0/663637757 conn(0x7fcad00ea880 msgr2=0x7fcad010ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:02.040 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:02.036+0000 7fcad591f6c0 1 -- 10.20.193.11:0/663637757 shutdown_connections 2026-02-13T02:19:02.040 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:02.036+0000 7fcad591f6c0 1 -- 10.20.193.11:0/663637757 wait complete. 2026-02-13T02:19:02.080 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph fs set cephfs allow_standby_replay true 2026-02-13T02:19:02.203 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:19:02.291 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:02 trial078 ceph-mon[14969]: pgmap v185: 97 pgs: 30 active+clean, 32 creating+peering, 35 unknown; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 511 B/s wr, 1 op/s 2026-02-13T02:19:02.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:02 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/3675487336' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2026-02-13T02:19:02.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:02 trial078 ceph-mon[14969]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-13T02:19:02.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:02 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/663637757' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5", "yes_i_really_mean_it": true} : dispatch 2026-02-13T02:19:02.316 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:02 trial011 ceph-mon[11956]: pgmap v185: 97 pgs: 30 active+clean, 32 creating+peering, 35 unknown; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 511 B/s wr, 1 op/s 2026-02-13T02:19:02.316 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:02 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/3675487336' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2026-02-13T02:19:02.316 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:02 trial011 ceph-mon[11956]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-13T02:19:02.316 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:02 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/663637757' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5", "yes_i_really_mean_it": true} : dispatch 2026-02-13T02:19:02.321 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:02.317+0000 7f3ae33a36c0 1 -- 10.20.193.11:0/2735178951 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f3adc10f230 msgr2=0x7f3adc10f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:02.321 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:02.317+0000 7f3ae33a36c0 1 --2- 10.20.193.11:0/2735178951 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f3adc10f230 0x7f3adc10f600 secure :-1 s=READY pgs=223 gs=1 cs=0 l=1 c_cookie=9888563819818156821 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3acc0099a0 tx=0x7f3acc02ed20 comp rx=0 tx=0).stop 2026-02-13T02:19:02.321 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:02.317+0000 7f3ae33a36c0 1 -- 10.20.193.11:0/2735178951 shutdown_connections 2026-02-13T02:19:02.321 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:02.317+0000 7f3ae33a36c0 1 --2- 10.20.193.11:0/2735178951 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f3adc115440 0x7f3adc175de0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:02.321 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:02.317+0000 7f3ae33a36c0 1 --2- 10.20.193.11:0/2735178951 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f3adc10fc20 0x7f3adc114c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:02.321 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:02.317+0000 7f3ae33a36c0 1 --2- 10.20.193.11:0/2735178951 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f3adc10f230 0x7f3adc10f600 unknown :-1 s=CLOSED pgs=223 gs=1 cs=0 l=1 c_cookie=9888563819818156821 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:02.321 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:02.317+0000 7f3ae33a36c0 1 -- 10.20.193.11:0/2735178951 >> 10.20.193.11:0/2735178951 conn(0x7f3adc0ecb30 msgr2=0x7f3adc10cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:02.322 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:02.317+0000 7f3ae33a36c0 1 -- 10.20.193.11:0/2735178951 shutdown_connections 2026-02-13T02:19:02.322 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:02.317+0000 7f3ae33a36c0 1 -- 10.20.193.11:0/2735178951 wait complete. 2026-02-13T02:19:02.322 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:02.317+0000 7f3ae33a36c0 1 Processor -- start 2026-02-13T02:19:02.322 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:02.317+0000 7f3ae33a36c0 1 -- start start 2026-02-13T02:19:02.322 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:02.317+0000 7f3ae33a36c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f3adc10f230 0x7f3adc11d1c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:02.322 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:02.317+0000 7f3ae33a36c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f3adc115440 0x7f3adc11d700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:02.322 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:02.317+0000 7f3ae33a36c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f3adc122ac0 0x7f3adc122f60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:02.322 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:02.317+0000 7f3ae33a36c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f3adc1234d0 con 0x7f3adc122ac0 2026-02-13T02:19:02.322 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:02.317+0000 7f3ae33a36c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f3adc123640 con 0x7f3adc115440 2026-02-13T02:19:02.322 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:02.317+0000 7f3ae33a36c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f3adc123800 con 0x7f3adc10f230 2026-02-13T02:19:02.322 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:02.317+0000 7f3ae19156c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f3adc122ac0 0x7f3adc122f60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:02.322 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:02.317+0000 7f3ae19156c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f3adc122ac0 0x7f3adc122f60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:48788/0 (socket says 10.20.193.11:48788) 2026-02-13T02:19:02.323 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:02.317+0000 7f3ae19156c0 1 -- 10.20.193.11:0/423801975 learned_addr learned my addr 10.20.193.11:0/423801975 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:19:02.323 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:02.317+0000 7f3ae09136c0 1 --2- 10.20.193.11:0/423801975 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f3adc115440 0x7f3adc11d700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:02.323 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:02.317+0000 7f3ae11146c0 1 --2- 10.20.193.11:0/423801975 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f3adc10f230 0x7f3adc11d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:02.323 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:02.317+0000 7f3ae19156c0 1 -- 10.20.193.11:0/423801975 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f3adc10f230 msgr2=0x7f3adc11d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:02.323 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:02.317+0000 7f3ae19156c0 1 --2- 10.20.193.11:0/423801975 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f3adc10f230 0x7f3adc11d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:02.323 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:02.317+0000 7f3ae19156c0 1 -- 10.20.193.11:0/423801975 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f3adc115440 msgr2=0x7f3adc11d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:02.323 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:02.317+0000 7f3ae19156c0 1 --2- 10.20.193.11:0/423801975 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f3adc115440 0x7f3adc11d700 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:02.323 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:02.317+0000 7f3ae19156c0 1 -- 10.20.193.11:0/423801975 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3acc009590 con 0x7f3adc122ac0 2026-02-13T02:19:02.323 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:02.317+0000 7f3ae19156c0 1 --2- 10.20.193.11:0/423801975 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f3adc122ac0 0x7f3adc122f60 secure :-1 s=READY pgs=224 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3ad8006ea0 tx=0x7f3ad800ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:02.323 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:02.318+0000 7f3aca7fc6c0 1 -- 10.20.193.11:0/423801975 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3ad8003c40 con 0x7f3adc122ac0 2026-02-13T02:19:02.323 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:02.318+0000 7f3aca7fc6c0 1 -- 10.20.193.11:0/423801975 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3ad8003da0 con 0x7f3adc122ac0 2026-02-13T02:19:02.323 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:02.318+0000 7f3ae33a36c0 1 -- 10.20.193.11:0/423801975 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3adc163cb0 con 0x7f3adc122ac0 2026-02-13T02:19:02.324 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:02.318+0000 7f3aca7fc6c0 1 -- 10.20.193.11:0/423801975 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3ad80081c0 con 0x7f3adc122ac0 2026-02-13T02:19:02.324 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:02.318+0000 7f3ae33a36c0 1 -- 10.20.193.11:0/423801975 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3adc164190 con 0x7f3adc122ac0 2026-02-13T02:19:02.324 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:02.318+0000 7f3ae33a36c0 1 -- 10.20.193.11:0/423801975 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3adc110500 con 0x7f3adc122ac0 2026-02-13T02:19:02.325 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:02.319+0000 7f3aca7fc6c0 1 -- 10.20.193.11:0/423801975 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 10) ==== 157066+0+0 (secure 0 0 0) 0x7f3ad800d590 con 0x7f3adc122ac0 2026-02-13T02:19:02.325 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:02.320+0000 7f3aca7fc6c0 1 --2- 10.20.193.11:0/423801975 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f3ab80b5680 0x7f3ab80d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:02.325 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:02.320+0000 7f3aca7fc6c0 1 -- 10.20.193.11:0/423801975 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7762+0+0 (secure 0 0 0) 0x7f3ad80e4a00 con 0x7f3adc122ac0 2026-02-13T02:19:02.325 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:02.320+0000 7f3ae11146c0 1 --2- 10.20.193.11:0/423801975 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f3ab80b5680 0x7f3ab80d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:02.325 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:02.320+0000 7f3aca7fc6c0 1 -- 10.20.193.11:0/423801975 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f3ad80a7580 con 0x7f3adc122ac0 2026-02-13T02:19:02.325 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:02.320+0000 7f3ae11146c0 1 --2- 10.20.193.11:0/423801975 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f3ab80b5680 0x7f3ab80d5b30 secure :-1 s=READY pgs=169 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3acc0023e0 tx=0x7f3acc031f90 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:02.436 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:02.434+0000 7f3ae33a36c0 1 -- 10.20.193.11:0/423801975 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f3adc10f600 con 0x7f3adc122ac0 2026-02-13T02:19:02.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:02 trial060 ceph-mon[14797]: pgmap v185: 97 pgs: 30 active+clean, 32 creating+peering, 35 unknown; 577 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 511 B/s wr, 1 op/s 2026-02-13T02:19:02.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:02 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/3675487336' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2026-02-13T02:19:02.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:02 trial060 ceph-mon[14797]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-13T02:19:02.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:02 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/663637757' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5", "yes_i_really_mean_it": true} : dispatch 2026-02-13T02:19:03.040 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:03.038+0000 7f3aca7fc6c0 1 -- 10.20.193.11:0/423801975 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v17) ==== 121+0+0 (secure 0 0 0) 0x7f3ad80aa730 con 0x7f3adc122ac0 2026-02-13T02:19:03.042 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:03.040+0000 7f3ae33a36c0 1 -- 10.20.193.11:0/423801975 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f3ab80b5680 msgr2=0x7f3ab80d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:03.042 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:03.040+0000 7f3ae33a36c0 1 --2- 10.20.193.11:0/423801975 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f3ab80b5680 0x7f3ab80d5b30 secure :-1 s=READY pgs=169 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3acc0023e0 tx=0x7f3acc031f90 comp rx=0 tx=0).stop 2026-02-13T02:19:03.042 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:03.040+0000 7f3ae33a36c0 1 -- 10.20.193.11:0/423801975 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f3adc122ac0 msgr2=0x7f3adc122f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:03.042 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:03.040+0000 7f3ae33a36c0 1 --2- 10.20.193.11:0/423801975 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f3adc122ac0 0x7f3adc122f60 secure :-1 s=READY pgs=224 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3ad8006ea0 tx=0x7f3ad800ce50 comp rx=0 tx=0).stop 2026-02-13T02:19:03.042 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:03.040+0000 7f3ae33a36c0 1 -- 10.20.193.11:0/423801975 shutdown_connections 2026-02-13T02:19:03.043 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:03.040+0000 7f3ae33a36c0 1 --2- 10.20.193.11:0/423801975 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f3ab80b5680 0x7f3ab80d5b30 unknown :-1 s=CLOSED pgs=169 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:03.043 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:03.040+0000 7f3ae33a36c0 1 --2- 10.20.193.11:0/423801975 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f3adc115440 0x7f3adc11d700 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:03.043 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:03.040+0000 7f3ae33a36c0 1 --2- 10.20.193.11:0/423801975 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f3adc122ac0 0x7f3adc122f60 unknown :-1 s=CLOSED pgs=224 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:03.043 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:03.040+0000 7f3ae33a36c0 1 --2- 10.20.193.11:0/423801975 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f3adc10f230 0x7f3adc11d1c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:03.043 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:03.040+0000 7f3ae33a36c0 1 -- 10.20.193.11:0/423801975 >> 10.20.193.11:0/423801975 conn(0x7f3adc0ecb30 msgr2=0x7f3adc10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:03.043 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:03.040+0000 7f3ae33a36c0 1 -- 10.20.193.11:0/423801975 shutdown_connections 2026-02-13T02:19:03.043 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:03.040+0000 7f3ae33a36c0 1 -- 10.20.193.11:0/423801975 wait complete. 2026-02-13T02:19:03.081 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph fs set cephfs session_timeout 300 2026-02-13T02:19:03.203 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:19:03.291 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:03 trial078 ceph-mon[14969]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2026-02-13T02:19:03.291 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:03 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/663637757' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5", "yes_i_really_mean_it": true}]': finished 2026-02-13T02:19:03.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:03 trial078 ceph-mon[14969]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2026-02-13T02:19:03.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:03 trial078 ceph-mon[14969]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-13T02:19:03.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:03 trial078 ceph-mon[14969]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2026-02-13T02:19:03.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:03 trial078 ceph-mon[14969]: daemon mds.h is now active in filesystem cephfs as rank 1 2026-02-13T02:19:03.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:03 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/423801975' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2026-02-13T02:19:03.317 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:03 trial011 ceph-mon[11956]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2026-02-13T02:19:03.317 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:03 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/663637757' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5", "yes_i_really_mean_it": true}]': finished 2026-02-13T02:19:03.317 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:03 trial011 ceph-mon[11956]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2026-02-13T02:19:03.317 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:03 trial011 ceph-mon[11956]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-13T02:19:03.317 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:03 trial011 ceph-mon[11956]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2026-02-13T02:19:03.317 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:03 trial011 ceph-mon[11956]: daemon mds.h is now active in filesystem cephfs as rank 1 2026-02-13T02:19:03.318 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:03 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/423801975' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2026-02-13T02:19:03.319 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:03.317+0000 7f2b280286c0 1 -- 10.20.193.11:0/2346635012 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f2b2010fbf0 msgr2=0x7f2b20114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:03.319 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:03.317+0000 7f2b280286c0 1 --2- 10.20.193.11:0/2346635012 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f2b2010fbf0 0x7f2b20114c30 secure :-1 s=READY pgs=225 gs=1 cs=0 l=1 c_cookie=18311447529336671238 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2b140099a0 tx=0x7f2b1402ed50 comp rx=0 tx=0).stop 2026-02-13T02:19:03.319 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:03.317+0000 7f2b280286c0 1 -- 10.20.193.11:0/2346635012 shutdown_connections 2026-02-13T02:19:03.319 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:03.317+0000 7f2b280286c0 1 --2- 10.20.193.11:0/2346635012 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f2b20115410 0x7f2b20175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:03.319 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:03.317+0000 7f2b280286c0 1 --2- 10.20.193.11:0/2346635012 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f2b2010fbf0 0x7f2b20114c30 unknown :-1 s=CLOSED pgs=225 gs=1 cs=0 l=1 c_cookie=18311447529336671238 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:03.319 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:03.317+0000 7f2b280286c0 1 --2- 10.20.193.11:0/2346635012 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f2b2010f200 0x7f2b2010f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:03.319 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:03.317+0000 7f2b280286c0 1 -- 10.20.193.11:0/2346635012 >> 10.20.193.11:0/2346635012 conn(0x7f2b200ecb00 msgr2=0x7f2b2010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:03.319 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:03.317+0000 7f2b280286c0 1 -- 10.20.193.11:0/2346635012 shutdown_connections 2026-02-13T02:19:03.319 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:03.317+0000 7f2b280286c0 1 -- 10.20.193.11:0/2346635012 wait complete. 2026-02-13T02:19:03.320 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:03.318+0000 7f2b280286c0 1 Processor -- start 2026-02-13T02:19:03.320 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:03.318+0000 7f2b280286c0 1 -- start start 2026-02-13T02:19:03.320 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:03.318+0000 7f2b280286c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f2b2010f200 0x7f2b200f4c50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:03.320 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:03.318+0000 7f2b280286c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f2b20115410 0x7f2b20175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:03.320 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:03.318+0000 7f2b280286c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f2b200f5280 0x7f2b200fa550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:03.320 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:03.318+0000 7f2b280286c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f2b200f5970 con 0x7f2b20115410 2026-02-13T02:19:03.320 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:03.318+0000 7f2b280286c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f2b200faa90 con 0x7f2b200f5280 2026-02-13T02:19:03.320 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:03.318+0000 7f2b280286c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f2b200fac50 con 0x7f2b2010f200 2026-02-13T02:19:03.320 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:03.318+0000 7f2b2559c6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f2b20115410 0x7f2b20175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:03.320 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:03.318+0000 7f2b2559c6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f2b20115410 0x7f2b20175cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:48804/0 (socket says 10.20.193.11:48804) 2026-02-13T02:19:03.320 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:03.318+0000 7f2b2559c6c0 1 -- 10.20.193.11:0/4257012315 learned_addr learned my addr 10.20.193.11:0/4257012315 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:19:03.320 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:03.318+0000 7f2b25d9d6c0 1 --2- 10.20.193.11:0/4257012315 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f2b2010f200 0x7f2b200f4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:03.320 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:03.318+0000 7f2b2659e6c0 1 --2- 10.20.193.11:0/4257012315 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f2b200f5280 0x7f2b200fa550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:03.320 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:03.318+0000 7f2b2559c6c0 1 -- 10.20.193.11:0/4257012315 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f2b2010f200 msgr2=0x7f2b200f4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:03.320 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:03.318+0000 7f2b2559c6c0 1 --2- 10.20.193.11:0/4257012315 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f2b2010f200 0x7f2b200f4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:03.320 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:03.318+0000 7f2b2559c6c0 1 -- 10.20.193.11:0/4257012315 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f2b200f5280 msgr2=0x7f2b200fa550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:03.320 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:03.318+0000 7f2b2559c6c0 1 --2- 10.20.193.11:0/4257012315 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f2b200f5280 0x7f2b200fa550 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:03.320 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:03.318+0000 7f2b2559c6c0 1 -- 10.20.193.11:0/4257012315 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b14009590 con 0x7f2b20115410 2026-02-13T02:19:03.320 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:03.318+0000 7f2b2659e6c0 1 --2- 10.20.193.11:0/4257012315 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f2b200f5280 0x7f2b200fa550 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:19:03.320 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:03.318+0000 7f2b2559c6c0 1 --2- 10.20.193.11:0/4257012315 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f2b20115410 0x7f2b20175cb0 secure :-1 s=READY pgs=226 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2b14005b40 tx=0x7f2b1402fbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:03.320 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:03.318+0000 7f2b0effd6c0 1 -- 10.20.193.11:0/4257012315 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2b14002ae0 con 0x7f2b20115410 2026-02-13T02:19:03.320 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:03.318+0000 7f2b0effd6c0 1 -- 10.20.193.11:0/4257012315 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2b14002c40 con 0x7f2b20115410 2026-02-13T02:19:03.320 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:03.318+0000 7f2b280286c0 1 -- 10.20.193.11:0/4257012315 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b200faed0 con 0x7f2b20115410 2026-02-13T02:19:03.321 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:03.318+0000 7f2b0effd6c0 1 -- 10.20.193.11:0/4257012315 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2b140312b0 con 0x7f2b20115410 2026-02-13T02:19:03.321 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:03.318+0000 7f2b280286c0 1 -- 10.20.193.11:0/4257012315 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b200fb3a0 con 0x7f2b20115410 2026-02-13T02:19:03.321 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:03.319+0000 7f2b280286c0 1 -- 10.20.193.11:0/4257012315 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b201104d0 con 0x7f2b20115410 2026-02-13T02:19:03.321 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:03.320+0000 7f2b0effd6c0 1 -- 10.20.193.11:0/4257012315 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 10) ==== 157066+0+0 (secure 0 0 0) 0x7f2b140077d0 con 0x7f2b20115410 2026-02-13T02:19:03.322 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:03.321+0000 7f2b0effd6c0 1 --2- 10.20.193.11:0/4257012315 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f2afc0b5680 0x7f2afc0d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:03.322 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:03.321+0000 7f2b25d9d6c0 1 --2- 10.20.193.11:0/4257012315 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f2afc0b5680 0x7f2afc0d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:03.322 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:03.321+0000 7f2b0effd6c0 1 -- 10.20.193.11:0/4257012315 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7762+0+0 (secure 0 0 0) 0x7f2b14107980 con 0x7f2b20115410 2026-02-13T02:19:03.322 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:03.321+0000 7f2b25d9d6c0 1 --2- 10.20.193.11:0/4257012315 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f2afc0b5680 0x7f2afc0d5b30 secure :-1 s=READY pgs=170 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2b10004750 tx=0x7f2b10009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:03.323 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:03.321+0000 7f2b0effd6c0 1 -- 10.20.193.11:0/4257012315 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f2b140ca540 con 0x7f2b20115410 2026-02-13T02:19:03.438 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:03.436+0000 7f2b280286c0 1 -- 10.20.193.11:0/4257012315 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f2b2010f5d0 con 0x7f2b20115410 2026-02-13T02:19:03.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:03 trial060 ceph-mon[14797]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2026-02-13T02:19:03.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:03 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/663637757' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5", "yes_i_really_mean_it": true}]': finished 2026-02-13T02:19:03.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:03 trial060 ceph-mon[14797]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2026-02-13T02:19:03.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:03 trial060 ceph-mon[14797]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-13T02:19:03.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:03 trial060 ceph-mon[14797]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2026-02-13T02:19:03.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:03 trial060 ceph-mon[14797]: daemon mds.h is now active in filesystem cephfs as rank 1 2026-02-13T02:19:03.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:03 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/423801975' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2026-02-13T02:19:04.046 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:04.043+0000 7f2b0effd6c0 1 -- 10.20.193.11:0/4257012315 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v19) ==== 115+0+0 (secure 0 0 0) 0x7f2b1402fd60 con 0x7f2b20115410 2026-02-13T02:19:04.048 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:04.046+0000 7f2b280286c0 1 -- 10.20.193.11:0/4257012315 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f2afc0b5680 msgr2=0x7f2afc0d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:04.048 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:04.046+0000 7f2b280286c0 1 --2- 10.20.193.11:0/4257012315 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f2afc0b5680 0x7f2afc0d5b30 secure :-1 s=READY pgs=170 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2b10004750 tx=0x7f2b10009260 comp rx=0 tx=0).stop 2026-02-13T02:19:04.048 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:04.046+0000 7f2b280286c0 1 -- 10.20.193.11:0/4257012315 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f2b20115410 msgr2=0x7f2b20175cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:04.049 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:04.046+0000 7f2b280286c0 1 --2- 10.20.193.11:0/4257012315 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f2b20115410 0x7f2b20175cb0 secure :-1 s=READY pgs=226 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2b14005b40 tx=0x7f2b1402fbf0 comp rx=0 tx=0).stop 2026-02-13T02:19:04.049 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:04.046+0000 7f2b280286c0 1 -- 10.20.193.11:0/4257012315 shutdown_connections 2026-02-13T02:19:04.049 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:04.046+0000 7f2b280286c0 1 --2- 10.20.193.11:0/4257012315 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f2afc0b5680 0x7f2afc0d5b30 unknown :-1 s=CLOSED pgs=170 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:04.049 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:04.046+0000 7f2b280286c0 1 --2- 10.20.193.11:0/4257012315 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f2b200f5280 0x7f2b200fa550 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:04.049 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:04.046+0000 7f2b280286c0 1 --2- 10.20.193.11:0/4257012315 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f2b20115410 0x7f2b20175cb0 unknown :-1 s=CLOSED pgs=226 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:04.049 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:04.046+0000 7f2b280286c0 1 --2- 10.20.193.11:0/4257012315 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f2b2010f200 0x7f2b200f4c50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:04.049 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:04.046+0000 7f2b280286c0 1 -- 10.20.193.11:0/4257012315 >> 10.20.193.11:0/4257012315 conn(0x7f2b200ecb00 msgr2=0x7f2b2010d900 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:04.049 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:04.046+0000 7f2b280286c0 1 -- 10.20.193.11:0/4257012315 shutdown_connections 2026-02-13T02:19:04.049 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:04.046+0000 7f2b280286c0 1 -- 10.20.193.11:0/4257012315 wait complete. 2026-02-13T02:19:04.086 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated'} subvols for filesystem 'cephfs' 2026-02-13T02:19:04.087 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph fs subvolumegroup create cephfs qa 2026-02-13T02:19:04.209 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:19:04.291 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:04 trial078 ceph-mon[14969]: pgmap v186: 97 pgs: 68 active+clean, 29 creating+peering; 578 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.0 KiB/s wr, 7 op/s 2026-02-13T02:19:04.291 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:04 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/423801975' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2026-02-13T02:19:04.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:04 trial078 ceph-mon[14969]: mds.? [v2:10.20.193.60:6836/1730049678,v1:10.20.193.60:6837/1730049678] up:active 2026-02-13T02:19:04.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:04 trial078 ceph-mon[14969]: daemon mds.e assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2026-02-13T02:19:04.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:04 trial078 ceph-mon[14969]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2026-02-13T02:19:04.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:04 trial078 ceph-mon[14969]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:creating} 9 up:standby 2026-02-13T02:19:04.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:04 trial078 ceph-mon[14969]: daemon mds.e is now active in filesystem cephfs as rank 2 2026-02-13T02:19:04.292 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:04 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/4257012315' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2026-02-13T02:19:04.322 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:04 trial011 ceph-mon[11956]: pgmap v186: 97 pgs: 68 active+clean, 29 creating+peering; 578 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.0 KiB/s wr, 7 op/s 2026-02-13T02:19:04.323 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:04 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/423801975' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2026-02-13T02:19:04.323 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:04 trial011 ceph-mon[11956]: mds.? [v2:10.20.193.60:6836/1730049678,v1:10.20.193.60:6837/1730049678] up:active 2026-02-13T02:19:04.323 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:04 trial011 ceph-mon[11956]: daemon mds.e assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2026-02-13T02:19:04.323 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:04 trial011 ceph-mon[11956]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2026-02-13T02:19:04.323 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:04 trial011 ceph-mon[11956]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:creating} 9 up:standby 2026-02-13T02:19:04.323 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:04 trial011 ceph-mon[11956]: daemon mds.e is now active in filesystem cephfs as rank 2 2026-02-13T02:19:04.323 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:04 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/4257012315' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2026-02-13T02:19:04.330 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:04.327+0000 7f237bc916c0 1 -- 10.20.193.11:0/1663839783 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f237410fbf0 msgr2=0x7f2374114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:04.331 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:04.327+0000 7f237bc916c0 1 --2- 10.20.193.11:0/1663839783 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f237410fbf0 0x7f2374114c30 secure :-1 s=READY pgs=227 gs=1 cs=0 l=1 c_cookie=12204458991961671925 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f23680099a0 tx=0x7f236802ed20 comp rx=0 tx=0).stop 2026-02-13T02:19:04.331 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:04.327+0000 7f237bc916c0 1 -- 10.20.193.11:0/1663839783 shutdown_connections 2026-02-13T02:19:04.331 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:04.327+0000 7f237bc916c0 1 --2- 10.20.193.11:0/1663839783 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f2374115410 0x7f2374175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:04.331 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:04.327+0000 7f237bc916c0 1 --2- 10.20.193.11:0/1663839783 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f237410fbf0 0x7f2374114c30 unknown :-1 s=CLOSED pgs=227 gs=1 cs=0 l=1 c_cookie=12204458991961671925 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:04.331 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:04.327+0000 7f237bc916c0 1 --2- 10.20.193.11:0/1663839783 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f237410f200 0x7f237410f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:04.331 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:04.327+0000 7f237bc916c0 1 -- 10.20.193.11:0/1663839783 >> 10.20.193.11:0/1663839783 conn(0x7f23740ecb00 msgr2=0x7f237410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:04.331 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:04.327+0000 7f237bc916c0 1 -- 10.20.193.11:0/1663839783 shutdown_connections 2026-02-13T02:19:04.331 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:04.327+0000 7f237bc916c0 1 -- 10.20.193.11:0/1663839783 wait complete. 2026-02-13T02:19:04.331 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:04.327+0000 7f237bc916c0 1 Processor -- start 2026-02-13T02:19:04.331 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:04.327+0000 7f237bc916c0 1 -- start start 2026-02-13T02:19:04.331 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:04.327+0000 7f237bc916c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f237410f200 0x7f23740f4c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:04.332 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:04.327+0000 7f237bc916c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f2374115410 0x7f2374175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:04.332 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:04.327+0000 7f237bc916c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f23740f5270 0x7f23740fa540 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:04.332 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:04.327+0000 7f237bc916c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f23740f5960 con 0x7f237410f200 2026-02-13T02:19:04.332 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:04.327+0000 7f237bc916c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f23740faa80 con 0x7f2374115410 2026-02-13T02:19:04.332 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:04.327+0000 7f237bc916c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f23740fac40 con 0x7f23740f5270 2026-02-13T02:19:04.332 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:04.327+0000 7f2379a026c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f237410f200 0x7f23740f4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:04.332 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:04.327+0000 7f2379a026c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f237410f200 0x7f23740f4c40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:48812/0 (socket says 10.20.193.11:48812) 2026-02-13T02:19:04.332 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:04.327+0000 7f2379a026c0 1 -- 10.20.193.11:0/3637546445 learned_addr learned my addr 10.20.193.11:0/3637546445 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:19:04.332 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:04.327+0000 7f23792016c0 1 --2- 10.20.193.11:0/3637546445 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f2374115410 0x7f2374175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:04.332 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:04.327+0000 7f237a2036c0 1 --2- 10.20.193.11:0/3637546445 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f23740f5270 0x7f23740fa540 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:04.332 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:04.327+0000 7f2379a026c0 1 -- 10.20.193.11:0/3637546445 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f23740f5270 msgr2=0x7f23740fa540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:04.332 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:04.327+0000 7f2379a026c0 1 --2- 10.20.193.11:0/3637546445 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f23740f5270 0x7f23740fa540 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:04.333 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:04.327+0000 7f2379a026c0 1 -- 10.20.193.11:0/3637546445 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f2374115410 msgr2=0x7f2374175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:04.333 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:04.327+0000 7f2379a026c0 1 --2- 10.20.193.11:0/3637546445 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f2374115410 0x7f2374175cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:04.333 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:04.327+0000 7f2379a026c0 1 -- 10.20.193.11:0/3637546445 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2368009590 con 0x7f237410f200 2026-02-13T02:19:04.333 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:04.328+0000 7f2379a026c0 1 --2- 10.20.193.11:0/3637546445 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f237410f200 0x7f23740f4c40 secure :-1 s=READY pgs=228 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2364005dc0 tx=0x7f236400bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:04.333 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:04.328+0000 7f2362ffd6c0 1 -- 10.20.193.11:0/3637546445 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2364004250 con 0x7f237410f200 2026-02-13T02:19:04.333 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:04.328+0000 7f2362ffd6c0 1 -- 10.20.193.11:0/3637546445 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2364009070 con 0x7f237410f200 2026-02-13T02:19:04.333 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:04.328+0000 7f237bc916c0 1 -- 10.20.193.11:0/3637546445 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23740faf20 con 0x7f237410f200 2026-02-13T02:19:04.333 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:04.328+0000 7f2362ffd6c0 1 -- 10.20.193.11:0/3637546445 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f236400ce10 con 0x7f237410f200 2026-02-13T02:19:04.333 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:04.328+0000 7f237bc916c0 1 -- 10.20.193.11:0/3637546445 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23740fb6b0 con 0x7f237410f200 2026-02-13T02:19:04.333 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:04.328+0000 7f237bc916c0 1 -- 10.20.193.11:0/3637546445 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23741104d0 con 0x7f237410f200 2026-02-13T02:19:04.334 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:04.329+0000 7f2362ffd6c0 1 -- 10.20.193.11:0/3637546445 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 10) ==== 157066+0+0 (secure 0 0 0) 0x7f23640028c0 con 0x7f237410f200 2026-02-13T02:19:04.334 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:04.330+0000 7f2362ffd6c0 1 --2- 10.20.193.11:0/3637546445 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f23500b5680 0x7f23500d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:04.334 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:04.330+0000 7f2362ffd6c0 1 -- 10.20.193.11:0/3637546445 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7762+0+0 (secure 0 0 0) 0x7f23640e38d0 con 0x7f237410f200 2026-02-13T02:19:04.335 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:04.330+0000 7f23792016c0 1 --2- 10.20.193.11:0/3637546445 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f23500b5680 0x7f23500d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:04.335 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:04.330+0000 7f23792016c0 1 --2- 10.20.193.11:0/3637546445 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f23500b5680 0x7f23500d5b30 secure :-1 s=READY pgs=171 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f23680092e0 tx=0x7f2368031f90 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:04.335 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:04.330+0000 7f2362ffd6c0 1 -- 10.20.193.11:0/3637546445 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f23640a6450 con 0x7f237410f200 2026-02-13T02:19:04.444 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:04.442+0000 7f237bc916c0 1 -- 10.20.193.11:0/3637546445 --> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f23740f5d90 con 0x7f23500b5680 2026-02-13T02:19:04.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:04 trial060 ceph-mon[14797]: pgmap v186: 97 pgs: 68 active+clean, 29 creating+peering; 578 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.0 KiB/s wr, 7 op/s 2026-02-13T02:19:04.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:04 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/423801975' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2026-02-13T02:19:04.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:04 trial060 ceph-mon[14797]: mds.? [v2:10.20.193.60:6836/1730049678,v1:10.20.193.60:6837/1730049678] up:active 2026-02-13T02:19:04.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:04 trial060 ceph-mon[14797]: daemon mds.e assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2026-02-13T02:19:04.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:04 trial060 ceph-mon[14797]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2026-02-13T02:19:04.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:04 trial060 ceph-mon[14797]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:creating} 9 up:standby 2026-02-13T02:19:04.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:04 trial060 ceph-mon[14797]: daemon mds.e is now active in filesystem cephfs as rank 2 2026-02-13T02:19:04.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:04 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/4257012315' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2026-02-13T02:19:04.702 INFO:journalctl@ceph.mgr.x.trial011.stdout:Feb 13 02:19:04 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mgr-x[12241]: 2026-02-13T02:19:04.449+0000 7fc1ba1766c0 -1 client.14859 error registering admin socket command: (17) File exists 2026-02-13T02:19:05.063 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.062+0000 7f2362ffd6c0 1 -- 10.20.193.11:0/3637546445 <== mgr.14116 v2:10.20.193.11:6800/861334768 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f23740f5d90 con 0x7f23500b5680 2026-02-13T02:19:05.066 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.064+0000 7f237bc916c0 1 -- 10.20.193.11:0/3637546445 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f23500b5680 msgr2=0x7f23500d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:05.066 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.064+0000 7f237bc916c0 1 --2- 10.20.193.11:0/3637546445 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f23500b5680 0x7f23500d5b30 secure :-1 s=READY pgs=171 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f23680092e0 tx=0x7f2368031f90 comp rx=0 tx=0).stop 2026-02-13T02:19:05.066 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.064+0000 7f237bc916c0 1 -- 10.20.193.11:0/3637546445 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f237410f200 msgr2=0x7f23740f4c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:05.066 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.064+0000 7f237bc916c0 1 --2- 10.20.193.11:0/3637546445 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f237410f200 0x7f23740f4c40 secure :-1 s=READY pgs=228 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2364005dc0 tx=0x7f236400bbb0 comp rx=0 tx=0).stop 2026-02-13T02:19:05.066 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.064+0000 7f237bc916c0 1 -- 10.20.193.11:0/3637546445 shutdown_connections 2026-02-13T02:19:05.067 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.064+0000 7f237bc916c0 1 --2- 10.20.193.11:0/3637546445 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f23500b5680 0x7f23500d5b30 unknown :-1 s=CLOSED pgs=171 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:05.067 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.064+0000 7f237bc916c0 1 --2- 10.20.193.11:0/3637546445 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f2374115410 0x7f2374175cb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:05.067 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.064+0000 7f237bc916c0 1 --2- 10.20.193.11:0/3637546445 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f23740f5270 0x7f23740fa540 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:05.067 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.064+0000 7f237bc916c0 1 --2- 10.20.193.11:0/3637546445 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f237410f200 0x7f23740f4c40 unknown :-1 s=CLOSED pgs=228 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:05.067 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.064+0000 7f237bc916c0 1 -- 10.20.193.11:0/3637546445 >> 10.20.193.11:0/3637546445 conn(0x7f23740ecb00 msgr2=0x7f237410d860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:05.067 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.064+0000 7f237bc916c0 1 -- 10.20.193.11:0/3637546445 shutdown_connections 2026-02-13T02:19:05.067 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.064+0000 7f237bc916c0 1 -- 10.20.193.11:0/3637546445 wait complete. 2026-02-13T02:19:05.105 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2026-02-13T02:19:05.227 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:19:05.341 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:05 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/4257012315' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2026-02-13T02:19:05.341 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:05 trial011 ceph-mon[11956]: mds.? [v2:10.20.193.60:6834/937612650,v1:10.20.193.60:6835/937612650] up:active 2026-02-13T02:19:05.341 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:05 trial011 ceph-mon[11956]: daemon mds.i assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2026-02-13T02:19:05.341 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:05 trial011 ceph-mon[11956]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 9 up:standby 2026-02-13T02:19:05.341 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:05 trial011 ceph-mon[11956]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=e=up:active,3=i=up:creating} 8 up:standby 2026-02-13T02:19:05.341 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:05 trial011 ceph-mon[11956]: daemon mds.i is now active in filesystem cephfs as rank 3 2026-02-13T02:19:05.341 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:05 trial011 ceph-mon[11956]: from='client.14853 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:19:05.349 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.345+0000 7fdd9b9c86c0 1 -- 10.20.193.11:0/3128080581 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fdd941142f0 msgr2=0x7fdd94175e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:05.349 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.345+0000 7fdd9b9c86c0 1 --2- 10.20.193.11:0/3128080581 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fdd941142f0 0x7fdd94175e20 secure :-1 s=READY pgs=231 gs=1 cs=0 l=1 c_cookie=16268724649818653908 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdd9000aa40 tx=0x7fdd9002fde0 comp rx=0 tx=0).stop 2026-02-13T02:19:05.349 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.345+0000 7fdd9b9c86c0 1 -- 10.20.193.11:0/3128080581 shutdown_connections 2026-02-13T02:19:05.349 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.345+0000 7fdd9b9c86c0 1 --2- 10.20.193.11:0/3128080581 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fdd9410bde0 0x7fdd94113b70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:05.349 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.345+0000 7fdd9b9c86c0 1 --2- 10.20.193.11:0/3128080581 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fdd941142f0 0x7fdd94175e20 unknown :-1 s=CLOSED pgs=231 gs=1 cs=0 l=1 c_cookie=16268724649818653908 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:05.349 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.345+0000 7fdd9b9c86c0 1 --2- 10.20.193.11:0/3128080581 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fdd9410b440 0x7fdd9410b810 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:05.349 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.345+0000 7fdd9b9c86c0 1 -- 10.20.193.11:0/3128080581 >> 10.20.193.11:0/3128080581 conn(0x7fdd94062e00 msgr2=0x7fdd94109660 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:05.349 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.345+0000 7fdd9b9c86c0 1 -- 10.20.193.11:0/3128080581 shutdown_connections 2026-02-13T02:19:05.349 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.345+0000 7fdd9b9c86c0 1 -- 10.20.193.11:0/3128080581 wait complete. 2026-02-13T02:19:05.349 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.345+0000 7fdd9b9c86c0 1 Processor -- start 2026-02-13T02:19:05.350 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.345+0000 7fdd9b9c86c0 1 -- start start 2026-02-13T02:19:05.350 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.345+0000 7fdd9b9c86c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fdd9410b440 0x7fdd9411d1c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:05.350 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.345+0000 7fdd9b9c86c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fdd9410bde0 0x7fdd9411d700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:05.350 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.345+0000 7fdd9b9c86c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fdd941142f0 0x7fdd94122ac0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:05.350 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.345+0000 7fdd9b9c86c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7fdd94123110 con 0x7fdd941142f0 2026-02-13T02:19:05.350 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.345+0000 7fdd9b9c86c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7fdd94123280 con 0x7fdd9410b440 2026-02-13T02:19:05.350 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.346+0000 7fdd9b9c86c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fdd94123440 con 0x7fdd9410bde0 2026-02-13T02:19:05.350 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.346+0000 7fdd997396c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fdd9410b440 0x7fdd9411d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:05.350 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.346+0000 7fdd99f3a6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fdd941142f0 0x7fdd94122ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:05.350 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.346+0000 7fdd997396c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fdd9410b440 0x7fdd9411d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.60:3300/0 says I am v2:10.20.193.11:34864/0 (socket says 10.20.193.11:34864) 2026-02-13T02:19:05.350 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.346+0000 7fdd997396c0 1 -- 10.20.193.11:0/1604859823 learned_addr learned my addr 10.20.193.11:0/1604859823 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:19:05.351 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.346+0000 7fdd98f386c0 1 --2- 10.20.193.11:0/1604859823 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fdd9410bde0 0x7fdd9411d700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:05.351 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.346+0000 7fdd99f3a6c0 1 -- 10.20.193.11:0/1604859823 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fdd9410bde0 msgr2=0x7fdd9411d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:05.351 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.346+0000 7fdd99f3a6c0 1 --2- 10.20.193.11:0/1604859823 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fdd9410bde0 0x7fdd9411d700 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:05.351 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.346+0000 7fdd99f3a6c0 1 -- 10.20.193.11:0/1604859823 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fdd9410b440 msgr2=0x7fdd9411d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:05.351 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.346+0000 7fdd99f3a6c0 1 --2- 10.20.193.11:0/1604859823 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fdd9410b440 0x7fdd9411d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:05.351 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.346+0000 7fdd99f3a6c0 1 -- 10.20.193.11:0/1604859823 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd9000a660 con 0x7fdd941142f0 2026-02-13T02:19:05.351 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.346+0000 7fdd997396c0 1 --2- 10.20.193.11:0/1604859823 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fdd9410b440 0x7fdd9411d1c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T02:19:05.351 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.346+0000 7fdd99f3a6c0 1 --2- 10.20.193.11:0/1604859823 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fdd941142f0 0x7fdd94122ac0 secure :-1 s=READY pgs=232 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdd9000aa40 tx=0x7fdd900054b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:05.351 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.346+0000 7fdd827fc6c0 1 -- 10.20.193.11:0/1604859823 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdd90003a30 con 0x7fdd941142f0 2026-02-13T02:19:05.351 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.346+0000 7fdd827fc6c0 1 -- 10.20.193.11:0/1604859823 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fdd90030990 con 0x7fdd941142f0 2026-02-13T02:19:05.351 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.346+0000 7fdd9b9c86c0 1 -- 10.20.193.11:0/1604859823 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd941236c0 con 0x7fdd941142f0 2026-02-13T02:19:05.351 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.346+0000 7fdd827fc6c0 1 -- 10.20.193.11:0/1604859823 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdd900382f0 con 0x7fdd941142f0 2026-02-13T02:19:05.352 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.346+0000 7fdd9b9c86c0 1 -- 10.20.193.11:0/1604859823 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd94123940 con 0x7fdd941142f0 2026-02-13T02:19:05.352 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.347+0000 7fdd9b9c86c0 1 -- 10.20.193.11:0/1604859823 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd9405f280 con 0x7fdd941142f0 2026-02-13T02:19:05.353 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.348+0000 7fdd827fc6c0 1 -- 10.20.193.11:0/1604859823 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 10) ==== 157066+0+0 (secure 0 0 0) 0x7fdd90003b90 con 0x7fdd941142f0 2026-02-13T02:19:05.353 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.349+0000 7fdd827fc6c0 1 --2- 10.20.193.11:0/1604859823 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fdd700b5600 0x7fdd700d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:05.353 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.349+0000 7fdd997396c0 1 --2- 10.20.193.11:0/1604859823 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fdd700b5600 0x7fdd700d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:05.353 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.349+0000 7fdd827fc6c0 1 -- 10.20.193.11:0/1604859823 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7762+0+0 (secure 0 0 0) 0x7fdd90108a60 con 0x7fdd941142f0 2026-02-13T02:19:05.353 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.349+0000 7fdd997396c0 1 --2- 10.20.193.11:0/1604859823 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fdd700b5600 0x7fdd700d5ab0 secure :-1 s=READY pgs=172 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdd84009260 tx=0x7fdd84009440 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:05.353 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.349+0000 7fdd827fc6c0 1 -- 10.20.193.11:0/1604859823 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fdd900cb620 con 0x7fdd941142f0 2026-02-13T02:19:05.465 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.463+0000 7fdd9b9c86c0 1 -- 10.20.193.11:0/1604859823 --> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fdd9411e380 con 0x7fdd700b5600 2026-02-13T02:19:05.479 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.477+0000 7fdd827fc6c0 1 -- 10.20.193.11:0/1604859823 <== mgr.14116 v2:10.20.193.11:6800/861334768 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fdd9411e380 con 0x7fdd700b5600 2026-02-13T02:19:05.480 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.478+0000 7fdd9b9c86c0 1 -- 10.20.193.11:0/1604859823 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fdd700b5600 msgr2=0x7fdd700d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:05.481 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.478+0000 7fdd9b9c86c0 1 --2- 10.20.193.11:0/1604859823 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fdd700b5600 0x7fdd700d5ab0 secure :-1 s=READY pgs=172 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdd84009260 tx=0x7fdd84009440 comp rx=0 tx=0).stop 2026-02-13T02:19:05.481 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.478+0000 7fdd9b9c86c0 1 -- 10.20.193.11:0/1604859823 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fdd941142f0 msgr2=0x7fdd94122ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:05.481 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.478+0000 7fdd9b9c86c0 1 --2- 10.20.193.11:0/1604859823 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fdd941142f0 0x7fdd94122ac0 secure :-1 s=READY pgs=232 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdd9000aa40 tx=0x7fdd900054b0 comp rx=0 tx=0).stop 2026-02-13T02:19:05.481 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.478+0000 7fdd9b9c86c0 1 -- 10.20.193.11:0/1604859823 shutdown_connections 2026-02-13T02:19:05.481 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.478+0000 7fdd9b9c86c0 1 --2- 10.20.193.11:0/1604859823 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fdd700b5600 0x7fdd700d5ab0 unknown :-1 s=CLOSED pgs=172 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:05.481 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.478+0000 7fdd9b9c86c0 1 --2- 10.20.193.11:0/1604859823 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fdd941142f0 0x7fdd94122ac0 unknown :-1 s=CLOSED pgs=232 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:05.481 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.478+0000 7fdd9b9c86c0 1 --2- 10.20.193.11:0/1604859823 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fdd9410bde0 0x7fdd9411d700 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:05.481 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.478+0000 7fdd9b9c86c0 1 --2- 10.20.193.11:0/1604859823 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fdd9410b440 0x7fdd9411d1c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:05.481 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.478+0000 7fdd9b9c86c0 1 -- 10.20.193.11:0/1604859823 >> 10.20.193.11:0/1604859823 conn(0x7fdd94062e00 msgr2=0x7fdd94114c70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:05.481 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.478+0000 7fdd9b9c86c0 1 -- 10.20.193.11:0/1604859823 shutdown_connections 2026-02-13T02:19:05.482 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.478+0000 7fdd9b9c86c0 1 -- 10.20.193.11:0/1604859823 wait complete. 2026-02-13T02:19:05.500 INFO:journalctl@ceph.mds.b.trial060.stdout:Feb 13 02:19:05 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mds-b[43709]: 2026-02-13T02:19:05.007+0000 7f012c0e96c0 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2026-02-13T02:19:05.500 INFO:journalctl@ceph.mds.b.trial060.stdout:Feb 13 02:19:05 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mds-b[43709]: 2026-02-13T02:19:05.007+0000 7f012c0e96c0 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2026-02-13T02:19:05.500 INFO:journalctl@ceph.mds.b.trial060.stdout:Feb 13 02:19:05 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mds-b[43709]: 2026-02-13T02:19:05.007+0000 7f012c0e96c0 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2026-02-13T02:19:05.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:05 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/4257012315' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2026-02-13T02:19:05.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:05 trial060 ceph-mon[14797]: mds.? [v2:10.20.193.60:6834/937612650,v1:10.20.193.60:6835/937612650] up:active 2026-02-13T02:19:05.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:05 trial060 ceph-mon[14797]: daemon mds.i assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2026-02-13T02:19:05.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:05 trial060 ceph-mon[14797]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 9 up:standby 2026-02-13T02:19:05.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:05 trial060 ceph-mon[14797]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=e=up:active,3=i=up:creating} 8 up:standby 2026-02-13T02:19:05.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:05 trial060 ceph-mon[14797]: daemon mds.i is now active in filesystem cephfs as rank 3 2026-02-13T02:19:05.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:05 trial060 ceph-mon[14797]: from='client.14853 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:19:05.518 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2026-02-13T02:19:05.541 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:05 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/4257012315' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2026-02-13T02:19:05.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:05 trial078 ceph-mon[14969]: mds.? [v2:10.20.193.60:6834/937612650,v1:10.20.193.60:6835/937612650] up:active 2026-02-13T02:19:05.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:05 trial078 ceph-mon[14969]: daemon mds.i assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2026-02-13T02:19:05.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:05 trial078 ceph-mon[14969]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 9 up:standby 2026-02-13T02:19:05.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:05 trial078 ceph-mon[14969]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=e=up:active,3=i=up:creating} 8 up:standby 2026-02-13T02:19:05.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:05 trial078 ceph-mon[14969]: daemon mds.i is now active in filesystem cephfs as rank 3 2026-02-13T02:19:05.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:05 trial078 ceph-mon[14969]: from='client.14853 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:19:05.641 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:19:05.755 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.751+0000 7fecda27d6c0 1 -- 10.20.193.11:0/3581002958 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fecd410f200 msgr2=0x7fecd410f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:05.755 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.751+0000 7fecda27d6c0 1 --2- 10.20.193.11:0/3581002958 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fecd410f200 0x7fecd410f5d0 secure :-1 s=READY pgs=233 gs=1 cs=0 l=1 c_cookie=11213488864797843911 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fecc00099a0 tx=0x7fecc002ed20 comp rx=0 tx=0).stop 2026-02-13T02:19:05.755 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.751+0000 7fecda27d6c0 1 -- 10.20.193.11:0/3581002958 shutdown_connections 2026-02-13T02:19:05.755 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.751+0000 7fecda27d6c0 1 --2- 10.20.193.11:0/3581002958 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fecd410fbf0 0x7fecd4114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:05.755 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.751+0000 7fecda27d6c0 1 --2- 10.20.193.11:0/3581002958 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fecd4115410 0x7fecd4175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:05.755 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.751+0000 7fecda27d6c0 1 --2- 10.20.193.11:0/3581002958 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fecd410f200 0x7fecd410f5d0 unknown :-1 s=CLOSED pgs=233 gs=1 cs=0 l=1 c_cookie=11213488864797843911 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:05.755 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.751+0000 7fecda27d6c0 1 -- 10.20.193.11:0/3581002958 >> 10.20.193.11:0/3581002958 conn(0x7fecd40ecb00 msgr2=0x7fecd410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:05.755 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.751+0000 7fecda27d6c0 1 -- 10.20.193.11:0/3581002958 shutdown_connections 2026-02-13T02:19:05.756 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.751+0000 7fecda27d6c0 1 -- 10.20.193.11:0/3581002958 wait complete. 2026-02-13T02:19:05.756 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.751+0000 7fecda27d6c0 1 Processor -- start 2026-02-13T02:19:05.756 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.751+0000 7fecda27d6c0 1 -- start start 2026-02-13T02:19:05.756 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.751+0000 7fecda27d6c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fecd410f200 0x7fecd411d1b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:05.756 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.751+0000 7fecda27d6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fecd4115410 0x7fecd411d6f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:05.756 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.751+0000 7fecda27d6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fecd4122ab0 0x7fecd4122f50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:05.756 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.751+0000 7fecda27d6c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7fecd41234c0 con 0x7fecd4122ab0 2026-02-13T02:19:05.756 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.751+0000 7fecda27d6c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7fecd4123630 con 0x7fecd410f200 2026-02-13T02:19:05.756 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.751+0000 7fecda27d6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fecd41237f0 con 0x7fecd4115410 2026-02-13T02:19:05.756 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.751+0000 7fecd3fff6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fecd4122ab0 0x7fecd4122f50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:05.756 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.751+0000 7fecd3fff6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fecd4122ab0 0x7fecd4122f50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:48866/0 (socket says 10.20.193.11:48866) 2026-02-13T02:19:05.756 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.751+0000 7fecd3fff6c0 1 -- 10.20.193.11:0/2077469877 learned_addr learned my addr 10.20.193.11:0/2077469877 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:19:05.757 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.751+0000 7fecd37fe6c0 1 --2- 10.20.193.11:0/2077469877 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fecd410f200 0x7fecd411d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:05.757 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.751+0000 7fecd2ffd6c0 1 --2- 10.20.193.11:0/2077469877 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fecd4115410 0x7fecd411d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:05.757 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.751+0000 7fecd3fff6c0 1 -- 10.20.193.11:0/2077469877 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fecd4115410 msgr2=0x7fecd411d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:05.757 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.751+0000 7fecd3fff6c0 1 --2- 10.20.193.11:0/2077469877 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fecd4115410 0x7fecd411d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:05.757 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.751+0000 7fecd3fff6c0 1 -- 10.20.193.11:0/2077469877 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fecd410f200 msgr2=0x7fecd411d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:05.757 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.751+0000 7fecd3fff6c0 1 --2- 10.20.193.11:0/2077469877 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fecd410f200 0x7fecd411d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:05.757 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.751+0000 7fecd3fff6c0 1 -- 10.20.193.11:0/2077469877 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecc0009590 con 0x7fecd4122ab0 2026-02-13T02:19:05.757 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.751+0000 7fecd37fe6c0 1 --2- 10.20.193.11:0/2077469877 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fecd410f200 0x7fecd411d1b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T02:19:05.757 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.752+0000 7fecd3fff6c0 1 --2- 10.20.193.11:0/2077469877 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fecd4122ab0 0x7fecd4122f50 secure :-1 s=READY pgs=234 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fecc8006ea0 tx=0x7fecc800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:05.757 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.752+0000 7fecd0ff96c0 1 -- 10.20.193.11:0/2077469877 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fecc8003a30 con 0x7fecd4122ab0 2026-02-13T02:19:05.757 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.752+0000 7fecda27d6c0 1 -- 10.20.193.11:0/2077469877 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecd4163ca0 con 0x7fecd4122ab0 2026-02-13T02:19:05.757 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.752+0000 7fecd0ff96c0 1 -- 10.20.193.11:0/2077469877 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fecc8005510 con 0x7fecd4122ab0 2026-02-13T02:19:05.758 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.752+0000 7fecd0ff96c0 1 -- 10.20.193.11:0/2077469877 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fecc800dd70 con 0x7fecd4122ab0 2026-02-13T02:19:05.758 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.752+0000 7fecda27d6c0 1 -- 10.20.193.11:0/2077469877 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecd4164180 con 0x7fecd4122ab0 2026-02-13T02:19:05.758 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.752+0000 7fecda27d6c0 1 -- 10.20.193.11:0/2077469877 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecd41104d0 con 0x7fecd4122ab0 2026-02-13T02:19:05.759 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.754+0000 7fecd0ff96c0 1 -- 10.20.193.11:0/2077469877 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 10) ==== 157066+0+0 (secure 0 0 0) 0x7fecc8003b90 con 0x7fecd4122ab0 2026-02-13T02:19:05.759 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.754+0000 7fecd0ff96c0 1 --2- 10.20.193.11:0/2077469877 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7feca80b5680 0x7feca80d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:05.759 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.754+0000 7fecd37fe6c0 1 --2- 10.20.193.11:0/2077469877 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7feca80b5680 0x7feca80d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:05.759 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.754+0000 7fecd0ff96c0 1 -- 10.20.193.11:0/2077469877 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7762+0+0 (secure 0 0 0) 0x7fecc80e4a50 con 0x7fecd4122ab0 2026-02-13T02:19:05.759 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.755+0000 7fecd37fe6c0 1 --2- 10.20.193.11:0/2077469877 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7feca80b5680 0x7feca80d5b30 secure :-1 s=READY pgs=173 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fecc00023e0 tx=0x7fecc0031f90 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:05.759 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.755+0000 7fecd0ff96c0 1 -- 10.20.193.11:0/2077469877 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fecc80a75d0 con 0x7fecd4122ab0 2026-02-13T02:19:05.868 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.866+0000 7fecda27d6c0 1 -- 10.20.193.11:0/2077469877 --> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7fecd410fbf0 con 0x7feca80b5680 2026-02-13T02:19:05.870 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.868+0000 7fecd0ff96c0 1 -- 10.20.193.11:0/2077469877 <== mgr.14116 v2:10.20.193.11:6800/861334768 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fecd410fbf0 con 0x7feca80b5680 2026-02-13T02:19:05.870 INFO:teuthology.orchestra.run.trial011.stdout:/volumes/qa/sv_0/8c7757e0-9d50-400a-8cbd-98f662be2002 2026-02-13T02:19:05.872 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.869+0000 7fecda27d6c0 1 -- 10.20.193.11:0/2077469877 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7feca80b5680 msgr2=0x7feca80d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:05.872 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.869+0000 7fecda27d6c0 1 --2- 10.20.193.11:0/2077469877 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7feca80b5680 0x7feca80d5b30 secure :-1 s=READY pgs=173 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fecc00023e0 tx=0x7fecc0031f90 comp rx=0 tx=0).stop 2026-02-13T02:19:05.872 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.869+0000 7fecda27d6c0 1 -- 10.20.193.11:0/2077469877 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fecd4122ab0 msgr2=0x7fecd4122f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:05.872 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.869+0000 7fecda27d6c0 1 --2- 10.20.193.11:0/2077469877 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fecd4122ab0 0x7fecd4122f50 secure :-1 s=READY pgs=234 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fecc8006ea0 tx=0x7fecc800cca0 comp rx=0 tx=0).stop 2026-02-13T02:19:05.872 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.869+0000 7fecda27d6c0 1 -- 10.20.193.11:0/2077469877 shutdown_connections 2026-02-13T02:19:05.872 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.869+0000 7fecda27d6c0 1 --2- 10.20.193.11:0/2077469877 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7feca80b5680 0x7feca80d5b30 unknown :-1 s=CLOSED pgs=173 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:05.872 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.869+0000 7fecda27d6c0 1 --2- 10.20.193.11:0/2077469877 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fecd4122ab0 0x7fecd4122f50 unknown :-1 s=CLOSED pgs=234 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:05.872 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.869+0000 7fecda27d6c0 1 --2- 10.20.193.11:0/2077469877 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fecd4115410 0x7fecd411d6f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:05.872 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.869+0000 7fecda27d6c0 1 --2- 10.20.193.11:0/2077469877 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fecd410f200 0x7fecd411d1b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:05.872 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.869+0000 7fecda27d6c0 1 -- 10.20.193.11:0/2077469877 >> 10.20.193.11:0/2077469877 conn(0x7fecd40ecb00 msgr2=0x7fecd410cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:05.873 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.869+0000 7fecda27d6c0 1 -- 10.20.193.11:0/2077469877 shutdown_connections 2026-02-13T02:19:05.873 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:05.869+0000 7fecda27d6c0 1 -- 10.20.193.11:0/2077469877 wait complete. 2026-02-13T02:19:05.911 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2026-02-13T02:19:06.033 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:19:06.152 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.148+0000 7fe42b7786c0 1 -- 10.20.193.11:0/3688579225 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fe42410fbf0 msgr2=0x7fe424114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:06.152 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.148+0000 7fe42b7786c0 1 --2- 10.20.193.11:0/3688579225 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fe42410fbf0 0x7fe424114c30 secure :-1 s=READY pgs=235 gs=1 cs=0 l=1 c_cookie=1874877641446985511 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe4180099a0 tx=0x7fe41802ed20 comp rx=0 tx=0).stop 2026-02-13T02:19:06.152 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.148+0000 7fe42b7786c0 1 -- 10.20.193.11:0/3688579225 shutdown_connections 2026-02-13T02:19:06.153 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.148+0000 7fe42b7786c0 1 --2- 10.20.193.11:0/3688579225 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fe424115410 0x7fe424175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:06.153 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.148+0000 7fe42b7786c0 1 --2- 10.20.193.11:0/3688579225 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fe42410fbf0 0x7fe424114c30 unknown :-1 s=CLOSED pgs=235 gs=1 cs=0 l=1 c_cookie=1874877641446985511 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:06.153 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.148+0000 7fe42b7786c0 1 --2- 10.20.193.11:0/3688579225 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fe42410f200 0x7fe42410f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:06.153 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.148+0000 7fe42b7786c0 1 -- 10.20.193.11:0/3688579225 >> 10.20.193.11:0/3688579225 conn(0x7fe4240ecb00 msgr2=0x7fe42410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:06.153 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.149+0000 7fe42b7786c0 1 -- 10.20.193.11:0/3688579225 shutdown_connections 2026-02-13T02:19:06.153 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.149+0000 7fe42b7786c0 1 -- 10.20.193.11:0/3688579225 wait complete. 2026-02-13T02:19:06.153 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.149+0000 7fe42b7786c0 1 Processor -- start 2026-02-13T02:19:06.153 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.149+0000 7fe42b7786c0 1 -- start start 2026-02-13T02:19:06.153 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.149+0000 7fe42b7786c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fe42410f200 0x7fe4240f4c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:06.153 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.149+0000 7fe42b7786c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fe424115410 0x7fe424175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:06.153 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.149+0000 7fe42b7786c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fe4240f5270 0x7fe4240fa540 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:06.153 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.149+0000 7fe42b7786c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7fe4240f5960 con 0x7fe4240f5270 2026-02-13T02:19:06.154 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.149+0000 7fe42b7786c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe4240faa80 con 0x7fe424115410 2026-02-13T02:19:06.154 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.149+0000 7fe42b7786c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fe4240fac40 con 0x7fe42410f200 2026-02-13T02:19:06.154 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.149+0000 7fe429cee6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fe4240f5270 0x7fe4240fa540 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:06.154 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.149+0000 7fe429cee6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fe4240f5270 0x7fe4240fa540 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:48896/0 (socket says 10.20.193.11:48896) 2026-02-13T02:19:06.154 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.149+0000 7fe429cee6c0 1 -- 10.20.193.11:0/1476742022 learned_addr learned my addr 10.20.193.11:0/1476742022 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:19:06.154 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.149+0000 7fe4294ed6c0 1 --2- 10.20.193.11:0/1476742022 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fe42410f200 0x7fe4240f4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:06.154 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.149+0000 7fe428cec6c0 1 --2- 10.20.193.11:0/1476742022 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fe424115410 0x7fe424175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:06.154 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.149+0000 7fe429cee6c0 1 -- 10.20.193.11:0/1476742022 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fe42410f200 msgr2=0x7fe4240f4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:06.154 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.149+0000 7fe429cee6c0 1 --2- 10.20.193.11:0/1476742022 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fe42410f200 0x7fe4240f4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:06.154 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.149+0000 7fe429cee6c0 1 -- 10.20.193.11:0/1476742022 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fe424115410 msgr2=0x7fe424175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:06.154 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.149+0000 7fe429cee6c0 1 --2- 10.20.193.11:0/1476742022 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fe424115410 0x7fe424175cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:06.154 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.149+0000 7fe429cee6c0 1 -- 10.20.193.11:0/1476742022 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe418009590 con 0x7fe4240f5270 2026-02-13T02:19:06.155 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.149+0000 7fe4294ed6c0 1 --2- 10.20.193.11:0/1476742022 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fe42410f200 0x7fe4240f4c40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T02:19:06.155 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.149+0000 7fe428cec6c0 1 --2- 10.20.193.11:0/1476742022 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fe424115410 0x7fe424175cb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T02:19:06.155 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.149+0000 7fe429cee6c0 1 --2- 10.20.193.11:0/1476742022 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fe4240f5270 0x7fe4240fa540 secure :-1 s=READY pgs=236 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe420006ea0 tx=0x7fe42000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:06.155 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.150+0000 7fe4127fc6c0 1 -- 10.20.193.11:0/1476742022 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe420003a30 con 0x7fe4240f5270 2026-02-13T02:19:06.155 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.150+0000 7fe42b7786c0 1 -- 10.20.193.11:0/1476742022 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4240faf20 con 0x7fe4240f5270 2026-02-13T02:19:06.155 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.150+0000 7fe4127fc6c0 1 -- 10.20.193.11:0/1476742022 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe420005510 con 0x7fe4240f5270 2026-02-13T02:19:06.155 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.150+0000 7fe4127fc6c0 1 -- 10.20.193.11:0/1476742022 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe42000dd70 con 0x7fe4240f5270 2026-02-13T02:19:06.155 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.150+0000 7fe42b7786c0 1 -- 10.20.193.11:0/1476742022 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4240fb3b0 con 0x7fe4240f5270 2026-02-13T02:19:06.155 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.150+0000 7fe42b7786c0 1 -- 10.20.193.11:0/1476742022 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4241104d0 con 0x7fe4240f5270 2026-02-13T02:19:06.156 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.151+0000 7fe4127fc6c0 1 -- 10.20.193.11:0/1476742022 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7fe420003b90 con 0x7fe4240f5270 2026-02-13T02:19:06.156 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.152+0000 7fe4127fc6c0 1 --2- 10.20.193.11:0/1476742022 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fe4000b5690 0x7fe4000d5b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:06.156 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.152+0000 7fe4127fc6c0 1 -- 10.20.193.11:0/1476742022 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7762+0+0 (secure 0 0 0) 0x7fe4200e4920 con 0x7fe4240f5270 2026-02-13T02:19:06.157 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.152+0000 7fe4294ed6c0 1 --2- 10.20.193.11:0/1476742022 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fe4000b5690 0x7fe4000d5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:06.157 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.152+0000 7fe4127fc6c0 1 -- 10.20.193.11:0/1476742022 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fe4200a7380 con 0x7fe4240f5270 2026-02-13T02:19:06.157 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.152+0000 7fe4294ed6c0 1 --2- 10.20.193.11:0/1476742022 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fe4000b5690 0x7fe4000d5b40 secure :-1 s=READY pgs=174 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe414004750 tx=0x7fe414009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:06.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:06 trial011 ceph-mon[11956]: pgmap v187: 97 pgs: 97 active+clean; 581 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s wr, 12 op/s 2026-02-13T02:19:06.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:06 trial011 ceph-mon[11956]: mds.? [v2:10.20.193.78:6838/2341862516,v1:10.20.193.78:6839/2341862516] up:active 2026-02-13T02:19:06.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:06 trial011 ceph-mon[11956]: daemon mds.c assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2026-02-13T02:19:06.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:06 trial011 ceph-mon[11956]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2026-02-13T02:19:06.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:06 trial011 ceph-mon[11956]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=e=up:active,3=i=up:active} 8 up:standby 2026-02-13T02:19:06.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:06 trial011 ceph-mon[11956]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2026-02-13T02:19:06.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:06 trial011 ceph-mon[11956]: daemon mds.c is now active in filesystem cephfs as rank 4 2026-02-13T02:19:06.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:06 trial011 ceph-mon[11956]: from='client.14865 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:19:06.263 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.261+0000 7fe42b7786c0 1 -- 10.20.193.11:0/1476742022 --> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fe4240fb3b0 con 0x7fe4000b5690 2026-02-13T02:19:06.276 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.275+0000 7fe4127fc6c0 1 -- 10.20.193.11:0/1476742022 <== mgr.14116 v2:10.20.193.11:6800/861334768 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fe4240fb3b0 con 0x7fe4000b5690 2026-02-13T02:19:06.278 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.276+0000 7fe42b7786c0 1 -- 10.20.193.11:0/1476742022 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fe4000b5690 msgr2=0x7fe4000d5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:06.278 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.276+0000 7fe42b7786c0 1 --2- 10.20.193.11:0/1476742022 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fe4000b5690 0x7fe4000d5b40 secure :-1 s=READY pgs=174 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe414004750 tx=0x7fe414009260 comp rx=0 tx=0).stop 2026-02-13T02:19:06.278 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.276+0000 7fe42b7786c0 1 -- 10.20.193.11:0/1476742022 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fe4240f5270 msgr2=0x7fe4240fa540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:06.278 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.276+0000 7fe42b7786c0 1 --2- 10.20.193.11:0/1476742022 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fe4240f5270 0x7fe4240fa540 secure :-1 s=READY pgs=236 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe420006ea0 tx=0x7fe42000cca0 comp rx=0 tx=0).stop 2026-02-13T02:19:06.278 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.276+0000 7fe42b7786c0 1 -- 10.20.193.11:0/1476742022 shutdown_connections 2026-02-13T02:19:06.278 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.276+0000 7fe42b7786c0 1 --2- 10.20.193.11:0/1476742022 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fe4000b5690 0x7fe4000d5b40 unknown :-1 s=CLOSED pgs=174 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:06.278 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.276+0000 7fe42b7786c0 1 --2- 10.20.193.11:0/1476742022 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fe424115410 0x7fe424175cb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:06.278 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.276+0000 7fe42b7786c0 1 --2- 10.20.193.11:0/1476742022 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fe4240f5270 0x7fe4240fa540 unknown :-1 s=CLOSED pgs=236 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:06.278 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.276+0000 7fe42b7786c0 1 --2- 10.20.193.11:0/1476742022 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fe42410f200 0x7fe4240f4c40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:06.278 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.276+0000 7fe42b7786c0 1 -- 10.20.193.11:0/1476742022 >> 10.20.193.11:0/1476742022 conn(0x7fe4240ecb00 msgr2=0x7fe42410d860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:06.278 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.276+0000 7fe42b7786c0 1 -- 10.20.193.11:0/1476742022 shutdown_connections 2026-02-13T02:19:06.279 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.276+0000 7fe42b7786c0 1 -- 10.20.193.11:0/1476742022 wait complete. 2026-02-13T02:19:06.314 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2026-02-13T02:19:06.436 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:19:06.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:06 trial060 ceph-mon[14797]: pgmap v187: 97 pgs: 97 active+clean; 581 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s wr, 12 op/s 2026-02-13T02:19:06.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:06 trial060 ceph-mon[14797]: mds.? [v2:10.20.193.78:6838/2341862516,v1:10.20.193.78:6839/2341862516] up:active 2026-02-13T02:19:06.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:06 trial060 ceph-mon[14797]: daemon mds.c assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2026-02-13T02:19:06.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:06 trial060 ceph-mon[14797]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2026-02-13T02:19:06.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:06 trial060 ceph-mon[14797]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=e=up:active,3=i=up:active} 8 up:standby 2026-02-13T02:19:06.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:06 trial060 ceph-mon[14797]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2026-02-13T02:19:06.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:06 trial060 ceph-mon[14797]: daemon mds.c is now active in filesystem cephfs as rank 4 2026-02-13T02:19:06.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:06 trial060 ceph-mon[14797]: from='client.14865 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:19:06.541 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:06 trial078 ceph-mon[14969]: pgmap v187: 97 pgs: 97 active+clean; 581 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s wr, 12 op/s 2026-02-13T02:19:06.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:06 trial078 ceph-mon[14969]: mds.? [v2:10.20.193.78:6838/2341862516,v1:10.20.193.78:6839/2341862516] up:active 2026-02-13T02:19:06.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:06 trial078 ceph-mon[14969]: daemon mds.c assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2026-02-13T02:19:06.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:06 trial078 ceph-mon[14969]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2026-02-13T02:19:06.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:06 trial078 ceph-mon[14969]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=e=up:active,3=i=up:active} 8 up:standby 2026-02-13T02:19:06.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:06 trial078 ceph-mon[14969]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2026-02-13T02:19:06.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:06 trial078 ceph-mon[14969]: daemon mds.c is now active in filesystem cephfs as rank 4 2026-02-13T02:19:06.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:06 trial078 ceph-mon[14969]: from='client.14865 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:19:06.563 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.560+0000 7f5f13b806c0 1 -- 10.20.193.11:0/4018525001 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f5f0c115440 msgr2=0x7f5f0c175de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:06.563 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.560+0000 7f5f13b806c0 1 --2- 10.20.193.11:0/4018525001 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f5f0c115440 0x7f5f0c175de0 secure :-1 s=READY pgs=237 gs=1 cs=0 l=1 c_cookie=7400635919012502733 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5f0800aa70 tx=0x7f5f0802fde0 comp rx=0 tx=0).stop 2026-02-13T02:19:06.564 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.560+0000 7f5f13b806c0 1 -- 10.20.193.11:0/4018525001 shutdown_connections 2026-02-13T02:19:06.564 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.560+0000 7f5f13b806c0 1 --2- 10.20.193.11:0/4018525001 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f5f0c10fc20 0x7f5f0c114c60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:06.564 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.560+0000 7f5f13b806c0 1 --2- 10.20.193.11:0/4018525001 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f5f0c115440 0x7f5f0c175de0 unknown :-1 s=CLOSED pgs=237 gs=1 cs=0 l=1 c_cookie=7400635919012502733 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:06.564 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.560+0000 7f5f13b806c0 1 --2- 10.20.193.11:0/4018525001 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f5f0c10f230 0x7f5f0c10f600 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:06.564 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.560+0000 7f5f13b806c0 1 -- 10.20.193.11:0/4018525001 >> 10.20.193.11:0/4018525001 conn(0x7f5f0c0ecb30 msgr2=0x7f5f0c10cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:06.564 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.560+0000 7f5f13b806c0 1 -- 10.20.193.11:0/4018525001 shutdown_connections 2026-02-13T02:19:06.564 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.560+0000 7f5f13b806c0 1 -- 10.20.193.11:0/4018525001 wait complete. 2026-02-13T02:19:06.564 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.560+0000 7f5f13b806c0 1 Processor -- start 2026-02-13T02:19:06.564 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.560+0000 7f5f13b806c0 1 -- start start 2026-02-13T02:19:06.564 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.560+0000 7f5f13b806c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f5f0c10f230 0x7f5f0c11d160 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:06.564 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.560+0000 7f5f13b806c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f5f0c115440 0x7f5f0c11d6a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:06.565 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.560+0000 7f5f13b806c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f5f0c122a60 0x7f5f0c122f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:06.565 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.560+0000 7f5f13b806c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f5f0c123470 con 0x7f5f0c115440 2026-02-13T02:19:06.565 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.560+0000 7f5f13b806c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f5f0c1235e0 con 0x7f5f0c122a60 2026-02-13T02:19:06.565 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.560+0000 7f5f13b806c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f5f0c1237a0 con 0x7f5f0c10f230 2026-02-13T02:19:06.565 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.560+0000 7f5f110f46c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f5f0c115440 0x7f5f0c11d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:06.565 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.560+0000 7f5f110f46c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f5f0c115440 0x7f5f0c11d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:48924/0 (socket says 10.20.193.11:48924) 2026-02-13T02:19:06.565 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.560+0000 7f5f110f46c0 1 -- 10.20.193.11:0/1183106109 learned_addr learned my addr 10.20.193.11:0/1183106109 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:19:06.565 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.560+0000 7f5f118f56c0 1 --2- 10.20.193.11:0/1183106109 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f5f0c10f230 0x7f5f0c11d160 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:06.565 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.560+0000 7f5f120f66c0 1 --2- 10.20.193.11:0/1183106109 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f5f0c122a60 0x7f5f0c122f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:06.565 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.560+0000 7f5f110f46c0 1 -- 10.20.193.11:0/1183106109 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f5f0c10f230 msgr2=0x7f5f0c11d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:06.565 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.560+0000 7f5f110f46c0 1 --2- 10.20.193.11:0/1183106109 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f5f0c10f230 0x7f5f0c11d160 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:06.566 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.560+0000 7f5f110f46c0 1 -- 10.20.193.11:0/1183106109 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f5f0c122a60 msgr2=0x7f5f0c122f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:06.566 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.560+0000 7f5f110f46c0 1 --2- 10.20.193.11:0/1183106109 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f5f0c122a60 0x7f5f0c122f00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:06.566 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.561+0000 7f5f110f46c0 1 -- 10.20.193.11:0/1183106109 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f0800a660 con 0x7f5f0c115440 2026-02-13T02:19:06.566 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.561+0000 7f5f110f46c0 1 --2- 10.20.193.11:0/1183106109 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f5f0c115440 0x7f5f0c11d6a0 secure :-1 s=READY pgs=238 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5f00005dc0 tx=0x7f5f0000bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:06.566 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.561+0000 7f5efaffd6c0 1 -- 10.20.193.11:0/1183106109 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5f00004250 con 0x7f5f0c115440 2026-02-13T02:19:06.566 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.561+0000 7f5efaffd6c0 1 -- 10.20.193.11:0/1183106109 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f5f00009070 con 0x7f5f0c115440 2026-02-13T02:19:06.566 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.561+0000 7f5f13b806c0 1 -- 10.20.193.11:0/1183106109 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f0c163c50 con 0x7f5f0c115440 2026-02-13T02:19:06.566 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.561+0000 7f5efaffd6c0 1 -- 10.20.193.11:0/1183106109 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5f0000cdc0 con 0x7f5f0c115440 2026-02-13T02:19:06.566 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.561+0000 7f5f13b806c0 1 -- 10.20.193.11:0/1183106109 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f0c1640e0 con 0x7f5f0c115440 2026-02-13T02:19:06.566 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.561+0000 7f5f13b806c0 1 -- 10.20.193.11:0/1183106109 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f0c110500 con 0x7f5f0c115440 2026-02-13T02:19:06.567 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.563+0000 7f5efaffd6c0 1 -- 10.20.193.11:0/1183106109 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7f5f000028c0 con 0x7f5f0c115440 2026-02-13T02:19:06.567 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.563+0000 7f5efaffd6c0 1 --2- 10.20.193.11:0/1183106109 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f5ee80b5690 0x7f5ee80d5b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:06.568 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.563+0000 7f5f118f56c0 1 --2- 10.20.193.11:0/1183106109 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f5ee80b5690 0x7f5ee80d5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:06.568 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.563+0000 7f5efaffd6c0 1 -- 10.20.193.11:0/1183106109 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7762+0+0 (secure 0 0 0) 0x7f5f000e3ac0 con 0x7f5f0c115440 2026-02-13T02:19:06.568 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.564+0000 7f5f118f56c0 1 --2- 10.20.193.11:0/1183106109 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f5ee80b5690 0x7f5ee80d5b40 secure :-1 s=READY pgs=175 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5efc005980 tx=0x7f5efc005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:06.568 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.564+0000 7f5efaffd6c0 1 -- 10.20.193.11:0/1183106109 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f5f000a6520 con 0x7f5f0c115440 2026-02-13T02:19:06.676 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.674+0000 7f5f13b806c0 1 -- 10.20.193.11:0/1183106109 --> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f5f0c11e340 con 0x7f5ee80b5690 2026-02-13T02:19:06.679 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.677+0000 7f5efaffd6c0 1 -- 10.20.193.11:0/1183106109 <== mgr.14116 v2:10.20.193.11:6800/861334768 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f5efc004050 con 0x7f5ee80b5690 2026-02-13T02:19:06.679 INFO:teuthology.orchestra.run.trial011.stdout:/volumes/qa/sv_1/f9a83c8b-09e7-4e2a-a6a2-e6d3a1343905 2026-02-13T02:19:06.680 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.679+0000 7f5f13b806c0 1 -- 10.20.193.11:0/1183106109 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f5ee80b5690 msgr2=0x7f5ee80d5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:06.680 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.679+0000 7f5f13b806c0 1 --2- 10.20.193.11:0/1183106109 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f5ee80b5690 0x7f5ee80d5b40 secure :-1 s=READY pgs=175 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5efc005980 tx=0x7f5efc005910 comp rx=0 tx=0).stop 2026-02-13T02:19:06.680 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.679+0000 7f5f13b806c0 1 -- 10.20.193.11:0/1183106109 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f5f0c115440 msgr2=0x7f5f0c11d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:06.680 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.679+0000 7f5f13b806c0 1 --2- 10.20.193.11:0/1183106109 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f5f0c115440 0x7f5f0c11d6a0 secure :-1 s=READY pgs=238 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5f00005dc0 tx=0x7f5f0000bbb0 comp rx=0 tx=0).stop 2026-02-13T02:19:06.680 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.679+0000 7f5f13b806c0 1 -- 10.20.193.11:0/1183106109 shutdown_connections 2026-02-13T02:19:06.680 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.679+0000 7f5f13b806c0 1 --2- 10.20.193.11:0/1183106109 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f5ee80b5690 0x7f5ee80d5b40 unknown :-1 s=CLOSED pgs=175 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:06.680 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.679+0000 7f5f13b806c0 1 --2- 10.20.193.11:0/1183106109 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f5f0c122a60 0x7f5f0c122f00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:06.680 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.679+0000 7f5f13b806c0 1 --2- 10.20.193.11:0/1183106109 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f5f0c115440 0x7f5f0c11d6a0 unknown :-1 s=CLOSED pgs=238 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:06.680 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.679+0000 7f5f13b806c0 1 --2- 10.20.193.11:0/1183106109 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f5f0c10f230 0x7f5f0c11d160 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:06.680 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.679+0000 7f5f13b806c0 1 -- 10.20.193.11:0/1183106109 >> 10.20.193.11:0/1183106109 conn(0x7f5f0c0ecb30 msgr2=0x7f5f0c10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:06.680 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.679+0000 7f5f13b806c0 1 -- 10.20.193.11:0/1183106109 shutdown_connections 2026-02-13T02:19:06.680 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.679+0000 7f5f13b806c0 1 -- 10.20.193.11:0/1183106109 wait complete. 2026-02-13T02:19:06.719 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph fs dump --format=json 2026-02-13T02:19:06.841 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:19:06.958 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.954+0000 7fd2c32c06c0 1 -- 10.20.193.11:0/2278493951 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fd2bc1131c0 msgr2=0x7fd2bc173b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:06.959 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.954+0000 7fd2c32c06c0 1 --2- 10.20.193.11:0/2278493951 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fd2bc1131c0 0x7fd2bc173b60 secure :-1 s=READY pgs=239 gs=1 cs=0 l=1 c_cookie=536650003695387265 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd2b800aa70 tx=0x7fd2b802fde0 comp rx=0 tx=0).stop 2026-02-13T02:19:06.959 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.954+0000 7fd2c32c06c0 1 -- 10.20.193.11:0/2278493951 shutdown_connections 2026-02-13T02:19:06.959 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.954+0000 7fd2c32c06c0 1 --2- 10.20.193.11:0/2278493951 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fd2bc1131c0 0x7fd2bc173b60 unknown :-1 s=CLOSED pgs=239 gs=1 cs=0 l=1 c_cookie=536650003695387265 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:06.959 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.954+0000 7fd2c32c06c0 1 --2- 10.20.193.11:0/2278493951 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd2bc10d9a0 0x7fd2bc1129e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:06.959 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.954+0000 7fd2c32c06c0 1 --2- 10.20.193.11:0/2278493951 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fd2bc10cfb0 0x7fd2bc10d380 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:06.959 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.954+0000 7fd2c32c06c0 1 -- 10.20.193.11:0/2278493951 >> 10.20.193.11:0/2278493951 conn(0x7fd2bc0ea8b0 msgr2=0x7fd2bc10acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:06.959 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.954+0000 7fd2c32c06c0 1 -- 10.20.193.11:0/2278493951 shutdown_connections 2026-02-13T02:19:06.959 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.954+0000 7fd2c32c06c0 1 -- 10.20.193.11:0/2278493951 wait complete. 2026-02-13T02:19:06.959 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.955+0000 7fd2c32c06c0 1 Processor -- start 2026-02-13T02:19:06.959 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.955+0000 7fd2c32c06c0 1 -- start start 2026-02-13T02:19:06.960 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.955+0000 7fd2c32c06c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fd2bc10cfb0 0x7fd2bc11af70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:06.960 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.955+0000 7fd2c32c06c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fd2bc1131c0 0x7fd2bc11b4b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:06.960 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.955+0000 7fd2c32c06c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd2bc120870 0x7fd2bc120d10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:06.960 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.955+0000 7fd2c32c06c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7fd2bc121280 con 0x7fd2bc10cfb0 2026-02-13T02:19:06.960 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.955+0000 7fd2c32c06c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd2bc1213f0 con 0x7fd2bc1131c0 2026-02-13T02:19:06.960 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.955+0000 7fd2c32c06c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fd2bc1215b0 con 0x7fd2bc120870 2026-02-13T02:19:06.960 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.955+0000 7fd2c10356c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fd2bc10cfb0 0x7fd2bc11af70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:06.960 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.955+0000 7fd2c10356c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fd2bc10cfb0 0x7fd2bc11af70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:48946/0 (socket says 10.20.193.11:48946) 2026-02-13T02:19:06.960 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.955+0000 7fd2c10356c0 1 -- 10.20.193.11:0/877753939 learned_addr learned my addr 10.20.193.11:0/877753939 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:19:06.960 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.955+0000 7fd2c18366c0 1 --2- 10.20.193.11:0/877753939 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd2bc120870 0x7fd2bc120d10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:06.960 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.955+0000 7fd2c08346c0 1 --2- 10.20.193.11:0/877753939 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fd2bc1131c0 0x7fd2bc11b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:06.961 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.955+0000 7fd2c10356c0 1 -- 10.20.193.11:0/877753939 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd2bc120870 msgr2=0x7fd2bc120d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:06.961 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.955+0000 7fd2c10356c0 1 --2- 10.20.193.11:0/877753939 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd2bc120870 0x7fd2bc120d10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:06.961 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.955+0000 7fd2c10356c0 1 -- 10.20.193.11:0/877753939 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fd2bc1131c0 msgr2=0x7fd2bc11b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:06.961 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.955+0000 7fd2c10356c0 1 --2- 10.20.193.11:0/877753939 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fd2bc1131c0 0x7fd2bc11b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:06.961 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.955+0000 7fd2c10356c0 1 -- 10.20.193.11:0/877753939 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2b800a660 con 0x7fd2bc10cfb0 2026-02-13T02:19:06.961 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.955+0000 7fd2c10356c0 1 --2- 10.20.193.11:0/877753939 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fd2bc10cfb0 0x7fd2bc11af70 secure :-1 s=READY pgs=240 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd2ac00b710 tx=0x7fd2ac00bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:06.961 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.955+0000 7fd2aa7fc6c0 1 -- 10.20.193.11:0/877753939 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd2ac004250 con 0x7fd2bc10cfb0 2026-02-13T02:19:06.961 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.955+0000 7fd2aa7fc6c0 1 -- 10.20.193.11:0/877753939 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd2ac002da0 con 0x7fd2bc10cfb0 2026-02-13T02:19:06.961 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.955+0000 7fd2c32c06c0 1 -- 10.20.193.11:0/877753939 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2bc161a60 con 0x7fd2bc10cfb0 2026-02-13T02:19:06.961 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.955+0000 7fd2aa7fc6c0 1 -- 10.20.193.11:0/877753939 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd2ac00ce40 con 0x7fd2bc10cfb0 2026-02-13T02:19:06.961 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.955+0000 7fd2c32c06c0 1 -- 10.20.193.11:0/877753939 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2bc161f40 con 0x7fd2bc10cfb0 2026-02-13T02:19:06.962 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.955+0000 7fd2c32c06c0 1 -- 10.20.193.11:0/877753939 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2bc10e280 con 0x7fd2bc10cfb0 2026-02-13T02:19:06.962 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.957+0000 7fd2aa7fc6c0 1 -- 10.20.193.11:0/877753939 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7fd2ac00c410 con 0x7fd2bc10cfb0 2026-02-13T02:19:06.963 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.957+0000 7fd2aa7fc6c0 1 --2- 10.20.193.11:0/877753939 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fd2980b5710 0x7fd2980d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:06.963 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.957+0000 7fd2aa7fc6c0 1 -- 10.20.193.11:0/877753939 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7762+0+0 (secure 0 0 0) 0x7fd2ac0e3cf0 con 0x7fd2bc10cfb0 2026-02-13T02:19:06.963 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.957+0000 7fd2c08346c0 1 --2- 10.20.193.11:0/877753939 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fd2980b5710 0x7fd2980d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:06.963 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.957+0000 7fd2c08346c0 1 --2- 10.20.193.11:0/877753939 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fd2980b5710 0x7fd2980d5bc0 secure :-1 s=READY pgs=176 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd2bc121900 tx=0x7fd2b00094f0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:06.963 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:06.958+0000 7fd2aa7fc6c0 1 -- 10.20.193.11:0/877753939 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fd2ac0a6710 con 0x7fd2bc10cfb0 2026-02-13T02:19:07.074 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.072+0000 7fd2c32c06c0 1 -- 10.20.193.11:0/877753939 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd2bc10d380 con 0x7fd2bc10cfb0 2026-02-13T02:19:07.075 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.072+0000 7fd2aa7fc6c0 1 -- 10.20.193.11:0/877753939 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11974 (secure 0 0 0) 0x7fd2ac0a98c0 con 0x7fd2bc10cfb0 2026-02-13T02:19:07.075 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:19:07.076 INFO:teuthology.orchestra.run.trial011.stdout:{"epoch":24,"btime":"2026-02-13T02:19:06:058820+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14718,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.11:6835/50369882","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6834","nonce":50369882},{"type":"v1","addr":"10.20.193.11:6835","nonce":50369882}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":14730,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.11:6837/2639332668","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6836","nonce":2639332668},{"type":"v1","addr":"10.20.193.11:6837","nonce":2639332668}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false,"allow_referent_inodes":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-13T02:18:58.420190+0000","modified":"2026-02-13T02:19:06.058812+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24524,"mds_1":24497,"mds_2":24473,"mds_3":24466,"mds_4":24457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14763":{"gid":14763,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.11:6839/1734176453","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6838","nonce":1734176453},{"type":"v1","addr":"10.20.193.11:6839","nonce":1734176453}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14775":{"gid":14775,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.11:6841/985131365","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6840","nonce":985131365},{"type":"v1","addr":"10.20.193.11:6841","nonce":985131365}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24421":{"gid":24421,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.78:6833/3863251566","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6832","nonce":3863251566},{"type":"v1","addr":"10.20.193.78:6833","nonce":3863251566}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24448":{"gid":24448,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.78:6835/3989291038","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6834","nonce":3989291038},{"type":"v1","addr":"10.20.193.78:6835","nonce":3989291038}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.60:6833/2039450283","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6832","nonce":2039450283},{"type":"v1","addr":"10.20.193.60:6833","nonce":2039450283}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24457":{"gid":24457,"name":"c","rank":4,"incarnation":22,"state":"up:active","state_seq":5,"addr":"10.20.193.78:6837/35592594","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6836","nonce":35592594},{"type":"v1","addr":"10.20.193.78:6837","nonce":35592594}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24466":{"gid":24466,"name":"i","rank":3,"incarnation":20,"state":"up:active","state_seq":4,"addr":"10.20.193.78:6839/2341862516","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6838","nonce":2341862516},{"type":"v1","addr":"10.20.193.78:6839","nonce":2341862516}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"e","rank":2,"incarnation":18,"state":"up:active","state_seq":5,"addr":"10.20.193.60:6835/937612650","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6834","nonce":937612650},{"type":"v1","addr":"10.20.193.60:6835","nonce":937612650}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"h","rank":1,"incarnation":16,"state":"up:active","state_seq":4,"addr":"10.20.193.60:6837/1730049678","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6836","nonce":1730049678},{"type":"v1","addr":"10.20.193.60:6837","nonce":1730049678}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24524":{"gid":24524,"name":"b","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"10.20.193.60:6839/1675549162","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6838","nonce":1675549162},{"type":"v1","addr":"10.20.193.60:6839","nonce":1675549162}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24524,"qdb_cluster":[24524,24497,24473,24466,24457]},"id":1}]} 2026-02-13T02:19:07.077 INFO:teuthology.orchestra.run.trial011.stderr:dumped fsmap epoch 24 2026-02-13T02:19:07.077 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.074+0000 7fd2c32c06c0 1 -- 10.20.193.11:0/877753939 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fd2980b5710 msgr2=0x7fd2980d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:07.077 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.074+0000 7fd2c32c06c0 1 --2- 10.20.193.11:0/877753939 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fd2980b5710 0x7fd2980d5bc0 secure :-1 s=READY pgs=176 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd2bc121900 tx=0x7fd2b00094f0 comp rx=0 tx=0).stop 2026-02-13T02:19:07.077 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.074+0000 7fd2c32c06c0 1 -- 10.20.193.11:0/877753939 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fd2bc10cfb0 msgr2=0x7fd2bc11af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:07.077 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.074+0000 7fd2c32c06c0 1 --2- 10.20.193.11:0/877753939 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fd2bc10cfb0 0x7fd2bc11af70 secure :-1 s=READY pgs=240 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd2ac00b710 tx=0x7fd2ac00bbe0 comp rx=0 tx=0).stop 2026-02-13T02:19:07.077 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.074+0000 7fd2c32c06c0 1 -- 10.20.193.11:0/877753939 shutdown_connections 2026-02-13T02:19:07.077 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.074+0000 7fd2c32c06c0 1 --2- 10.20.193.11:0/877753939 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fd2980b5710 0x7fd2980d5bc0 unknown :-1 s=CLOSED pgs=176 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:07.077 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.074+0000 7fd2c32c06c0 1 --2- 10.20.193.11:0/877753939 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fd2bc1131c0 0x7fd2bc11b4b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:07.077 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.074+0000 7fd2c32c06c0 1 --2- 10.20.193.11:0/877753939 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd2bc120870 0x7fd2bc120d10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:07.078 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.074+0000 7fd2c32c06c0 1 --2- 10.20.193.11:0/877753939 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fd2bc10cfb0 0x7fd2bc11af70 unknown :-1 s=CLOSED pgs=240 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:07.078 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.074+0000 7fd2c32c06c0 1 -- 10.20.193.11:0/877753939 >> 10.20.193.11:0/877753939 conn(0x7fd2bc0ea8b0 msgr2=0x7fd2bc10ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:07.078 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.074+0000 7fd2c32c06c0 1 -- 10.20.193.11:0/877753939 shutdown_connections 2026-02-13T02:19:07.078 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.074+0000 7fd2c32c06c0 1 -- 10.20.193.11:0/877753939 wait complete. 2026-02-13T02:19:07.112 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:07 trial011 ceph-mon[11956]: from='client.14871 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:19:07.113 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:07 trial011 ceph-mon[11956]: mds.? [v2:10.20.193.78:6836/35592594,v1:10.20.193.78:6837/35592594] up:active 2026-02-13T02:19:07.113 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:07 trial011 ceph-mon[11956]: fsmap cephfs:5 7 up:standby 5 up:active 2026-02-13T02:19:07.113 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:07 trial011 ceph-mon[11956]: mgrmap e11: x(active, since 2m), standbys: z, y 2026-02-13T02:19:07.113 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:07 trial011 ceph-mon[11956]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2026-02-13T02:19:07.113 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:07 trial011 ceph-mon[11956]: from='client.14877 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:19:07.115 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph osd dump --format=json 2026-02-13T02:19:07.236 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:19:07.358 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.356+0000 7f613929c6c0 1 -- 10.20.193.11:0/3851065862 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f613410f230 msgr2=0x7f613410f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:07.358 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.356+0000 7f613929c6c0 1 --2- 10.20.193.11:0/3851065862 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f613410f230 0x7f613410f600 secure :-1 s=READY pgs=241 gs=1 cs=0 l=1 c_cookie=6021340414610408189 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f61280099a0 tx=0x7f612802ed20 comp rx=0 tx=0).stop 2026-02-13T02:19:07.358 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.356+0000 7f613929c6c0 1 -- 10.20.193.11:0/3851065862 shutdown_connections 2026-02-13T02:19:07.358 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.356+0000 7f613929c6c0 1 --2- 10.20.193.11:0/3851065862 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f613410fc20 0x7f6134114c60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:07.358 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.356+0000 7f613929c6c0 1 --2- 10.20.193.11:0/3851065862 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6134115440 0x7f6134175de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:07.358 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.356+0000 7f613929c6c0 1 --2- 10.20.193.11:0/3851065862 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f613410f230 0x7f613410f600 unknown :-1 s=CLOSED pgs=241 gs=1 cs=0 l=1 c_cookie=6021340414610408189 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:07.358 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.356+0000 7f613929c6c0 1 -- 10.20.193.11:0/3851065862 >> 10.20.193.11:0/3851065862 conn(0x7f61340ecb30 msgr2=0x7f613410cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:07.358 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.356+0000 7f613929c6c0 1 -- 10.20.193.11:0/3851065862 shutdown_connections 2026-02-13T02:19:07.358 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.356+0000 7f613929c6c0 1 -- 10.20.193.11:0/3851065862 wait complete. 2026-02-13T02:19:07.359 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.356+0000 7f613929c6c0 1 Processor -- start 2026-02-13T02:19:07.359 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.357+0000 7f613929c6c0 1 -- start start 2026-02-13T02:19:07.359 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.357+0000 7f613929c6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f613410f230 0x7f613411d140 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:07.359 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.357+0000 7f613929c6c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f6134115440 0x7f613411d680 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:07.359 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.357+0000 7f613929c6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f6134122a40 0x7f6134122ee0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:07.359 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.357+0000 7f613929c6c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f6134123450 con 0x7f6134122a40 2026-02-13T02:19:07.359 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.357+0000 7f613929c6c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f61341235c0 con 0x7f6134115440 2026-02-13T02:19:07.359 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.357+0000 7f613929c6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f6134123780 con 0x7f613410f230 2026-02-13T02:19:07.359 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.357+0000 7f61337fe6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f6134122a40 0x7f6134122ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:07.359 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.357+0000 7f61337fe6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f6134122a40 0x7f6134122ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:48976/0 (socket says 10.20.193.11:48976) 2026-02-13T02:19:07.359 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.357+0000 7f61337fe6c0 1 -- 10.20.193.11:0/2922979105 learned_addr learned my addr 10.20.193.11:0/2922979105 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:19:07.359 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.357+0000 7f6132ffd6c0 1 --2- 10.20.193.11:0/2922979105 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f613410f230 0x7f613411d140 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:07.359 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.357+0000 7f61327fc6c0 1 --2- 10.20.193.11:0/2922979105 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f6134115440 0x7f613411d680 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:07.359 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.357+0000 7f61337fe6c0 1 -- 10.20.193.11:0/2922979105 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f613410f230 msgr2=0x7f613411d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:07.359 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.357+0000 7f61337fe6c0 1 --2- 10.20.193.11:0/2922979105 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f613410f230 0x7f613411d140 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:07.359 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.357+0000 7f61337fe6c0 1 -- 10.20.193.11:0/2922979105 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f6134115440 msgr2=0x7f613411d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:07.359 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.357+0000 7f61337fe6c0 1 --2- 10.20.193.11:0/2922979105 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f6134115440 0x7f613411d680 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:07.359 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.357+0000 7f61337fe6c0 1 -- 10.20.193.11:0/2922979105 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6128009590 con 0x7f6134122a40 2026-02-13T02:19:07.359 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.357+0000 7f6132ffd6c0 1 --2- 10.20.193.11:0/2922979105 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f613410f230 0x7f613411d140 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T02:19:07.359 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.357+0000 7f61327fc6c0 1 --2- 10.20.193.11:0/2922979105 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f6134115440 0x7f613411d680 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T02:19:07.359 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.357+0000 7f61337fe6c0 1 --2- 10.20.193.11:0/2922979105 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f6134122a40 0x7f6134122ee0 secure :-1 s=READY pgs=242 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6124006ea0 tx=0x7f612400ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:07.359 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.357+0000 7f6113fff6c0 1 -- 10.20.193.11:0/2922979105 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6124003c40 con 0x7f6134122a40 2026-02-13T02:19:07.360 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.357+0000 7f6113fff6c0 1 -- 10.20.193.11:0/2922979105 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6124003da0 con 0x7f6134122a40 2026-02-13T02:19:07.360 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.357+0000 7f613929c6c0 1 -- 10.20.193.11:0/2922979105 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6134163c30 con 0x7f6134122a40 2026-02-13T02:19:07.360 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.357+0000 7f6113fff6c0 1 -- 10.20.193.11:0/2922979105 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f61240081c0 con 0x7f6134122a40 2026-02-13T02:19:07.360 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.357+0000 7f613929c6c0 1 -- 10.20.193.11:0/2922979105 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61341640c0 con 0x7f6134122a40 2026-02-13T02:19:07.360 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.357+0000 7f613929c6c0 1 -- 10.20.193.11:0/2922979105 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6134110500 con 0x7f6134122a40 2026-02-13T02:19:07.360 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.359+0000 7f6113fff6c0 1 -- 10.20.193.11:0/2922979105 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7f612400d590 con 0x7f6134122a40 2026-02-13T02:19:07.361 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.359+0000 7f6113fff6c0 1 --2- 10.20.193.11:0/2922979105 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f61080b5710 0x7f61080d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:07.361 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.359+0000 7f6113fff6c0 1 -- 10.20.193.11:0/2922979105 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7762+0+0 (secure 0 0 0) 0x7f61240e4c00 con 0x7f6134122a40 2026-02-13T02:19:07.361 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.359+0000 7f6132ffd6c0 1 --2- 10.20.193.11:0/2922979105 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f61080b5710 0x7f61080d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:07.361 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.359+0000 7f6113fff6c0 1 -- 10.20.193.11:0/2922979105 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f61240a7660 con 0x7f6134122a40 2026-02-13T02:19:07.361 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.360+0000 7f6132ffd6c0 1 --2- 10.20.193.11:0/2922979105 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f61080b5710 0x7f61080d5bc0 secure :-1 s=READY pgs=177 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f61280023e0 tx=0x7f6128031f90 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:07.453 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.451+0000 7f613929c6c0 1 -- 10.20.193.11:0/2922979105 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f613411e2c0 con 0x7f6134122a40 2026-02-13T02:19:07.453 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.452+0000 7f6113fff6c0 1 -- 10.20.193.11:0/2922979105 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) ==== 74+0+21954 (secure 0 0 0) 0x7f61240aa810 con 0x7f6134122a40 2026-02-13T02:19:07.454 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:19:07.454 INFO:teuthology.orchestra.run.trial011.stdout:{"epoch":71,"fsid":"fc631695-0881-11f1-899c-d404e6e7d460","created":"2026-02-13T02:16:35.175761+0000","modified":"2026-02-13T02:19:00.017879+0000","last_up_change":"2026-02-13T02:18:43.665240+0000","last_in_change":"2026-02-13T02:18:35.014003+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-13T02:17:39.931888+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-13T02:18:56.323027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-13T02:18:57.399537+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb9a005b-9a16-4fda-95c0-d23831f0cffc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6802","nonce":1061379396},{"type":"v1","addr":"10.20.193.11:6803","nonce":1061379396}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6804","nonce":1061379396},{"type":"v1","addr":"10.20.193.11:6805","nonce":1061379396}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6808","nonce":1061379396},{"type":"v1","addr":"10.20.193.11:6809","nonce":1061379396}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6806","nonce":1061379396},{"type":"v1","addr":"10.20.193.11:6807","nonce":1061379396}]},"public_addr":"10.20.193.11:6803/1061379396","cluster_addr":"10.20.193.11:6805/1061379396","heartbeat_back_addr":"10.20.193.11:6809/1061379396","heartbeat_front_addr":"10.20.193.11:6807/1061379396","state":["exists","up"]},{"osd":1,"uuid":"c1786ae4-a736-47b0-8302-b06423efd012","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6800","nonce":2198425396},{"type":"v1","addr":"10.20.193.60:6801","nonce":2198425396}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6802","nonce":2198425396},{"type":"v1","addr":"10.20.193.60:6803","nonce":2198425396}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6806","nonce":2198425396},{"type":"v1","addr":"10.20.193.60:6807","nonce":2198425396}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6804","nonce":2198425396},{"type":"v1","addr":"10.20.193.60:6805","nonce":2198425396}]},"public_addr":"10.20.193.60:6801/2198425396","cluster_addr":"10.20.193.60:6803/2198425396","heartbeat_back_addr":"10.20.193.60:6807/2198425396","heartbeat_front_addr":"10.20.193.60:6805/2198425396","state":["exists","up"]},{"osd":2,"uuid":"516f1aa0-bc7c-4808-8ac8-4ff406c71890","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6800","nonce":3723638526},{"type":"v1","addr":"10.20.193.78:6801","nonce":3723638526}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6802","nonce":3723638526},{"type":"v1","addr":"10.20.193.78:6803","nonce":3723638526}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6806","nonce":3723638526},{"type":"v1","addr":"10.20.193.78:6807","nonce":3723638526}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6804","nonce":3723638526},{"type":"v1","addr":"10.20.193.78:6805","nonce":3723638526}]},"public_addr":"10.20.193.78:6801/3723638526","cluster_addr":"10.20.193.78:6803/3723638526","heartbeat_back_addr":"10.20.193.78:6807/3723638526","heartbeat_front_addr":"10.20.193.78:6805/3723638526","state":["exists","up"]},{"osd":3,"uuid":"8cf508c2-b05d-42be-92e3-db0a57d22a85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6810","nonce":4224399876},{"type":"v1","addr":"10.20.193.11:6811","nonce":4224399876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6812","nonce":4224399876},{"type":"v1","addr":"10.20.193.11:6813","nonce":4224399876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6816","nonce":4224399876},{"type":"v1","addr":"10.20.193.11:6817","nonce":4224399876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6814","nonce":4224399876},{"type":"v1","addr":"10.20.193.11:6815","nonce":4224399876}]},"public_addr":"10.20.193.11:6811/4224399876","cluster_addr":"10.20.193.11:6813/4224399876","heartbeat_back_addr":"10.20.193.11:6817/4224399876","heartbeat_front_addr":"10.20.193.11:6815/4224399876","state":["exists","up"]},{"osd":4,"uuid":"abf31616-2588-43c1-b15a-7f703ae8e1c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":28,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6808","nonce":3289387254},{"type":"v1","addr":"10.20.193.60:6809","nonce":3289387254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6810","nonce":3289387254},{"type":"v1","addr":"10.20.193.60:6811","nonce":3289387254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6814","nonce":3289387254},{"type":"v1","addr":"10.20.193.60:6815","nonce":3289387254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6812","nonce":3289387254},{"type":"v1","addr":"10.20.193.60:6813","nonce":3289387254}]},"public_addr":"10.20.193.60:6809/3289387254","cluster_addr":"10.20.193.60:6811/3289387254","heartbeat_back_addr":"10.20.193.60:6815/3289387254","heartbeat_front_addr":"10.20.193.60:6813/3289387254","state":["exists","up"]},{"osd":5,"uuid":"70c3d0b0-8e3d-4432-87e2-bb5391cf0167","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6808","nonce":3975711592},{"type":"v1","addr":"10.20.193.78:6809","nonce":3975711592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6810","nonce":3975711592},{"type":"v1","addr":"10.20.193.78:6811","nonce":3975711592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6814","nonce":3975711592},{"type":"v1","addr":"10.20.193.78:6815","nonce":3975711592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6812","nonce":3975711592},{"type":"v1","addr":"10.20.193.78:6813","nonce":3975711592}]},"public_addr":"10.20.193.78:6809/3975711592","cluster_addr":"10.20.193.78:6811/3975711592","heartbeat_back_addr":"10.20.193.78:6815/3975711592","heartbeat_front_addr":"10.20.193.78:6813/3975711592","state":["exists","up"]},{"osd":6,"uuid":"bc1293b8-53e6-4386-b02b-31ca7030976d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6818","nonce":2393344644},{"type":"v1","addr":"10.20.193.11:6819","nonce":2393344644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6820","nonce":2393344644},{"type":"v1","addr":"10.20.193.11:6821","nonce":2393344644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6824","nonce":2393344644},{"type":"v1","addr":"10.20.193.11:6825","nonce":2393344644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6822","nonce":2393344644},{"type":"v1","addr":"10.20.193.11:6823","nonce":2393344644}]},"public_addr":"10.20.193.11:6819/2393344644","cluster_addr":"10.20.193.11:6821/2393344644","heartbeat_back_addr":"10.20.193.11:6825/2393344644","heartbeat_front_addr":"10.20.193.11:6823/2393344644","state":["exists","up"]},{"osd":7,"uuid":"da596d81-14dc-403b-9a20-90a7587da04c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6816","nonce":2908560893},{"type":"v1","addr":"10.20.193.60:6817","nonce":2908560893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6818","nonce":2908560893},{"type":"v1","addr":"10.20.193.60:6819","nonce":2908560893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6822","nonce":2908560893},{"type":"v1","addr":"10.20.193.60:6823","nonce":2908560893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6820","nonce":2908560893},{"type":"v1","addr":"10.20.193.60:6821","nonce":2908560893}]},"public_addr":"10.20.193.60:6817/2908560893","cluster_addr":"10.20.193.60:6819/2908560893","heartbeat_back_addr":"10.20.193.60:6823/2908560893","heartbeat_front_addr":"10.20.193.60:6821/2908560893","state":["exists","up"]},{"osd":8,"uuid":"24098987-9f02-4f06-b93e-8af84291cc82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6816","nonce":242640323},{"type":"v1","addr":"10.20.193.78:6817","nonce":242640323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6818","nonce":242640323},{"type":"v1","addr":"10.20.193.78:6819","nonce":242640323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6822","nonce":242640323},{"type":"v1","addr":"10.20.193.78:6823","nonce":242640323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6820","nonce":242640323},{"type":"v1","addr":"10.20.193.78:6821","nonce":242640323}]},"public_addr":"10.20.193.78:6817/242640323","cluster_addr":"10.20.193.78:6819/242640323","heartbeat_back_addr":"10.20.193.78:6823/242640323","heartbeat_front_addr":"10.20.193.78:6821/242640323","state":["exists","up"]},{"osd":9,"uuid":"25cd90dd-8e86-4ac1-a693-a4080b035da1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6826","nonce":132317204},{"type":"v1","addr":"10.20.193.11:6827","nonce":132317204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6828","nonce":132317204},{"type":"v1","addr":"10.20.193.11:6829","nonce":132317204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6832","nonce":132317204},{"type":"v1","addr":"10.20.193.11:6833","nonce":132317204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6830","nonce":132317204},{"type":"v1","addr":"10.20.193.11:6831","nonce":132317204}]},"public_addr":"10.20.193.11:6827/132317204","cluster_addr":"10.20.193.11:6829/132317204","heartbeat_back_addr":"10.20.193.11:6833/132317204","heartbeat_front_addr":"10.20.193.11:6831/132317204","state":["exists","up"]},{"osd":10,"uuid":"727f51ff-9428-44ae-a69a-0f555f1397ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6824","nonce":3534951144},{"type":"v1","addr":"10.20.193.60:6825","nonce":3534951144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6826","nonce":3534951144},{"type":"v1","addr":"10.20.193.60:6827","nonce":3534951144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6830","nonce":3534951144},{"type":"v1","addr":"10.20.193.60:6831","nonce":3534951144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6828","nonce":3534951144},{"type":"v1","addr":"10.20.193.60:6829","nonce":3534951144}]},"public_addr":"10.20.193.60:6825/3534951144","cluster_addr":"10.20.193.60:6827/3534951144","heartbeat_back_addr":"10.20.193.60:6831/3534951144","heartbeat_front_addr":"10.20.193.60:6829/3534951144","state":["exists","up"]},{"osd":11,"uuid":"03e11d54-a857-418b-8ac1-c8d7a9a23305","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6824","nonce":537170494},{"type":"v1","addr":"10.20.193.78:6825","nonce":537170494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6826","nonce":537170494},{"type":"v1","addr":"10.20.193.78:6827","nonce":537170494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6830","nonce":537170494},{"type":"v1","addr":"10.20.193.78:6831","nonce":537170494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6828","nonce":537170494},{"type":"v1","addr":"10.20.193.78:6829","nonce":537170494}]},"public_addr":"10.20.193.78:6825/537170494","cluster_addr":"10.20.193.78:6827/537170494","heartbeat_back_addr":"10.20.193.78:6831/537170494","heartbeat_front_addr":"10.20.193.78:6829/537170494","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:17:22.330213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:17:29.302695+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:17:36.305494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:17:43.706241+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:17:51.095807+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:17:58.083703+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:18:05.097723+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:18:12.357395+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:18:19.659255+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:18:27.054774+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:18:34.465790+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:18:41.783401+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.11:0/1644541112":"2026-02-14T02:16:41.426146+0000","10.20.193.11:0/1423851105":"2026-02-14T02:16:41.426146+0000","10.20.193.11:0/1602612884":"2026-02-14T02:16:41.426146+0000","10.20.193.11:6801/2469571860":"2026-02-14T02:16:41.426146+0000","10.20.193.11:6800/2469571860":"2026-02-14T02:16:41.426146+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-13T02:19:07.454 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.453+0000 7f613929c6c0 1 -- 10.20.193.11:0/2922979105 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f61080b5710 msgr2=0x7f61080d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:07.454 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.453+0000 7f613929c6c0 1 --2- 10.20.193.11:0/2922979105 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f61080b5710 0x7f61080d5bc0 secure :-1 s=READY pgs=177 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f61280023e0 tx=0x7f6128031f90 comp rx=0 tx=0).stop 2026-02-13T02:19:07.454 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.453+0000 7f613929c6c0 1 -- 10.20.193.11:0/2922979105 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f6134122a40 msgr2=0x7f6134122ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:07.455 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.453+0000 7f613929c6c0 1 --2- 10.20.193.11:0/2922979105 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f6134122a40 0x7f6134122ee0 secure :-1 s=READY pgs=242 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6124006ea0 tx=0x7f612400ce50 comp rx=0 tx=0).stop 2026-02-13T02:19:07.455 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.453+0000 7f613929c6c0 1 -- 10.20.193.11:0/2922979105 shutdown_connections 2026-02-13T02:19:07.455 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.453+0000 7f613929c6c0 1 --2- 10.20.193.11:0/2922979105 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f61080b5710 0x7f61080d5bc0 unknown :-1 s=CLOSED pgs=177 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:07.455 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.453+0000 7f613929c6c0 1 --2- 10.20.193.11:0/2922979105 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f6134115440 0x7f613411d680 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:07.455 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.453+0000 7f613929c6c0 1 --2- 10.20.193.11:0/2922979105 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f6134122a40 0x7f6134122ee0 unknown :-1 s=CLOSED pgs=242 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:07.455 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.453+0000 7f613929c6c0 1 --2- 10.20.193.11:0/2922979105 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f613410f230 0x7f613411d140 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:07.455 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.453+0000 7f613929c6c0 1 -- 10.20.193.11:0/2922979105 >> 10.20.193.11:0/2922979105 conn(0x7f61340ecb30 msgr2=0x7f613410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:07.455 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.453+0000 7f613929c6c0 1 -- 10.20.193.11:0/2922979105 shutdown_connections 2026-02-13T02:19:07.455 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.453+0000 7f613929c6c0 1 -- 10.20.193.11:0/2922979105 wait complete. 2026-02-13T02:19:07.493 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2026-02-13T02:19:07.493 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph pg dump --format=json 2026-02-13T02:19:07.499 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:07 trial060 ceph-mon[14797]: from='client.14871 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:19:07.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:07 trial060 ceph-mon[14797]: mds.? [v2:10.20.193.78:6836/35592594,v1:10.20.193.78:6837/35592594] up:active 2026-02-13T02:19:07.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:07 trial060 ceph-mon[14797]: fsmap cephfs:5 7 up:standby 5 up:active 2026-02-13T02:19:07.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:07 trial060 ceph-mon[14797]: mgrmap e11: x(active, since 2m), standbys: z, y 2026-02-13T02:19:07.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:07 trial060 ceph-mon[14797]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2026-02-13T02:19:07.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:07 trial060 ceph-mon[14797]: from='client.14877 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:19:07.541 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:07 trial078 ceph-mon[14969]: from='client.14871 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:19:07.541 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:07 trial078 ceph-mon[14969]: mds.? [v2:10.20.193.78:6836/35592594,v1:10.20.193.78:6837/35592594] up:active 2026-02-13T02:19:07.541 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:07 trial078 ceph-mon[14969]: fsmap cephfs:5 7 up:standby 5 up:active 2026-02-13T02:19:07.541 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:07 trial078 ceph-mon[14969]: mgrmap e11: x(active, since 2m), standbys: z, y 2026-02-13T02:19:07.541 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:07 trial078 ceph-mon[14969]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2026-02-13T02:19:07.541 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:07 trial078 ceph-mon[14969]: from='client.14877 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:19:07.615 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:19:07.730 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.728+0000 7fac314ff6c0 1 -- 10.20.193.11:0/2855273516 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fac2c10d970 msgr2=0x7fac2c1129b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:07.730 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.728+0000 7fac314ff6c0 1 --2- 10.20.193.11:0/2855273516 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fac2c10d970 0x7fac2c1129b0 secure :-1 s=READY pgs=243 gs=1 cs=0 l=1 c_cookie=17133077276233153179 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fac140099a0 tx=0x7fac1402ed20 comp rx=0 tx=0).stop 2026-02-13T02:19:07.730 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.728+0000 7fac314ff6c0 1 -- 10.20.193.11:0/2855273516 shutdown_connections 2026-02-13T02:19:07.730 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.728+0000 7fac314ff6c0 1 --2- 10.20.193.11:0/2855273516 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fac2c113190 0x7fac2c173b30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:07.730 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.728+0000 7fac314ff6c0 1 --2- 10.20.193.11:0/2855273516 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fac2c10d970 0x7fac2c1129b0 unknown :-1 s=CLOSED pgs=243 gs=1 cs=0 l=1 c_cookie=17133077276233153179 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:07.730 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.728+0000 7fac314ff6c0 1 --2- 10.20.193.11:0/2855273516 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fac2c10cf80 0x7fac2c10d350 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:07.730 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.728+0000 7fac314ff6c0 1 -- 10.20.193.11:0/2855273516 >> 10.20.193.11:0/2855273516 conn(0x7fac2c0ea880 msgr2=0x7fac2c10ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:07.730 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.729+0000 7fac314ff6c0 1 -- 10.20.193.11:0/2855273516 shutdown_connections 2026-02-13T02:19:07.730 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.729+0000 7fac314ff6c0 1 -- 10.20.193.11:0/2855273516 wait complete. 2026-02-13T02:19:07.731 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.729+0000 7fac314ff6c0 1 Processor -- start 2026-02-13T02:19:07.731 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.729+0000 7fac314ff6c0 1 -- start start 2026-02-13T02:19:07.731 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.729+0000 7fac314ff6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fac2c10cf80 0x7fac2c0f2960 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:07.731 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.729+0000 7fac314ff6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fac2c113190 0x7fac2c173a30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:07.731 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.729+0000 7fac314ff6c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fac2c0f2f90 0x7fac2c0f8260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:07.731 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.729+0000 7fac314ff6c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7fac2c0f3680 con 0x7fac2c113190 2026-02-13T02:19:07.731 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.729+0000 7fac314ff6c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7fac2c0f87a0 con 0x7fac2c0f2f90 2026-02-13T02:19:07.731 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.729+0000 7fac314ff6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fac2c0f8960 con 0x7fac2c10cf80 2026-02-13T02:19:07.731 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.729+0000 7fac2a7fc6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fac2c113190 0x7fac2c173a30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:07.731 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.729+0000 7fac2a7fc6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fac2c113190 0x7fac2c173a30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:48996/0 (socket says 10.20.193.11:48996) 2026-02-13T02:19:07.731 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.729+0000 7fac2a7fc6c0 1 -- 10.20.193.11:0/2125373311 learned_addr learned my addr 10.20.193.11:0/2125373311 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:19:07.731 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.729+0000 7fac2b7fe6c0 1 --2- 10.20.193.11:0/2125373311 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fac2c0f2f90 0x7fac2c0f8260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:07.731 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.729+0000 7fac2affd6c0 1 --2- 10.20.193.11:0/2125373311 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fac2c10cf80 0x7fac2c0f2960 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:07.731 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.729+0000 7fac2a7fc6c0 1 -- 10.20.193.11:0/2125373311 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fac2c10cf80 msgr2=0x7fac2c0f2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:07.731 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.729+0000 7fac2a7fc6c0 1 --2- 10.20.193.11:0/2125373311 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fac2c10cf80 0x7fac2c0f2960 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:07.731 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.729+0000 7fac2a7fc6c0 1 -- 10.20.193.11:0/2125373311 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fac2c0f2f90 msgr2=0x7fac2c0f8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:07.731 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.729+0000 7fac2a7fc6c0 1 --2- 10.20.193.11:0/2125373311 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fac2c0f2f90 0x7fac2c0f8260 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:07.731 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.729+0000 7fac2a7fc6c0 1 -- 10.20.193.11:0/2125373311 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac14009590 con 0x7fac2c113190 2026-02-13T02:19:07.732 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.729+0000 7fac2affd6c0 1 --2- 10.20.193.11:0/2125373311 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fac2c10cf80 0x7fac2c0f2960 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:19:07.732 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.729+0000 7fac2a7fc6c0 1 --2- 10.20.193.11:0/2125373311 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fac2c113190 0x7fac2c173a30 secure :-1 s=READY pgs=244 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fac14031f90 tx=0x7fac140047f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:07.732 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.729+0000 7fac0bfff6c0 1 -- 10.20.193.11:0/2125373311 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fac14002ae0 con 0x7fac2c113190 2026-02-13T02:19:07.732 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.729+0000 7fac0bfff6c0 1 -- 10.20.193.11:0/2125373311 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fac14002c40 con 0x7fac2c113190 2026-02-13T02:19:07.732 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.729+0000 7fac0bfff6c0 1 -- 10.20.193.11:0/2125373311 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fac140312b0 con 0x7fac2c113190 2026-02-13T02:19:07.732 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.729+0000 7fac314ff6c0 1 -- 10.20.193.11:0/2125373311 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac2c0f8be0 con 0x7fac2c113190 2026-02-13T02:19:07.732 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.729+0000 7fac314ff6c0 1 -- 10.20.193.11:0/2125373311 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac2c0f9010 con 0x7fac2c113190 2026-02-13T02:19:07.732 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.730+0000 7fac314ff6c0 1 -- 10.20.193.11:0/2125373311 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac2c10e250 con 0x7fac2c113190 2026-02-13T02:19:07.733 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.731+0000 7fac0bfff6c0 1 -- 10.20.193.11:0/2125373311 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7fac14007260 con 0x7fac2c113190 2026-02-13T02:19:07.733 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.732+0000 7fac0bfff6c0 1 --2- 10.20.193.11:0/2125373311 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fac000b5710 0x7fac000d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:07.734 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.732+0000 7fac2affd6c0 1 --2- 10.20.193.11:0/2125373311 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fac000b5710 0x7fac000d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:07.734 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.732+0000 7fac0bfff6c0 1 -- 10.20.193.11:0/2125373311 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7762+0+0 (secure 0 0 0) 0x7fac14107c40 con 0x7fac2c113190 2026-02-13T02:19:07.734 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.732+0000 7fac0bfff6c0 1 -- 10.20.193.11:0/2125373311 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fac140ca6a0 con 0x7fac2c113190 2026-02-13T02:19:07.734 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.732+0000 7fac2affd6c0 1 --2- 10.20.193.11:0/2125373311 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fac000b5710 0x7fac000d5bc0 secure :-1 s=READY pgs=178 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fac20005830 tx=0x7fac2000a1e0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:07.824 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.822+0000 7fac314ff6c0 1 -- 10.20.193.11:0/2125373311 --> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fac2c10d970 con 0x7fac000b5710 2026-02-13T02:19:07.826 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.824+0000 7fac0bfff6c0 1 -- 10.20.193.11:0/2125373311 <== mgr.14116 v2:10.20.193.11:6800/861334768 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258803 (secure 0 0 0) 0x7fac2c10d970 con 0x7fac000b5710 2026-02-13T02:19:07.829 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:19:07.831 INFO:teuthology.orchestra.run.trial011.stderr:dumped all 2026-02-13T02:19:07.833 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.826+0000 7fac314ff6c0 1 -- 10.20.193.11:0/2125373311 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fac000b5710 msgr2=0x7fac000d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:07.833 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.826+0000 7fac314ff6c0 1 --2- 10.20.193.11:0/2125373311 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fac000b5710 0x7fac000d5bc0 secure :-1 s=READY pgs=178 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fac20005830 tx=0x7fac2000a1e0 comp rx=0 tx=0).stop 2026-02-13T02:19:07.833 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.826+0000 7fac314ff6c0 1 -- 10.20.193.11:0/2125373311 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fac2c113190 msgr2=0x7fac2c173a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:07.833 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.826+0000 7fac314ff6c0 1 --2- 10.20.193.11:0/2125373311 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fac2c113190 0x7fac2c173a30 secure :-1 s=READY pgs=244 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fac14031f90 tx=0x7fac140047f0 comp rx=0 tx=0).stop 2026-02-13T02:19:07.833 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.826+0000 7fac314ff6c0 1 -- 10.20.193.11:0/2125373311 shutdown_connections 2026-02-13T02:19:07.833 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.826+0000 7fac314ff6c0 1 --2- 10.20.193.11:0/2125373311 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fac000b5710 0x7fac000d5bc0 unknown :-1 s=CLOSED pgs=178 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:07.834 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.826+0000 7fac314ff6c0 1 --2- 10.20.193.11:0/2125373311 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fac2c0f2f90 0x7fac2c0f8260 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:07.834 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.826+0000 7fac314ff6c0 1 --2- 10.20.193.11:0/2125373311 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fac2c113190 0x7fac2c173a30 unknown :-1 s=CLOSED pgs=244 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:07.834 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.826+0000 7fac314ff6c0 1 --2- 10.20.193.11:0/2125373311 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fac2c10cf80 0x7fac2c0f2960 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:07.834 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.826+0000 7fac314ff6c0 1 -- 10.20.193.11:0/2125373311 >> 10.20.193.11:0/2125373311 conn(0x7fac2c0ea880 msgr2=0x7fac2c10b5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:07.834 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.826+0000 7fac314ff6c0 1 -- 10.20.193.11:0/2125373311 shutdown_connections 2026-02-13T02:19:07.834 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:07.826+0000 7fac314ff6c0 1 -- 10.20.193.11:0/2125373311 wait complete. 2026-02-13T02:19:07.867 INFO:teuthology.orchestra.run.trial011.stdout:{"pg_ready":true,"pg_map":{"version":188,"stamp":"2026-02-13T02:19:06.946281+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":620633,"num_objects":79,"num_object_clones":0,"num_object_copies":237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":116,"num_read_kb":101,"num_write":363,"num_write_kb":3801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":300,"ondisk_log_size":300,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":284,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":8808038400,"kb_used":334500,"kb_used_data":10932,"kb_used_omap":398,"kb_used_meta":322929,"kb_avail":8807703900,"statfs":{"total":9019431321600,"available":9019088793600,"internally_reserved":0,"allocated":11194368,"data_stored":6189199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":407577,"internal_metadata":330680295},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":30265,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":174,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001850"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.023100+0000","last_change":"2026-02-13T02:18:59.021168+0000","last_active":"2026-02-13T02:19:00.023100+0000","last_peered":"2026-02-13T02:19:00.023100+0000","last_clean":"2026-02-13T02:19:00.023100+0000","last_became_active":"2026-02-13T02:18:59.020969+0000","last_became_peered":"2026-02-13T02:18:59.020969+0000","last_unstale":"2026-02-13T02:19:00.023100+0000","last_undegraded":"2026-02-13T02:19:00.023100+0000","last_fullsized":"2026-02-13T02:19:00.023100+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:15:33.793511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:01.085894+0000","last_change":"2026-02-13T02:18:59.021361+0000","last_active":"2026-02-13T02:19:01.085894+0000","last_peered":"2026-02-13T02:19:01.085894+0000","last_clean":"2026-02-13T02:19:01.085894+0000","last_became_active":"2026-02-13T02:18:59.021114+0000","last_became_peered":"2026-02-13T02:18:59.021114+0000","last_unstale":"2026-02-13T02:19:01.085894+0000","last_undegraded":"2026-02-13T02:19:01.085894+0000","last_fullsized":"2026-02-13T02:19:01.085894+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:17:48.819148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:01.085816+0000","last_change":"2026-02-13T02:18:59.022954+0000","last_active":"2026-02-13T02:19:01.085816+0000","last_peered":"2026-02-13T02:19:01.085816+0000","last_clean":"2026-02-13T02:19:01.085816+0000","last_became_active":"2026-02-13T02:18:59.022582+0000","last_became_peered":"2026-02-13T02:18:59.022582+0000","last_unstale":"2026-02-13T02:19:01.085816+0000","last_undegraded":"2026-02-13T02:19:01.085816+0000","last_fullsized":"2026-02-13T02:19:01.085816+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:34:51.801255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.398301+0000","last_change":"2026-02-13T02:18:59.022389+0000","last_active":"2026-02-13T02:19:00.398301+0000","last_peered":"2026-02-13T02:19:00.398301+0000","last_clean":"2026-02-13T02:19:00.398301+0000","last_became_active":"2026-02-13T02:18:59.022176+0000","last_became_peered":"2026-02-13T02:18:59.022176+0000","last_unstale":"2026-02-13T02:19:00.398301+0000","last_undegraded":"2026-02-13T02:19:00.398301+0000","last_fullsized":"2026-02-13T02:19:00.398301+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:46:51.207583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.269641+0000","last_change":"2026-02-13T02:18:59.021747+0000","last_active":"2026-02-13T02:19:00.269641+0000","last_peered":"2026-02-13T02:19:00.269641+0000","last_clean":"2026-02-13T02:19:00.269641+0000","last_became_active":"2026-02-13T02:18:59.021407+0000","last_became_peered":"2026-02-13T02:18:59.021407+0000","last_unstale":"2026-02-13T02:19:00.269641+0000","last_undegraded":"2026-02-13T02:19:00.269641+0000","last_fullsized":"2026-02-13T02:19:00.269641+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:39:47.768337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026389+0000","last_change":"2026-02-13T02:18:59.022054+0000","last_active":"2026-02-13T02:19:00.026389+0000","last_peered":"2026-02-13T02:19:00.026389+0000","last_clean":"2026-02-13T02:19:00.026389+0000","last_became_active":"2026-02-13T02:18:59.021802+0000","last_became_peered":"2026-02-13T02:18:59.021802+0000","last_unstale":"2026-02-13T02:19:00.026389+0000","last_undegraded":"2026-02-13T02:19:00.026389+0000","last_fullsized":"2026-02-13T02:19:00.026389+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:49:10.152281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026097+0000","last_change":"2026-02-13T02:18:59.023580+0000","last_active":"2026-02-13T02:19:00.026097+0000","last_peered":"2026-02-13T02:19:00.026097+0000","last_clean":"2026-02-13T02:19:00.026097+0000","last_became_active":"2026-02-13T02:18:59.023348+0000","last_became_peered":"2026-02-13T02:18:59.023348+0000","last_unstale":"2026-02-13T02:19:00.026097+0000","last_undegraded":"2026-02-13T02:19:00.026097+0000","last_fullsized":"2026-02-13T02:19:00.026097+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:21:20.473098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.025858+0000","last_change":"2026-02-13T02:18:59.023105+0000","last_active":"2026-02-13T02:19:00.025858+0000","last_peered":"2026-02-13T02:19:00.025858+0000","last_clean":"2026-02-13T02:19:00.025858+0000","last_became_active":"2026-02-13T02:18:59.022960+0000","last_became_peered":"2026-02-13T02:18:59.022960+0000","last_unstale":"2026-02-13T02:19:00.025858+0000","last_undegraded":"2026-02-13T02:19:00.025858+0000","last_fullsized":"2026-02-13T02:19:00.025858+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:04:13.537414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026452+0000","last_change":"2026-02-13T02:18:59.025487+0000","last_active":"2026-02-13T02:19:00.026452+0000","last_peered":"2026-02-13T02:19:00.026452+0000","last_clean":"2026-02-13T02:19:00.026452+0000","last_became_active":"2026-02-13T02:18:59.025162+0000","last_became_peered":"2026-02-13T02:18:59.025162+0000","last_unstale":"2026-02-13T02:19:00.026452+0000","last_undegraded":"2026-02-13T02:19:00.026452+0000","last_fullsized":"2026-02-13T02:19:00.026452+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:02:12.030985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026633+0000","last_change":"2026-02-13T02:18:59.024537+0000","last_active":"2026-02-13T02:19:00.026633+0000","last_peered":"2026-02-13T02:19:00.026633+0000","last_clean":"2026-02-13T02:19:00.026633+0000","last_became_active":"2026-02-13T02:18:59.024265+0000","last_became_peered":"2026-02-13T02:18:59.024265+0000","last_unstale":"2026-02-13T02:19:00.026633+0000","last_undegraded":"2026-02-13T02:19:00.026633+0000","last_fullsized":"2026-02-13T02:19:00.026633+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:34:28.463458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026396+0000","last_change":"2026-02-13T02:18:59.024867+0000","last_active":"2026-02-13T02:19:00.026396+0000","last_peered":"2026-02-13T02:19:00.026396+0000","last_clean":"2026-02-13T02:19:00.026396+0000","last_became_active":"2026-02-13T02:18:59.024696+0000","last_became_peered":"2026-02-13T02:18:59.024696+0000","last_unstale":"2026-02-13T02:19:00.026396+0000","last_undegraded":"2026-02-13T02:19:00.026396+0000","last_fullsized":"2026-02-13T02:19:00.026396+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:09:44.461888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.398342+0000","last_change":"2026-02-13T02:18:59.022594+0000","last_active":"2026-02-13T02:19:00.398342+0000","last_peered":"2026-02-13T02:19:00.398342+0000","last_clean":"2026-02-13T02:19:00.398342+0000","last_became_active":"2026-02-13T02:18:59.022375+0000","last_became_peered":"2026-02-13T02:18:59.022375+0000","last_unstale":"2026-02-13T02:19:00.398342+0000","last_undegraded":"2026-02-13T02:19:00.398342+0000","last_fullsized":"2026-02-13T02:19:00.398342+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:55:59.143677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.025380+0000","last_change":"2026-02-13T02:18:59.023047+0000","last_active":"2026-02-13T02:19:00.025380+0000","last_peered":"2026-02-13T02:19:00.025380+0000","last_clean":"2026-02-13T02:19:00.025380+0000","last_became_active":"2026-02-13T02:18:59.022786+0000","last_became_peered":"2026-02-13T02:18:59.022786+0000","last_unstale":"2026-02-13T02:19:00.025380+0000","last_undegraded":"2026-02-13T02:19:00.025380+0000","last_fullsized":"2026-02-13T02:19:00.025380+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:28:02.421314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:01.085745+0000","last_change":"2026-02-13T02:18:59.022223+0000","last_active":"2026-02-13T02:19:01.085745+0000","last_peered":"2026-02-13T02:19:01.085745+0000","last_clean":"2026-02-13T02:19:01.085745+0000","last_became_active":"2026-02-13T02:18:59.021655+0000","last_became_peered":"2026-02-13T02:18:59.021655+0000","last_unstale":"2026-02-13T02:19:01.085745+0000","last_undegraded":"2026-02-13T02:19:01.085745+0000","last_fullsized":"2026-02-13T02:19:01.085745+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:14:17.871724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:01.085745+0000","last_change":"2026-02-13T02:18:59.022539+0000","last_active":"2026-02-13T02:19:01.085745+0000","last_peered":"2026-02-13T02:19:01.085745+0000","last_clean":"2026-02-13T02:19:01.085745+0000","last_became_active":"2026-02-13T02:18:59.022262+0000","last_became_peered":"2026-02-13T02:18:59.022262+0000","last_unstale":"2026-02-13T02:19:01.085745+0000","last_undegraded":"2026-02-13T02:19:01.085745+0000","last_fullsized":"2026-02-13T02:19:01.085745+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:55:02.955479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026233+0000","last_change":"2026-02-13T02:18:59.024960+0000","last_active":"2026-02-13T02:19:00.026233+0000","last_peered":"2026-02-13T02:19:00.026233+0000","last_clean":"2026-02-13T02:19:00.026233+0000","last_became_active":"2026-02-13T02:18:59.023945+0000","last_became_peered":"2026-02-13T02:18:59.023945+0000","last_unstale":"2026-02-13T02:19:00.026233+0000","last_undegraded":"2026-02-13T02:19:00.026233+0000","last_fullsized":"2026-02-13T02:19:00.026233+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:13:11.195636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.023170+0000","last_change":"2026-02-13T02:18:59.021383+0000","last_active":"2026-02-13T02:19:00.023170+0000","last_peered":"2026-02-13T02:19:00.023170+0000","last_clean":"2026-02-13T02:19:00.023170+0000","last_became_active":"2026-02-13T02:18:59.021225+0000","last_became_peered":"2026-02-13T02:18:59.021225+0000","last_unstale":"2026-02-13T02:19:00.023170+0000","last_undegraded":"2026-02-13T02:19:00.023170+0000","last_fullsized":"2026-02-13T02:19:00.023170+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:26:53.426955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:01.022801+0000","last_change":"2026-02-13T02:18:59.020231+0000","last_active":"2026-02-13T02:19:01.022801+0000","last_peered":"2026-02-13T02:19:01.022801+0000","last_clean":"2026-02-13T02:19:01.022801+0000","last_became_active":"2026-02-13T02:18:59.020054+0000","last_became_peered":"2026-02-13T02:18:59.020054+0000","last_unstale":"2026-02-13T02:19:01.022801+0000","last_undegraded":"2026-02-13T02:19:01.022801+0000","last_fullsized":"2026-02-13T02:19:01.022801+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:32:25.993500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:01.058735+0000","last_change":"2026-02-13T02:18:59.020750+0000","last_active":"2026-02-13T02:19:01.058735+0000","last_peered":"2026-02-13T02:19:01.058735+0000","last_clean":"2026-02-13T02:19:01.058735+0000","last_became_active":"2026-02-13T02:18:59.020321+0000","last_became_peered":"2026-02-13T02:18:59.020321+0000","last_unstale":"2026-02-13T02:19:01.058735+0000","last_undegraded":"2026-02-13T02:19:01.058735+0000","last_fullsized":"2026-02-13T02:19:01.058735+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:58:49.111664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.023065+0000","last_change":"2026-02-13T02:18:59.019826+0000","last_active":"2026-02-13T02:19:00.023065+0000","last_peered":"2026-02-13T02:19:00.023065+0000","last_clean":"2026-02-13T02:19:00.023065+0000","last_became_active":"2026-02-13T02:18:59.019638+0000","last_became_peered":"2026-02-13T02:18:59.019638+0000","last_unstale":"2026-02-13T02:19:00.023065+0000","last_undegraded":"2026-02-13T02:19:00.023065+0000","last_fullsized":"2026-02-13T02:19:00.023065+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:34:29.076454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.025414+0000","last_change":"2026-02-13T02:18:59.021568+0000","last_active":"2026-02-13T02:19:00.025414+0000","last_peered":"2026-02-13T02:19:00.025414+0000","last_clean":"2026-02-13T02:19:00.025414+0000","last_became_active":"2026-02-13T02:18:59.021304+0000","last_became_peered":"2026-02-13T02:18:59.021304+0000","last_unstale":"2026-02-13T02:19:00.025414+0000","last_undegraded":"2026-02-13T02:19:00.025414+0000","last_fullsized":"2026-02-13T02:19:00.025414+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:38:59.142564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026218+0000","last_change":"2026-02-13T02:18:59.024188+0000","last_active":"2026-02-13T02:19:00.026218+0000","last_peered":"2026-02-13T02:19:00.026218+0000","last_clean":"2026-02-13T02:19:00.026218+0000","last_became_active":"2026-02-13T02:18:59.023908+0000","last_became_peered":"2026-02-13T02:18:59.023908+0000","last_unstale":"2026-02-13T02:19:00.026218+0000","last_undegraded":"2026-02-13T02:19:00.026218+0000","last_fullsized":"2026-02-13T02:19:00.026218+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:10:18.045079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.025946+0000","last_change":"2026-02-13T02:18:59.023175+0000","last_active":"2026-02-13T02:19:00.025946+0000","last_peered":"2026-02-13T02:19:00.025946+0000","last_clean":"2026-02-13T02:19:00.025946+0000","last_became_active":"2026-02-13T02:18:59.022967+0000","last_became_peered":"2026-02-13T02:18:59.022967+0000","last_unstale":"2026-02-13T02:19:00.025946+0000","last_undegraded":"2026-02-13T02:19:00.025946+0000","last_fullsized":"2026-02-13T02:19:00.025946+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:52:00.572082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:01.059499+0000","last_change":"2026-02-13T02:18:59.021552+0000","last_active":"2026-02-13T02:19:01.059499+0000","last_peered":"2026-02-13T02:19:01.059499+0000","last_clean":"2026-02-13T02:19:01.059499+0000","last_became_active":"2026-02-13T02:18:59.021213+0000","last_became_peered":"2026-02-13T02:18:59.021213+0000","last_unstale":"2026-02-13T02:19:01.059499+0000","last_undegraded":"2026-02-13T02:19:01.059499+0000","last_fullsized":"2026-02-13T02:19:01.059499+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:10:29.362585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026274+0000","last_change":"2026-02-13T02:18:59.022674+0000","last_active":"2026-02-13T02:19:00.026274+0000","last_peered":"2026-02-13T02:19:00.026274+0000","last_clean":"2026-02-13T02:19:00.026274+0000","last_became_active":"2026-02-13T02:18:59.022325+0000","last_became_peered":"2026-02-13T02:18:59.022325+0000","last_unstale":"2026-02-13T02:19:00.026274+0000","last_undegraded":"2026-02-13T02:19:00.026274+0000","last_fullsized":"2026-02-13T02:19:00.026274+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:31:28.596666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:01.058743+0000","last_change":"2026-02-13T02:18:59.020392+0000","last_active":"2026-02-13T02:19:01.058743+0000","last_peered":"2026-02-13T02:19:01.058743+0000","last_clean":"2026-02-13T02:19:01.058743+0000","last_became_active":"2026-02-13T02:18:59.019982+0000","last_became_peered":"2026-02-13T02:18:59.019982+0000","last_unstale":"2026-02-13T02:19:01.058743+0000","last_undegraded":"2026-02-13T02:19:01.058743+0000","last_fullsized":"2026-02-13T02:19:01.058743+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:05:17.845797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.023147+0000","last_change":"2026-02-13T02:18:59.020196+0000","last_active":"2026-02-13T02:19:00.023147+0000","last_peered":"2026-02-13T02:19:00.023147+0000","last_clean":"2026-02-13T02:19:00.023147+0000","last_became_active":"2026-02-13T02:18:59.019918+0000","last_became_peered":"2026-02-13T02:18:59.019918+0000","last_unstale":"2026-02-13T02:19:00.023147+0000","last_undegraded":"2026-02-13T02:19:00.023147+0000","last_fullsized":"2026-02-13T02:19:00.023147+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:12:07.357874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.025392+0000","last_change":"2026-02-13T02:18:59.021792+0000","last_active":"2026-02-13T02:19:00.025392+0000","last_peered":"2026-02-13T02:19:00.025392+0000","last_clean":"2026-02-13T02:19:00.025392+0000","last_became_active":"2026-02-13T02:18:59.021490+0000","last_became_peered":"2026-02-13T02:18:59.021490+0000","last_unstale":"2026-02-13T02:19:00.025392+0000","last_undegraded":"2026-02-13T02:19:00.025392+0000","last_fullsized":"2026-02-13T02:19:00.025392+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:25:48.353959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:01.085846+0000","last_change":"2026-02-13T02:18:59.022139+0000","last_active":"2026-02-13T02:19:01.085846+0000","last_peered":"2026-02-13T02:19:01.085846+0000","last_clean":"2026-02-13T02:19:01.085846+0000","last_became_active":"2026-02-13T02:18:59.021874+0000","last_became_peered":"2026-02-13T02:18:59.021874+0000","last_unstale":"2026-02-13T02:19:01.085846+0000","last_undegraded":"2026-02-13T02:19:01.085846+0000","last_fullsized":"2026-02-13T02:19:01.085846+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:57:27.700971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:01.058631+0000","last_change":"2026-02-13T02:18:59.019769+0000","last_active":"2026-02-13T02:19:01.058631+0000","last_peered":"2026-02-13T02:19:01.058631+0000","last_clean":"2026-02-13T02:19:01.058631+0000","last_became_active":"2026-02-13T02:18:59.019582+0000","last_became_peered":"2026-02-13T02:18:59.019582+0000","last_unstale":"2026-02-13T02:19:01.058631+0000","last_undegraded":"2026-02-13T02:19:01.058631+0000","last_fullsized":"2026-02-13T02:19:01.058631+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:53:56.089564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:01.058600+0000","last_change":"2026-02-13T02:18:59.020880+0000","last_active":"2026-02-13T02:19:01.058600+0000","last_peered":"2026-02-13T02:19:01.058600+0000","last_clean":"2026-02-13T02:19:01.058600+0000","last_became_active":"2026-02-13T02:18:59.020558+0000","last_became_peered":"2026-02-13T02:18:59.020558+0000","last_unstale":"2026-02-13T02:19:01.058600+0000","last_undegraded":"2026-02-13T02:19:01.058600+0000","last_fullsized":"2026-02-13T02:19:01.058600+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:02:40.364817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.023030+0000","last_change":"2026-02-13T02:18:59.022093+0000","last_active":"2026-02-13T02:19:00.023030+0000","last_peered":"2026-02-13T02:19:00.023030+0000","last_clean":"2026-02-13T02:19:00.023030+0000","last_became_active":"2026-02-13T02:18:59.021669+0000","last_became_peered":"2026-02-13T02:18:59.021669+0000","last_unstale":"2026-02-13T02:19:00.023030+0000","last_undegraded":"2026-02-13T02:19:00.023030+0000","last_fullsized":"2026-02-13T02:19:00.023030+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:30:30.662498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.269509+0000","last_change":"2026-02-13T02:18:59.021435+0000","last_active":"2026-02-13T02:19:00.269509+0000","last_peered":"2026-02-13T02:19:00.269509+0000","last_clean":"2026-02-13T02:19:00.269509+0000","last_became_active":"2026-02-13T02:18:59.020960+0000","last_became_peered":"2026-02-13T02:18:59.020960+0000","last_unstale":"2026-02-13T02:19:00.269509+0000","last_undegraded":"2026-02-13T02:19:00.269509+0000","last_fullsized":"2026-02-13T02:19:00.269509+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:38:16.139971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"71'5","reported_seq":21,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:02.040455+0000","last_change":"2026-02-13T02:18:58.015175+0000","last_active":"2026-02-13T02:19:02.040455+0000","last_peered":"2026-02-13T02:19:02.040455+0000","last_clean":"2026-02-13T02:19:02.040455+0000","last_became_active":"2026-02-13T02:18:58.014835+0000","last_became_peered":"2026-02-13T02:18:58.014835+0000","last_unstale":"2026-02-13T02:19:02.040455+0000","last_undegraded":"2026-02-13T02:19:02.040455+0000","last_fullsized":"2026-02-13T02:19:02.040455+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:27:53.220446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:01.059509+0000","last_change":"2026-02-13T02:18:59.021246+0000","last_active":"2026-02-13T02:19:01.059509+0000","last_peered":"2026-02-13T02:19:01.059509+0000","last_clean":"2026-02-13T02:19:01.059509+0000","last_became_active":"2026-02-13T02:18:59.020902+0000","last_became_peered":"2026-02-13T02:18:59.020902+0000","last_unstale":"2026-02-13T02:19:01.059509+0000","last_undegraded":"2026-02-13T02:19:01.059509+0000","last_fullsized":"2026-02-13T02:19:01.059509+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:22:04.706073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"71'7","reported_seq":23,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:04.053335+0000","last_change":"2026-02-13T02:18:58.019626+0000","last_active":"2026-02-13T02:19:04.053335+0000","last_peered":"2026-02-13T02:19:04.053335+0000","last_clean":"2026-02-13T02:19:04.053335+0000","last_became_active":"2026-02-13T02:18:58.019415+0000","last_became_peered":"2026-02-13T02:18:58.019415+0000","last_unstale":"2026-02-13T02:19:04.053335+0000","last_undegraded":"2026-02-13T02:19:04.053335+0000","last_fullsized":"2026-02-13T02:19:04.053335+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:33:18.766107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"71'3","reported_seq":19,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:03.045478+0000","last_change":"2026-02-13T02:18:58.017302+0000","last_active":"2026-02-13T02:19:03.045478+0000","last_peered":"2026-02-13T02:19:03.045478+0000","last_clean":"2026-02-13T02:19:03.045478+0000","last_became_active":"2026-02-13T02:18:58.016498+0000","last_became_peered":"2026-02-13T02:18:58.016498+0000","last_unstale":"2026-02-13T02:19:03.045478+0000","last_undegraded":"2026-02-13T02:19:03.045478+0000","last_fullsized":"2026-02-13T02:19:03.045478+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:51:46.201734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026051+0000","last_change":"2026-02-13T02:18:59.021203+0000","last_active":"2026-02-13T02:19:00.026051+0000","last_peered":"2026-02-13T02:19:00.026051+0000","last_clean":"2026-02-13T02:19:00.026051+0000","last_became_active":"2026-02-13T02:18:59.020781+0000","last_became_peered":"2026-02-13T02:18:59.020781+0000","last_unstale":"2026-02-13T02:19:00.026051+0000","last_undegraded":"2026-02-13T02:19:00.026051+0000","last_fullsized":"2026-02-13T02:19:00.026051+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:22:58.765719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"71'2","reported_seq":18,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:02.040064+0000","last_change":"2026-02-13T02:18:58.016151+0000","last_active":"2026-02-13T02:19:02.040064+0000","last_peered":"2026-02-13T02:19:02.040064+0000","last_clean":"2026-02-13T02:19:02.040064+0000","last_became_active":"2026-02-13T02:18:58.015775+0000","last_became_peered":"2026-02-13T02:18:58.015775+0000","last_unstale":"2026-02-13T02:19:02.040064+0000","last_undegraded":"2026-02-13T02:19:02.040064+0000","last_fullsized":"2026-02-13T02:19:02.040064+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:59:25.743829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:01.022817+0000","last_change":"2026-02-13T02:18:59.020334+0000","last_active":"2026-02-13T02:19:01.022817+0000","last_peered":"2026-02-13T02:19:01.022817+0000","last_clean":"2026-02-13T02:19:01.022817+0000","last_became_active":"2026-02-13T02:18:59.020137+0000","last_became_peered":"2026-02-13T02:18:59.020137+0000","last_unstale":"2026-02-13T02:19:01.022817+0000","last_undegraded":"2026-02-13T02:19:01.022817+0000","last_fullsized":"2026-02-13T02:19:01.022817+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:31:43.321951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"71'4","reported_seq":20,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:02.042626+0000","last_change":"2026-02-13T02:18:58.020328+0000","last_active":"2026-02-13T02:19:02.042626+0000","last_peered":"2026-02-13T02:19:02.042626+0000","last_clean":"2026-02-13T02:19:02.042626+0000","last_became_active":"2026-02-13T02:18:58.020172+0000","last_became_peered":"2026-02-13T02:18:58.020172+0000","last_unstale":"2026-02-13T02:19:02.042626+0000","last_undegraded":"2026-02-13T02:19:02.042626+0000","last_fullsized":"2026-02-13T02:19:02.042626+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:38:31.643491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026409+0000","last_change":"2026-02-13T02:18:59.022851+0000","last_active":"2026-02-13T02:19:00.026409+0000","last_peered":"2026-02-13T02:19:00.026409+0000","last_clean":"2026-02-13T02:19:00.026409+0000","last_became_active":"2026-02-13T02:18:59.022669+0000","last_became_peered":"2026-02-13T02:18:59.022669+0000","last_unstale":"2026-02-13T02:19:00.026409+0000","last_undegraded":"2026-02-13T02:19:00.026409+0000","last_fullsized":"2026-02-13T02:19:00.026409+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:51:54.769188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"71'2","reported_seq":18,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:02.042387+0000","last_change":"2026-02-13T02:18:58.018467+0000","last_active":"2026-02-13T02:19:02.042387+0000","last_peered":"2026-02-13T02:19:02.042387+0000","last_clean":"2026-02-13T02:19:02.042387+0000","last_became_active":"2026-02-13T02:18:58.018121+0000","last_became_peered":"2026-02-13T02:18:58.018121+0000","last_unstale":"2026-02-13T02:19:02.042387+0000","last_undegraded":"2026-02-13T02:19:02.042387+0000","last_fullsized":"2026-02-13T02:19:02.042387+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:26:43.250379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:01.086021+0000","last_change":"2026-02-13T02:18:59.022489+0000","last_active":"2026-02-13T02:19:01.086021+0000","last_peered":"2026-02-13T02:19:01.086021+0000","last_clean":"2026-02-13T02:19:01.086021+0000","last_became_active":"2026-02-13T02:18:59.022123+0000","last_became_peered":"2026-02-13T02:18:59.022123+0000","last_unstale":"2026-02-13T02:19:01.086021+0000","last_undegraded":"2026-02-13T02:19:01.086021+0000","last_fullsized":"2026-02-13T02:19:01.086021+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:44:21.124098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"71'5","reported_seq":21,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:02.040214+0000","last_change":"2026-02-13T02:18:58.015339+0000","last_active":"2026-02-13T02:19:02.040214+0000","last_peered":"2026-02-13T02:19:02.040214+0000","last_clean":"2026-02-13T02:19:02.040214+0000","last_became_active":"2026-02-13T02:18:58.015045+0000","last_became_peered":"2026-02-13T02:18:58.015045+0000","last_unstale":"2026-02-13T02:19:02.040214+0000","last_undegraded":"2026-02-13T02:19:02.040214+0000","last_fullsized":"2026-02-13T02:19:02.040214+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:41:53.333544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":694,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026351+0000","last_change":"2026-02-13T02:18:59.024095+0000","last_active":"2026-02-13T02:19:00.026351+0000","last_peered":"2026-02-13T02:19:00.026351+0000","last_clean":"2026-02-13T02:19:00.026351+0000","last_became_active":"2026-02-13T02:18:59.023757+0000","last_became_peered":"2026-02-13T02:18:59.023757+0000","last_unstale":"2026-02-13T02:19:00.026351+0000","last_undegraded":"2026-02-13T02:19:00.026351+0000","last_fullsized":"2026-02-13T02:19:00.026351+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:37:25.170781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"71'18","reported_seq":34,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:05.476309+0000","last_change":"2026-02-13T02:18:58.019442+0000","last_active":"2026-02-13T02:19:05.476309+0000","last_peered":"2026-02-13T02:19:05.476309+0000","last_clean":"2026-02-13T02:19:05.476309+0000","last_became_active":"2026-02-13T02:18:58.019224+0000","last_became_peered":"2026-02-13T02:18:58.019224+0000","last_unstale":"2026-02-13T02:19:05.476309+0000","last_undegraded":"2026-02-13T02:19:05.476309+0000","last_fullsized":"2026-02-13T02:19:05.476309+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:18:16.234056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25594,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.269821+0000","last_change":"2026-02-13T02:18:59.020682+0000","last_active":"2026-02-13T02:19:00.269821+0000","last_peered":"2026-02-13T02:19:00.269821+0000","last_clean":"2026-02-13T02:19:00.269821+0000","last_became_active":"2026-02-13T02:18:59.019992+0000","last_became_peered":"2026-02-13T02:18:59.019992+0000","last_unstale":"2026-02-13T02:19:00.269821+0000","last_undegraded":"2026-02-13T02:19:00.269821+0000","last_fullsized":"2026-02-13T02:19:00.269821+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:26:25.490570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"71'6","reported_seq":22,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:03.043736+0000","last_change":"2026-02-13T02:18:58.017003+0000","last_active":"2026-02-13T02:19:03.043736+0000","last_peered":"2026-02-13T02:19:03.043736+0000","last_clean":"2026-02-13T02:19:03.043736+0000","last_became_active":"2026-02-13T02:18:58.016821+0000","last_became_peered":"2026-02-13T02:18:58.016821+0000","last_unstale":"2026-02-13T02:19:03.043736+0000","last_undegraded":"2026-02-13T02:19:03.043736+0000","last_fullsized":"2026-02-13T02:19:03.043736+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:52:59.197342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.025359+0000","last_change":"2026-02-13T02:18:59.022587+0000","last_active":"2026-02-13T02:19:00.025359+0000","last_peered":"2026-02-13T02:19:00.025359+0000","last_clean":"2026-02-13T02:19:00.025359+0000","last_became_active":"2026-02-13T02:18:59.021700+0000","last_became_peered":"2026-02-13T02:18:59.021700+0000","last_unstale":"2026-02-13T02:19:00.025359+0000","last_undegraded":"2026-02-13T02:19:00.025359+0000","last_fullsized":"2026-02-13T02:19:00.025359+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:25:36.714629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"71'4","reported_seq":20,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:02.040426+0000","last_change":"2026-02-13T02:18:58.016995+0000","last_active":"2026-02-13T02:19:02.040426+0000","last_peered":"2026-02-13T02:19:02.040426+0000","last_clean":"2026-02-13T02:19:02.040426+0000","last_became_active":"2026-02-13T02:18:58.016790+0000","last_became_peered":"2026-02-13T02:18:58.016790+0000","last_unstale":"2026-02-13T02:19:02.040426+0000","last_undegraded":"2026-02-13T02:19:02.040426+0000","last_fullsized":"2026-02-13T02:19:02.040426+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:16:22.317768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026344+0000","last_change":"2026-02-13T02:18:59.023842+0000","last_active":"2026-02-13T02:19:00.026344+0000","last_peered":"2026-02-13T02:19:00.026344+0000","last_clean":"2026-02-13T02:19:00.026344+0000","last_became_active":"2026-02-13T02:18:59.023100+0000","last_became_peered":"2026-02-13T02:18:59.023100+0000","last_unstale":"2026-02-13T02:19:00.026344+0000","last_undegraded":"2026-02-13T02:19:00.026344+0000","last_fullsized":"2026-02-13T02:19:00.026344+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:49:06.786362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.397793+0000","last_change":"2026-02-13T02:18:58.016750+0000","last_active":"2026-02-13T02:19:00.397793+0000","last_peered":"2026-02-13T02:19:00.397793+0000","last_clean":"2026-02-13T02:19:00.397793+0000","last_became_active":"2026-02-13T02:18:58.016568+0000","last_became_peered":"2026-02-13T02:18:58.016568+0000","last_unstale":"2026-02-13T02:19:00.397793+0000","last_undegraded":"2026-02-13T02:19:00.397793+0000","last_fullsized":"2026-02-13T02:19:00.397793+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:30:56.973436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026083+0000","last_change":"2026-02-13T02:18:59.023967+0000","last_active":"2026-02-13T02:19:00.026083+0000","last_peered":"2026-02-13T02:19:00.026083+0000","last_clean":"2026-02-13T02:19:00.026083+0000","last_became_active":"2026-02-13T02:18:59.023488+0000","last_became_peered":"2026-02-13T02:18:59.023488+0000","last_unstale":"2026-02-13T02:19:00.026083+0000","last_undegraded":"2026-02-13T02:19:00.026083+0000","last_fullsized":"2026-02-13T02:19:00.026083+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:22:22.901773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"71'17","reported_seq":34,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:05.056052+0000","last_change":"2026-02-13T02:18:58.017311+0000","last_active":"2026-02-13T02:19:05.056052+0000","last_peered":"2026-02-13T02:19:05.056052+0000","last_clean":"2026-02-13T02:19:05.056052+0000","last_became_active":"2026-02-13T02:18:58.016759+0000","last_became_peered":"2026-02-13T02:18:58.016759+0000","last_unstale":"2026-02-13T02:19:05.056052+0000","last_undegraded":"2026-02-13T02:19:05.056052+0000","last_fullsized":"2026-02-13T02:19:05.056052+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:56:39.432654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:01.059526+0000","last_change":"2026-02-13T02:18:59.021764+0000","last_active":"2026-02-13T02:19:01.059526+0000","last_peered":"2026-02-13T02:19:01.059526+0000","last_clean":"2026-02-13T02:19:01.059526+0000","last_became_active":"2026-02-13T02:18:59.021364+0000","last_became_peered":"2026-02-13T02:18:59.021364+0000","last_unstale":"2026-02-13T02:19:01.059526+0000","last_undegraded":"2026-02-13T02:19:01.059526+0000","last_fullsized":"2026-02-13T02:19:01.059526+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:13:00.776080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"71'2","reported_seq":19,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:05.042750+0000","last_change":"2026-02-13T02:18:58.017465+0000","last_active":"2026-02-13T02:19:05.042750+0000","last_peered":"2026-02-13T02:19:05.042750+0000","last_clean":"2026-02-13T02:19:05.042750+0000","last_became_active":"2026-02-13T02:18:58.016957+0000","last_became_peered":"2026-02-13T02:18:58.016957+0000","last_unstale":"2026-02-13T02:19:05.042750+0000","last_undegraded":"2026-02-13T02:19:05.042750+0000","last_fullsized":"2026-02-13T02:19:05.042750+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:17:33.831136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.022946+0000","last_change":"2026-02-13T02:18:59.020929+0000","last_active":"2026-02-13T02:19:00.022946+0000","last_peered":"2026-02-13T02:19:00.022946+0000","last_clean":"2026-02-13T02:19:00.022946+0000","last_became_active":"2026-02-13T02:18:59.020519+0000","last_became_peered":"2026-02-13T02:18:59.020519+0000","last_unstale":"2026-02-13T02:19:00.022946+0000","last_undegraded":"2026-02-13T02:19:00.022946+0000","last_fullsized":"2026-02-13T02:19:00.022946+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:46:07.242524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"71'5","reported_seq":21,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:05.057217+0000","last_change":"2026-02-13T02:18:58.017516+0000","last_active":"2026-02-13T02:19:05.057217+0000","last_peered":"2026-02-13T02:19:05.057217+0000","last_clean":"2026-02-13T02:19:05.057217+0000","last_became_active":"2026-02-13T02:18:58.017217+0000","last_became_peered":"2026-02-13T02:18:58.017217+0000","last_unstale":"2026-02-13T02:19:05.057217+0000","last_undegraded":"2026-02-13T02:19:05.057217+0000","last_fullsized":"2026-02-13T02:19:05.057217+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:02:32.458073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026497+0000","last_change":"2026-02-13T02:18:59.022648+0000","last_active":"2026-02-13T02:19:00.026497+0000","last_peered":"2026-02-13T02:19:00.026497+0000","last_clean":"2026-02-13T02:19:00.026497+0000","last_became_active":"2026-02-13T02:18:59.022416+0000","last_became_peered":"2026-02-13T02:18:59.022416+0000","last_unstale":"2026-02-13T02:19:00.026497+0000","last_undegraded":"2026-02-13T02:19:00.026497+0000","last_fullsized":"2026-02-13T02:19:00.026497+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:27:43.916972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"71'2","reported_seq":18,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:01.060019+0000","last_change":"2026-02-13T02:18:58.016793+0000","last_active":"2026-02-13T02:19:01.060019+0000","last_peered":"2026-02-13T02:19:01.060019+0000","last_clean":"2026-02-13T02:19:01.060019+0000","last_became_active":"2026-02-13T02:18:58.016440+0000","last_became_peered":"2026-02-13T02:18:58.016440+0000","last_unstale":"2026-02-13T02:19:01.060019+0000","last_undegraded":"2026-02-13T02:19:01.060019+0000","last_fullsized":"2026-02-13T02:19:01.060019+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:50:19.963252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026243+0000","last_change":"2026-02-13T02:18:59.024040+0000","last_active":"2026-02-13T02:19:00.026243+0000","last_peered":"2026-02-13T02:19:00.026243+0000","last_clean":"2026-02-13T02:19:00.026243+0000","last_became_active":"2026-02-13T02:18:59.023539+0000","last_became_peered":"2026-02-13T02:18:59.023539+0000","last_unstale":"2026-02-13T02:19:00.026243+0000","last_undegraded":"2026-02-13T02:19:00.026243+0000","last_fullsized":"2026-02-13T02:19:00.026243+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:04:33.603294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"71'3","reported_seq":19,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:03.044265+0000","last_change":"2026-02-13T02:18:58.015927+0000","last_active":"2026-02-13T02:19:03.044265+0000","last_peered":"2026-02-13T02:19:03.044265+0000","last_clean":"2026-02-13T02:19:03.044265+0000","last_became_active":"2026-02-13T02:18:58.015746+0000","last_became_peered":"2026-02-13T02:18:58.015746+0000","last_unstale":"2026-02-13T02:19:03.044265+0000","last_undegraded":"2026-02-13T02:19:03.044265+0000","last_fullsized":"2026-02-13T02:19:03.044265+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:25:54.397951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026442+0000","last_change":"2026-02-13T02:18:59.025074+0000","last_active":"2026-02-13T02:19:00.026442+0000","last_peered":"2026-02-13T02:19:00.026442+0000","last_clean":"2026-02-13T02:19:00.026442+0000","last_became_active":"2026-02-13T02:18:59.024633+0000","last_became_peered":"2026-02-13T02:18:59.024633+0000","last_unstale":"2026-02-13T02:19:00.026442+0000","last_undegraded":"2026-02-13T02:19:00.026442+0000","last_fullsized":"2026-02-13T02:19:00.026442+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:39:45.349715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'152","reported_seq":337,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026105+0000","last_change":"2026-02-13T02:18:39.248696+0000","last_active":"2026-02-13T02:19:00.026105+0000","last_peered":"2026-02-13T02:19:00.026105+0000","last_clean":"2026-02-13T02:19:00.026105+0000","last_became_active":"2026-02-13T02:18:39.248579+0000","last_became_peered":"2026-02-13T02:18:39.248579+0000","last_unstale":"2026-02-13T02:19:00.026105+0000","last_undegraded":"2026-02-13T02:19:00.026105+0000","last_fullsized":"2026-02-13T02:19:00.026105+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:17:40.238745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:17:40.238745+0000","last_clean_scrub_stamp":"2026-02-13T02:17:40.238745+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:50:58.102014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"71'2","reported_seq":18,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:02.042416+0000","last_change":"2026-02-13T02:18:58.017400+0000","last_active":"2026-02-13T02:19:02.042416+0000","last_peered":"2026-02-13T02:19:02.042416+0000","last_clean":"2026-02-13T02:19:02.042416+0000","last_became_active":"2026-02-13T02:18:58.017073+0000","last_became_peered":"2026-02-13T02:18:58.017073+0000","last_unstale":"2026-02-13T02:19:02.042416+0000","last_undegraded":"2026-02-13T02:19:02.042416+0000","last_fullsized":"2026-02-13T02:19:02.042416+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:07:32.354072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026155+0000","last_change":"2026-02-13T02:18:59.022794+0000","last_active":"2026-02-13T02:19:00.026155+0000","last_peered":"2026-02-13T02:19:00.026155+0000","last_clean":"2026-02-13T02:19:00.026155+0000","last_became_active":"2026-02-13T02:18:59.022108+0000","last_became_peered":"2026-02-13T02:18:59.022108+0000","last_unstale":"2026-02-13T02:19:00.026155+0000","last_undegraded":"2026-02-13T02:19:00.026155+0000","last_fullsized":"2026-02-13T02:19:00.026155+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:22:15.433204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"71'3","reported_seq":19,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:03.046655+0000","last_change":"2026-02-13T02:18:58.018751+0000","last_active":"2026-02-13T02:19:03.046655+0000","last_peered":"2026-02-13T02:19:03.046655+0000","last_clean":"2026-02-13T02:19:03.046655+0000","last_became_active":"2026-02-13T02:18:58.018516+0000","last_became_peered":"2026-02-13T02:18:58.018516+0000","last_unstale":"2026-02-13T02:19:03.046655+0000","last_undegraded":"2026-02-13T02:19:03.046655+0000","last_fullsized":"2026-02-13T02:19:03.046655+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:20:45.263014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.025233+0000","last_change":"2026-02-13T02:18:59.023047+0000","last_active":"2026-02-13T02:19:00.025233+0000","last_peered":"2026-02-13T02:19:00.025233+0000","last_clean":"2026-02-13T02:19:00.025233+0000","last_became_active":"2026-02-13T02:18:59.022759+0000","last_became_peered":"2026-02-13T02:18:59.022759+0000","last_unstale":"2026-02-13T02:19:00.025233+0000","last_undegraded":"2026-02-13T02:19:00.025233+0000","last_fullsized":"2026-02-13T02:19:00.025233+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:41:05.253744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"71'5","reported_seq":23,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:06.066051+0000","last_change":"2026-02-13T02:18:58.017745+0000","last_active":"2026-02-13T02:19:06.066051+0000","last_peered":"2026-02-13T02:19:06.066051+0000","last_clean":"2026-02-13T02:19:06.066051+0000","last_became_active":"2026-02-13T02:18:58.017075+0000","last_became_peered":"2026-02-13T02:18:58.017075+0000","last_unstale":"2026-02-13T02:19:06.066051+0000","last_undegraded":"2026-02-13T02:19:06.066051+0000","last_fullsized":"2026-02-13T02:19:06.066051+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:30:40.480682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:01.059608+0000","last_change":"2026-02-13T02:18:59.020766+0000","last_active":"2026-02-13T02:19:01.059608+0000","last_peered":"2026-02-13T02:19:01.059608+0000","last_clean":"2026-02-13T02:19:01.059608+0000","last_became_active":"2026-02-13T02:18:59.020423+0000","last_became_peered":"2026-02-13T02:18:59.020423+0000","last_unstale":"2026-02-13T02:19:01.059608+0000","last_undegraded":"2026-02-13T02:19:01.059608+0000","last_fullsized":"2026-02-13T02:19:01.059608+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:28:14.129049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"71'1","reported_seq":17,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026268+0000","last_change":"2026-02-13T02:18:58.018774+0000","last_active":"2026-02-13T02:19:00.026268+0000","last_peered":"2026-02-13T02:19:00.026268+0000","last_clean":"2026-02-13T02:19:00.026268+0000","last_became_active":"2026-02-13T02:18:58.018494+0000","last_became_peered":"2026-02-13T02:18:58.018494+0000","last_unstale":"2026-02-13T02:19:00.026268+0000","last_undegraded":"2026-02-13T02:19:00.026268+0000","last_fullsized":"2026-02-13T02:19:00.026268+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:54:08.283495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026508+0000","last_change":"2026-02-13T02:18:59.024900+0000","last_active":"2026-02-13T02:19:00.026508+0000","last_peered":"2026-02-13T02:19:00.026508+0000","last_clean":"2026-02-13T02:19:00.026508+0000","last_became_active":"2026-02-13T02:18:59.024012+0000","last_became_peered":"2026-02-13T02:18:59.024012+0000","last_unstale":"2026-02-13T02:19:00.026508+0000","last_undegraded":"2026-02-13T02:19:00.026508+0000","last_fullsized":"2026-02-13T02:19:00.026508+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:30:24.252966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:01.022695+0000","last_change":"2026-02-13T02:18:58.018004+0000","last_active":"2026-02-13T02:19:01.022695+0000","last_peered":"2026-02-13T02:19:01.022695+0000","last_clean":"2026-02-13T02:19:01.022695+0000","last_became_active":"2026-02-13T02:18:58.017319+0000","last_became_peered":"2026-02-13T02:18:58.017319+0000","last_unstale":"2026-02-13T02:19:01.022695+0000","last_undegraded":"2026-02-13T02:19:01.022695+0000","last_fullsized":"2026-02-13T02:19:01.022695+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:26:29.965359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"71'1","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:01.037590+0000","last_change":"2026-02-13T02:18:59.025358+0000","last_active":"2026-02-13T02:19:01.037590+0000","last_peered":"2026-02-13T02:19:01.037590+0000","last_clean":"2026-02-13T02:19:01.037590+0000","last_became_active":"2026-02-13T02:18:59.024743+0000","last_became_peered":"2026-02-13T02:18:59.024743+0000","last_unstale":"2026-02-13T02:19:01.037590+0000","last_undegraded":"2026-02-13T02:19:01.037590+0000","last_fullsized":"2026-02-13T02:19:01.037590+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:05:43.480846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"71'4","reported_seq":21,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:05.056604+0000","last_change":"2026-02-13T02:18:58.017585+0000","last_active":"2026-02-13T02:19:05.056604+0000","last_peered":"2026-02-13T02:19:05.056604+0000","last_clean":"2026-02-13T02:19:05.056604+0000","last_became_active":"2026-02-13T02:18:58.017323+0000","last_became_peered":"2026-02-13T02:18:58.017323+0000","last_unstale":"2026-02-13T02:19:05.056604+0000","last_undegraded":"2026-02-13T02:19:05.056604+0000","last_fullsized":"2026-02-13T02:19:05.056604+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:25:25.624809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.025394+0000","last_change":"2026-02-13T02:18:59.020945+0000","last_active":"2026-02-13T02:19:00.025394+0000","last_peered":"2026-02-13T02:19:00.025394+0000","last_clean":"2026-02-13T02:19:00.025394+0000","last_became_active":"2026-02-13T02:18:59.020719+0000","last_became_peered":"2026-02-13T02:18:59.020719+0000","last_unstale":"2026-02-13T02:19:00.025394+0000","last_undegraded":"2026-02-13T02:19:00.025394+0000","last_fullsized":"2026-02-13T02:19:00.025394+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:13:20.283266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"71'3","reported_seq":19,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:03.044867+0000","last_change":"2026-02-13T02:18:58.018055+0000","last_active":"2026-02-13T02:19:03.044867+0000","last_peered":"2026-02-13T02:19:03.044867+0000","last_clean":"2026-02-13T02:19:03.044867+0000","last_became_active":"2026-02-13T02:18:58.017824+0000","last_became_peered":"2026-02-13T02:18:58.017824+0000","last_unstale":"2026-02-13T02:19:03.044867+0000","last_undegraded":"2026-02-13T02:19:03.044867+0000","last_fullsized":"2026-02-13T02:19:03.044867+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:00:19.476969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026322+0000","last_change":"2026-02-13T02:18:59.021532+0000","last_active":"2026-02-13T02:19:00.026322+0000","last_peered":"2026-02-13T02:19:00.026322+0000","last_clean":"2026-02-13T02:19:00.026322+0000","last_became_active":"2026-02-13T02:18:59.020792+0000","last_became_peered":"2026-02-13T02:18:59.020792+0000","last_unstale":"2026-02-13T02:19:00.026322+0000","last_undegraded":"2026-02-13T02:19:00.026322+0000","last_fullsized":"2026-02-13T02:19:00.026322+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:55:45.772056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"71'4","reported_seq":20,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:02.042382+0000","last_change":"2026-02-13T02:18:58.017322+0000","last_active":"2026-02-13T02:19:02.042382+0000","last_peered":"2026-02-13T02:19:02.042382+0000","last_clean":"2026-02-13T02:19:02.042382+0000","last_became_active":"2026-02-13T02:18:58.017078+0000","last_became_peered":"2026-02-13T02:18:58.017078+0000","last_unstale":"2026-02-13T02:19:02.042382+0000","last_undegraded":"2026-02-13T02:19:02.042382+0000","last_fullsized":"2026-02-13T02:19:02.042382+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:38:36.066817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:01.085941+0000","last_change":"2026-02-13T02:18:59.023478+0000","last_active":"2026-02-13T02:19:01.085941+0000","last_peered":"2026-02-13T02:19:01.085941+0000","last_clean":"2026-02-13T02:19:01.085941+0000","last_became_active":"2026-02-13T02:18:59.023251+0000","last_became_peered":"2026-02-13T02:18:59.023251+0000","last_unstale":"2026-02-13T02:19:01.085941+0000","last_undegraded":"2026-02-13T02:19:01.085941+0000","last_fullsized":"2026-02-13T02:19:01.085941+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:46:43.414532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"71'2","reported_seq":18,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:02.042384+0000","last_change":"2026-02-13T02:18:58.018029+0000","last_active":"2026-02-13T02:19:02.042384+0000","last_peered":"2026-02-13T02:19:02.042384+0000","last_clean":"2026-02-13T02:19:02.042384+0000","last_became_active":"2026-02-13T02:18:58.017853+0000","last_became_peered":"2026-02-13T02:18:58.017853+0000","last_unstale":"2026-02-13T02:19:02.042384+0000","last_undegraded":"2026-02-13T02:19:02.042384+0000","last_fullsized":"2026-02-13T02:19:02.042384+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:42:13.248907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.269489+0000","last_change":"2026-02-13T02:18:59.021333+0000","last_active":"2026-02-13T02:19:00.269489+0000","last_peered":"2026-02-13T02:19:00.269489+0000","last_clean":"2026-02-13T02:19:00.269489+0000","last_became_active":"2026-02-13T02:18:59.020957+0000","last_became_peered":"2026-02-13T02:18:59.020957+0000","last_unstale":"2026-02-13T02:19:00.269489+0000","last_undegraded":"2026-02-13T02:19:00.269489+0000","last_fullsized":"2026-02-13T02:19:00.269489+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:03:43.534623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"71'7","reported_seq":23,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:05.057144+0000","last_change":"2026-02-13T02:18:58.018621+0000","last_active":"2026-02-13T02:19:05.057144+0000","last_peered":"2026-02-13T02:19:05.057144+0000","last_clean":"2026-02-13T02:19:05.057144+0000","last_became_active":"2026-02-13T02:18:58.018470+0000","last_became_peered":"2026-02-13T02:18:58.018470+0000","last_unstale":"2026-02-13T02:19:05.057144+0000","last_undegraded":"2026-02-13T02:19:05.057144+0000","last_fullsized":"2026-02-13T02:19:05.057144+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:23:51.053480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.023004+0000","last_change":"2026-02-13T02:18:59.020330+0000","last_active":"2026-02-13T02:19:00.023004+0000","last_peered":"2026-02-13T02:19:00.023004+0000","last_clean":"2026-02-13T02:19:00.023004+0000","last_became_active":"2026-02-13T02:18:59.020032+0000","last_became_peered":"2026-02-13T02:18:59.020032+0000","last_unstale":"2026-02-13T02:19:00.023004+0000","last_undegraded":"2026-02-13T02:19:00.023004+0000","last_fullsized":"2026-02-13T02:19:00.023004+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:53:04.758527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:01.058538+0000","last_change":"2026-02-13T02:18:58.017473+0000","last_active":"2026-02-13T02:19:01.058538+0000","last_peered":"2026-02-13T02:19:01.058538+0000","last_clean":"2026-02-13T02:19:01.058538+0000","last_became_active":"2026-02-13T02:18:58.017315+0000","last_became_peered":"2026-02-13T02:18:58.017315+0000","last_unstale":"2026-02-13T02:19:01.058538+0000","last_undegraded":"2026-02-13T02:19:01.058538+0000","last_fullsized":"2026-02-13T02:19:01.058538+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:25:15.481559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026238+0000","last_change":"2026-02-13T02:18:59.023576+0000","last_active":"2026-02-13T02:19:00.026238+0000","last_peered":"2026-02-13T02:19:00.026238+0000","last_clean":"2026-02-13T02:19:00.026238+0000","last_became_active":"2026-02-13T02:18:59.022528+0000","last_became_peered":"2026-02-13T02:18:59.022528+0000","last_unstale":"2026-02-13T02:19:00.026238+0000","last_undegraded":"2026-02-13T02:19:00.026238+0000","last_fullsized":"2026-02-13T02:19:00.026238+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:14:20.280447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"71'4","reported_seq":21,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:02.040196+0000","last_change":"2026-02-13T02:18:58.017265+0000","last_active":"2026-02-13T02:19:02.040196+0000","last_peered":"2026-02-13T02:19:02.040196+0000","last_clean":"2026-02-13T02:19:02.040196+0000","last_became_active":"2026-02-13T02:18:58.016951+0000","last_became_peered":"2026-02-13T02:18:58.016951+0000","last_unstale":"2026-02-13T02:19:02.040196+0000","last_undegraded":"2026-02-13T02:19:02.040196+0000","last_fullsized":"2026-02-13T02:19:02.040196+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:50:01.682853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026205+0000","last_change":"2026-02-13T02:18:59.022425+0000","last_active":"2026-02-13T02:19:00.026205+0000","last_peered":"2026-02-13T02:19:00.026205+0000","last_clean":"2026-02-13T02:19:00.026205+0000","last_became_active":"2026-02-13T02:18:59.022229+0000","last_became_peered":"2026-02-13T02:18:59.022229+0000","last_unstale":"2026-02-13T02:19:00.026205+0000","last_undegraded":"2026-02-13T02:19:00.026205+0000","last_fullsized":"2026-02-13T02:19:00.026205+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:46:02.938928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:01.059766+0000","last_change":"2026-02-13T02:18:59.022165+0000","last_active":"2026-02-13T02:19:01.059766+0000","last_peered":"2026-02-13T02:19:01.059766+0000","last_clean":"2026-02-13T02:19:01.059766+0000","last_became_active":"2026-02-13T02:18:59.021833+0000","last_became_peered":"2026-02-13T02:18:59.021833+0000","last_unstale":"2026-02-13T02:19:01.059766+0000","last_undegraded":"2026-02-13T02:19:01.059766+0000","last_fullsized":"2026-02-13T02:19:01.059766+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:37:51.478861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"71'5","reported_seq":22,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:05.056744+0000","last_change":"2026-02-13T02:18:58.016572+0000","last_active":"2026-02-13T02:19:05.056744+0000","last_peered":"2026-02-13T02:19:05.056744+0000","last_clean":"2026-02-13T02:19:05.056744+0000","last_became_active":"2026-02-13T02:18:58.016013+0000","last_became_peered":"2026-02-13T02:18:58.016013+0000","last_unstale":"2026-02-13T02:19:05.056744+0000","last_undegraded":"2026-02-13T02:19:05.056744+0000","last_fullsized":"2026-02-13T02:19:05.056744+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:07:58.232144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026287+0000","last_change":"2026-02-13T02:18:59.022737+0000","last_active":"2026-02-13T02:19:00.026287+0000","last_peered":"2026-02-13T02:19:00.026287+0000","last_clean":"2026-02-13T02:19:00.026287+0000","last_became_active":"2026-02-13T02:18:59.022601+0000","last_became_peered":"2026-02-13T02:18:59.022601+0000","last_unstale":"2026-02-13T02:19:00.026287+0000","last_undegraded":"2026-02-13T02:19:00.026287+0000","last_fullsized":"2026-02-13T02:19:00.026287+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:08:39.591613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"71'11","reported_seq":28,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:05.056881+0000","last_change":"2026-02-13T02:18:58.016288+0000","last_active":"2026-02-13T02:19:05.056881+0000","last_peered":"2026-02-13T02:19:05.056881+0000","last_clean":"2026-02-13T02:19:05.056881+0000","last_became_active":"2026-02-13T02:18:58.015859+0000","last_became_peered":"2026-02-13T02:18:58.015859+0000","last_unstale":"2026-02-13T02:19:05.056881+0000","last_undegraded":"2026-02-13T02:19:05.056881+0000","last_fullsized":"2026-02-13T02:19:05.056881+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:23:12.911321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":15,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:01.085995+0000","last_change":"2026-02-13T02:18:59.022151+0000","last_active":"2026-02-13T02:19:01.085995+0000","last_peered":"2026-02-13T02:19:01.085995+0000","last_clean":"2026-02-13T02:19:01.085995+0000","last_became_active":"2026-02-13T02:18:59.021969+0000","last_became_peered":"2026-02-13T02:18:59.021969+0000","last_unstale":"2026-02-13T02:19:01.085995+0000","last_undegraded":"2026-02-13T02:19:01.085995+0000","last_fullsized":"2026-02-13T02:19:01.085995+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:58:12.160164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"71'2","reported_seq":18,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.545301+0000","last_change":"2026-02-13T02:18:58.018388+0000","last_active":"2026-02-13T02:19:00.545301+0000","last_peered":"2026-02-13T02:19:00.545301+0000","last_clean":"2026-02-13T02:19:00.545301+0000","last_became_active":"2026-02-13T02:18:58.018186+0000","last_became_peered":"2026-02-13T02:18:58.018186+0000","last_unstale":"2026-02-13T02:19:00.545301+0000","last_undegraded":"2026-02-13T02:19:00.545301+0000","last_fullsized":"2026-02-13T02:19:00.545301+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:26:19.032391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026257+0000","last_change":"2026-02-13T02:18:59.021699+0000","last_active":"2026-02-13T02:19:00.026257+0000","last_peered":"2026-02-13T02:19:00.026257+0000","last_clean":"2026-02-13T02:19:00.026257+0000","last_became_active":"2026-02-13T02:18:59.021479+0000","last_became_peered":"2026-02-13T02:18:59.021479+0000","last_unstale":"2026-02-13T02:19:00.026257+0000","last_undegraded":"2026-02-13T02:19:00.026257+0000","last_fullsized":"2026-02-13T02:19:00.026257+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:26:34.039117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"71'9","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:03.045511+0000","last_change":"2026-02-13T02:18:58.017925+0000","last_active":"2026-02-13T02:19:03.045511+0000","last_peered":"2026-02-13T02:19:03.045511+0000","last_clean":"2026-02-13T02:19:03.045511+0000","last_became_active":"2026-02-13T02:18:58.017527+0000","last_became_peered":"2026-02-13T02:18:58.017527+0000","last_unstale":"2026-02-13T02:19:03.045511+0000","last_undegraded":"2026-02-13T02:19:03.045511+0000","last_fullsized":"2026-02-13T02:19:03.045511+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:30:09.132332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":30148,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":173,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":360448,"data_stored":67938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":150662,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":66,"seq":283467841542,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27704,"kb_used_data":740,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":733975496,"statfs":{"total":751619276800,"available":751590907904,"internally_reserved":0,"allocated":757760,"data_stored":364103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8793,"internal_metadata":27581863},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":59,"seq":253403070471,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28368,"kb_used_data":1404,"kb_used_omap":34,"kb_used_meta":26909,"kb_avail":733974832,"statfs":{"total":751619276800,"available":751590227968,"internally_reserved":0,"allocated":1437696,"data_stored":982350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":35780,"internal_metadata":27554876},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":56,"seq":240518168585,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27724,"kb_used_data":760,"kb_used_omap":21,"kb_used_meta":26922,"kb_avail":733975476,"statfs":{"total":751619276800,"available":751590887424,"internally_reserved":0,"allocated":778240,"data_stored":364943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21846,"internal_metadata":27568810},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":49,"seq":210453397515,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27736,"kb_used_data":772,"kb_used_omap":33,"kb_used_meta":26910,"kb_avail":733975464,"statfs":{"total":751619276800,"available":751590875136,"internally_reserved":0,"allocated":790528,"data_stored":365647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":34036,"internal_metadata":27556620},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":42,"seq":180388626443,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28300,"kb_used_data":1336,"kb_used_omap":31,"kb_used_meta":26912,"kb_avail":733974900,"statfs":{"total":751619276800,"available":751590297600,"internally_reserved":0,"allocated":1368064,"data_stored":956285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":32556,"internal_metadata":27558100},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":39,"seq":167503724558,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27724,"kb_used_data":760,"kb_used_omap":22,"kb_used_meta":26921,"kb_avail":733975476,"statfs":{"total":751619276800,"available":751590887424,"internally_reserved":0,"allocated":778240,"data_stored":364942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22674,"internal_metadata":27567982},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":32,"seq":137438953487,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28312,"kb_used_data":1348,"kb_used_omap":22,"kb_used_meta":26921,"kb_avail":733974888,"statfs":{"total":751619276800,"available":751590285312,"internally_reserved":0,"allocated":1380352,"data_stored":955969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23338,"internal_metadata":27567318},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":28,"seq":120259084304,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27708,"kb_used_data":744,"kb_used_omap":38,"kb_used_meta":26905,"kb_avail":733975492,"statfs":{"total":751619276800,"available":751590903808,"internally_reserved":0,"allocated":761856,"data_stored":364125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":38976,"internal_metadata":27551680},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":21,"seq":90194313234,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27732,"kb_used_data":768,"kb_used_omap":44,"kb_used_meta":26899,"kb_avail":733975468,"statfs":{"total":751619276800,"available":751590879232,"internally_reserved":0,"allocated":786432,"data_stored":364533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":45431,"internal_metadata":27545225},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542163,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27728,"kb_used_data":764,"kb_used_omap":49,"kb_used_meta":26894,"kb_avail":733975472,"statfs":{"total":751619276800,"available":751590883328,"internally_reserved":0,"allocated":782336,"data_stored":366393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":51130,"internal_metadata":27539526},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672980,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27732,"kb_used_data":768,"kb_used_omap":43,"kb_used_meta":26900,"kb_avail":733975468,"statfs":{"total":751619276800,"available":751590879232,"internally_reserved":0,"allocated":786432,"data_stored":374284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":45022,"internal_metadata":27545634},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":7,"seq":30064771093,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27732,"kb_used_data":768,"kb_used_omap":46,"kb_used_meta":26897,"kb_avail":733975468,"statfs":{"total":751619276800,"available":751590879232,"internally_reserved":0,"allocated":786432,"data_stored":365625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47995,"internal_metadata":27542661},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4653,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":27390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3996,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":3006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8445,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25722,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6598,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6900,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10745,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15543,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":33230,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10905,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":27762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20517,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3408,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-13T02:19:07.876 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph pg dump --format=json 2026-02-13T02:19:08.032 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:19:08.148 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.143+0000 7f84b2c006c0 1 -- 10.20.193.11:0/552697183 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f84ac10fbf0 msgr2=0x7f84ac114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:08.149 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.143+0000 7f84b2c006c0 1 --2- 10.20.193.11:0/552697183 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f84ac10fbf0 0x7f84ac114c30 secure :-1 s=READY pgs=245 gs=1 cs=0 l=1 c_cookie=14567793909415189314 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f84940099a0 tx=0x7f849402ed20 comp rx=0 tx=0).stop 2026-02-13T02:19:08.149 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.143+0000 7f84b2c006c0 1 -- 10.20.193.11:0/552697183 shutdown_connections 2026-02-13T02:19:08.149 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.143+0000 7f84b2c006c0 1 --2- 10.20.193.11:0/552697183 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f84ac115410 0x7f84ac175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:08.149 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.143+0000 7f84b2c006c0 1 --2- 10.20.193.11:0/552697183 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f84ac10fbf0 0x7f84ac114c30 unknown :-1 s=CLOSED pgs=245 gs=1 cs=0 l=1 c_cookie=14567793909415189314 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:08.149 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.143+0000 7f84b2c006c0 1 --2- 10.20.193.11:0/552697183 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f84ac10f200 0x7f84ac10f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:08.149 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.143+0000 7f84b2c006c0 1 -- 10.20.193.11:0/552697183 >> 10.20.193.11:0/552697183 conn(0x7f84ac0ecb00 msgr2=0x7f84ac10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:08.149 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.143+0000 7f84b2c006c0 1 -- 10.20.193.11:0/552697183 shutdown_connections 2026-02-13T02:19:08.149 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.143+0000 7f84b2c006c0 1 -- 10.20.193.11:0/552697183 wait complete. 2026-02-13T02:19:08.149 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.144+0000 7f84b2c006c0 1 Processor -- start 2026-02-13T02:19:08.149 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.144+0000 7f84b2c006c0 1 -- start start 2026-02-13T02:19:08.150 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.144+0000 7f84b2c006c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f84ac10f200 0x7f84ac0f4c50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:08.150 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.144+0000 7f84b2c006c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f84ac115410 0x7f84ac175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:08.150 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.144+0000 7f84b2c006c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f84ac0f5280 0x7f84ac0fa550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:08.150 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.144+0000 7f84b2c006c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f84ac0f5970 con 0x7f84ac115410 2026-02-13T02:19:08.150 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.144+0000 7f84b2c006c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f84ac0faa90 con 0x7f84ac0f5280 2026-02-13T02:19:08.150 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.144+0000 7f84b2c006c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f84ac0fac50 con 0x7f84ac10f200 2026-02-13T02:19:08.150 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.144+0000 7f84a3fff6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f84ac115410 0x7f84ac175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:08.150 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.144+0000 7f84a3fff6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f84ac115410 0x7f84ac175cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:49002/0 (socket says 10.20.193.11:49002) 2026-02-13T02:19:08.150 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.144+0000 7f84a3fff6c0 1 -- 10.20.193.11:0/2751778940 learned_addr learned my addr 10.20.193.11:0/2751778940 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:19:08.150 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.144+0000 7f84b11766c0 1 --2- 10.20.193.11:0/2751778940 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f84ac0f5280 0x7f84ac0fa550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:08.150 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.144+0000 7f84a3fff6c0 1 -- 10.20.193.11:0/2751778940 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f84ac10f200 msgr2=0x7f84ac0f4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:08.151 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.144+0000 7f84a3fff6c0 1 --2- 10.20.193.11:0/2751778940 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f84ac10f200 0x7f84ac0f4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:08.151 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.144+0000 7f84a3fff6c0 1 -- 10.20.193.11:0/2751778940 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f84ac0f5280 msgr2=0x7f84ac0fa550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:08.151 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.144+0000 7f84a3fff6c0 1 --2- 10.20.193.11:0/2751778940 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f84ac0f5280 0x7f84ac0fa550 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:08.151 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.144+0000 7f84a3fff6c0 1 -- 10.20.193.11:0/2751778940 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8494009590 con 0x7f84ac115410 2026-02-13T02:19:08.151 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.144+0000 7f84a3fff6c0 1 --2- 10.20.193.11:0/2751778940 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f84ac115410 0x7f84ac175cb0 secure :-1 s=READY pgs=246 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8494031f90 tx=0x7f84940047f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:08.151 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.144+0000 7f84a1ffb6c0 1 -- 10.20.193.11:0/2751778940 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8494002ae0 con 0x7f84ac115410 2026-02-13T02:19:08.151 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.144+0000 7f84a1ffb6c0 1 -- 10.20.193.11:0/2751778940 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f8494002c40 con 0x7f84ac115410 2026-02-13T02:19:08.151 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.144+0000 7f84b2c006c0 1 -- 10.20.193.11:0/2751778940 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84ac0faed0 con 0x7f84ac115410 2026-02-13T02:19:08.151 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.144+0000 7f84a1ffb6c0 1 -- 10.20.193.11:0/2751778940 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f84940312b0 con 0x7f84ac115410 2026-02-13T02:19:08.151 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.144+0000 7f84b2c006c0 1 -- 10.20.193.11:0/2751778940 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84ac0fb3a0 con 0x7f84ac115410 2026-02-13T02:19:08.151 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.145+0000 7f84b2c006c0 1 -- 10.20.193.11:0/2751778940 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84ac1104d0 con 0x7f84ac115410 2026-02-13T02:19:08.151 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.146+0000 7f84a1ffb6c0 1 -- 10.20.193.11:0/2751778940 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7f8494007260 con 0x7f84ac115410 2026-02-13T02:19:08.152 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.146+0000 7f84a1ffb6c0 1 --2- 10.20.193.11:0/2751778940 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f84880b5710 0x7f84880d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:08.152 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.147+0000 7f84b09756c0 1 --2- 10.20.193.11:0/2751778940 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f84880b5710 0x7f84880d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:08.152 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.147+0000 7f84a1ffb6c0 1 -- 10.20.193.11:0/2751778940 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7762+0+0 (secure 0 0 0) 0x7f8494107c80 con 0x7f84ac115410 2026-02-13T02:19:08.152 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.147+0000 7f84b09756c0 1 --2- 10.20.193.11:0/2751778940 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f84880b5710 0x7f84880d5bc0 secure :-1 s=READY pgs=179 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f849c005980 tx=0x7f849c005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:08.152 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.147+0000 7f84a1ffb6c0 1 -- 10.20.193.11:0/2751778940 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f84940ca6a0 con 0x7f84ac115410 2026-02-13T02:19:08.239 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.237+0000 7f84b2c006c0 1 -- 10.20.193.11:0/2751778940 --> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f84ac10fbf0 con 0x7f84880b5710 2026-02-13T02:19:08.241 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.240+0000 7f84a1ffb6c0 1 -- 10.20.193.11:0/2751778940 <== mgr.14116 v2:10.20.193.11:6800/861334768 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258803 (secure 0 0 0) 0x7f84ac10fbf0 con 0x7f84880b5710 2026-02-13T02:19:08.246 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:19:08.247 INFO:teuthology.orchestra.run.trial011.stderr:dumped all 2026-02-13T02:19:08.249 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.242+0000 7f84b2c006c0 1 -- 10.20.193.11:0/2751778940 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f84880b5710 msgr2=0x7f84880d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:08.250 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.242+0000 7f84b2c006c0 1 --2- 10.20.193.11:0/2751778940 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f84880b5710 0x7f84880d5bc0 secure :-1 s=READY pgs=179 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f849c005980 tx=0x7f849c005910 comp rx=0 tx=0).stop 2026-02-13T02:19:08.250 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.242+0000 7f84b2c006c0 1 -- 10.20.193.11:0/2751778940 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f84ac115410 msgr2=0x7f84ac175cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:08.250 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.242+0000 7f84b2c006c0 1 --2- 10.20.193.11:0/2751778940 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f84ac115410 0x7f84ac175cb0 secure :-1 s=READY pgs=246 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8494031f90 tx=0x7f84940047f0 comp rx=0 tx=0).stop 2026-02-13T02:19:08.250 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.242+0000 7f84b2c006c0 1 -- 10.20.193.11:0/2751778940 shutdown_connections 2026-02-13T02:19:08.250 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.242+0000 7f84b2c006c0 1 --2- 10.20.193.11:0/2751778940 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f84880b5710 0x7f84880d5bc0 unknown :-1 s=CLOSED pgs=179 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:08.250 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.242+0000 7f84b2c006c0 1 --2- 10.20.193.11:0/2751778940 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f84ac0f5280 0x7f84ac0fa550 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:08.250 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.242+0000 7f84b2c006c0 1 --2- 10.20.193.11:0/2751778940 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f84ac115410 0x7f84ac175cb0 unknown :-1 s=CLOSED pgs=246 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:08.250 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.242+0000 7f84b2c006c0 1 --2- 10.20.193.11:0/2751778940 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f84ac10f200 0x7f84ac0f4c50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:08.250 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.242+0000 7f84b2c006c0 1 -- 10.20.193.11:0/2751778940 >> 10.20.193.11:0/2751778940 conn(0x7f84ac0ecb00 msgr2=0x7f84ac10d900 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:08.250 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.242+0000 7f84b2c006c0 1 -- 10.20.193.11:0/2751778940 shutdown_connections 2026-02-13T02:19:08.250 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.242+0000 7f84b2c006c0 1 -- 10.20.193.11:0/2751778940 wait complete. 2026-02-13T02:19:08.281 INFO:teuthology.orchestra.run.trial011.stdout:{"pg_ready":true,"pg_map":{"version":188,"stamp":"2026-02-13T02:19:06.946281+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":620633,"num_objects":79,"num_object_clones":0,"num_object_copies":237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":116,"num_read_kb":101,"num_write":363,"num_write_kb":3801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":300,"ondisk_log_size":300,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":284,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":8808038400,"kb_used":334500,"kb_used_data":10932,"kb_used_omap":398,"kb_used_meta":322929,"kb_avail":8807703900,"statfs":{"total":9019431321600,"available":9019088793600,"internally_reserved":0,"allocated":11194368,"data_stored":6189199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":407577,"internal_metadata":330680295},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":30265,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":174,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001850"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.023100+0000","last_change":"2026-02-13T02:18:59.021168+0000","last_active":"2026-02-13T02:19:00.023100+0000","last_peered":"2026-02-13T02:19:00.023100+0000","last_clean":"2026-02-13T02:19:00.023100+0000","last_became_active":"2026-02-13T02:18:59.020969+0000","last_became_peered":"2026-02-13T02:18:59.020969+0000","last_unstale":"2026-02-13T02:19:00.023100+0000","last_undegraded":"2026-02-13T02:19:00.023100+0000","last_fullsized":"2026-02-13T02:19:00.023100+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:15:33.793511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:01.085894+0000","last_change":"2026-02-13T02:18:59.021361+0000","last_active":"2026-02-13T02:19:01.085894+0000","last_peered":"2026-02-13T02:19:01.085894+0000","last_clean":"2026-02-13T02:19:01.085894+0000","last_became_active":"2026-02-13T02:18:59.021114+0000","last_became_peered":"2026-02-13T02:18:59.021114+0000","last_unstale":"2026-02-13T02:19:01.085894+0000","last_undegraded":"2026-02-13T02:19:01.085894+0000","last_fullsized":"2026-02-13T02:19:01.085894+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:17:48.819148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:01.085816+0000","last_change":"2026-02-13T02:18:59.022954+0000","last_active":"2026-02-13T02:19:01.085816+0000","last_peered":"2026-02-13T02:19:01.085816+0000","last_clean":"2026-02-13T02:19:01.085816+0000","last_became_active":"2026-02-13T02:18:59.022582+0000","last_became_peered":"2026-02-13T02:18:59.022582+0000","last_unstale":"2026-02-13T02:19:01.085816+0000","last_undegraded":"2026-02-13T02:19:01.085816+0000","last_fullsized":"2026-02-13T02:19:01.085816+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:34:51.801255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.398301+0000","last_change":"2026-02-13T02:18:59.022389+0000","last_active":"2026-02-13T02:19:00.398301+0000","last_peered":"2026-02-13T02:19:00.398301+0000","last_clean":"2026-02-13T02:19:00.398301+0000","last_became_active":"2026-02-13T02:18:59.022176+0000","last_became_peered":"2026-02-13T02:18:59.022176+0000","last_unstale":"2026-02-13T02:19:00.398301+0000","last_undegraded":"2026-02-13T02:19:00.398301+0000","last_fullsized":"2026-02-13T02:19:00.398301+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:46:51.207583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.269641+0000","last_change":"2026-02-13T02:18:59.021747+0000","last_active":"2026-02-13T02:19:00.269641+0000","last_peered":"2026-02-13T02:19:00.269641+0000","last_clean":"2026-02-13T02:19:00.269641+0000","last_became_active":"2026-02-13T02:18:59.021407+0000","last_became_peered":"2026-02-13T02:18:59.021407+0000","last_unstale":"2026-02-13T02:19:00.269641+0000","last_undegraded":"2026-02-13T02:19:00.269641+0000","last_fullsized":"2026-02-13T02:19:00.269641+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:39:47.768337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026389+0000","last_change":"2026-02-13T02:18:59.022054+0000","last_active":"2026-02-13T02:19:00.026389+0000","last_peered":"2026-02-13T02:19:00.026389+0000","last_clean":"2026-02-13T02:19:00.026389+0000","last_became_active":"2026-02-13T02:18:59.021802+0000","last_became_peered":"2026-02-13T02:18:59.021802+0000","last_unstale":"2026-02-13T02:19:00.026389+0000","last_undegraded":"2026-02-13T02:19:00.026389+0000","last_fullsized":"2026-02-13T02:19:00.026389+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:49:10.152281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026097+0000","last_change":"2026-02-13T02:18:59.023580+0000","last_active":"2026-02-13T02:19:00.026097+0000","last_peered":"2026-02-13T02:19:00.026097+0000","last_clean":"2026-02-13T02:19:00.026097+0000","last_became_active":"2026-02-13T02:18:59.023348+0000","last_became_peered":"2026-02-13T02:18:59.023348+0000","last_unstale":"2026-02-13T02:19:00.026097+0000","last_undegraded":"2026-02-13T02:19:00.026097+0000","last_fullsized":"2026-02-13T02:19:00.026097+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:21:20.473098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.025858+0000","last_change":"2026-02-13T02:18:59.023105+0000","last_active":"2026-02-13T02:19:00.025858+0000","last_peered":"2026-02-13T02:19:00.025858+0000","last_clean":"2026-02-13T02:19:00.025858+0000","last_became_active":"2026-02-13T02:18:59.022960+0000","last_became_peered":"2026-02-13T02:18:59.022960+0000","last_unstale":"2026-02-13T02:19:00.025858+0000","last_undegraded":"2026-02-13T02:19:00.025858+0000","last_fullsized":"2026-02-13T02:19:00.025858+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:04:13.537414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026452+0000","last_change":"2026-02-13T02:18:59.025487+0000","last_active":"2026-02-13T02:19:00.026452+0000","last_peered":"2026-02-13T02:19:00.026452+0000","last_clean":"2026-02-13T02:19:00.026452+0000","last_became_active":"2026-02-13T02:18:59.025162+0000","last_became_peered":"2026-02-13T02:18:59.025162+0000","last_unstale":"2026-02-13T02:19:00.026452+0000","last_undegraded":"2026-02-13T02:19:00.026452+0000","last_fullsized":"2026-02-13T02:19:00.026452+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:02:12.030985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026633+0000","last_change":"2026-02-13T02:18:59.024537+0000","last_active":"2026-02-13T02:19:00.026633+0000","last_peered":"2026-02-13T02:19:00.026633+0000","last_clean":"2026-02-13T02:19:00.026633+0000","last_became_active":"2026-02-13T02:18:59.024265+0000","last_became_peered":"2026-02-13T02:18:59.024265+0000","last_unstale":"2026-02-13T02:19:00.026633+0000","last_undegraded":"2026-02-13T02:19:00.026633+0000","last_fullsized":"2026-02-13T02:19:00.026633+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:34:28.463458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026396+0000","last_change":"2026-02-13T02:18:59.024867+0000","last_active":"2026-02-13T02:19:00.026396+0000","last_peered":"2026-02-13T02:19:00.026396+0000","last_clean":"2026-02-13T02:19:00.026396+0000","last_became_active":"2026-02-13T02:18:59.024696+0000","last_became_peered":"2026-02-13T02:18:59.024696+0000","last_unstale":"2026-02-13T02:19:00.026396+0000","last_undegraded":"2026-02-13T02:19:00.026396+0000","last_fullsized":"2026-02-13T02:19:00.026396+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:09:44.461888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.398342+0000","last_change":"2026-02-13T02:18:59.022594+0000","last_active":"2026-02-13T02:19:00.398342+0000","last_peered":"2026-02-13T02:19:00.398342+0000","last_clean":"2026-02-13T02:19:00.398342+0000","last_became_active":"2026-02-13T02:18:59.022375+0000","last_became_peered":"2026-02-13T02:18:59.022375+0000","last_unstale":"2026-02-13T02:19:00.398342+0000","last_undegraded":"2026-02-13T02:19:00.398342+0000","last_fullsized":"2026-02-13T02:19:00.398342+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:55:59.143677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.025380+0000","last_change":"2026-02-13T02:18:59.023047+0000","last_active":"2026-02-13T02:19:00.025380+0000","last_peered":"2026-02-13T02:19:00.025380+0000","last_clean":"2026-02-13T02:19:00.025380+0000","last_became_active":"2026-02-13T02:18:59.022786+0000","last_became_peered":"2026-02-13T02:18:59.022786+0000","last_unstale":"2026-02-13T02:19:00.025380+0000","last_undegraded":"2026-02-13T02:19:00.025380+0000","last_fullsized":"2026-02-13T02:19:00.025380+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:28:02.421314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:01.085745+0000","last_change":"2026-02-13T02:18:59.022223+0000","last_active":"2026-02-13T02:19:01.085745+0000","last_peered":"2026-02-13T02:19:01.085745+0000","last_clean":"2026-02-13T02:19:01.085745+0000","last_became_active":"2026-02-13T02:18:59.021655+0000","last_became_peered":"2026-02-13T02:18:59.021655+0000","last_unstale":"2026-02-13T02:19:01.085745+0000","last_undegraded":"2026-02-13T02:19:01.085745+0000","last_fullsized":"2026-02-13T02:19:01.085745+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:14:17.871724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:01.085745+0000","last_change":"2026-02-13T02:18:59.022539+0000","last_active":"2026-02-13T02:19:01.085745+0000","last_peered":"2026-02-13T02:19:01.085745+0000","last_clean":"2026-02-13T02:19:01.085745+0000","last_became_active":"2026-02-13T02:18:59.022262+0000","last_became_peered":"2026-02-13T02:18:59.022262+0000","last_unstale":"2026-02-13T02:19:01.085745+0000","last_undegraded":"2026-02-13T02:19:01.085745+0000","last_fullsized":"2026-02-13T02:19:01.085745+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:55:02.955479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026233+0000","last_change":"2026-02-13T02:18:59.024960+0000","last_active":"2026-02-13T02:19:00.026233+0000","last_peered":"2026-02-13T02:19:00.026233+0000","last_clean":"2026-02-13T02:19:00.026233+0000","last_became_active":"2026-02-13T02:18:59.023945+0000","last_became_peered":"2026-02-13T02:18:59.023945+0000","last_unstale":"2026-02-13T02:19:00.026233+0000","last_undegraded":"2026-02-13T02:19:00.026233+0000","last_fullsized":"2026-02-13T02:19:00.026233+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:13:11.195636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.023170+0000","last_change":"2026-02-13T02:18:59.021383+0000","last_active":"2026-02-13T02:19:00.023170+0000","last_peered":"2026-02-13T02:19:00.023170+0000","last_clean":"2026-02-13T02:19:00.023170+0000","last_became_active":"2026-02-13T02:18:59.021225+0000","last_became_peered":"2026-02-13T02:18:59.021225+0000","last_unstale":"2026-02-13T02:19:00.023170+0000","last_undegraded":"2026-02-13T02:19:00.023170+0000","last_fullsized":"2026-02-13T02:19:00.023170+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:26:53.426955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:01.022801+0000","last_change":"2026-02-13T02:18:59.020231+0000","last_active":"2026-02-13T02:19:01.022801+0000","last_peered":"2026-02-13T02:19:01.022801+0000","last_clean":"2026-02-13T02:19:01.022801+0000","last_became_active":"2026-02-13T02:18:59.020054+0000","last_became_peered":"2026-02-13T02:18:59.020054+0000","last_unstale":"2026-02-13T02:19:01.022801+0000","last_undegraded":"2026-02-13T02:19:01.022801+0000","last_fullsized":"2026-02-13T02:19:01.022801+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:32:25.993500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:01.058735+0000","last_change":"2026-02-13T02:18:59.020750+0000","last_active":"2026-02-13T02:19:01.058735+0000","last_peered":"2026-02-13T02:19:01.058735+0000","last_clean":"2026-02-13T02:19:01.058735+0000","last_became_active":"2026-02-13T02:18:59.020321+0000","last_became_peered":"2026-02-13T02:18:59.020321+0000","last_unstale":"2026-02-13T02:19:01.058735+0000","last_undegraded":"2026-02-13T02:19:01.058735+0000","last_fullsized":"2026-02-13T02:19:01.058735+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:58:49.111664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.023065+0000","last_change":"2026-02-13T02:18:59.019826+0000","last_active":"2026-02-13T02:19:00.023065+0000","last_peered":"2026-02-13T02:19:00.023065+0000","last_clean":"2026-02-13T02:19:00.023065+0000","last_became_active":"2026-02-13T02:18:59.019638+0000","last_became_peered":"2026-02-13T02:18:59.019638+0000","last_unstale":"2026-02-13T02:19:00.023065+0000","last_undegraded":"2026-02-13T02:19:00.023065+0000","last_fullsized":"2026-02-13T02:19:00.023065+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:34:29.076454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.025414+0000","last_change":"2026-02-13T02:18:59.021568+0000","last_active":"2026-02-13T02:19:00.025414+0000","last_peered":"2026-02-13T02:19:00.025414+0000","last_clean":"2026-02-13T02:19:00.025414+0000","last_became_active":"2026-02-13T02:18:59.021304+0000","last_became_peered":"2026-02-13T02:18:59.021304+0000","last_unstale":"2026-02-13T02:19:00.025414+0000","last_undegraded":"2026-02-13T02:19:00.025414+0000","last_fullsized":"2026-02-13T02:19:00.025414+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:38:59.142564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026218+0000","last_change":"2026-02-13T02:18:59.024188+0000","last_active":"2026-02-13T02:19:00.026218+0000","last_peered":"2026-02-13T02:19:00.026218+0000","last_clean":"2026-02-13T02:19:00.026218+0000","last_became_active":"2026-02-13T02:18:59.023908+0000","last_became_peered":"2026-02-13T02:18:59.023908+0000","last_unstale":"2026-02-13T02:19:00.026218+0000","last_undegraded":"2026-02-13T02:19:00.026218+0000","last_fullsized":"2026-02-13T02:19:00.026218+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:10:18.045079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.025946+0000","last_change":"2026-02-13T02:18:59.023175+0000","last_active":"2026-02-13T02:19:00.025946+0000","last_peered":"2026-02-13T02:19:00.025946+0000","last_clean":"2026-02-13T02:19:00.025946+0000","last_became_active":"2026-02-13T02:18:59.022967+0000","last_became_peered":"2026-02-13T02:18:59.022967+0000","last_unstale":"2026-02-13T02:19:00.025946+0000","last_undegraded":"2026-02-13T02:19:00.025946+0000","last_fullsized":"2026-02-13T02:19:00.025946+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:52:00.572082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:01.059499+0000","last_change":"2026-02-13T02:18:59.021552+0000","last_active":"2026-02-13T02:19:01.059499+0000","last_peered":"2026-02-13T02:19:01.059499+0000","last_clean":"2026-02-13T02:19:01.059499+0000","last_became_active":"2026-02-13T02:18:59.021213+0000","last_became_peered":"2026-02-13T02:18:59.021213+0000","last_unstale":"2026-02-13T02:19:01.059499+0000","last_undegraded":"2026-02-13T02:19:01.059499+0000","last_fullsized":"2026-02-13T02:19:01.059499+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:10:29.362585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026274+0000","last_change":"2026-02-13T02:18:59.022674+0000","last_active":"2026-02-13T02:19:00.026274+0000","last_peered":"2026-02-13T02:19:00.026274+0000","last_clean":"2026-02-13T02:19:00.026274+0000","last_became_active":"2026-02-13T02:18:59.022325+0000","last_became_peered":"2026-02-13T02:18:59.022325+0000","last_unstale":"2026-02-13T02:19:00.026274+0000","last_undegraded":"2026-02-13T02:19:00.026274+0000","last_fullsized":"2026-02-13T02:19:00.026274+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:31:28.596666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:01.058743+0000","last_change":"2026-02-13T02:18:59.020392+0000","last_active":"2026-02-13T02:19:01.058743+0000","last_peered":"2026-02-13T02:19:01.058743+0000","last_clean":"2026-02-13T02:19:01.058743+0000","last_became_active":"2026-02-13T02:18:59.019982+0000","last_became_peered":"2026-02-13T02:18:59.019982+0000","last_unstale":"2026-02-13T02:19:01.058743+0000","last_undegraded":"2026-02-13T02:19:01.058743+0000","last_fullsized":"2026-02-13T02:19:01.058743+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:05:17.845797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.023147+0000","last_change":"2026-02-13T02:18:59.020196+0000","last_active":"2026-02-13T02:19:00.023147+0000","last_peered":"2026-02-13T02:19:00.023147+0000","last_clean":"2026-02-13T02:19:00.023147+0000","last_became_active":"2026-02-13T02:18:59.019918+0000","last_became_peered":"2026-02-13T02:18:59.019918+0000","last_unstale":"2026-02-13T02:19:00.023147+0000","last_undegraded":"2026-02-13T02:19:00.023147+0000","last_fullsized":"2026-02-13T02:19:00.023147+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:12:07.357874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.025392+0000","last_change":"2026-02-13T02:18:59.021792+0000","last_active":"2026-02-13T02:19:00.025392+0000","last_peered":"2026-02-13T02:19:00.025392+0000","last_clean":"2026-02-13T02:19:00.025392+0000","last_became_active":"2026-02-13T02:18:59.021490+0000","last_became_peered":"2026-02-13T02:18:59.021490+0000","last_unstale":"2026-02-13T02:19:00.025392+0000","last_undegraded":"2026-02-13T02:19:00.025392+0000","last_fullsized":"2026-02-13T02:19:00.025392+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:25:48.353959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:01.085846+0000","last_change":"2026-02-13T02:18:59.022139+0000","last_active":"2026-02-13T02:19:01.085846+0000","last_peered":"2026-02-13T02:19:01.085846+0000","last_clean":"2026-02-13T02:19:01.085846+0000","last_became_active":"2026-02-13T02:18:59.021874+0000","last_became_peered":"2026-02-13T02:18:59.021874+0000","last_unstale":"2026-02-13T02:19:01.085846+0000","last_undegraded":"2026-02-13T02:19:01.085846+0000","last_fullsized":"2026-02-13T02:19:01.085846+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:57:27.700971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:01.058631+0000","last_change":"2026-02-13T02:18:59.019769+0000","last_active":"2026-02-13T02:19:01.058631+0000","last_peered":"2026-02-13T02:19:01.058631+0000","last_clean":"2026-02-13T02:19:01.058631+0000","last_became_active":"2026-02-13T02:18:59.019582+0000","last_became_peered":"2026-02-13T02:18:59.019582+0000","last_unstale":"2026-02-13T02:19:01.058631+0000","last_undegraded":"2026-02-13T02:19:01.058631+0000","last_fullsized":"2026-02-13T02:19:01.058631+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:53:56.089564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:01.058600+0000","last_change":"2026-02-13T02:18:59.020880+0000","last_active":"2026-02-13T02:19:01.058600+0000","last_peered":"2026-02-13T02:19:01.058600+0000","last_clean":"2026-02-13T02:19:01.058600+0000","last_became_active":"2026-02-13T02:18:59.020558+0000","last_became_peered":"2026-02-13T02:18:59.020558+0000","last_unstale":"2026-02-13T02:19:01.058600+0000","last_undegraded":"2026-02-13T02:19:01.058600+0000","last_fullsized":"2026-02-13T02:19:01.058600+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:02:40.364817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.023030+0000","last_change":"2026-02-13T02:18:59.022093+0000","last_active":"2026-02-13T02:19:00.023030+0000","last_peered":"2026-02-13T02:19:00.023030+0000","last_clean":"2026-02-13T02:19:00.023030+0000","last_became_active":"2026-02-13T02:18:59.021669+0000","last_became_peered":"2026-02-13T02:18:59.021669+0000","last_unstale":"2026-02-13T02:19:00.023030+0000","last_undegraded":"2026-02-13T02:19:00.023030+0000","last_fullsized":"2026-02-13T02:19:00.023030+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:30:30.662498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.269509+0000","last_change":"2026-02-13T02:18:59.021435+0000","last_active":"2026-02-13T02:19:00.269509+0000","last_peered":"2026-02-13T02:19:00.269509+0000","last_clean":"2026-02-13T02:19:00.269509+0000","last_became_active":"2026-02-13T02:18:59.020960+0000","last_became_peered":"2026-02-13T02:18:59.020960+0000","last_unstale":"2026-02-13T02:19:00.269509+0000","last_undegraded":"2026-02-13T02:19:00.269509+0000","last_fullsized":"2026-02-13T02:19:00.269509+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:38:16.139971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"71'5","reported_seq":21,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:02.040455+0000","last_change":"2026-02-13T02:18:58.015175+0000","last_active":"2026-02-13T02:19:02.040455+0000","last_peered":"2026-02-13T02:19:02.040455+0000","last_clean":"2026-02-13T02:19:02.040455+0000","last_became_active":"2026-02-13T02:18:58.014835+0000","last_became_peered":"2026-02-13T02:18:58.014835+0000","last_unstale":"2026-02-13T02:19:02.040455+0000","last_undegraded":"2026-02-13T02:19:02.040455+0000","last_fullsized":"2026-02-13T02:19:02.040455+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:27:53.220446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:01.059509+0000","last_change":"2026-02-13T02:18:59.021246+0000","last_active":"2026-02-13T02:19:01.059509+0000","last_peered":"2026-02-13T02:19:01.059509+0000","last_clean":"2026-02-13T02:19:01.059509+0000","last_became_active":"2026-02-13T02:18:59.020902+0000","last_became_peered":"2026-02-13T02:18:59.020902+0000","last_unstale":"2026-02-13T02:19:01.059509+0000","last_undegraded":"2026-02-13T02:19:01.059509+0000","last_fullsized":"2026-02-13T02:19:01.059509+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:22:04.706073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"71'7","reported_seq":23,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:04.053335+0000","last_change":"2026-02-13T02:18:58.019626+0000","last_active":"2026-02-13T02:19:04.053335+0000","last_peered":"2026-02-13T02:19:04.053335+0000","last_clean":"2026-02-13T02:19:04.053335+0000","last_became_active":"2026-02-13T02:18:58.019415+0000","last_became_peered":"2026-02-13T02:18:58.019415+0000","last_unstale":"2026-02-13T02:19:04.053335+0000","last_undegraded":"2026-02-13T02:19:04.053335+0000","last_fullsized":"2026-02-13T02:19:04.053335+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:33:18.766107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"71'3","reported_seq":19,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:03.045478+0000","last_change":"2026-02-13T02:18:58.017302+0000","last_active":"2026-02-13T02:19:03.045478+0000","last_peered":"2026-02-13T02:19:03.045478+0000","last_clean":"2026-02-13T02:19:03.045478+0000","last_became_active":"2026-02-13T02:18:58.016498+0000","last_became_peered":"2026-02-13T02:18:58.016498+0000","last_unstale":"2026-02-13T02:19:03.045478+0000","last_undegraded":"2026-02-13T02:19:03.045478+0000","last_fullsized":"2026-02-13T02:19:03.045478+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:51:46.201734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026051+0000","last_change":"2026-02-13T02:18:59.021203+0000","last_active":"2026-02-13T02:19:00.026051+0000","last_peered":"2026-02-13T02:19:00.026051+0000","last_clean":"2026-02-13T02:19:00.026051+0000","last_became_active":"2026-02-13T02:18:59.020781+0000","last_became_peered":"2026-02-13T02:18:59.020781+0000","last_unstale":"2026-02-13T02:19:00.026051+0000","last_undegraded":"2026-02-13T02:19:00.026051+0000","last_fullsized":"2026-02-13T02:19:00.026051+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:22:58.765719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"71'2","reported_seq":18,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:02.040064+0000","last_change":"2026-02-13T02:18:58.016151+0000","last_active":"2026-02-13T02:19:02.040064+0000","last_peered":"2026-02-13T02:19:02.040064+0000","last_clean":"2026-02-13T02:19:02.040064+0000","last_became_active":"2026-02-13T02:18:58.015775+0000","last_became_peered":"2026-02-13T02:18:58.015775+0000","last_unstale":"2026-02-13T02:19:02.040064+0000","last_undegraded":"2026-02-13T02:19:02.040064+0000","last_fullsized":"2026-02-13T02:19:02.040064+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:59:25.743829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:01.022817+0000","last_change":"2026-02-13T02:18:59.020334+0000","last_active":"2026-02-13T02:19:01.022817+0000","last_peered":"2026-02-13T02:19:01.022817+0000","last_clean":"2026-02-13T02:19:01.022817+0000","last_became_active":"2026-02-13T02:18:59.020137+0000","last_became_peered":"2026-02-13T02:18:59.020137+0000","last_unstale":"2026-02-13T02:19:01.022817+0000","last_undegraded":"2026-02-13T02:19:01.022817+0000","last_fullsized":"2026-02-13T02:19:01.022817+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:31:43.321951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"71'4","reported_seq":20,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:02.042626+0000","last_change":"2026-02-13T02:18:58.020328+0000","last_active":"2026-02-13T02:19:02.042626+0000","last_peered":"2026-02-13T02:19:02.042626+0000","last_clean":"2026-02-13T02:19:02.042626+0000","last_became_active":"2026-02-13T02:18:58.020172+0000","last_became_peered":"2026-02-13T02:18:58.020172+0000","last_unstale":"2026-02-13T02:19:02.042626+0000","last_undegraded":"2026-02-13T02:19:02.042626+0000","last_fullsized":"2026-02-13T02:19:02.042626+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:38:31.643491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026409+0000","last_change":"2026-02-13T02:18:59.022851+0000","last_active":"2026-02-13T02:19:00.026409+0000","last_peered":"2026-02-13T02:19:00.026409+0000","last_clean":"2026-02-13T02:19:00.026409+0000","last_became_active":"2026-02-13T02:18:59.022669+0000","last_became_peered":"2026-02-13T02:18:59.022669+0000","last_unstale":"2026-02-13T02:19:00.026409+0000","last_undegraded":"2026-02-13T02:19:00.026409+0000","last_fullsized":"2026-02-13T02:19:00.026409+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:51:54.769188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"71'2","reported_seq":18,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:02.042387+0000","last_change":"2026-02-13T02:18:58.018467+0000","last_active":"2026-02-13T02:19:02.042387+0000","last_peered":"2026-02-13T02:19:02.042387+0000","last_clean":"2026-02-13T02:19:02.042387+0000","last_became_active":"2026-02-13T02:18:58.018121+0000","last_became_peered":"2026-02-13T02:18:58.018121+0000","last_unstale":"2026-02-13T02:19:02.042387+0000","last_undegraded":"2026-02-13T02:19:02.042387+0000","last_fullsized":"2026-02-13T02:19:02.042387+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:26:43.250379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:01.086021+0000","last_change":"2026-02-13T02:18:59.022489+0000","last_active":"2026-02-13T02:19:01.086021+0000","last_peered":"2026-02-13T02:19:01.086021+0000","last_clean":"2026-02-13T02:19:01.086021+0000","last_became_active":"2026-02-13T02:18:59.022123+0000","last_became_peered":"2026-02-13T02:18:59.022123+0000","last_unstale":"2026-02-13T02:19:01.086021+0000","last_undegraded":"2026-02-13T02:19:01.086021+0000","last_fullsized":"2026-02-13T02:19:01.086021+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:44:21.124098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"71'5","reported_seq":21,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:02.040214+0000","last_change":"2026-02-13T02:18:58.015339+0000","last_active":"2026-02-13T02:19:02.040214+0000","last_peered":"2026-02-13T02:19:02.040214+0000","last_clean":"2026-02-13T02:19:02.040214+0000","last_became_active":"2026-02-13T02:18:58.015045+0000","last_became_peered":"2026-02-13T02:18:58.015045+0000","last_unstale":"2026-02-13T02:19:02.040214+0000","last_undegraded":"2026-02-13T02:19:02.040214+0000","last_fullsized":"2026-02-13T02:19:02.040214+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:41:53.333544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":694,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026351+0000","last_change":"2026-02-13T02:18:59.024095+0000","last_active":"2026-02-13T02:19:00.026351+0000","last_peered":"2026-02-13T02:19:00.026351+0000","last_clean":"2026-02-13T02:19:00.026351+0000","last_became_active":"2026-02-13T02:18:59.023757+0000","last_became_peered":"2026-02-13T02:18:59.023757+0000","last_unstale":"2026-02-13T02:19:00.026351+0000","last_undegraded":"2026-02-13T02:19:00.026351+0000","last_fullsized":"2026-02-13T02:19:00.026351+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:37:25.170781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"71'18","reported_seq":34,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:05.476309+0000","last_change":"2026-02-13T02:18:58.019442+0000","last_active":"2026-02-13T02:19:05.476309+0000","last_peered":"2026-02-13T02:19:05.476309+0000","last_clean":"2026-02-13T02:19:05.476309+0000","last_became_active":"2026-02-13T02:18:58.019224+0000","last_became_peered":"2026-02-13T02:18:58.019224+0000","last_unstale":"2026-02-13T02:19:05.476309+0000","last_undegraded":"2026-02-13T02:19:05.476309+0000","last_fullsized":"2026-02-13T02:19:05.476309+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:18:16.234056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25594,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.269821+0000","last_change":"2026-02-13T02:18:59.020682+0000","last_active":"2026-02-13T02:19:00.269821+0000","last_peered":"2026-02-13T02:19:00.269821+0000","last_clean":"2026-02-13T02:19:00.269821+0000","last_became_active":"2026-02-13T02:18:59.019992+0000","last_became_peered":"2026-02-13T02:18:59.019992+0000","last_unstale":"2026-02-13T02:19:00.269821+0000","last_undegraded":"2026-02-13T02:19:00.269821+0000","last_fullsized":"2026-02-13T02:19:00.269821+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:26:25.490570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"71'6","reported_seq":22,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:03.043736+0000","last_change":"2026-02-13T02:18:58.017003+0000","last_active":"2026-02-13T02:19:03.043736+0000","last_peered":"2026-02-13T02:19:03.043736+0000","last_clean":"2026-02-13T02:19:03.043736+0000","last_became_active":"2026-02-13T02:18:58.016821+0000","last_became_peered":"2026-02-13T02:18:58.016821+0000","last_unstale":"2026-02-13T02:19:03.043736+0000","last_undegraded":"2026-02-13T02:19:03.043736+0000","last_fullsized":"2026-02-13T02:19:03.043736+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:52:59.197342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.025359+0000","last_change":"2026-02-13T02:18:59.022587+0000","last_active":"2026-02-13T02:19:00.025359+0000","last_peered":"2026-02-13T02:19:00.025359+0000","last_clean":"2026-02-13T02:19:00.025359+0000","last_became_active":"2026-02-13T02:18:59.021700+0000","last_became_peered":"2026-02-13T02:18:59.021700+0000","last_unstale":"2026-02-13T02:19:00.025359+0000","last_undegraded":"2026-02-13T02:19:00.025359+0000","last_fullsized":"2026-02-13T02:19:00.025359+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:25:36.714629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"71'4","reported_seq":20,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:02.040426+0000","last_change":"2026-02-13T02:18:58.016995+0000","last_active":"2026-02-13T02:19:02.040426+0000","last_peered":"2026-02-13T02:19:02.040426+0000","last_clean":"2026-02-13T02:19:02.040426+0000","last_became_active":"2026-02-13T02:18:58.016790+0000","last_became_peered":"2026-02-13T02:18:58.016790+0000","last_unstale":"2026-02-13T02:19:02.040426+0000","last_undegraded":"2026-02-13T02:19:02.040426+0000","last_fullsized":"2026-02-13T02:19:02.040426+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:16:22.317768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026344+0000","last_change":"2026-02-13T02:18:59.023842+0000","last_active":"2026-02-13T02:19:00.026344+0000","last_peered":"2026-02-13T02:19:00.026344+0000","last_clean":"2026-02-13T02:19:00.026344+0000","last_became_active":"2026-02-13T02:18:59.023100+0000","last_became_peered":"2026-02-13T02:18:59.023100+0000","last_unstale":"2026-02-13T02:19:00.026344+0000","last_undegraded":"2026-02-13T02:19:00.026344+0000","last_fullsized":"2026-02-13T02:19:00.026344+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:49:06.786362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.397793+0000","last_change":"2026-02-13T02:18:58.016750+0000","last_active":"2026-02-13T02:19:00.397793+0000","last_peered":"2026-02-13T02:19:00.397793+0000","last_clean":"2026-02-13T02:19:00.397793+0000","last_became_active":"2026-02-13T02:18:58.016568+0000","last_became_peered":"2026-02-13T02:18:58.016568+0000","last_unstale":"2026-02-13T02:19:00.397793+0000","last_undegraded":"2026-02-13T02:19:00.397793+0000","last_fullsized":"2026-02-13T02:19:00.397793+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:30:56.973436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026083+0000","last_change":"2026-02-13T02:18:59.023967+0000","last_active":"2026-02-13T02:19:00.026083+0000","last_peered":"2026-02-13T02:19:00.026083+0000","last_clean":"2026-02-13T02:19:00.026083+0000","last_became_active":"2026-02-13T02:18:59.023488+0000","last_became_peered":"2026-02-13T02:18:59.023488+0000","last_unstale":"2026-02-13T02:19:00.026083+0000","last_undegraded":"2026-02-13T02:19:00.026083+0000","last_fullsized":"2026-02-13T02:19:00.026083+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:22:22.901773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"71'17","reported_seq":34,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:05.056052+0000","last_change":"2026-02-13T02:18:58.017311+0000","last_active":"2026-02-13T02:19:05.056052+0000","last_peered":"2026-02-13T02:19:05.056052+0000","last_clean":"2026-02-13T02:19:05.056052+0000","last_became_active":"2026-02-13T02:18:58.016759+0000","last_became_peered":"2026-02-13T02:18:58.016759+0000","last_unstale":"2026-02-13T02:19:05.056052+0000","last_undegraded":"2026-02-13T02:19:05.056052+0000","last_fullsized":"2026-02-13T02:19:05.056052+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:56:39.432654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:01.059526+0000","last_change":"2026-02-13T02:18:59.021764+0000","last_active":"2026-02-13T02:19:01.059526+0000","last_peered":"2026-02-13T02:19:01.059526+0000","last_clean":"2026-02-13T02:19:01.059526+0000","last_became_active":"2026-02-13T02:18:59.021364+0000","last_became_peered":"2026-02-13T02:18:59.021364+0000","last_unstale":"2026-02-13T02:19:01.059526+0000","last_undegraded":"2026-02-13T02:19:01.059526+0000","last_fullsized":"2026-02-13T02:19:01.059526+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:13:00.776080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"71'2","reported_seq":19,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:05.042750+0000","last_change":"2026-02-13T02:18:58.017465+0000","last_active":"2026-02-13T02:19:05.042750+0000","last_peered":"2026-02-13T02:19:05.042750+0000","last_clean":"2026-02-13T02:19:05.042750+0000","last_became_active":"2026-02-13T02:18:58.016957+0000","last_became_peered":"2026-02-13T02:18:58.016957+0000","last_unstale":"2026-02-13T02:19:05.042750+0000","last_undegraded":"2026-02-13T02:19:05.042750+0000","last_fullsized":"2026-02-13T02:19:05.042750+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:17:33.831136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.022946+0000","last_change":"2026-02-13T02:18:59.020929+0000","last_active":"2026-02-13T02:19:00.022946+0000","last_peered":"2026-02-13T02:19:00.022946+0000","last_clean":"2026-02-13T02:19:00.022946+0000","last_became_active":"2026-02-13T02:18:59.020519+0000","last_became_peered":"2026-02-13T02:18:59.020519+0000","last_unstale":"2026-02-13T02:19:00.022946+0000","last_undegraded":"2026-02-13T02:19:00.022946+0000","last_fullsized":"2026-02-13T02:19:00.022946+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:46:07.242524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"71'5","reported_seq":21,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:05.057217+0000","last_change":"2026-02-13T02:18:58.017516+0000","last_active":"2026-02-13T02:19:05.057217+0000","last_peered":"2026-02-13T02:19:05.057217+0000","last_clean":"2026-02-13T02:19:05.057217+0000","last_became_active":"2026-02-13T02:18:58.017217+0000","last_became_peered":"2026-02-13T02:18:58.017217+0000","last_unstale":"2026-02-13T02:19:05.057217+0000","last_undegraded":"2026-02-13T02:19:05.057217+0000","last_fullsized":"2026-02-13T02:19:05.057217+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:02:32.458073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026497+0000","last_change":"2026-02-13T02:18:59.022648+0000","last_active":"2026-02-13T02:19:00.026497+0000","last_peered":"2026-02-13T02:19:00.026497+0000","last_clean":"2026-02-13T02:19:00.026497+0000","last_became_active":"2026-02-13T02:18:59.022416+0000","last_became_peered":"2026-02-13T02:18:59.022416+0000","last_unstale":"2026-02-13T02:19:00.026497+0000","last_undegraded":"2026-02-13T02:19:00.026497+0000","last_fullsized":"2026-02-13T02:19:00.026497+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:27:43.916972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"71'2","reported_seq":18,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:01.060019+0000","last_change":"2026-02-13T02:18:58.016793+0000","last_active":"2026-02-13T02:19:01.060019+0000","last_peered":"2026-02-13T02:19:01.060019+0000","last_clean":"2026-02-13T02:19:01.060019+0000","last_became_active":"2026-02-13T02:18:58.016440+0000","last_became_peered":"2026-02-13T02:18:58.016440+0000","last_unstale":"2026-02-13T02:19:01.060019+0000","last_undegraded":"2026-02-13T02:19:01.060019+0000","last_fullsized":"2026-02-13T02:19:01.060019+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:50:19.963252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026243+0000","last_change":"2026-02-13T02:18:59.024040+0000","last_active":"2026-02-13T02:19:00.026243+0000","last_peered":"2026-02-13T02:19:00.026243+0000","last_clean":"2026-02-13T02:19:00.026243+0000","last_became_active":"2026-02-13T02:18:59.023539+0000","last_became_peered":"2026-02-13T02:18:59.023539+0000","last_unstale":"2026-02-13T02:19:00.026243+0000","last_undegraded":"2026-02-13T02:19:00.026243+0000","last_fullsized":"2026-02-13T02:19:00.026243+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:04:33.603294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"71'3","reported_seq":19,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:03.044265+0000","last_change":"2026-02-13T02:18:58.015927+0000","last_active":"2026-02-13T02:19:03.044265+0000","last_peered":"2026-02-13T02:19:03.044265+0000","last_clean":"2026-02-13T02:19:03.044265+0000","last_became_active":"2026-02-13T02:18:58.015746+0000","last_became_peered":"2026-02-13T02:18:58.015746+0000","last_unstale":"2026-02-13T02:19:03.044265+0000","last_undegraded":"2026-02-13T02:19:03.044265+0000","last_fullsized":"2026-02-13T02:19:03.044265+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:25:54.397951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026442+0000","last_change":"2026-02-13T02:18:59.025074+0000","last_active":"2026-02-13T02:19:00.026442+0000","last_peered":"2026-02-13T02:19:00.026442+0000","last_clean":"2026-02-13T02:19:00.026442+0000","last_became_active":"2026-02-13T02:18:59.024633+0000","last_became_peered":"2026-02-13T02:18:59.024633+0000","last_unstale":"2026-02-13T02:19:00.026442+0000","last_undegraded":"2026-02-13T02:19:00.026442+0000","last_fullsized":"2026-02-13T02:19:00.026442+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:39:45.349715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'152","reported_seq":337,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026105+0000","last_change":"2026-02-13T02:18:39.248696+0000","last_active":"2026-02-13T02:19:00.026105+0000","last_peered":"2026-02-13T02:19:00.026105+0000","last_clean":"2026-02-13T02:19:00.026105+0000","last_became_active":"2026-02-13T02:18:39.248579+0000","last_became_peered":"2026-02-13T02:18:39.248579+0000","last_unstale":"2026-02-13T02:19:00.026105+0000","last_undegraded":"2026-02-13T02:19:00.026105+0000","last_fullsized":"2026-02-13T02:19:00.026105+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:17:40.238745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:17:40.238745+0000","last_clean_scrub_stamp":"2026-02-13T02:17:40.238745+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:50:58.102014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"71'2","reported_seq":18,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:02.042416+0000","last_change":"2026-02-13T02:18:58.017400+0000","last_active":"2026-02-13T02:19:02.042416+0000","last_peered":"2026-02-13T02:19:02.042416+0000","last_clean":"2026-02-13T02:19:02.042416+0000","last_became_active":"2026-02-13T02:18:58.017073+0000","last_became_peered":"2026-02-13T02:18:58.017073+0000","last_unstale":"2026-02-13T02:19:02.042416+0000","last_undegraded":"2026-02-13T02:19:02.042416+0000","last_fullsized":"2026-02-13T02:19:02.042416+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:07:32.354072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026155+0000","last_change":"2026-02-13T02:18:59.022794+0000","last_active":"2026-02-13T02:19:00.026155+0000","last_peered":"2026-02-13T02:19:00.026155+0000","last_clean":"2026-02-13T02:19:00.026155+0000","last_became_active":"2026-02-13T02:18:59.022108+0000","last_became_peered":"2026-02-13T02:18:59.022108+0000","last_unstale":"2026-02-13T02:19:00.026155+0000","last_undegraded":"2026-02-13T02:19:00.026155+0000","last_fullsized":"2026-02-13T02:19:00.026155+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:22:15.433204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"71'3","reported_seq":19,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:03.046655+0000","last_change":"2026-02-13T02:18:58.018751+0000","last_active":"2026-02-13T02:19:03.046655+0000","last_peered":"2026-02-13T02:19:03.046655+0000","last_clean":"2026-02-13T02:19:03.046655+0000","last_became_active":"2026-02-13T02:18:58.018516+0000","last_became_peered":"2026-02-13T02:18:58.018516+0000","last_unstale":"2026-02-13T02:19:03.046655+0000","last_undegraded":"2026-02-13T02:19:03.046655+0000","last_fullsized":"2026-02-13T02:19:03.046655+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:20:45.263014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.025233+0000","last_change":"2026-02-13T02:18:59.023047+0000","last_active":"2026-02-13T02:19:00.025233+0000","last_peered":"2026-02-13T02:19:00.025233+0000","last_clean":"2026-02-13T02:19:00.025233+0000","last_became_active":"2026-02-13T02:18:59.022759+0000","last_became_peered":"2026-02-13T02:18:59.022759+0000","last_unstale":"2026-02-13T02:19:00.025233+0000","last_undegraded":"2026-02-13T02:19:00.025233+0000","last_fullsized":"2026-02-13T02:19:00.025233+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:41:05.253744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"71'5","reported_seq":23,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:06.066051+0000","last_change":"2026-02-13T02:18:58.017745+0000","last_active":"2026-02-13T02:19:06.066051+0000","last_peered":"2026-02-13T02:19:06.066051+0000","last_clean":"2026-02-13T02:19:06.066051+0000","last_became_active":"2026-02-13T02:18:58.017075+0000","last_became_peered":"2026-02-13T02:18:58.017075+0000","last_unstale":"2026-02-13T02:19:06.066051+0000","last_undegraded":"2026-02-13T02:19:06.066051+0000","last_fullsized":"2026-02-13T02:19:06.066051+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:30:40.480682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:01.059608+0000","last_change":"2026-02-13T02:18:59.020766+0000","last_active":"2026-02-13T02:19:01.059608+0000","last_peered":"2026-02-13T02:19:01.059608+0000","last_clean":"2026-02-13T02:19:01.059608+0000","last_became_active":"2026-02-13T02:18:59.020423+0000","last_became_peered":"2026-02-13T02:18:59.020423+0000","last_unstale":"2026-02-13T02:19:01.059608+0000","last_undegraded":"2026-02-13T02:19:01.059608+0000","last_fullsized":"2026-02-13T02:19:01.059608+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:28:14.129049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"71'1","reported_seq":17,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026268+0000","last_change":"2026-02-13T02:18:58.018774+0000","last_active":"2026-02-13T02:19:00.026268+0000","last_peered":"2026-02-13T02:19:00.026268+0000","last_clean":"2026-02-13T02:19:00.026268+0000","last_became_active":"2026-02-13T02:18:58.018494+0000","last_became_peered":"2026-02-13T02:18:58.018494+0000","last_unstale":"2026-02-13T02:19:00.026268+0000","last_undegraded":"2026-02-13T02:19:00.026268+0000","last_fullsized":"2026-02-13T02:19:00.026268+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:54:08.283495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026508+0000","last_change":"2026-02-13T02:18:59.024900+0000","last_active":"2026-02-13T02:19:00.026508+0000","last_peered":"2026-02-13T02:19:00.026508+0000","last_clean":"2026-02-13T02:19:00.026508+0000","last_became_active":"2026-02-13T02:18:59.024012+0000","last_became_peered":"2026-02-13T02:18:59.024012+0000","last_unstale":"2026-02-13T02:19:00.026508+0000","last_undegraded":"2026-02-13T02:19:00.026508+0000","last_fullsized":"2026-02-13T02:19:00.026508+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:30:24.252966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:01.022695+0000","last_change":"2026-02-13T02:18:58.018004+0000","last_active":"2026-02-13T02:19:01.022695+0000","last_peered":"2026-02-13T02:19:01.022695+0000","last_clean":"2026-02-13T02:19:01.022695+0000","last_became_active":"2026-02-13T02:18:58.017319+0000","last_became_peered":"2026-02-13T02:18:58.017319+0000","last_unstale":"2026-02-13T02:19:01.022695+0000","last_undegraded":"2026-02-13T02:19:01.022695+0000","last_fullsized":"2026-02-13T02:19:01.022695+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:26:29.965359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"71'1","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:01.037590+0000","last_change":"2026-02-13T02:18:59.025358+0000","last_active":"2026-02-13T02:19:01.037590+0000","last_peered":"2026-02-13T02:19:01.037590+0000","last_clean":"2026-02-13T02:19:01.037590+0000","last_became_active":"2026-02-13T02:18:59.024743+0000","last_became_peered":"2026-02-13T02:18:59.024743+0000","last_unstale":"2026-02-13T02:19:01.037590+0000","last_undegraded":"2026-02-13T02:19:01.037590+0000","last_fullsized":"2026-02-13T02:19:01.037590+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:05:43.480846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"71'4","reported_seq":21,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:05.056604+0000","last_change":"2026-02-13T02:18:58.017585+0000","last_active":"2026-02-13T02:19:05.056604+0000","last_peered":"2026-02-13T02:19:05.056604+0000","last_clean":"2026-02-13T02:19:05.056604+0000","last_became_active":"2026-02-13T02:18:58.017323+0000","last_became_peered":"2026-02-13T02:18:58.017323+0000","last_unstale":"2026-02-13T02:19:05.056604+0000","last_undegraded":"2026-02-13T02:19:05.056604+0000","last_fullsized":"2026-02-13T02:19:05.056604+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:25:25.624809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.025394+0000","last_change":"2026-02-13T02:18:59.020945+0000","last_active":"2026-02-13T02:19:00.025394+0000","last_peered":"2026-02-13T02:19:00.025394+0000","last_clean":"2026-02-13T02:19:00.025394+0000","last_became_active":"2026-02-13T02:18:59.020719+0000","last_became_peered":"2026-02-13T02:18:59.020719+0000","last_unstale":"2026-02-13T02:19:00.025394+0000","last_undegraded":"2026-02-13T02:19:00.025394+0000","last_fullsized":"2026-02-13T02:19:00.025394+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:13:20.283266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"71'3","reported_seq":19,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:03.044867+0000","last_change":"2026-02-13T02:18:58.018055+0000","last_active":"2026-02-13T02:19:03.044867+0000","last_peered":"2026-02-13T02:19:03.044867+0000","last_clean":"2026-02-13T02:19:03.044867+0000","last_became_active":"2026-02-13T02:18:58.017824+0000","last_became_peered":"2026-02-13T02:18:58.017824+0000","last_unstale":"2026-02-13T02:19:03.044867+0000","last_undegraded":"2026-02-13T02:19:03.044867+0000","last_fullsized":"2026-02-13T02:19:03.044867+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:00:19.476969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026322+0000","last_change":"2026-02-13T02:18:59.021532+0000","last_active":"2026-02-13T02:19:00.026322+0000","last_peered":"2026-02-13T02:19:00.026322+0000","last_clean":"2026-02-13T02:19:00.026322+0000","last_became_active":"2026-02-13T02:18:59.020792+0000","last_became_peered":"2026-02-13T02:18:59.020792+0000","last_unstale":"2026-02-13T02:19:00.026322+0000","last_undegraded":"2026-02-13T02:19:00.026322+0000","last_fullsized":"2026-02-13T02:19:00.026322+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:55:45.772056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"71'4","reported_seq":20,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:02.042382+0000","last_change":"2026-02-13T02:18:58.017322+0000","last_active":"2026-02-13T02:19:02.042382+0000","last_peered":"2026-02-13T02:19:02.042382+0000","last_clean":"2026-02-13T02:19:02.042382+0000","last_became_active":"2026-02-13T02:18:58.017078+0000","last_became_peered":"2026-02-13T02:18:58.017078+0000","last_unstale":"2026-02-13T02:19:02.042382+0000","last_undegraded":"2026-02-13T02:19:02.042382+0000","last_fullsized":"2026-02-13T02:19:02.042382+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:38:36.066817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:01.085941+0000","last_change":"2026-02-13T02:18:59.023478+0000","last_active":"2026-02-13T02:19:01.085941+0000","last_peered":"2026-02-13T02:19:01.085941+0000","last_clean":"2026-02-13T02:19:01.085941+0000","last_became_active":"2026-02-13T02:18:59.023251+0000","last_became_peered":"2026-02-13T02:18:59.023251+0000","last_unstale":"2026-02-13T02:19:01.085941+0000","last_undegraded":"2026-02-13T02:19:01.085941+0000","last_fullsized":"2026-02-13T02:19:01.085941+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:46:43.414532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"71'2","reported_seq":18,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:02.042384+0000","last_change":"2026-02-13T02:18:58.018029+0000","last_active":"2026-02-13T02:19:02.042384+0000","last_peered":"2026-02-13T02:19:02.042384+0000","last_clean":"2026-02-13T02:19:02.042384+0000","last_became_active":"2026-02-13T02:18:58.017853+0000","last_became_peered":"2026-02-13T02:18:58.017853+0000","last_unstale":"2026-02-13T02:19:02.042384+0000","last_undegraded":"2026-02-13T02:19:02.042384+0000","last_fullsized":"2026-02-13T02:19:02.042384+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:42:13.248907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.269489+0000","last_change":"2026-02-13T02:18:59.021333+0000","last_active":"2026-02-13T02:19:00.269489+0000","last_peered":"2026-02-13T02:19:00.269489+0000","last_clean":"2026-02-13T02:19:00.269489+0000","last_became_active":"2026-02-13T02:18:59.020957+0000","last_became_peered":"2026-02-13T02:18:59.020957+0000","last_unstale":"2026-02-13T02:19:00.269489+0000","last_undegraded":"2026-02-13T02:19:00.269489+0000","last_fullsized":"2026-02-13T02:19:00.269489+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:03:43.534623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"71'7","reported_seq":23,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:05.057144+0000","last_change":"2026-02-13T02:18:58.018621+0000","last_active":"2026-02-13T02:19:05.057144+0000","last_peered":"2026-02-13T02:19:05.057144+0000","last_clean":"2026-02-13T02:19:05.057144+0000","last_became_active":"2026-02-13T02:18:58.018470+0000","last_became_peered":"2026-02-13T02:18:58.018470+0000","last_unstale":"2026-02-13T02:19:05.057144+0000","last_undegraded":"2026-02-13T02:19:05.057144+0000","last_fullsized":"2026-02-13T02:19:05.057144+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:23:51.053480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.023004+0000","last_change":"2026-02-13T02:18:59.020330+0000","last_active":"2026-02-13T02:19:00.023004+0000","last_peered":"2026-02-13T02:19:00.023004+0000","last_clean":"2026-02-13T02:19:00.023004+0000","last_became_active":"2026-02-13T02:18:59.020032+0000","last_became_peered":"2026-02-13T02:18:59.020032+0000","last_unstale":"2026-02-13T02:19:00.023004+0000","last_undegraded":"2026-02-13T02:19:00.023004+0000","last_fullsized":"2026-02-13T02:19:00.023004+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:53:04.758527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:01.058538+0000","last_change":"2026-02-13T02:18:58.017473+0000","last_active":"2026-02-13T02:19:01.058538+0000","last_peered":"2026-02-13T02:19:01.058538+0000","last_clean":"2026-02-13T02:19:01.058538+0000","last_became_active":"2026-02-13T02:18:58.017315+0000","last_became_peered":"2026-02-13T02:18:58.017315+0000","last_unstale":"2026-02-13T02:19:01.058538+0000","last_undegraded":"2026-02-13T02:19:01.058538+0000","last_fullsized":"2026-02-13T02:19:01.058538+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:25:15.481559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026238+0000","last_change":"2026-02-13T02:18:59.023576+0000","last_active":"2026-02-13T02:19:00.026238+0000","last_peered":"2026-02-13T02:19:00.026238+0000","last_clean":"2026-02-13T02:19:00.026238+0000","last_became_active":"2026-02-13T02:18:59.022528+0000","last_became_peered":"2026-02-13T02:18:59.022528+0000","last_unstale":"2026-02-13T02:19:00.026238+0000","last_undegraded":"2026-02-13T02:19:00.026238+0000","last_fullsized":"2026-02-13T02:19:00.026238+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:14:20.280447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"71'4","reported_seq":21,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:02.040196+0000","last_change":"2026-02-13T02:18:58.017265+0000","last_active":"2026-02-13T02:19:02.040196+0000","last_peered":"2026-02-13T02:19:02.040196+0000","last_clean":"2026-02-13T02:19:02.040196+0000","last_became_active":"2026-02-13T02:18:58.016951+0000","last_became_peered":"2026-02-13T02:18:58.016951+0000","last_unstale":"2026-02-13T02:19:02.040196+0000","last_undegraded":"2026-02-13T02:19:02.040196+0000","last_fullsized":"2026-02-13T02:19:02.040196+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:50:01.682853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026205+0000","last_change":"2026-02-13T02:18:59.022425+0000","last_active":"2026-02-13T02:19:00.026205+0000","last_peered":"2026-02-13T02:19:00.026205+0000","last_clean":"2026-02-13T02:19:00.026205+0000","last_became_active":"2026-02-13T02:18:59.022229+0000","last_became_peered":"2026-02-13T02:18:59.022229+0000","last_unstale":"2026-02-13T02:19:00.026205+0000","last_undegraded":"2026-02-13T02:19:00.026205+0000","last_fullsized":"2026-02-13T02:19:00.026205+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:46:02.938928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:01.059766+0000","last_change":"2026-02-13T02:18:59.022165+0000","last_active":"2026-02-13T02:19:01.059766+0000","last_peered":"2026-02-13T02:19:01.059766+0000","last_clean":"2026-02-13T02:19:01.059766+0000","last_became_active":"2026-02-13T02:18:59.021833+0000","last_became_peered":"2026-02-13T02:18:59.021833+0000","last_unstale":"2026-02-13T02:19:01.059766+0000","last_undegraded":"2026-02-13T02:19:01.059766+0000","last_fullsized":"2026-02-13T02:19:01.059766+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:37:51.478861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"71'5","reported_seq":22,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:05.056744+0000","last_change":"2026-02-13T02:18:58.016572+0000","last_active":"2026-02-13T02:19:05.056744+0000","last_peered":"2026-02-13T02:19:05.056744+0000","last_clean":"2026-02-13T02:19:05.056744+0000","last_became_active":"2026-02-13T02:18:58.016013+0000","last_became_peered":"2026-02-13T02:18:58.016013+0000","last_unstale":"2026-02-13T02:19:05.056744+0000","last_undegraded":"2026-02-13T02:19:05.056744+0000","last_fullsized":"2026-02-13T02:19:05.056744+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:07:58.232144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026287+0000","last_change":"2026-02-13T02:18:59.022737+0000","last_active":"2026-02-13T02:19:00.026287+0000","last_peered":"2026-02-13T02:19:00.026287+0000","last_clean":"2026-02-13T02:19:00.026287+0000","last_became_active":"2026-02-13T02:18:59.022601+0000","last_became_peered":"2026-02-13T02:18:59.022601+0000","last_unstale":"2026-02-13T02:19:00.026287+0000","last_undegraded":"2026-02-13T02:19:00.026287+0000","last_fullsized":"2026-02-13T02:19:00.026287+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:08:39.591613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"71'11","reported_seq":28,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:05.056881+0000","last_change":"2026-02-13T02:18:58.016288+0000","last_active":"2026-02-13T02:19:05.056881+0000","last_peered":"2026-02-13T02:19:05.056881+0000","last_clean":"2026-02-13T02:19:05.056881+0000","last_became_active":"2026-02-13T02:18:58.015859+0000","last_became_peered":"2026-02-13T02:18:58.015859+0000","last_unstale":"2026-02-13T02:19:05.056881+0000","last_undegraded":"2026-02-13T02:19:05.056881+0000","last_fullsized":"2026-02-13T02:19:05.056881+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:23:12.911321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":15,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:01.085995+0000","last_change":"2026-02-13T02:18:59.022151+0000","last_active":"2026-02-13T02:19:01.085995+0000","last_peered":"2026-02-13T02:19:01.085995+0000","last_clean":"2026-02-13T02:19:01.085995+0000","last_became_active":"2026-02-13T02:18:59.021969+0000","last_became_peered":"2026-02-13T02:18:59.021969+0000","last_unstale":"2026-02-13T02:19:01.085995+0000","last_undegraded":"2026-02-13T02:19:01.085995+0000","last_fullsized":"2026-02-13T02:19:01.085995+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:58:12.160164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"71'2","reported_seq":18,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.545301+0000","last_change":"2026-02-13T02:18:58.018388+0000","last_active":"2026-02-13T02:19:00.545301+0000","last_peered":"2026-02-13T02:19:00.545301+0000","last_clean":"2026-02-13T02:19:00.545301+0000","last_became_active":"2026-02-13T02:18:58.018186+0000","last_became_peered":"2026-02-13T02:18:58.018186+0000","last_unstale":"2026-02-13T02:19:00.545301+0000","last_undegraded":"2026-02-13T02:19:00.545301+0000","last_fullsized":"2026-02-13T02:19:00.545301+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:26:19.032391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026257+0000","last_change":"2026-02-13T02:18:59.021699+0000","last_active":"2026-02-13T02:19:00.026257+0000","last_peered":"2026-02-13T02:19:00.026257+0000","last_clean":"2026-02-13T02:19:00.026257+0000","last_became_active":"2026-02-13T02:18:59.021479+0000","last_became_peered":"2026-02-13T02:18:59.021479+0000","last_unstale":"2026-02-13T02:19:00.026257+0000","last_undegraded":"2026-02-13T02:19:00.026257+0000","last_fullsized":"2026-02-13T02:19:00.026257+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:26:34.039117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"71'9","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:03.045511+0000","last_change":"2026-02-13T02:18:58.017925+0000","last_active":"2026-02-13T02:19:03.045511+0000","last_peered":"2026-02-13T02:19:03.045511+0000","last_clean":"2026-02-13T02:19:03.045511+0000","last_became_active":"2026-02-13T02:18:58.017527+0000","last_became_peered":"2026-02-13T02:18:58.017527+0000","last_unstale":"2026-02-13T02:19:03.045511+0000","last_undegraded":"2026-02-13T02:19:03.045511+0000","last_fullsized":"2026-02-13T02:19:03.045511+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:30:09.132332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":30148,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":173,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":52,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":360448,"data_stored":67938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":150662,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":66,"seq":283467841542,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27704,"kb_used_data":740,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":733975496,"statfs":{"total":751619276800,"available":751590907904,"internally_reserved":0,"allocated":757760,"data_stored":364103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8793,"internal_metadata":27581863},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":59,"seq":253403070471,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28368,"kb_used_data":1404,"kb_used_omap":34,"kb_used_meta":26909,"kb_avail":733974832,"statfs":{"total":751619276800,"available":751590227968,"internally_reserved":0,"allocated":1437696,"data_stored":982350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":35780,"internal_metadata":27554876},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":56,"seq":240518168585,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27724,"kb_used_data":760,"kb_used_omap":21,"kb_used_meta":26922,"kb_avail":733975476,"statfs":{"total":751619276800,"available":751590887424,"internally_reserved":0,"allocated":778240,"data_stored":364943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21846,"internal_metadata":27568810},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":49,"seq":210453397515,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27736,"kb_used_data":772,"kb_used_omap":33,"kb_used_meta":26910,"kb_avail":733975464,"statfs":{"total":751619276800,"available":751590875136,"internally_reserved":0,"allocated":790528,"data_stored":365647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":34036,"internal_metadata":27556620},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":42,"seq":180388626443,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28300,"kb_used_data":1336,"kb_used_omap":31,"kb_used_meta":26912,"kb_avail":733974900,"statfs":{"total":751619276800,"available":751590297600,"internally_reserved":0,"allocated":1368064,"data_stored":956285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":32556,"internal_metadata":27558100},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":39,"seq":167503724558,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27724,"kb_used_data":760,"kb_used_omap":22,"kb_used_meta":26921,"kb_avail":733975476,"statfs":{"total":751619276800,"available":751590887424,"internally_reserved":0,"allocated":778240,"data_stored":364942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22674,"internal_metadata":27567982},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":32,"seq":137438953487,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28312,"kb_used_data":1348,"kb_used_omap":22,"kb_used_meta":26921,"kb_avail":733974888,"statfs":{"total":751619276800,"available":751590285312,"internally_reserved":0,"allocated":1380352,"data_stored":955969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23338,"internal_metadata":27567318},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":28,"seq":120259084304,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27708,"kb_used_data":744,"kb_used_omap":38,"kb_used_meta":26905,"kb_avail":733975492,"statfs":{"total":751619276800,"available":751590903808,"internally_reserved":0,"allocated":761856,"data_stored":364125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":38976,"internal_metadata":27551680},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":21,"seq":90194313234,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27732,"kb_used_data":768,"kb_used_omap":44,"kb_used_meta":26899,"kb_avail":733975468,"statfs":{"total":751619276800,"available":751590879232,"internally_reserved":0,"allocated":786432,"data_stored":364533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":45431,"internal_metadata":27545225},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542163,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27728,"kb_used_data":764,"kb_used_omap":49,"kb_used_meta":26894,"kb_avail":733975472,"statfs":{"total":751619276800,"available":751590883328,"internally_reserved":0,"allocated":782336,"data_stored":366393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":51130,"internal_metadata":27539526},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672980,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27732,"kb_used_data":768,"kb_used_omap":43,"kb_used_meta":26900,"kb_avail":733975468,"statfs":{"total":751619276800,"available":751590879232,"internally_reserved":0,"allocated":786432,"data_stored":374284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":45022,"internal_metadata":27545634},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":7,"seq":30064771093,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27732,"kb_used_data":768,"kb_used_omap":46,"kb_used_meta":26897,"kb_avail":733975468,"statfs":{"total":751619276800,"available":751590879232,"internally_reserved":0,"allocated":786432,"data_stored":365625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47995,"internal_metadata":27542661},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4653,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":27390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3996,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":3006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8445,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25722,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6598,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6900,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10745,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15543,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":33230,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10905,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":27762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20517,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3408,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-13T02:19:08.289 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2026-02-13T02:19:08.290 INFO:tasks.cephadm:Setting up client nodes... 2026-02-13T02:19:08.290 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2026-02-13T02:19:08.347 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:08 trial011 ceph-mon[11956]: from='client.14883 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:19:08.347 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:08 trial011 ceph-mon[11956]: pgmap v188: 97 pgs: 97 active+clean; 606 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 11 KiB/s wr, 22 op/s 2026-02-13T02:19:08.347 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:08 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/877753939' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T02:19:08.347 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:08 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/2922979105' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T02:19:08.444 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:19:08.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:08 trial060 ceph-mon[14797]: from='client.14883 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:19:08.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:08 trial060 ceph-mon[14797]: pgmap v188: 97 pgs: 97 active+clean; 606 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 11 KiB/s wr, 22 op/s 2026-02-13T02:19:08.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:08 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/877753939' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T02:19:08.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:08 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/2922979105' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T02:19:08.541 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:08 trial078 ceph-mon[14969]: from='client.14883 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T02:19:08.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:08 trial078 ceph-mon[14969]: pgmap v188: 97 pgs: 97 active+clean; 606 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 1.2 KiB/s rd, 11 KiB/s wr, 22 op/s 2026-02-13T02:19:08.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:08 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/877753939' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T02:19:08.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:08 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/2922979105' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T02:19:08.563 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.559+0000 7fc0162f46c0 1 -- 10.20.193.11:0/1168645816 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fc01010fe80 msgr2=0x7fc0101102f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:08.564 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.559+0000 7fc0162f46c0 1 --2- 10.20.193.11:0/1168645816 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fc01010fe80 0x7fc0101102f0 secure :-1 s=READY pgs=247 gs=1 cs=0 l=1 c_cookie=17347543976041525745 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc004009970 tx=0x7fc00402ed20 comp rx=0 tx=0).stop 2026-02-13T02:19:08.564 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.559+0000 7fc0162f46c0 1 -- 10.20.193.11:0/1168645816 shutdown_connections 2026-02-13T02:19:08.564 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.559+0000 7fc0162f46c0 1 --2- 10.20.193.11:0/1168645816 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fc010110830 0x7fc0101711c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:08.564 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.559+0000 7fc0162f46c0 1 --2- 10.20.193.11:0/1168645816 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fc01010fe80 0x7fc0101102f0 unknown :-1 s=CLOSED pgs=247 gs=1 cs=0 l=1 c_cookie=17347543976041525745 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:08.564 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.559+0000 7fc0162f46c0 1 --2- 10.20.193.11:0/1168645816 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fc01010ed00 0x7fc01010f0f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:08.564 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.559+0000 7fc0162f46c0 1 -- 10.20.193.11:0/1168645816 >> 10.20.193.11:0/1168645816 conn(0x7fc0100ec400 msgr2=0x7fc01010c830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:08.564 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.559+0000 7fc0162f46c0 1 -- 10.20.193.11:0/1168645816 shutdown_connections 2026-02-13T02:19:08.565 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.559+0000 7fc0162f46c0 1 -- 10.20.193.11:0/1168645816 wait complete. 2026-02-13T02:19:08.565 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.559+0000 7fc0162f46c0 1 Processor -- start 2026-02-13T02:19:08.565 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.559+0000 7fc0162f46c0 1 -- start start 2026-02-13T02:19:08.565 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.559+0000 7fc0162f46c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fc01010ed00 0x7fc0100f8380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:08.565 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.559+0000 7fc0162f46c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fc01010fe80 0x7fc0101711a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:08.565 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.559+0000 7fc0162f46c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fc010110830 0x7fc0100f8bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:08.565 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.559+0000 7fc0162f46c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7fc0100f9810 con 0x7fc01010ed00 2026-02-13T02:19:08.565 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.559+0000 7fc0162f46c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc0100f9980 con 0x7fc010110830 2026-02-13T02:19:08.565 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.559+0000 7fc0162f46c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc0100f9b40 con 0x7fc01010fe80 2026-02-13T02:19:08.565 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.560+0000 7fc0152f26c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fc01010ed00 0x7fc0100f8380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:08.565 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.560+0000 7fc0152f26c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fc01010ed00 0x7fc0100f8380 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:49016/0 (socket says 10.20.193.11:49016) 2026-02-13T02:19:08.566 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.560+0000 7fc0152f26c0 1 -- 10.20.193.11:0/3762569616 learned_addr learned my addr 10.20.193.11:0/3762569616 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:19:08.566 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.560+0000 7fc014af16c0 1 --2- 10.20.193.11:0/3762569616 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fc01010fe80 0x7fc0101711a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:08.566 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.560+0000 7fc015af36c0 1 --2- 10.20.193.11:0/3762569616 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fc010110830 0x7fc0100f8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:08.566 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.560+0000 7fc0152f26c0 1 -- 10.20.193.11:0/3762569616 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fc01010fe80 msgr2=0x7fc0101711a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:08.566 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.560+0000 7fc0152f26c0 1 --2- 10.20.193.11:0/3762569616 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fc01010fe80 0x7fc0101711a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:08.566 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.560+0000 7fc0152f26c0 1 -- 10.20.193.11:0/3762569616 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fc010110830 msgr2=0x7fc0100f8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:08.566 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.560+0000 7fc0152f26c0 1 --2- 10.20.193.11:0/3762569616 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fc010110830 0x7fc0100f8bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:08.566 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.560+0000 7fc0152f26c0 1 -- 10.20.193.11:0/3762569616 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc004009590 con 0x7fc01010ed00 2026-02-13T02:19:08.566 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.560+0000 7fc014af16c0 1 --2- 10.20.193.11:0/3762569616 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fc01010fe80 0x7fc0101711a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T02:19:08.566 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.560+0000 7fc0152f26c0 1 --2- 10.20.193.11:0/3762569616 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fc01010ed00 0x7fc0100f8380 secure :-1 s=READY pgs=248 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc000005dc0 tx=0x7fc00000bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:08.566 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.560+0000 7fbffe7fc6c0 1 -- 10.20.193.11:0/3762569616 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc000004250 con 0x7fc01010ed00 2026-02-13T02:19:08.567 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.560+0000 7fbffe7fc6c0 1 -- 10.20.193.11:0/3762569616 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fc000009070 con 0x7fc01010ed00 2026-02-13T02:19:08.567 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.560+0000 7fc0162f46c0 1 -- 10.20.193.11:0/3762569616 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0100f9dc0 con 0x7fc01010ed00 2026-02-13T02:19:08.567 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.560+0000 7fbffe7fc6c0 1 -- 10.20.193.11:0/3762569616 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc00000cde0 con 0x7fc01010ed00 2026-02-13T02:19:08.567 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.560+0000 7fc0162f46c0 1 -- 10.20.193.11:0/3762569616 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0100fa2a0 con 0x7fc01010ed00 2026-02-13T02:19:08.567 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.560+0000 7fc0162f46c0 1 -- 10.20.193.11:0/3762569616 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0101751f0 con 0x7fc01010ed00 2026-02-13T02:19:08.567 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.562+0000 7fbffe7fc6c0 1 -- 10.20.193.11:0/3762569616 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7fc0000028c0 con 0x7fc01010ed00 2026-02-13T02:19:08.568 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.562+0000 7fbffe7fc6c0 1 --2- 10.20.193.11:0/3762569616 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fbfec0b5710 0x7fbfec0d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:08.568 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.562+0000 7fc014af16c0 1 --2- 10.20.193.11:0/3762569616 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fbfec0b5710 0x7fbfec0d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:08.568 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.563+0000 7fbffe7fc6c0 1 -- 10.20.193.11:0/3762569616 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7762+0+0 (secure 0 0 0) 0x7fc0000e3a90 con 0x7fc01010ed00 2026-02-13T02:19:08.569 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.563+0000 7fc014af16c0 1 --2- 10.20.193.11:0/3762569616 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fbfec0b5710 0x7fbfec0d5bc0 secure :-1 s=READY pgs=180 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc0040023e0 tx=0x7fc004031f90 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:08.569 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.563+0000 7fbffe7fc6c0 1 -- 10.20.193.11:0/3762569616 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fc0000a9f10 con 0x7fc01010ed00 2026-02-13T02:19:08.692 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.690+0000 7fc0162f46c0 1 -- 10.20.193.11:0/3762569616 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7fc01010f0f0 con 0x7fc01010ed00 2026-02-13T02:19:08.693 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.692+0000 7fbffe7fc6c0 1 -- 10.20.193.11:0/3762569616 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v31) ==== 170+0+59 (secure 0 0 0) 0x7fc0000a9660 con 0x7fc01010ed00 2026-02-13T02:19:08.694 INFO:teuthology.orchestra.run.trial011.stdout:[client.0] 2026-02-13T02:19:08.694 INFO:teuthology.orchestra.run.trial011.stdout: key = AQAcio5pj1w9KRAAAlcBnSyzM0Iku4L3ZWdjzw== 2026-02-13T02:19:08.695 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.693+0000 7fc0162f46c0 1 -- 10.20.193.11:0/3762569616 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fbfec0b5710 msgr2=0x7fbfec0d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:08.695 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.693+0000 7fc0162f46c0 1 --2- 10.20.193.11:0/3762569616 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fbfec0b5710 0x7fbfec0d5bc0 secure :-1 s=READY pgs=180 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc0040023e0 tx=0x7fc004031f90 comp rx=0 tx=0).stop 2026-02-13T02:19:08.695 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.693+0000 7fc0162f46c0 1 -- 10.20.193.11:0/3762569616 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fc01010ed00 msgr2=0x7fc0100f8380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:08.695 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.693+0000 7fc0162f46c0 1 --2- 10.20.193.11:0/3762569616 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fc01010ed00 0x7fc0100f8380 secure :-1 s=READY pgs=248 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc000005dc0 tx=0x7fc00000bbb0 comp rx=0 tx=0).stop 2026-02-13T02:19:08.696 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.693+0000 7fc0162f46c0 1 -- 10.20.193.11:0/3762569616 shutdown_connections 2026-02-13T02:19:08.696 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.693+0000 7fc0162f46c0 1 --2- 10.20.193.11:0/3762569616 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fbfec0b5710 0x7fbfec0d5bc0 unknown :-1 s=CLOSED pgs=180 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:08.696 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.693+0000 7fc0162f46c0 1 --2- 10.20.193.11:0/3762569616 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fc010110830 0x7fc0100f8bc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:08.696 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.693+0000 7fc0162f46c0 1 --2- 10.20.193.11:0/3762569616 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fc01010fe80 0x7fc0101711a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:08.696 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.693+0000 7fc0162f46c0 1 --2- 10.20.193.11:0/3762569616 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fc01010ed00 0x7fc0100f8380 unknown :-1 s=CLOSED pgs=248 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:08.696 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.693+0000 7fc0162f46c0 1 -- 10.20.193.11:0/3762569616 >> 10.20.193.11:0/3762569616 conn(0x7fc0100ec400 msgr2=0x7fc0100ee940 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:08.696 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.693+0000 7fc0162f46c0 1 -- 10.20.193.11:0/3762569616 shutdown_connections 2026-02-13T02:19:08.696 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:08.693+0000 7fc0162f46c0 1 -- 10.20.193.11:0/3762569616 wait complete. 2026-02-13T02:19:08.733 DEBUG:teuthology.orchestra.run.trial011:> set -ex 2026-02-13T02:19:08.733 DEBUG:teuthology.orchestra.run.trial011:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2026-02-13T02:19:08.733 DEBUG:teuthology.orchestra.run.trial011:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-13T02:19:08.811 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph config log 1 --format=json 2026-02-13T02:19:08.974 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:19:09.088 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.084+0000 7f3b9b4296c0 1 -- 10.20.193.11:0/3729801824 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f3b9410fbf0 msgr2=0x7f3b94114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:09.088 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.084+0000 7f3b9b4296c0 1 --2- 10.20.193.11:0/3729801824 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f3b9410fbf0 0x7f3b94114c30 secure :-1 s=READY pgs=249 gs=1 cs=0 l=1 c_cookie=4007585535927233145 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3b880099a0 tx=0x7f3b8802ed20 comp rx=0 tx=0).stop 2026-02-13T02:19:09.088 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.084+0000 7f3b9b4296c0 1 -- 10.20.193.11:0/3729801824 shutdown_connections 2026-02-13T02:19:09.088 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.084+0000 7f3b9b4296c0 1 --2- 10.20.193.11:0/3729801824 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f3b94115410 0x7f3b94175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:09.089 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.084+0000 7f3b9b4296c0 1 --2- 10.20.193.11:0/3729801824 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f3b9410fbf0 0x7f3b94114c30 unknown :-1 s=CLOSED pgs=249 gs=1 cs=0 l=1 c_cookie=4007585535927233145 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:09.089 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.084+0000 7f3b9b4296c0 1 --2- 10.20.193.11:0/3729801824 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f3b9410f200 0x7f3b9410f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:09.089 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.084+0000 7f3b9b4296c0 1 -- 10.20.193.11:0/3729801824 >> 10.20.193.11:0/3729801824 conn(0x7f3b940ecb00 msgr2=0x7f3b9410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:09.089 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.084+0000 7f3b9b4296c0 1 -- 10.20.193.11:0/3729801824 shutdown_connections 2026-02-13T02:19:09.089 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.084+0000 7f3b9b4296c0 1 -- 10.20.193.11:0/3729801824 wait complete. 2026-02-13T02:19:09.089 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.084+0000 7f3b9b4296c0 1 Processor -- start 2026-02-13T02:19:09.089 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.084+0000 7f3b9b4296c0 1 -- start start 2026-02-13T02:19:09.089 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.084+0000 7f3b9b4296c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f3b9410f200 0x7f3b940f4c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:09.089 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.084+0000 7f3b9b4296c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f3b94115410 0x7f3b94175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:09.089 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.084+0000 7f3b9b4296c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f3b940f5270 0x7f3b940fa540 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:09.089 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.084+0000 7f3b9b4296c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f3b940f5960 con 0x7f3b940f5270 2026-02-13T02:19:09.090 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.084+0000 7f3b9b4296c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f3b940faa80 con 0x7f3b94115410 2026-02-13T02:19:09.090 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.084+0000 7f3b9b4296c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f3b940fac40 con 0x7f3b9410f200 2026-02-13T02:19:09.090 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.084+0000 7f3b9999b6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f3b940f5270 0x7f3b940fa540 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:09.090 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.084+0000 7f3b9999b6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f3b940f5270 0x7f3b940fa540 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:49040/0 (socket says 10.20.193.11:49040) 2026-02-13T02:19:09.090 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.084+0000 7f3b9999b6c0 1 -- 10.20.193.11:0/2939192386 learned_addr learned my addr 10.20.193.11:0/2939192386 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:19:09.090 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.084+0000 7f3b989996c0 1 --2- 10.20.193.11:0/2939192386 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f3b94115410 0x7f3b94175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:09.090 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.084+0000 7f3b9919a6c0 1 --2- 10.20.193.11:0/2939192386 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f3b9410f200 0x7f3b940f4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:09.090 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.084+0000 7f3b9999b6c0 1 -- 10.20.193.11:0/2939192386 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f3b9410f200 msgr2=0x7f3b940f4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:09.090 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.084+0000 7f3b9999b6c0 1 --2- 10.20.193.11:0/2939192386 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f3b9410f200 0x7f3b940f4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:09.090 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.084+0000 7f3b9999b6c0 1 -- 10.20.193.11:0/2939192386 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f3b94115410 msgr2=0x7f3b94175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:09.090 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.084+0000 7f3b9999b6c0 1 --2- 10.20.193.11:0/2939192386 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f3b94115410 0x7f3b94175cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:09.090 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.084+0000 7f3b9999b6c0 1 -- 10.20.193.11:0/2939192386 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b88009590 con 0x7f3b940f5270 2026-02-13T02:19:09.091 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.084+0000 7f3b9999b6c0 1 --2- 10.20.193.11:0/2939192386 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f3b940f5270 0x7f3b940fa540 secure :-1 s=READY pgs=250 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3b90006ea0 tx=0x7f3b9000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:09.091 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.085+0000 7f3b827fc6c0 1 -- 10.20.193.11:0/2939192386 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3b90003a30 con 0x7f3b940f5270 2026-02-13T02:19:09.091 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.085+0000 7f3b827fc6c0 1 -- 10.20.193.11:0/2939192386 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3b90005510 con 0x7f3b940f5270 2026-02-13T02:19:09.091 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.085+0000 7f3b9b4296c0 1 -- 10.20.193.11:0/2939192386 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b940faf20 con 0x7f3b940f5270 2026-02-13T02:19:09.091 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.085+0000 7f3b827fc6c0 1 -- 10.20.193.11:0/2939192386 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3b9000dd70 con 0x7f3b940f5270 2026-02-13T02:19:09.091 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.085+0000 7f3b9b4296c0 1 -- 10.20.193.11:0/2939192386 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b940fb3b0 con 0x7f3b940f5270 2026-02-13T02:19:09.091 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.085+0000 7f3b9b4296c0 1 -- 10.20.193.11:0/2939192386 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b941104d0 con 0x7f3b940f5270 2026-02-13T02:19:09.091 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.086+0000 7f3b827fc6c0 1 -- 10.20.193.11:0/2939192386 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7f3b90003b90 con 0x7f3b940f5270 2026-02-13T02:19:09.092 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.087+0000 7f3b827fc6c0 1 --2- 10.20.193.11:0/2939192386 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f3b700b5690 0x7f3b700d5b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:09.092 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.087+0000 7f3b9919a6c0 1 --2- 10.20.193.11:0/2939192386 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f3b700b5690 0x7f3b700d5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:09.092 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.087+0000 7f3b827fc6c0 1 -- 10.20.193.11:0/2939192386 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7762+0+0 (secure 0 0 0) 0x7f3b900e4920 con 0x7f3b940f5270 2026-02-13T02:19:09.092 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.087+0000 7f3b9919a6c0 1 --2- 10.20.193.11:0/2939192386 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f3b700b5690 0x7f3b700d5b40 secure :-1 s=READY pgs=181 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3b84005980 tx=0x7f3b840094b0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:09.093 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.087+0000 7f3b827fc6c0 1 -- 10.20.193.11:0/2939192386 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f3b900a7380 con 0x7f3b940f5270 2026-02-13T02:19:09.182 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.179+0000 7f3b9b4296c0 1 -- 10.20.193.11:0/2939192386 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f3b940fb3b0 con 0x7f3b940f5270 2026-02-13T02:19:09.182 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.180+0000 7f3b827fc6c0 1 -- 10.20.193.11:0/2939192386 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v45) ==== 86+0+133 (secure 0 0 0) 0x7f3b900aa530 con 0x7f3b940f5270 2026-02-13T02:19:09.182 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:19:09.183 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.181+0000 7f3b9b4296c0 1 -- 10.20.193.11:0/2939192386 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f3b700b5690 msgr2=0x7f3b700d5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:09.183 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.181+0000 7f3b9b4296c0 1 --2- 10.20.193.11:0/2939192386 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f3b700b5690 0x7f3b700d5b40 secure :-1 s=READY pgs=181 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3b84005980 tx=0x7f3b840094b0 comp rx=0 tx=0).stop 2026-02-13T02:19:09.183 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.181+0000 7f3b9b4296c0 1 -- 10.20.193.11:0/2939192386 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f3b940f5270 msgr2=0x7f3b940fa540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:09.184 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.181+0000 7f3b9b4296c0 1 --2- 10.20.193.11:0/2939192386 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f3b940f5270 0x7f3b940fa540 secure :-1 s=READY pgs=250 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3b90006ea0 tx=0x7f3b9000cca0 comp rx=0 tx=0).stop 2026-02-13T02:19:09.184 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.181+0000 7f3b9b4296c0 1 -- 10.20.193.11:0/2939192386 shutdown_connections 2026-02-13T02:19:09.184 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.181+0000 7f3b9b4296c0 1 --2- 10.20.193.11:0/2939192386 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f3b700b5690 0x7f3b700d5b40 unknown :-1 s=CLOSED pgs=181 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:09.184 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.181+0000 7f3b9b4296c0 1 --2- 10.20.193.11:0/2939192386 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f3b94115410 0x7f3b94175cb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:09.184 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.181+0000 7f3b9b4296c0 1 --2- 10.20.193.11:0/2939192386 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f3b940f5270 0x7f3b940fa540 unknown :-1 s=CLOSED pgs=250 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:09.184 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.181+0000 7f3b9b4296c0 1 --2- 10.20.193.11:0/2939192386 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f3b9410f200 0x7f3b940f4c40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:09.184 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.181+0000 7f3b9b4296c0 1 -- 10.20.193.11:0/2939192386 >> 10.20.193.11:0/2939192386 conn(0x7f3b940ecb00 msgr2=0x7f3b9410d860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:09.184 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.181+0000 7f3b9b4296c0 1 -- 10.20.193.11:0/2939192386 shutdown_connections 2026-02-13T02:19:09.184 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.181+0000 7f3b9b4296c0 1 -- 10.20.193.11:0/2939192386 wait complete. 2026-02-13T02:19:09.219 INFO:teuthology.orchestra.run.trial011.stdout:[{"version":45,"timestamp":"2026-02-13T02:18:54.497631+0000","name":"","changes":[{"name":"mds.all/mds_join_fs","new_value":"all"}]}] 2026-02-13T02:19:09.220 INFO:tasks.ceph_manager:config epoch is 45 2026-02-13T02:19:09.220 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-13T02:19:09.220 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2026-02-13T02:19:09.221 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph mgr dump --format=json 2026-02-13T02:19:09.247 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:09 trial011 ceph-mon[11956]: from='client.14901 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T02:19:09.247 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:09 trial011 ceph-mon[11956]: from='client.14907 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T02:19:09.247 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:09 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/3762569616' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-13T02:19:09.247 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:09 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/3762569616' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-13T02:19:09.344 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:19:09.460 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.456+0000 7fc66c2016c0 1 -- 10.20.193.11:0/2706901144 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fc66410f200 msgr2=0x7fc66410f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:09.460 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.456+0000 7fc66c2016c0 1 --2- 10.20.193.11:0/2706901144 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fc66410f200 0x7fc66410f5d0 secure :-1 s=READY pgs=251 gs=1 cs=0 l=1 c_cookie=9387255813052581294 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc6540099a0 tx=0x7fc65402ed20 comp rx=0 tx=0).stop 2026-02-13T02:19:09.460 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.456+0000 7fc66c2016c0 1 -- 10.20.193.11:0/2706901144 shutdown_connections 2026-02-13T02:19:09.461 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.456+0000 7fc66c2016c0 1 --2- 10.20.193.11:0/2706901144 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fc664115410 0x7fc664175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:09.461 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.456+0000 7fc66c2016c0 1 --2- 10.20.193.11:0/2706901144 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fc66410fbf0 0x7fc664114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:09.461 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.456+0000 7fc66c2016c0 1 --2- 10.20.193.11:0/2706901144 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fc66410f200 0x7fc66410f5d0 unknown :-1 s=CLOSED pgs=251 gs=1 cs=0 l=1 c_cookie=9387255813052581294 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:09.461 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.456+0000 7fc66c2016c0 1 -- 10.20.193.11:0/2706901144 >> 10.20.193.11:0/2706901144 conn(0x7fc6640ecb00 msgr2=0x7fc66410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:09.461 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.456+0000 7fc66c2016c0 1 -- 10.20.193.11:0/2706901144 shutdown_connections 2026-02-13T02:19:09.461 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.456+0000 7fc66c2016c0 1 -- 10.20.193.11:0/2706901144 wait complete. 2026-02-13T02:19:09.461 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.456+0000 7fc66c2016c0 1 Processor -- start 2026-02-13T02:19:09.461 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.456+0000 7fc66c2016c0 1 -- start start 2026-02-13T02:19:09.461 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.456+0000 7fc66c2016c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fc66410f200 0x7fc66411d1e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:09.461 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.456+0000 7fc66c2016c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fc664115410 0x7fc66411d720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:09.461 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.456+0000 7fc66c2016c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fc664122ae0 0x7fc664122f80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:09.462 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.456+0000 7fc66c2016c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7fc6641234f0 con 0x7fc664115410 2026-02-13T02:19:09.462 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.456+0000 7fc66c2016c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc664123660 con 0x7fc66410f200 2026-02-13T02:19:09.462 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.456+0000 7fc66c2016c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc664123820 con 0x7fc664122ae0 2026-02-13T02:19:09.462 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.456+0000 7fc6697716c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fc664115410 0x7fc66411d720 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:09.462 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.456+0000 7fc6697716c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fc664115410 0x7fc66411d720 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:49058/0 (socket says 10.20.193.11:49058) 2026-02-13T02:19:09.462 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.456+0000 7fc6697716c0 1 -- 10.20.193.11:0/3711161422 learned_addr learned my addr 10.20.193.11:0/3711161422 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:19:09.462 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.456+0000 7fc669f726c0 1 --2- 10.20.193.11:0/3711161422 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fc66410f200 0x7fc66411d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:09.462 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.456+0000 7fc66a7736c0 1 --2- 10.20.193.11:0/3711161422 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fc664122ae0 0x7fc664122f80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:09.462 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.456+0000 7fc6697716c0 1 -- 10.20.193.11:0/3711161422 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fc664122ae0 msgr2=0x7fc664122f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:09.462 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.456+0000 7fc6697716c0 1 --2- 10.20.193.11:0/3711161422 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fc664122ae0 0x7fc664122f80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:09.462 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.456+0000 7fc6697716c0 1 -- 10.20.193.11:0/3711161422 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fc66410f200 msgr2=0x7fc66411d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:09.463 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.456+0000 7fc6697716c0 1 --2- 10.20.193.11:0/3711161422 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fc66410f200 0x7fc66411d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:09.463 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.456+0000 7fc6697716c0 1 -- 10.20.193.11:0/3711161422 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc654009590 con 0x7fc664115410 2026-02-13T02:19:09.463 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.457+0000 7fc6697716c0 1 --2- 10.20.193.11:0/3711161422 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fc664115410 0x7fc66411d720 secure :-1 s=READY pgs=252 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc658005dc0 tx=0x7fc65800bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:09.463 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.457+0000 7fc652ffd6c0 1 -- 10.20.193.11:0/3711161422 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc658004250 con 0x7fc664115410 2026-02-13T02:19:09.463 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.457+0000 7fc652ffd6c0 1 -- 10.20.193.11:0/3711161422 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fc658009070 con 0x7fc664115410 2026-02-13T02:19:09.463 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.457+0000 7fc66c2016c0 1 -- 10.20.193.11:0/3711161422 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc664163cd0 con 0x7fc664115410 2026-02-13T02:19:09.463 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.457+0000 7fc652ffd6c0 1 -- 10.20.193.11:0/3711161422 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc65800cdc0 con 0x7fc664115410 2026-02-13T02:19:09.463 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.457+0000 7fc66c2016c0 1 -- 10.20.193.11:0/3711161422 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc664164160 con 0x7fc664115410 2026-02-13T02:19:09.463 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.457+0000 7fc66c2016c0 1 -- 10.20.193.11:0/3711161422 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6641104d0 con 0x7fc664115410 2026-02-13T02:19:09.463 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.458+0000 7fc652ffd6c0 1 -- 10.20.193.11:0/3711161422 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7fc6580028c0 con 0x7fc664115410 2026-02-13T02:19:09.464 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.459+0000 7fc652ffd6c0 1 --2- 10.20.193.11:0/3711161422 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fc6400b5690 0x7fc6400d5b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:09.465 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.459+0000 7fc669f726c0 1 --2- 10.20.193.11:0/3711161422 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fc6400b5690 0x7fc6400d5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:09.465 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.459+0000 7fc652ffd6c0 1 -- 10.20.193.11:0/3711161422 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7762+0+0 (secure 0 0 0) 0x7fc6580e3b40 con 0x7fc664115410 2026-02-13T02:19:09.465 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.459+0000 7fc669f726c0 1 --2- 10.20.193.11:0/3711161422 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fc6400b5690 0x7fc6400d5b40 secure :-1 s=READY pgs=182 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc6540023e0 tx=0x7fc654031f90 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:09.465 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.460+0000 7fc652ffd6c0 1 -- 10.20.193.11:0/3711161422 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fc6580a65a0 con 0x7fc664115410 2026-02-13T02:19:09.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:09 trial060 ceph-mon[14797]: from='client.14901 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T02:19:09.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:09 trial060 ceph-mon[14797]: from='client.14907 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T02:19:09.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:09 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/3762569616' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-13T02:19:09.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:09 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/3762569616' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-13T02:19:09.541 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:09 trial078 ceph-mon[14969]: from='client.14901 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T02:19:09.541 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:09 trial078 ceph-mon[14969]: from='client.14907 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T02:19:09.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:09 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/3762569616' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-13T02:19:09.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:09 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/3762569616' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-13T02:19:09.579 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.577+0000 7fc66c2016c0 1 -- 10.20.193.11:0/3711161422 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fc66410f5d0 con 0x7fc664115410 2026-02-13T02:19:09.582 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.580+0000 7fc652ffd6c0 1 -- 10.20.193.11:0/3711161422 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v11) ==== 74+0+297575 (secure 0 0 0) 0x7fc6580a9750 con 0x7fc664115410 2026-02-13T02:19:09.588 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:19:09.591 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.583+0000 7fc66c2016c0 1 -- 10.20.193.11:0/3711161422 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fc6400b5690 msgr2=0x7fc6400d5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:09.591 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.583+0000 7fc66c2016c0 1 --2- 10.20.193.11:0/3711161422 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fc6400b5690 0x7fc6400d5b40 secure :-1 s=READY pgs=182 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc6540023e0 tx=0x7fc654031f90 comp rx=0 tx=0).stop 2026-02-13T02:19:09.591 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.583+0000 7fc66c2016c0 1 -- 10.20.193.11:0/3711161422 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fc664115410 msgr2=0x7fc66411d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:09.591 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.583+0000 7fc66c2016c0 1 --2- 10.20.193.11:0/3711161422 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fc664115410 0x7fc66411d720 secure :-1 s=READY pgs=252 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc658005dc0 tx=0x7fc65800bbb0 comp rx=0 tx=0).stop 2026-02-13T02:19:09.591 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.583+0000 7fc66c2016c0 1 -- 10.20.193.11:0/3711161422 shutdown_connections 2026-02-13T02:19:09.591 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.583+0000 7fc66c2016c0 1 --2- 10.20.193.11:0/3711161422 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fc6400b5690 0x7fc6400d5b40 unknown :-1 s=CLOSED pgs=182 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:09.591 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.583+0000 7fc66c2016c0 1 --2- 10.20.193.11:0/3711161422 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fc664122ae0 0x7fc664122f80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:09.591 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.583+0000 7fc66c2016c0 1 --2- 10.20.193.11:0/3711161422 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fc664115410 0x7fc66411d720 unknown :-1 s=CLOSED pgs=252 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:09.591 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.583+0000 7fc66c2016c0 1 --2- 10.20.193.11:0/3711161422 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fc66410f200 0x7fc66411d1e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:09.592 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.583+0000 7fc66c2016c0 1 -- 10.20.193.11:0/3711161422 >> 10.20.193.11:0/3711161422 conn(0x7fc6640ecb00 msgr2=0x7fc66410cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:09.592 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.583+0000 7fc66c2016c0 1 -- 10.20.193.11:0/3711161422 shutdown_connections 2026-02-13T02:19:09.592 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.583+0000 7fc66c2016c0 1 -- 10.20.193.11:0/3711161422 wait complete. 2026-02-13T02:19:09.623 INFO:teuthology.orchestra.run.trial011.stdout:{"epoch":11,"flags":0,"active_gid":14116,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6800","nonce":861334768},{"type":"v1","addr":"10.20.193.11:6801","nonce":861334768}]},"active_addr":"10.20.193.11:6801/861334768","active_change":"2026-02-13T02:16:41.426244+0000","active_mgr_features":4544132024016699391,"available":true,"standbys":[{"gid":14247,"name":"z","mgr_features":4544132024016699391,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often the agent on each host will gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"The first TCP port the agent will try to bind to. Up to 1000 subsequent ports will be attempted if this port cannot be bound","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this option can facilitate debugging daemons that encounter runtime problems.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"Fraction of total system memory to divide among autotuned daemons. Converged systems hosting both Ceph and compute should set a lower value; systems with more than 10 GiB of memory per OSD may benefit from a slightly larger value so that the abundance of RAM can be fully utilized","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command persistent logging","long_desc":"","tags":[],"see_also":[]},"certificate_automated_rotation_enabled":{"name":"certificate_automated_rotation_enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"This flag controls whether cephadm automatically rotates certificates upon expiration.","long_desc":"","tags":[],"see_also":[]},"certificate_check_debug_mode":{"name":"certificate_check_debug_mode","type":"bool","level":"dev","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.","long_desc":"","tags":[],"see_also":[]},"certificate_check_period":{"name":"certificate_check_period","type":"int","level":"advanced","flags":0,"default_value":"1","min":"0","max":"30","enum_allowed":[],"desc":"Specifies how often (in days) the certificate should be checked for validity.","long_desc":"","tags":[],"see_also":[]},"certificate_duration_days":{"name":"certificate_duration_days","type":"int","level":"advanced","flags":0,"default_value":"1095","min":"90","max":"3650","enum_allowed":[],"desc":"Specifies the duration of self-signed certificates generated and signed by the cephadm root CA","long_desc":"","tags":[],"see_also":[]},"certificate_renewal_threshold_days":{"name":"certificate_renewal_threshold_days","type":"int","level":"advanced","flags":0,"default_value":"30","min":"10","max":"90","enum_allowed":[],"desc":"Specifies the lead time in days to initiate certificate renewal before expiration.","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently Podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.28.1","min":"","max":"","enum_allowed":[],"desc":"Alertmanager container image","long_desc":"","tags":[],"see_also":[]},"container_image_alloy":{"name":"container_image_alloy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/alloy:latest","min":"","max":"","enum_allowed":[],"desc":"Alloy container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"Elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:12.3.1","min":"","max":"","enum_allowed":[],"desc":"Grafana container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"Haproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.9.1","min":"","max":"","enum_allowed":[],"desc":"Node exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.6","min":"","max":"","enum_allowed":[],"desc":"Nvmeof container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"Oauth2 proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v3.6.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba metrics container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"Snmp gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"Location of dashboards to include in Grafana","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether the hardware monitoring daemon be deployed on every host?","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at the debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of daemons per service per host: guard against mistakes and runaways","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of OSDs that will be drained simultaneously when OSDs are removed","long_desc":"","tags":[],"see_also":[]},"max_parallel_osd_upgrades":{"name":"max_parallel_osd_upgrades","type":"int","level":"advanced","flags":0,"default_value":"16","min":"","max":"","enum_allowed":[],"desc":"Maximum number of OSD daemons upgraded in parallel.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"Mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default IP address for RedFish API (OOB management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"Location of alerts to include in Prometheus Alertmanager","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry URL for login purposes. This is not the default registry.","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"Cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Customized SSH config file to distribute to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many sequential SSH connection liveness check failures before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often SSH connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"stray_daemon_check_interval":{"name":"stray_daemon_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"How frequently cephadm should check for the presence of stray daemons","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use the cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest to ensure that all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROM_ALERT_CREDENTIAL_CACHE_TTL":{"name":"PROM_ALERT_CREDENTIAL_CACHE_TTL","type":"int","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_HOSTNAME_PER_DAEMON":{"name":"RGW_HOSTNAME_PER_DAEMON","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"healthcheck_history_max_entries":{"name":"healthcheck_history_max_entries","type":"int","level":"advanced","flags":1,"default_value":"1000","min":"","max":"","enum_allowed":[],"desc":"Maximum number of health check history entries to keep","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"prometheus_tls_secret_name":{"name":"prometheus_tls_secret_name","type":"str","level":"advanced","flags":0,"default_value":"rook-ceph-prometheus-server-tls","min":"","max":"","enum_allowed":[],"desc":"name of tls secret in k8s for prometheus","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":14352,"name":"y","mgr_features":4544132024016699391,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often the agent on each host will gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"The first TCP port the agent will try to bind to. Up to 1000 subsequent ports will be attempted if this port cannot be bound","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this option can facilitate debugging daemons that encounter runtime problems.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"Fraction of total system memory to divide among autotuned daemons. Converged systems hosting both Ceph and compute should set a lower value; systems with more than 10 GiB of memory per OSD may benefit from a slightly larger value so that the abundance of RAM can be fully utilized","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command persistent logging","long_desc":"","tags":[],"see_also":[]},"certificate_automated_rotation_enabled":{"name":"certificate_automated_rotation_enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"This flag controls whether cephadm automatically rotates certificates upon expiration.","long_desc":"","tags":[],"see_also":[]},"certificate_check_debug_mode":{"name":"certificate_check_debug_mode","type":"bool","level":"dev","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.","long_desc":"","tags":[],"see_also":[]},"certificate_check_period":{"name":"certificate_check_period","type":"int","level":"advanced","flags":0,"default_value":"1","min":"0","max":"30","enum_allowed":[],"desc":"Specifies how often (in days) the certificate should be checked for validity.","long_desc":"","tags":[],"see_also":[]},"certificate_duration_days":{"name":"certificate_duration_days","type":"int","level":"advanced","flags":0,"default_value":"1095","min":"90","max":"3650","enum_allowed":[],"desc":"Specifies the duration of self-signed certificates generated and signed by the cephadm root CA","long_desc":"","tags":[],"see_also":[]},"certificate_renewal_threshold_days":{"name":"certificate_renewal_threshold_days","type":"int","level":"advanced","flags":0,"default_value":"30","min":"10","max":"90","enum_allowed":[],"desc":"Specifies the lead time in days to initiate certificate renewal before expiration.","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently Podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.28.1","min":"","max":"","enum_allowed":[],"desc":"Alertmanager container image","long_desc":"","tags":[],"see_also":[]},"container_image_alloy":{"name":"container_image_alloy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/alloy:latest","min":"","max":"","enum_allowed":[],"desc":"Alloy container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"Elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:12.3.1","min":"","max":"","enum_allowed":[],"desc":"Grafana container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"Haproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.9.1","min":"","max":"","enum_allowed":[],"desc":"Node exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.6","min":"","max":"","enum_allowed":[],"desc":"Nvmeof container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"Oauth2 proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v3.6.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba metrics container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"Snmp gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"Location of dashboards to include in Grafana","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether the hardware monitoring daemon be deployed on every host?","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at the debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of daemons per service per host: guard against mistakes and runaways","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of OSDs that will be drained simultaneously when OSDs are removed","long_desc":"","tags":[],"see_also":[]},"max_parallel_osd_upgrades":{"name":"max_parallel_osd_upgrades","type":"int","level":"advanced","flags":0,"default_value":"16","min":"","max":"","enum_allowed":[],"desc":"Maximum number of OSD daemons upgraded in parallel.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"Mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default IP address for RedFish API (OOB management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"Location of alerts to include in Prometheus Alertmanager","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry URL for login purposes. This is not the default registry.","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"Cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Customized SSH config file to distribute to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many sequential SSH connection liveness check failures before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often SSH connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"stray_daemon_check_interval":{"name":"stray_daemon_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"How frequently cephadm should check for the presence of stray daemons","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use the cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest to ensure that all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROM_ALERT_CREDENTIAL_CACHE_TTL":{"name":"PROM_ALERT_CREDENTIAL_CACHE_TTL","type":"int","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_HOSTNAME_PER_DAEMON":{"name":"RGW_HOSTNAME_PER_DAEMON","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"healthcheck_history_max_entries":{"name":"healthcheck_history_max_entries","type":"int","level":"advanced","flags":1,"default_value":"1000","min":"","max":"","enum_allowed":[],"desc":"Maximum number of health check history entries to keep","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"prometheus_tls_secret_name":{"name":"prometheus_tls_secret_name","type":"str","level":"advanced","flags":0,"default_value":"rook-ceph-prometheus-server-tls","min":"","max":"","enum_allowed":[],"desc":"name of tls secret in k8s for prometheus","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","iostat","nfs"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often the agent on each host will gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"The first TCP port the agent will try to bind to. Up to 1000 subsequent ports will be attempted if this port cannot be bound","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this option can facilitate debugging daemons that encounter runtime problems.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"Fraction of total system memory to divide among autotuned daemons. Converged systems hosting both Ceph and compute should set a lower value; systems with more than 10 GiB of memory per OSD may benefit from a slightly larger value so that the abundance of RAM can be fully utilized","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command persistent logging","long_desc":"","tags":[],"see_also":[]},"certificate_automated_rotation_enabled":{"name":"certificate_automated_rotation_enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"This flag controls whether cephadm automatically rotates certificates upon expiration.","long_desc":"","tags":[],"see_also":[]},"certificate_check_debug_mode":{"name":"certificate_check_debug_mode","type":"bool","level":"dev","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.","long_desc":"","tags":[],"see_also":[]},"certificate_check_period":{"name":"certificate_check_period","type":"int","level":"advanced","flags":0,"default_value":"1","min":"0","max":"30","enum_allowed":[],"desc":"Specifies how often (in days) the certificate should be checked for validity.","long_desc":"","tags":[],"see_also":[]},"certificate_duration_days":{"name":"certificate_duration_days","type":"int","level":"advanced","flags":0,"default_value":"1095","min":"90","max":"3650","enum_allowed":[],"desc":"Specifies the duration of self-signed certificates generated and signed by the cephadm root CA","long_desc":"","tags":[],"see_also":[]},"certificate_renewal_threshold_days":{"name":"certificate_renewal_threshold_days","type":"int","level":"advanced","flags":0,"default_value":"30","min":"10","max":"90","enum_allowed":[],"desc":"Specifies the lead time in days to initiate certificate renewal before expiration.","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently Podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.28.1","min":"","max":"","enum_allowed":[],"desc":"Alertmanager container image","long_desc":"","tags":[],"see_also":[]},"container_image_alloy":{"name":"container_image_alloy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/alloy:latest","min":"","max":"","enum_allowed":[],"desc":"Alloy container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"Elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:12.3.1","min":"","max":"","enum_allowed":[],"desc":"Grafana container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"Haproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.9.1","min":"","max":"","enum_allowed":[],"desc":"Node exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.6","min":"","max":"","enum_allowed":[],"desc":"Nvmeof container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"Oauth2 proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v3.6.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba metrics container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"Snmp gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"Location of dashboards to include in Grafana","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether the hardware monitoring daemon be deployed on every host?","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at the debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of daemons per service per host: guard against mistakes and runaways","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of OSDs that will be drained simultaneously when OSDs are removed","long_desc":"","tags":[],"see_also":[]},"max_parallel_osd_upgrades":{"name":"max_parallel_osd_upgrades","type":"int","level":"advanced","flags":0,"default_value":"16","min":"","max":"","enum_allowed":[],"desc":"Maximum number of OSD daemons upgraded in parallel.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"Mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default IP address for RedFish API (OOB management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"Location of alerts to include in Prometheus Alertmanager","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry URL for login purposes. This is not the default registry.","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"Cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Customized SSH config file to distribute to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many sequential SSH connection liveness check failures before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often SSH connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"stray_daemon_check_interval":{"name":"stray_daemon_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"How frequently cephadm should check for the presence of stray daemons","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use the cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest to ensure that all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROM_ALERT_CREDENTIAL_CACHE_TTL":{"name":"PROM_ALERT_CREDENTIAL_CACHE_TTL","type":"int","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_HOSTNAME_PER_DAEMON":{"name":"RGW_HOSTNAME_PER_DAEMON","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"healthcheck_history_max_entries":{"name":"healthcheck_history_max_entries","type":"int","level":"advanced","flags":1,"default_value":"1000","min":"","max":"","enum_allowed":[],"desc":"Maximum number of health check history entries to keep","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"prometheus_tls_secret_name":{"name":"prometheus_tls_secret_name","type":"str","level":"advanced","flags":0,"default_value":"rook-ceph-prometheus-server-tls","min":"","max":"","enum_allowed":[],"desc":"name of tls secret in k8s for prometheus","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"tentacle":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":2,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"10.20.193.11:0","nonce":3122398620}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.11:0","nonce":911950780}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.11:0","nonce":3639208955}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.11:0","nonce":1455468061}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.11:0","nonce":3250928280}]}]} 2026-02-13T02:19:09.634 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2026-02-13T02:19:09.634 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2026-02-13T02:19:09.634 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph osd dump --format=json 2026-02-13T02:19:09.785 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:19:09.898 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.896+0000 7fe00b0a16c0 1 -- 10.20.193.11:0/2044230778 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fe004115440 msgr2=0x7fe004175de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:09.898 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.896+0000 7fe00b0a16c0 1 --2- 10.20.193.11:0/2044230778 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fe004115440 0x7fe004175de0 secure :-1 s=READY pgs=253 gs=1 cs=0 l=1 c_cookie=1385408044464378086 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe00000aa70 tx=0x7fe00002fde0 comp rx=0 tx=0).stop 2026-02-13T02:19:09.898 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.897+0000 7fe00b0a16c0 1 -- 10.20.193.11:0/2044230778 shutdown_connections 2026-02-13T02:19:09.899 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.897+0000 7fe00b0a16c0 1 --2- 10.20.193.11:0/2044230778 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fe004115440 0x7fe004175de0 unknown :-1 s=CLOSED pgs=253 gs=1 cs=0 l=1 c_cookie=1385408044464378086 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:09.899 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.897+0000 7fe00b0a16c0 1 --2- 10.20.193.11:0/2044230778 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fe00410fc20 0x7fe004114c60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:09.899 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.897+0000 7fe00b0a16c0 1 --2- 10.20.193.11:0/2044230778 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fe00410f230 0x7fe00410f600 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:09.899 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.897+0000 7fe00b0a16c0 1 -- 10.20.193.11:0/2044230778 >> 10.20.193.11:0/2044230778 conn(0x7fe0040ecb30 msgr2=0x7fe00410cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:09.899 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.897+0000 7fe00b0a16c0 1 -- 10.20.193.11:0/2044230778 shutdown_connections 2026-02-13T02:19:09.899 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.897+0000 7fe00b0a16c0 1 -- 10.20.193.11:0/2044230778 wait complete. 2026-02-13T02:19:09.900 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.897+0000 7fe00b0a16c0 1 Processor -- start 2026-02-13T02:19:09.900 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.897+0000 7fe00b0a16c0 1 -- start start 2026-02-13T02:19:09.900 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.897+0000 7fe00b0a16c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fe00410f230 0x7fe00411d1a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:09.900 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.897+0000 7fe00b0a16c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fe004115440 0x7fe00411d6e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:09.900 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.897+0000 7fe00b0a16c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fe004122aa0 0x7fe004122f40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:09.900 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.897+0000 7fe00b0a16c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7fe0041234b0 con 0x7fe004115440 2026-02-13T02:19:09.900 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.897+0000 7fe00b0a16c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe004123620 con 0x7fe00410f230 2026-02-13T02:19:09.900 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.897+0000 7fe00b0a16c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fe0041237e0 con 0x7fe004122aa0 2026-02-13T02:19:09.900 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.897+0000 7fdffbfff6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fe004115440 0x7fe00411d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:09.900 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.897+0000 7fdffbfff6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fe004115440 0x7fe00411d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:49070/0 (socket says 10.20.193.11:49070) 2026-02-13T02:19:09.900 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.897+0000 7fdffbfff6c0 1 -- 10.20.193.11:0/2352869461 learned_addr learned my addr 10.20.193.11:0/2352869461 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:19:09.900 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.897+0000 7fe008e126c0 1 --2- 10.20.193.11:0/2352869461 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fe00410f230 0x7fe00411d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:09.900 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.897+0000 7fdffbfff6c0 1 -- 10.20.193.11:0/2352869461 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fe004122aa0 msgr2=0x7fe004122f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:09.900 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.897+0000 7fe0096136c0 1 --2- 10.20.193.11:0/2352869461 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fe004122aa0 0x7fe004122f40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:09.900 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.897+0000 7fdffbfff6c0 1 --2- 10.20.193.11:0/2352869461 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fe004122aa0 0x7fe004122f40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:09.900 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.897+0000 7fdffbfff6c0 1 -- 10.20.193.11:0/2352869461 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fe00410f230 msgr2=0x7fe00411d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:09.900 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.897+0000 7fdffbfff6c0 1 --2- 10.20.193.11:0/2352869461 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fe00410f230 0x7fe00411d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:09.900 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.897+0000 7fdffbfff6c0 1 -- 10.20.193.11:0/2352869461 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe00000a660 con 0x7fe004115440 2026-02-13T02:19:09.900 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.897+0000 7fe0096136c0 1 --2- 10.20.193.11:0/2352869461 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fe004122aa0 0x7fe004122f40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:19:09.900 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.897+0000 7fdffbfff6c0 1 --2- 10.20.193.11:0/2352869461 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fe004115440 0x7fe00411d6e0 secure :-1 s=READY pgs=254 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdfec00b750 tx=0x7fdfec00bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:09.900 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.897+0000 7fdff9ffb6c0 1 -- 10.20.193.11:0/2352869461 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdfec004a80 con 0x7fe004115440 2026-02-13T02:19:09.900 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.898+0000 7fdff9ffb6c0 1 -- 10.20.193.11:0/2352869461 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fdfec009030 con 0x7fe004115440 2026-02-13T02:19:09.900 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.898+0000 7fe00b0a16c0 1 -- 10.20.193.11:0/2352869461 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe004163c90 con 0x7fe004115440 2026-02-13T02:19:09.900 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.898+0000 7fdff9ffb6c0 1 -- 10.20.193.11:0/2352869461 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdfec00cdd0 con 0x7fe004115440 2026-02-13T02:19:09.901 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.898+0000 7fe00b0a16c0 1 -- 10.20.193.11:0/2352869461 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe004164120 con 0x7fe004115440 2026-02-13T02:19:09.901 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.898+0000 7fe00b0a16c0 1 -- 10.20.193.11:0/2352869461 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe004110500 con 0x7fe004115440 2026-02-13T02:19:09.901 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.899+0000 7fdff9ffb6c0 1 -- 10.20.193.11:0/2352869461 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7fdfec005020 con 0x7fe004115440 2026-02-13T02:19:09.901 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.900+0000 7fdff9ffb6c0 1 --2- 10.20.193.11:0/2352869461 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fdfe00b5710 0x7fdfe00d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:09.902 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.900+0000 7fe008e126c0 1 --2- 10.20.193.11:0/2352869461 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fdfe00b5710 0x7fdfe00d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:09.902 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.900+0000 7fdff9ffb6c0 1 -- 10.20.193.11:0/2352869461 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7762+0+0 (secure 0 0 0) 0x7fdfec0e3aa0 con 0x7fe004115440 2026-02-13T02:19:09.902 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.900+0000 7fdff9ffb6c0 1 -- 10.20.193.11:0/2352869461 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fdfec0a64c0 con 0x7fe004115440 2026-02-13T02:19:09.902 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.900+0000 7fe008e126c0 1 --2- 10.20.193.11:0/2352869461 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fdfe00b5710 0x7fdfe00d5bc0 secure :-1 s=READY pgs=183 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdff4004750 tx=0x7fdff4005f90 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:09.996 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.994+0000 7fe00b0a16c0 1 -- 10.20.193.11:0/2352869461 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe00410fc20 con 0x7fe004115440 2026-02-13T02:19:09.996 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.995+0000 7fdff9ffb6c0 1 -- 10.20.193.11:0/2352869461 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) ==== 74+0+21954 (secure 0 0 0) 0x7fdfec004d00 con 0x7fe004115440 2026-02-13T02:19:09.997 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:19:09.997 INFO:teuthology.orchestra.run.trial011.stdout:{"epoch":71,"fsid":"fc631695-0881-11f1-899c-d404e6e7d460","created":"2026-02-13T02:16:35.175761+0000","modified":"2026-02-13T02:19:00.017879+0000","last_up_change":"2026-02-13T02:18:43.665240+0000","last_in_change":"2026-02-13T02:18:35.014003+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-13T02:17:39.931888+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-13T02:18:56.323027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-13T02:18:57.399537+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb9a005b-9a16-4fda-95c0-d23831f0cffc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6802","nonce":1061379396},{"type":"v1","addr":"10.20.193.11:6803","nonce":1061379396}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6804","nonce":1061379396},{"type":"v1","addr":"10.20.193.11:6805","nonce":1061379396}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6808","nonce":1061379396},{"type":"v1","addr":"10.20.193.11:6809","nonce":1061379396}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6806","nonce":1061379396},{"type":"v1","addr":"10.20.193.11:6807","nonce":1061379396}]},"public_addr":"10.20.193.11:6803/1061379396","cluster_addr":"10.20.193.11:6805/1061379396","heartbeat_back_addr":"10.20.193.11:6809/1061379396","heartbeat_front_addr":"10.20.193.11:6807/1061379396","state":["exists","up"]},{"osd":1,"uuid":"c1786ae4-a736-47b0-8302-b06423efd012","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6800","nonce":2198425396},{"type":"v1","addr":"10.20.193.60:6801","nonce":2198425396}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6802","nonce":2198425396},{"type":"v1","addr":"10.20.193.60:6803","nonce":2198425396}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6806","nonce":2198425396},{"type":"v1","addr":"10.20.193.60:6807","nonce":2198425396}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6804","nonce":2198425396},{"type":"v1","addr":"10.20.193.60:6805","nonce":2198425396}]},"public_addr":"10.20.193.60:6801/2198425396","cluster_addr":"10.20.193.60:6803/2198425396","heartbeat_back_addr":"10.20.193.60:6807/2198425396","heartbeat_front_addr":"10.20.193.60:6805/2198425396","state":["exists","up"]},{"osd":2,"uuid":"516f1aa0-bc7c-4808-8ac8-4ff406c71890","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6800","nonce":3723638526},{"type":"v1","addr":"10.20.193.78:6801","nonce":3723638526}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6802","nonce":3723638526},{"type":"v1","addr":"10.20.193.78:6803","nonce":3723638526}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6806","nonce":3723638526},{"type":"v1","addr":"10.20.193.78:6807","nonce":3723638526}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6804","nonce":3723638526},{"type":"v1","addr":"10.20.193.78:6805","nonce":3723638526}]},"public_addr":"10.20.193.78:6801/3723638526","cluster_addr":"10.20.193.78:6803/3723638526","heartbeat_back_addr":"10.20.193.78:6807/3723638526","heartbeat_front_addr":"10.20.193.78:6805/3723638526","state":["exists","up"]},{"osd":3,"uuid":"8cf508c2-b05d-42be-92e3-db0a57d22a85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6810","nonce":4224399876},{"type":"v1","addr":"10.20.193.11:6811","nonce":4224399876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6812","nonce":4224399876},{"type":"v1","addr":"10.20.193.11:6813","nonce":4224399876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6816","nonce":4224399876},{"type":"v1","addr":"10.20.193.11:6817","nonce":4224399876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6814","nonce":4224399876},{"type":"v1","addr":"10.20.193.11:6815","nonce":4224399876}]},"public_addr":"10.20.193.11:6811/4224399876","cluster_addr":"10.20.193.11:6813/4224399876","heartbeat_back_addr":"10.20.193.11:6817/4224399876","heartbeat_front_addr":"10.20.193.11:6815/4224399876","state":["exists","up"]},{"osd":4,"uuid":"abf31616-2588-43c1-b15a-7f703ae8e1c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":28,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6808","nonce":3289387254},{"type":"v1","addr":"10.20.193.60:6809","nonce":3289387254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6810","nonce":3289387254},{"type":"v1","addr":"10.20.193.60:6811","nonce":3289387254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6814","nonce":3289387254},{"type":"v1","addr":"10.20.193.60:6815","nonce":3289387254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6812","nonce":3289387254},{"type":"v1","addr":"10.20.193.60:6813","nonce":3289387254}]},"public_addr":"10.20.193.60:6809/3289387254","cluster_addr":"10.20.193.60:6811/3289387254","heartbeat_back_addr":"10.20.193.60:6815/3289387254","heartbeat_front_addr":"10.20.193.60:6813/3289387254","state":["exists","up"]},{"osd":5,"uuid":"70c3d0b0-8e3d-4432-87e2-bb5391cf0167","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6808","nonce":3975711592},{"type":"v1","addr":"10.20.193.78:6809","nonce":3975711592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6810","nonce":3975711592},{"type":"v1","addr":"10.20.193.78:6811","nonce":3975711592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6814","nonce":3975711592},{"type":"v1","addr":"10.20.193.78:6815","nonce":3975711592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6812","nonce":3975711592},{"type":"v1","addr":"10.20.193.78:6813","nonce":3975711592}]},"public_addr":"10.20.193.78:6809/3975711592","cluster_addr":"10.20.193.78:6811/3975711592","heartbeat_back_addr":"10.20.193.78:6815/3975711592","heartbeat_front_addr":"10.20.193.78:6813/3975711592","state":["exists","up"]},{"osd":6,"uuid":"bc1293b8-53e6-4386-b02b-31ca7030976d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6818","nonce":2393344644},{"type":"v1","addr":"10.20.193.11:6819","nonce":2393344644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6820","nonce":2393344644},{"type":"v1","addr":"10.20.193.11:6821","nonce":2393344644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6824","nonce":2393344644},{"type":"v1","addr":"10.20.193.11:6825","nonce":2393344644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6822","nonce":2393344644},{"type":"v1","addr":"10.20.193.11:6823","nonce":2393344644}]},"public_addr":"10.20.193.11:6819/2393344644","cluster_addr":"10.20.193.11:6821/2393344644","heartbeat_back_addr":"10.20.193.11:6825/2393344644","heartbeat_front_addr":"10.20.193.11:6823/2393344644","state":["exists","up"]},{"osd":7,"uuid":"da596d81-14dc-403b-9a20-90a7587da04c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6816","nonce":2908560893},{"type":"v1","addr":"10.20.193.60:6817","nonce":2908560893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6818","nonce":2908560893},{"type":"v1","addr":"10.20.193.60:6819","nonce":2908560893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6822","nonce":2908560893},{"type":"v1","addr":"10.20.193.60:6823","nonce":2908560893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6820","nonce":2908560893},{"type":"v1","addr":"10.20.193.60:6821","nonce":2908560893}]},"public_addr":"10.20.193.60:6817/2908560893","cluster_addr":"10.20.193.60:6819/2908560893","heartbeat_back_addr":"10.20.193.60:6823/2908560893","heartbeat_front_addr":"10.20.193.60:6821/2908560893","state":["exists","up"]},{"osd":8,"uuid":"24098987-9f02-4f06-b93e-8af84291cc82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6816","nonce":242640323},{"type":"v1","addr":"10.20.193.78:6817","nonce":242640323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6818","nonce":242640323},{"type":"v1","addr":"10.20.193.78:6819","nonce":242640323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6822","nonce":242640323},{"type":"v1","addr":"10.20.193.78:6823","nonce":242640323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6820","nonce":242640323},{"type":"v1","addr":"10.20.193.78:6821","nonce":242640323}]},"public_addr":"10.20.193.78:6817/242640323","cluster_addr":"10.20.193.78:6819/242640323","heartbeat_back_addr":"10.20.193.78:6823/242640323","heartbeat_front_addr":"10.20.193.78:6821/242640323","state":["exists","up"]},{"osd":9,"uuid":"25cd90dd-8e86-4ac1-a693-a4080b035da1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6826","nonce":132317204},{"type":"v1","addr":"10.20.193.11:6827","nonce":132317204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6828","nonce":132317204},{"type":"v1","addr":"10.20.193.11:6829","nonce":132317204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6832","nonce":132317204},{"type":"v1","addr":"10.20.193.11:6833","nonce":132317204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6830","nonce":132317204},{"type":"v1","addr":"10.20.193.11:6831","nonce":132317204}]},"public_addr":"10.20.193.11:6827/132317204","cluster_addr":"10.20.193.11:6829/132317204","heartbeat_back_addr":"10.20.193.11:6833/132317204","heartbeat_front_addr":"10.20.193.11:6831/132317204","state":["exists","up"]},{"osd":10,"uuid":"727f51ff-9428-44ae-a69a-0f555f1397ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6824","nonce":3534951144},{"type":"v1","addr":"10.20.193.60:6825","nonce":3534951144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6826","nonce":3534951144},{"type":"v1","addr":"10.20.193.60:6827","nonce":3534951144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6830","nonce":3534951144},{"type":"v1","addr":"10.20.193.60:6831","nonce":3534951144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6828","nonce":3534951144},{"type":"v1","addr":"10.20.193.60:6829","nonce":3534951144}]},"public_addr":"10.20.193.60:6825/3534951144","cluster_addr":"10.20.193.60:6827/3534951144","heartbeat_back_addr":"10.20.193.60:6831/3534951144","heartbeat_front_addr":"10.20.193.60:6829/3534951144","state":["exists","up"]},{"osd":11,"uuid":"03e11d54-a857-418b-8ac1-c8d7a9a23305","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6824","nonce":537170494},{"type":"v1","addr":"10.20.193.78:6825","nonce":537170494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6826","nonce":537170494},{"type":"v1","addr":"10.20.193.78:6827","nonce":537170494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6830","nonce":537170494},{"type":"v1","addr":"10.20.193.78:6831","nonce":537170494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6828","nonce":537170494},{"type":"v1","addr":"10.20.193.78:6829","nonce":537170494}]},"public_addr":"10.20.193.78:6825/537170494","cluster_addr":"10.20.193.78:6827/537170494","heartbeat_back_addr":"10.20.193.78:6831/537170494","heartbeat_front_addr":"10.20.193.78:6829/537170494","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:17:22.330213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:17:29.302695+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:17:36.305494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:17:43.706241+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:17:51.095807+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:17:58.083703+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:18:05.097723+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:18:12.357395+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:18:19.659255+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:18:27.054774+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:18:34.465790+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:18:41.783401+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.11:0/1644541112":"2026-02-14T02:16:41.426146+0000","10.20.193.11:0/1423851105":"2026-02-14T02:16:41.426146+0000","10.20.193.11:0/1602612884":"2026-02-14T02:16:41.426146+0000","10.20.193.11:6801/2469571860":"2026-02-14T02:16:41.426146+0000","10.20.193.11:6800/2469571860":"2026-02-14T02:16:41.426146+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-13T02:19:09.999 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.996+0000 7fe00b0a16c0 1 -- 10.20.193.11:0/2352869461 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fdfe00b5710 msgr2=0x7fdfe00d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:09.999 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.996+0000 7fe00b0a16c0 1 --2- 10.20.193.11:0/2352869461 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fdfe00b5710 0x7fdfe00d5bc0 secure :-1 s=READY pgs=183 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdff4004750 tx=0x7fdff4005f90 comp rx=0 tx=0).stop 2026-02-13T02:19:09.999 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.996+0000 7fe00b0a16c0 1 -- 10.20.193.11:0/2352869461 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fe004115440 msgr2=0x7fe00411d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:09.999 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.996+0000 7fe00b0a16c0 1 --2- 10.20.193.11:0/2352869461 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fe004115440 0x7fe00411d6e0 secure :-1 s=READY pgs=254 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdfec00b750 tx=0x7fdfec00bc20 comp rx=0 tx=0).stop 2026-02-13T02:19:09.999 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.996+0000 7fe00b0a16c0 1 -- 10.20.193.11:0/2352869461 shutdown_connections 2026-02-13T02:19:09.999 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.996+0000 7fe00b0a16c0 1 --2- 10.20.193.11:0/2352869461 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fdfe00b5710 0x7fdfe00d5bc0 unknown :-1 s=CLOSED pgs=183 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:09.999 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.996+0000 7fe00b0a16c0 1 --2- 10.20.193.11:0/2352869461 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fe004122aa0 0x7fe004122f40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:09.999 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.996+0000 7fe00b0a16c0 1 --2- 10.20.193.11:0/2352869461 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fe004115440 0x7fe00411d6e0 unknown :-1 s=CLOSED pgs=254 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:09.999 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.996+0000 7fe00b0a16c0 1 --2- 10.20.193.11:0/2352869461 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fe00410f230 0x7fe00411d1a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.000 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.996+0000 7fe00b0a16c0 1 -- 10.20.193.11:0/2352869461 >> 10.20.193.11:0/2352869461 conn(0x7fe0040ecb30 msgr2=0x7fe00410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:10.000 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.997+0000 7fe00b0a16c0 1 -- 10.20.193.11:0/2352869461 shutdown_connections 2026-02-13T02:19:10.000 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:09.997+0000 7fe00b0a16c0 1 -- 10.20.193.11:0/2352869461 wait complete. 2026-02-13T02:19:10.035 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2026-02-13T02:19:10.035 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph osd dump --format=json 2026-02-13T02:19:10.157 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:19:10.178 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:10 trial011 ceph-mon[11956]: pgmap v189: 97 pgs: 97 active+clean; 609 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 2.7 KiB/s rd, 9.8 KiB/s wr, 25 op/s 2026-02-13T02:19:10.179 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:10 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/2939192386' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2026-02-13T02:19:10.179 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:10 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/3711161422' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2026-02-13T02:19:10.179 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:10 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/2352869461' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T02:19:10.277 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.273+0000 7f3caf2e56c0 1 -- 10.20.193.11:0/3066857405 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f3ca8115410 msgr2=0x7f3ca8175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:10.277 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.273+0000 7f3caf2e56c0 1 --2- 10.20.193.11:0/3066857405 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f3ca8115410 0x7f3ca8175db0 secure :-1 s=READY pgs=255 gs=1 cs=0 l=1 c_cookie=13436227045697354736 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3ca400aa70 tx=0x7f3ca402fde0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.278 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.273+0000 7f3caf2e56c0 1 -- 10.20.193.11:0/3066857405 shutdown_connections 2026-02-13T02:19:10.278 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.273+0000 7f3caf2e56c0 1 --2- 10.20.193.11:0/3066857405 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f3ca810fbf0 0x7f3ca8114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.278 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.273+0000 7f3caf2e56c0 1 --2- 10.20.193.11:0/3066857405 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f3ca8115410 0x7f3ca8175db0 unknown :-1 s=CLOSED pgs=255 gs=1 cs=0 l=1 c_cookie=13436227045697354736 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.278 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.273+0000 7f3caf2e56c0 1 --2- 10.20.193.11:0/3066857405 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f3ca810f200 0x7f3ca810f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.278 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.273+0000 7f3caf2e56c0 1 -- 10.20.193.11:0/3066857405 >> 10.20.193.11:0/3066857405 conn(0x7f3ca80ecb00 msgr2=0x7f3ca810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:10.278 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.273+0000 7f3caf2e56c0 1 -- 10.20.193.11:0/3066857405 shutdown_connections 2026-02-13T02:19:10.278 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.273+0000 7f3caf2e56c0 1 -- 10.20.193.11:0/3066857405 wait complete. 2026-02-13T02:19:10.278 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.273+0000 7f3caf2e56c0 1 Processor -- start 2026-02-13T02:19:10.278 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.274+0000 7f3caf2e56c0 1 -- start start 2026-02-13T02:19:10.278 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.274+0000 7f3caf2e56c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f3ca810f200 0x7f3ca811d110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:10.279 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.274+0000 7f3caf2e56c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f3ca8115410 0x7f3ca811d650 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:10.279 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.274+0000 7f3caf2e56c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f3ca8122a10 0x7f3ca8122eb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:10.279 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.274+0000 7f3caf2e56c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f3ca8123420 con 0x7f3ca810f200 2026-02-13T02:19:10.279 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.274+0000 7f3caf2e56c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f3ca8123590 con 0x7f3ca8122a10 2026-02-13T02:19:10.279 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.274+0000 7f3caf2e56c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f3ca8123750 con 0x7f3ca8115410 2026-02-13T02:19:10.279 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.274+0000 7f3cad0566c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f3ca810f200 0x7f3ca811d110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:10.279 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.274+0000 7f3cad0566c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f3ca810f200 0x7f3ca811d110 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:49098/0 (socket says 10.20.193.11:49098) 2026-02-13T02:19:10.279 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.274+0000 7f3cad0566c0 1 -- 10.20.193.11:0/2308964302 learned_addr learned my addr 10.20.193.11:0/2308964302 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:19:10.279 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.274+0000 7f3cac8556c0 1 --2- 10.20.193.11:0/2308964302 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f3ca8115410 0x7f3ca811d650 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:10.279 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.274+0000 7f3cad8576c0 1 --2- 10.20.193.11:0/2308964302 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f3ca8122a10 0x7f3ca8122eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:10.279 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.274+0000 7f3cad0566c0 1 -- 10.20.193.11:0/2308964302 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f3ca8115410 msgr2=0x7f3ca811d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:10.280 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.274+0000 7f3cad0566c0 1 --2- 10.20.193.11:0/2308964302 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f3ca8115410 0x7f3ca811d650 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.280 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.274+0000 7f3cad0566c0 1 -- 10.20.193.11:0/2308964302 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f3ca8122a10 msgr2=0x7f3ca8122eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:10.280 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.274+0000 7f3cad0566c0 1 --2- 10.20.193.11:0/2308964302 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f3ca8122a10 0x7f3ca8122eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.280 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.274+0000 7f3cad0566c0 1 -- 10.20.193.11:0/2308964302 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ca400a660 con 0x7f3ca810f200 2026-02-13T02:19:10.280 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.274+0000 7f3cad8576c0 1 --2- 10.20.193.11:0/2308964302 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f3ca8122a10 0x7f3ca8122eb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:19:10.280 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.274+0000 7f3cad0566c0 1 --2- 10.20.193.11:0/2308964302 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f3ca810f200 0x7f3ca811d110 secure :-1 s=READY pgs=256 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3c98005dc0 tx=0x7f3c9800bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:10.280 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.274+0000 7f3c967fc6c0 1 -- 10.20.193.11:0/2308964302 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3c98004250 con 0x7f3ca810f200 2026-02-13T02:19:10.280 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.274+0000 7f3caf2e56c0 1 -- 10.20.193.11:0/2308964302 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ca8163c00 con 0x7f3ca810f200 2026-02-13T02:19:10.280 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.274+0000 7f3c967fc6c0 1 -- 10.20.193.11:0/2308964302 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3c98009070 con 0x7f3ca810f200 2026-02-13T02:19:10.280 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.274+0000 7f3c967fc6c0 1 -- 10.20.193.11:0/2308964302 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3c9800cde0 con 0x7f3ca810f200 2026-02-13T02:19:10.280 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.274+0000 7f3caf2e56c0 1 -- 10.20.193.11:0/2308964302 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ca8164090 con 0x7f3ca810f200 2026-02-13T02:19:10.280 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.275+0000 7f3caf2e56c0 1 -- 10.20.193.11:0/2308964302 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ca81104d0 con 0x7f3ca810f200 2026-02-13T02:19:10.280 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.276+0000 7f3c967fc6c0 1 -- 10.20.193.11:0/2308964302 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7f3c980028c0 con 0x7f3ca810f200 2026-02-13T02:19:10.281 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.276+0000 7f3c967fc6c0 1 --2- 10.20.193.11:0/2308964302 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f3c840b5690 0x7f3c840d5b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:10.282 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.276+0000 7f3cac8556c0 1 --2- 10.20.193.11:0/2308964302 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f3c840b5690 0x7f3c840d5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:10.282 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.277+0000 7f3c967fc6c0 1 -- 10.20.193.11:0/2308964302 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7762+0+0 (secure 0 0 0) 0x7f3c980e3ba0 con 0x7f3ca810f200 2026-02-13T02:19:10.282 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.277+0000 7f3cac8556c0 1 --2- 10.20.193.11:0/2308964302 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f3c840b5690 0x7f3c840d5b40 secure :-1 s=READY pgs=184 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3ca8123aa0 tx=0x7f3c9c009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:10.282 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.277+0000 7f3c967fc6c0 1 -- 10.20.193.11:0/2308964302 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f3c980a65c0 con 0x7f3ca810f200 2026-02-13T02:19:10.371 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.369+0000 7f3caf2e56c0 1 -- 10.20.193.11:0/2308964302 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3ca811e2c0 con 0x7f3ca810f200 2026-02-13T02:19:10.371 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.369+0000 7f3c967fc6c0 1 -- 10.20.193.11:0/2308964302 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) ==== 74+0+21954 (secure 0 0 0) 0x7f3c980a9770 con 0x7f3ca810f200 2026-02-13T02:19:10.372 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:19:10.372 INFO:teuthology.orchestra.run.trial011.stdout:{"epoch":71,"fsid":"fc631695-0881-11f1-899c-d404e6e7d460","created":"2026-02-13T02:16:35.175761+0000","modified":"2026-02-13T02:19:00.017879+0000","last_up_change":"2026-02-13T02:18:43.665240+0000","last_in_change":"2026-02-13T02:18:35.014003+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-13T02:17:39.931888+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-13T02:18:56.323027+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-13T02:18:57.399537+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bb9a005b-9a16-4fda-95c0-d23831f0cffc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":7,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6802","nonce":1061379396},{"type":"v1","addr":"10.20.193.11:6803","nonce":1061379396}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6804","nonce":1061379396},{"type":"v1","addr":"10.20.193.11:6805","nonce":1061379396}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6808","nonce":1061379396},{"type":"v1","addr":"10.20.193.11:6809","nonce":1061379396}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6806","nonce":1061379396},{"type":"v1","addr":"10.20.193.11:6807","nonce":1061379396}]},"public_addr":"10.20.193.11:6803/1061379396","cluster_addr":"10.20.193.11:6805/1061379396","heartbeat_back_addr":"10.20.193.11:6809/1061379396","heartbeat_front_addr":"10.20.193.11:6807/1061379396","state":["exists","up"]},{"osd":1,"uuid":"c1786ae4-a736-47b0-8302-b06423efd012","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6800","nonce":2198425396},{"type":"v1","addr":"10.20.193.60:6801","nonce":2198425396}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6802","nonce":2198425396},{"type":"v1","addr":"10.20.193.60:6803","nonce":2198425396}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6806","nonce":2198425396},{"type":"v1","addr":"10.20.193.60:6807","nonce":2198425396}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6804","nonce":2198425396},{"type":"v1","addr":"10.20.193.60:6805","nonce":2198425396}]},"public_addr":"10.20.193.60:6801/2198425396","cluster_addr":"10.20.193.60:6803/2198425396","heartbeat_back_addr":"10.20.193.60:6807/2198425396","heartbeat_front_addr":"10.20.193.60:6805/2198425396","state":["exists","up"]},{"osd":2,"uuid":"516f1aa0-bc7c-4808-8ac8-4ff406c71890","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6800","nonce":3723638526},{"type":"v1","addr":"10.20.193.78:6801","nonce":3723638526}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6802","nonce":3723638526},{"type":"v1","addr":"10.20.193.78:6803","nonce":3723638526}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6806","nonce":3723638526},{"type":"v1","addr":"10.20.193.78:6807","nonce":3723638526}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6804","nonce":3723638526},{"type":"v1","addr":"10.20.193.78:6805","nonce":3723638526}]},"public_addr":"10.20.193.78:6801/3723638526","cluster_addr":"10.20.193.78:6803/3723638526","heartbeat_back_addr":"10.20.193.78:6807/3723638526","heartbeat_front_addr":"10.20.193.78:6805/3723638526","state":["exists","up"]},{"osd":3,"uuid":"8cf508c2-b05d-42be-92e3-db0a57d22a85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6810","nonce":4224399876},{"type":"v1","addr":"10.20.193.11:6811","nonce":4224399876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6812","nonce":4224399876},{"type":"v1","addr":"10.20.193.11:6813","nonce":4224399876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6816","nonce":4224399876},{"type":"v1","addr":"10.20.193.11:6817","nonce":4224399876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6814","nonce":4224399876},{"type":"v1","addr":"10.20.193.11:6815","nonce":4224399876}]},"public_addr":"10.20.193.11:6811/4224399876","cluster_addr":"10.20.193.11:6813/4224399876","heartbeat_back_addr":"10.20.193.11:6817/4224399876","heartbeat_front_addr":"10.20.193.11:6815/4224399876","state":["exists","up"]},{"osd":4,"uuid":"abf31616-2588-43c1-b15a-7f703ae8e1c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":28,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6808","nonce":3289387254},{"type":"v1","addr":"10.20.193.60:6809","nonce":3289387254}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6810","nonce":3289387254},{"type":"v1","addr":"10.20.193.60:6811","nonce":3289387254}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6814","nonce":3289387254},{"type":"v1","addr":"10.20.193.60:6815","nonce":3289387254}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6812","nonce":3289387254},{"type":"v1","addr":"10.20.193.60:6813","nonce":3289387254}]},"public_addr":"10.20.193.60:6809/3289387254","cluster_addr":"10.20.193.60:6811/3289387254","heartbeat_back_addr":"10.20.193.60:6815/3289387254","heartbeat_front_addr":"10.20.193.60:6813/3289387254","state":["exists","up"]},{"osd":5,"uuid":"70c3d0b0-8e3d-4432-87e2-bb5391cf0167","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6808","nonce":3975711592},{"type":"v1","addr":"10.20.193.78:6809","nonce":3975711592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6810","nonce":3975711592},{"type":"v1","addr":"10.20.193.78:6811","nonce":3975711592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6814","nonce":3975711592},{"type":"v1","addr":"10.20.193.78:6815","nonce":3975711592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6812","nonce":3975711592},{"type":"v1","addr":"10.20.193.78:6813","nonce":3975711592}]},"public_addr":"10.20.193.78:6809/3975711592","cluster_addr":"10.20.193.78:6811/3975711592","heartbeat_back_addr":"10.20.193.78:6815/3975711592","heartbeat_front_addr":"10.20.193.78:6813/3975711592","state":["exists","up"]},{"osd":6,"uuid":"bc1293b8-53e6-4386-b02b-31ca7030976d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6818","nonce":2393344644},{"type":"v1","addr":"10.20.193.11:6819","nonce":2393344644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6820","nonce":2393344644},{"type":"v1","addr":"10.20.193.11:6821","nonce":2393344644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6824","nonce":2393344644},{"type":"v1","addr":"10.20.193.11:6825","nonce":2393344644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6822","nonce":2393344644},{"type":"v1","addr":"10.20.193.11:6823","nonce":2393344644}]},"public_addr":"10.20.193.11:6819/2393344644","cluster_addr":"10.20.193.11:6821/2393344644","heartbeat_back_addr":"10.20.193.11:6825/2393344644","heartbeat_front_addr":"10.20.193.11:6823/2393344644","state":["exists","up"]},{"osd":7,"uuid":"da596d81-14dc-403b-9a20-90a7587da04c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6816","nonce":2908560893},{"type":"v1","addr":"10.20.193.60:6817","nonce":2908560893}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6818","nonce":2908560893},{"type":"v1","addr":"10.20.193.60:6819","nonce":2908560893}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6822","nonce":2908560893},{"type":"v1","addr":"10.20.193.60:6823","nonce":2908560893}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6820","nonce":2908560893},{"type":"v1","addr":"10.20.193.60:6821","nonce":2908560893}]},"public_addr":"10.20.193.60:6817/2908560893","cluster_addr":"10.20.193.60:6819/2908560893","heartbeat_back_addr":"10.20.193.60:6823/2908560893","heartbeat_front_addr":"10.20.193.60:6821/2908560893","state":["exists","up"]},{"osd":8,"uuid":"24098987-9f02-4f06-b93e-8af84291cc82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6816","nonce":242640323},{"type":"v1","addr":"10.20.193.78:6817","nonce":242640323}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6818","nonce":242640323},{"type":"v1","addr":"10.20.193.78:6819","nonce":242640323}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6822","nonce":242640323},{"type":"v1","addr":"10.20.193.78:6823","nonce":242640323}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6820","nonce":242640323},{"type":"v1","addr":"10.20.193.78:6821","nonce":242640323}]},"public_addr":"10.20.193.78:6817/242640323","cluster_addr":"10.20.193.78:6819/242640323","heartbeat_back_addr":"10.20.193.78:6823/242640323","heartbeat_front_addr":"10.20.193.78:6821/242640323","state":["exists","up"]},{"osd":9,"uuid":"25cd90dd-8e86-4ac1-a693-a4080b035da1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6826","nonce":132317204},{"type":"v1","addr":"10.20.193.11:6827","nonce":132317204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6828","nonce":132317204},{"type":"v1","addr":"10.20.193.11:6829","nonce":132317204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6832","nonce":132317204},{"type":"v1","addr":"10.20.193.11:6833","nonce":132317204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.11:6830","nonce":132317204},{"type":"v1","addr":"10.20.193.11:6831","nonce":132317204}]},"public_addr":"10.20.193.11:6827/132317204","cluster_addr":"10.20.193.11:6829/132317204","heartbeat_back_addr":"10.20.193.11:6833/132317204","heartbeat_front_addr":"10.20.193.11:6831/132317204","state":["exists","up"]},{"osd":10,"uuid":"727f51ff-9428-44ae-a69a-0f555f1397ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6824","nonce":3534951144},{"type":"v1","addr":"10.20.193.60:6825","nonce":3534951144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6826","nonce":3534951144},{"type":"v1","addr":"10.20.193.60:6827","nonce":3534951144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6830","nonce":3534951144},{"type":"v1","addr":"10.20.193.60:6831","nonce":3534951144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.60:6828","nonce":3534951144},{"type":"v1","addr":"10.20.193.60:6829","nonce":3534951144}]},"public_addr":"10.20.193.60:6825/3534951144","cluster_addr":"10.20.193.60:6827/3534951144","heartbeat_back_addr":"10.20.193.60:6831/3534951144","heartbeat_front_addr":"10.20.193.60:6829/3534951144","state":["exists","up"]},{"osd":11,"uuid":"03e11d54-a857-418b-8ac1-c8d7a9a23305","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6824","nonce":537170494},{"type":"v1","addr":"10.20.193.78:6825","nonce":537170494}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6826","nonce":537170494},{"type":"v1","addr":"10.20.193.78:6827","nonce":537170494}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6830","nonce":537170494},{"type":"v1","addr":"10.20.193.78:6831","nonce":537170494}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.78:6828","nonce":537170494},{"type":"v1","addr":"10.20.193.78:6829","nonce":537170494}]},"public_addr":"10.20.193.78:6825/537170494","cluster_addr":"10.20.193.78:6827/537170494","heartbeat_back_addr":"10.20.193.78:6831/537170494","heartbeat_front_addr":"10.20.193.78:6829/537170494","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:17:22.330213+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:17:29.302695+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:17:36.305494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:17:43.706241+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:17:51.095807+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:17:58.083703+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:18:05.097723+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:18:12.357395+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:18:19.659255+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:18:27.054774+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:18:34.465790+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T02:18:41.783401+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.11:0/1644541112":"2026-02-14T02:16:41.426146+0000","10.20.193.11:0/1423851105":"2026-02-14T02:16:41.426146+0000","10.20.193.11:0/1602612884":"2026-02-14T02:16:41.426146+0000","10.20.193.11:6801/2469571860":"2026-02-14T02:16:41.426146+0000","10.20.193.11:6800/2469571860":"2026-02-14T02:16:41.426146+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-13T02:19:10.374 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.371+0000 7f3caf2e56c0 1 -- 10.20.193.11:0/2308964302 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f3c840b5690 msgr2=0x7f3c840d5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:10.374 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.371+0000 7f3caf2e56c0 1 --2- 10.20.193.11:0/2308964302 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f3c840b5690 0x7f3c840d5b40 secure :-1 s=READY pgs=184 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3ca8123aa0 tx=0x7f3c9c009260 comp rx=0 tx=0).stop 2026-02-13T02:19:10.374 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.371+0000 7f3caf2e56c0 1 -- 10.20.193.11:0/2308964302 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f3ca810f200 msgr2=0x7f3ca811d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:10.374 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.371+0000 7f3caf2e56c0 1 --2- 10.20.193.11:0/2308964302 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f3ca810f200 0x7f3ca811d110 secure :-1 s=READY pgs=256 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3c98005dc0 tx=0x7f3c9800bbb0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.374 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.371+0000 7f3caf2e56c0 1 -- 10.20.193.11:0/2308964302 shutdown_connections 2026-02-13T02:19:10.374 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.371+0000 7f3caf2e56c0 1 --2- 10.20.193.11:0/2308964302 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f3c840b5690 0x7f3c840d5b40 unknown :-1 s=CLOSED pgs=184 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.375 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.371+0000 7f3caf2e56c0 1 --2- 10.20.193.11:0/2308964302 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f3ca8122a10 0x7f3ca8122eb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.375 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.371+0000 7f3caf2e56c0 1 --2- 10.20.193.11:0/2308964302 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f3ca8115410 0x7f3ca811d650 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.375 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.371+0000 7f3caf2e56c0 1 --2- 10.20.193.11:0/2308964302 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f3ca810f200 0x7f3ca811d110 unknown :-1 s=CLOSED pgs=256 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.375 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.371+0000 7f3caf2e56c0 1 -- 10.20.193.11:0/2308964302 >> 10.20.193.11:0/2308964302 conn(0x7f3ca80ecb00 msgr2=0x7f3ca810cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:10.375 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.371+0000 7f3caf2e56c0 1 -- 10.20.193.11:0/2308964302 shutdown_connections 2026-02-13T02:19:10.375 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.371+0000 7f3caf2e56c0 1 -- 10.20.193.11:0/2308964302 wait complete. 2026-02-13T02:19:10.401 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:10 trial060 ceph-mon[14797]: pgmap v189: 97 pgs: 97 active+clean; 609 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 2.7 KiB/s rd, 9.8 KiB/s wr, 25 op/s 2026-02-13T02:19:10.401 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:10 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/2939192386' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2026-02-13T02:19:10.401 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:10 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/3711161422' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2026-02-13T02:19:10.401 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:10 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/2352869461' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T02:19:10.402 INFO:journalctl@ceph.mds.b.trial060.stdout:Feb 13 02:19:10 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mds-b[43709]: 2026-02-13T02:19:10.008+0000 7f012c0e96c0 -1 mds.pinger is_rank_lagging: rank=3 was never sent ping request. 2026-02-13T02:19:10.402 INFO:journalctl@ceph.mds.b.trial060.stdout:Feb 13 02:19:10 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mds-b[43709]: 2026-02-13T02:19:10.008+0000 7f012c0e96c0 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2026-02-13T02:19:10.412 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph tell osd.0 flush_pg_stats 2026-02-13T02:19:10.413 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph tell osd.1 flush_pg_stats 2026-02-13T02:19:10.413 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph tell osd.2 flush_pg_stats 2026-02-13T02:19:10.414 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph tell osd.3 flush_pg_stats 2026-02-13T02:19:10.414 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph tell osd.4 flush_pg_stats 2026-02-13T02:19:10.414 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph tell osd.5 flush_pg_stats 2026-02-13T02:19:10.415 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph tell osd.6 flush_pg_stats 2026-02-13T02:19:10.415 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph tell osd.7 flush_pg_stats 2026-02-13T02:19:10.417 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph tell osd.8 flush_pg_stats 2026-02-13T02:19:10.418 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph tell osd.9 flush_pg_stats 2026-02-13T02:19:10.418 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph tell osd.10 flush_pg_stats 2026-02-13T02:19:10.419 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph tell osd.11 flush_pg_stats 2026-02-13T02:19:10.541 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:10 trial078 ceph-mon[14969]: pgmap v189: 97 pgs: 97 active+clean; 609 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 2.7 KiB/s rd, 9.8 KiB/s wr, 25 op/s 2026-02-13T02:19:10.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:10 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/2939192386' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2026-02-13T02:19:10.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:10 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/3711161422' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2026-02-13T02:19:10.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:10 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/2352869461' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T02:19:10.567 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:19:10.570 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:19:10.571 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:19:10.571 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:19:10.572 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:19:10.572 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:19:10.586 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:19:10.586 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:19:10.588 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:19:10.620 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:19:10.621 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:19:10.646 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:19:10.713 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.709+0000 7f1de51506c0 1 -- 10.20.193.11:0/403918182 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f1de010fc20 msgr2=0x7f1de0114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:10.713 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.709+0000 7f1de51506c0 1 --2- 10.20.193.11:0/403918182 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f1de010fc20 0x7f1de0114c60 secure :-1 s=READY pgs=257 gs=1 cs=0 l=1 c_cookie=16900737037528391873 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1dc80099a0 tx=0x7f1dc802ed20 comp rx=0 tx=0).stop 2026-02-13T02:19:10.713 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.709+0000 7f1de51506c0 1 -- 10.20.193.11:0/403918182 shutdown_connections 2026-02-13T02:19:10.713 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.709+0000 7f1de51506c0 1 --2- 10.20.193.11:0/403918182 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1de0115440 0x7f1de0175de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.713 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.709+0000 7f1de51506c0 1 --2- 10.20.193.11:0/403918182 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f1de010fc20 0x7f1de0114c60 unknown :-1 s=CLOSED pgs=257 gs=1 cs=0 l=1 c_cookie=16900737037528391873 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.713 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.709+0000 7f1de51506c0 1 --2- 10.20.193.11:0/403918182 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f1de010f230 0x7f1de010f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.713 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.709+0000 7f1de51506c0 1 -- 10.20.193.11:0/403918182 >> 10.20.193.11:0/403918182 conn(0x7f1de00ecb30 msgr2=0x7f1de010cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:10.713 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.709+0000 7f1de51506c0 1 -- 10.20.193.11:0/403918182 shutdown_connections 2026-02-13T02:19:10.714 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.709+0000 7f1de51506c0 1 -- 10.20.193.11:0/403918182 wait complete. 2026-02-13T02:19:10.714 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.710+0000 7f1de51506c0 1 Processor -- start 2026-02-13T02:19:10.714 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.710+0000 7f1de51506c0 1 -- start start 2026-02-13T02:19:10.714 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.710+0000 7f1de51506c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f1de010f230 0x7f1de00f4b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:10.714 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.710+0000 7f1de51506c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f1de0115440 0x7f1de0175ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:10.714 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.710+0000 7f1de51506c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1de00f5140 0x7f1de00fa410 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:10.714 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.710+0000 7f1de51506c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f1de00f5830 con 0x7f1de010f230 2026-02-13T02:19:10.714 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.710+0000 7f1de51506c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f1de00fa950 con 0x7f1de0115440 2026-02-13T02:19:10.714 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.710+0000 7f1de51506c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f1de00fab10 con 0x7f1de00f5140 2026-02-13T02:19:10.714 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.710+0000 7f1dded766c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f1de010f230 0x7f1de00f4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:10.714 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.710+0000 7f1dded766c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f1de010f230 0x7f1de00f4b10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:49108/0 (socket says 10.20.193.11:49108) 2026-02-13T02:19:10.714 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.710+0000 7f1dded766c0 1 -- 10.20.193.11:0/3161241023 learned_addr learned my addr 10.20.193.11:0/3161241023 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:19:10.715 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.710+0000 7f1dde5756c0 1 --2- 10.20.193.11:0/3161241023 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f1de0115440 0x7f1de0175ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:10.715 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.710+0000 7f1ddf5776c0 1 --2- 10.20.193.11:0/3161241023 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1de00f5140 0x7f1de00fa410 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:10.715 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.710+0000 7f1dded766c0 1 -- 10.20.193.11:0/3161241023 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1de00f5140 msgr2=0x7f1de00fa410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:10.715 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.710+0000 7f1dded766c0 1 --2- 10.20.193.11:0/3161241023 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1de00f5140 0x7f1de00fa410 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.715 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.710+0000 7f1dded766c0 1 -- 10.20.193.11:0/3161241023 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f1de0115440 msgr2=0x7f1de0175ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:10.715 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.710+0000 7f1dded766c0 1 --2- 10.20.193.11:0/3161241023 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f1de0115440 0x7f1de0175ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.715 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.710+0000 7f1dded766c0 1 -- 10.20.193.11:0/3161241023 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dc8009590 con 0x7f1de010f230 2026-02-13T02:19:10.715 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.710+0000 7f1dded766c0 1 --2- 10.20.193.11:0/3161241023 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f1de010f230 0x7f1de00f4b10 secure :-1 s=READY pgs=258 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1dd4009490 tx=0x7f1dd400bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:10.715 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.710+0000 7f1dbffff6c0 1 -- 10.20.193.11:0/3161241023 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1dd4004a80 con 0x7f1de010f230 2026-02-13T02:19:10.715 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.710+0000 7f1dbffff6c0 1 -- 10.20.193.11:0/3161241023 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1dd4009030 con 0x7f1de010f230 2026-02-13T02:19:10.716 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.710+0000 7f1dbffff6c0 1 -- 10.20.193.11:0/3161241023 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1dd40071c0 con 0x7f1de010f230 2026-02-13T02:19:10.716 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.711+0000 7f1de51506c0 1 -- 10.20.193.11:0/3161241023 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1de00fadf0 con 0x7f1de010f230 2026-02-13T02:19:10.716 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.711+0000 7f1de51506c0 1 -- 10.20.193.11:0/3161241023 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1de00fb280 con 0x7f1de010f230 2026-02-13T02:19:10.717 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.711+0000 7f1de51506c0 1 -- 10.20.193.11:0/3161241023 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1de0052a50 con 0x7f1de010f230 2026-02-13T02:19:10.717 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.713+0000 7f1dbffff6c0 1 -- 10.20.193.11:0/3161241023 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7f1dd4005000 con 0x7f1de010f230 2026-02-13T02:19:10.717 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.713+0000 7f1dbffff6c0 1 --2- 10.20.193.11:0/3161241023 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f1db40b5710 0x7f1db40d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:10.717 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.714+0000 7f1dbffff6c0 1 -- 10.20.193.11:0/3161241023 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7762+0+0 (secure 0 0 0) 0x7f1dd40e3910 con 0x7f1de010f230 2026-02-13T02:19:10.717 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.714+0000 7f1dde5756c0 1 --2- 10.20.193.11:0/3161241023 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f1db40b5710 0x7f1db40d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:10.717 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.714+0000 7f1dbffff6c0 1 --2- 10.20.193.11:0/3161241023 >> [v2:10.20.193.78:6808/3975711592,v1:10.20.193.78:6809/3975711592] conn(0x7f1db40dccf0 0x7f1db40fd100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:10.718 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.714+0000 7f1dbffff6c0 1 -- 10.20.193.11:0/3161241023 --> [v2:10.20.193.78:6808/3975711592,v1:10.20.193.78:6809/3975711592] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1db40fd7b0 con 0x7f1db40dccf0 2026-02-13T02:19:10.718 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.714+0000 7f1dbffff6c0 1 -- 10.20.193.11:0/3161241023 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7f1dd40e3d30 con 0x7f1de010f230 2026-02-13T02:19:10.718 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.714+0000 7f1ddf5776c0 1 --2- 10.20.193.11:0/3161241023 >> [v2:10.20.193.78:6808/3975711592,v1:10.20.193.78:6809/3975711592] conn(0x7f1db40dccf0 0x7f1db40fd100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:10.718 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.714+0000 7f1dde5756c0 1 --2- 10.20.193.11:0/3161241023 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f1db40b5710 0x7f1db40d5bc0 secure :-1 s=READY pgs=185 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1de00fb4a0 tx=0x7f1dc80023a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:10.718 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.714+0000 7f1ddf5776c0 1 --2- 10.20.193.11:0/3161241023 >> [v2:10.20.193.78:6808/3975711592,v1:10.20.193.78:6809/3975711592] conn(0x7f1db40dccf0 0x7f1db40fd100 crc :-1 s=READY pgs=14 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:10.718 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.715+0000 7f6b7e1476c0 1 -- 10.20.193.11:0/1324415631 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f6b7810fc20 msgr2=0x7f6b78114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:10.719 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.715+0000 7f6b7e1476c0 1 --2- 10.20.193.11:0/1324415631 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f6b7810fc20 0x7f6b78114c60 secure :-1 s=READY pgs=259 gs=1 cs=0 l=1 c_cookie=4531518971806860676 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6b680099a0 tx=0x7f6b6802ed50 comp rx=0 tx=0).stop 2026-02-13T02:19:10.719 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.715+0000 7f1dbffff6c0 1 -- 10.20.193.11:0/3161241023 <== osd.5 v2:10.20.193.78:6808/3975711592 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7f1db40fd7b0 con 0x7f1db40dccf0 2026-02-13T02:19:10.720 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.715+0000 7f6b7e1476c0 1 -- 10.20.193.11:0/1324415631 shutdown_connections 2026-02-13T02:19:10.720 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.715+0000 7f6b7e1476c0 1 --2- 10.20.193.11:0/1324415631 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f6b78115440 0x7f6b78175de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.720 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.715+0000 7f6b7e1476c0 1 --2- 10.20.193.11:0/1324415631 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f6b7810fc20 0x7f6b78114c60 unknown :-1 s=CLOSED pgs=259 gs=1 cs=0 l=1 c_cookie=4531518971806860676 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.720 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.715+0000 7f6b7e1476c0 1 --2- 10.20.193.11:0/1324415631 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6b7810f230 0x7f6b7810f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.720 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.715+0000 7f6b7e1476c0 1 -- 10.20.193.11:0/1324415631 >> 10.20.193.11:0/1324415631 conn(0x7f6b780ecb30 msgr2=0x7f6b7810cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:10.720 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.715+0000 7f6b7e1476c0 1 -- 10.20.193.11:0/1324415631 shutdown_connections 2026-02-13T02:19:10.720 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.715+0000 7f6b7e1476c0 1 -- 10.20.193.11:0/1324415631 wait complete. 2026-02-13T02:19:10.721 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.716+0000 7f5b760d36c0 1 -- 10.20.193.11:0/1222791697 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f5b70060740 msgr2=0x7f5b70060b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:10.721 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.716+0000 7f5b760d36c0 1 --2- 10.20.193.11:0/1222791697 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f5b70060740 0x7f5b70060b10 secure :-1 s=READY pgs=260 gs=1 cs=0 l=1 c_cookie=16418094323011270262 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5b5c009970 tx=0x7f5b5c02ed50 comp rx=0 tx=0).stop 2026-02-13T02:19:10.721 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.716+0000 7f5b760d36c0 1 -- 10.20.193.11:0/1222791697 shutdown_connections 2026-02-13T02:19:10.721 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.716+0000 7f5b760d36c0 1 --2- 10.20.193.11:0/1222791697 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f5b701556c0 0x7f5b70175aa0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.721 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.716+0000 7f5b760d36c0 1 --2- 10.20.193.11:0/1222791697 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f5b70061050 0x7f5b70155180 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.721 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.716+0000 7f5b760d36c0 1 --2- 10.20.193.11:0/1222791697 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f5b70060740 0x7f5b70060b10 unknown :-1 s=CLOSED pgs=260 gs=1 cs=0 l=1 c_cookie=16418094323011270262 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.721 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.716+0000 7f5b760d36c0 1 -- 10.20.193.11:0/1222791697 >> 10.20.193.11:0/1222791697 conn(0x7f5b700ea8b0 msgr2=0x7f5b7010acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:10.722 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.716+0000 7f5b760d36c0 1 -- 10.20.193.11:0/1222791697 shutdown_connections 2026-02-13T02:19:10.722 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.716+0000 7f5b760d36c0 1 -- 10.20.193.11:0/1222791697 wait complete. 2026-02-13T02:19:10.722 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.716+0000 7f6b7e1476c0 1 Processor -- start 2026-02-13T02:19:10.722 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.716+0000 7f6b7e1476c0 1 -- start start 2026-02-13T02:19:10.723 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.716+0000 7f5b760d36c0 1 Processor -- start 2026-02-13T02:19:10.723 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.716+0000 7f6b7e1476c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f6b7810f230 0x7f6b7811b400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:10.723 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.716+0000 7f6b7e1476c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6b78115440 0x7f6b7811b940 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:10.724 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.716+0000 7f6b7e1476c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f6b78120d00 0x7f6b781211a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:10.724 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.716+0000 7f6b7e1476c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f6b78121710 con 0x7f6b78120d00 2026-02-13T02:19:10.724 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.716+0000 7f6b7e1476c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6b78121880 con 0x7f6b7810f230 2026-02-13T02:19:10.724 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.716+0000 7f6b7e1476c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f6b78121a40 con 0x7f6b78115440 2026-02-13T02:19:10.724 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.716+0000 7f5b760d36c0 1 -- start start 2026-02-13T02:19:10.725 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.716+0000 7f6b777fe6c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f6b7810f230 0x7f6b7811b400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:10.725 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.716+0000 7f6b77fff6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f6b78120d00 0x7f6b781211a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:10.725 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.716+0000 7f5b760d36c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f5b70060740 0x7f5b701613b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:10.726 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.716+0000 7f6b77fff6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f6b78120d00 0x7f6b781211a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:49140/0 (socket says 10.20.193.11:49140) 2026-02-13T02:19:10.726 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.716+0000 7f6b77fff6c0 1 -- 10.20.193.11:0/3123780370 learned_addr learned my addr 10.20.193.11:0/3123780370 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:19:10.727 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.716+0000 7f5b760d36c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f5b70061050 0x7f5b701618f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:10.727 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.716+0000 7f5b760d36c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f5b701556c0 0x7f5b70166cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:10.727 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.716+0000 7f5b760d36c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f5b70167300 con 0x7f5b70060740 2026-02-13T02:19:10.727 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.716+0000 7f5b760d36c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f5b70167470 con 0x7f5b70061050 2026-02-13T02:19:10.727 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.716+0000 7f5b760d36c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f5b70167630 con 0x7f5b701556c0 2026-02-13T02:19:10.727 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.717+0000 7f5b6f7fe6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f5b70060740 0x7f5b701613b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:10.727 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.717+0000 7f5b6f7fe6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f5b70060740 0x7f5b701613b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:49146/0 (socket says 10.20.193.11:49146) 2026-02-13T02:19:10.727 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.717+0000 7f5b6f7fe6c0 1 -- 10.20.193.11:0/4031767205 learned_addr learned my addr 10.20.193.11:0/4031767205 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:19:10.728 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.717+0000 7f6b76ffd6c0 1 --2- 10.20.193.11:0/3123780370 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6b78115440 0x7f6b7811b940 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:10.728 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.717+0000 7f5b6effd6c0 1 --2- 10.20.193.11:0/4031767205 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f5b70061050 0x7f5b701618f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:10.728 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.717+0000 7f5b6ffff6c0 1 --2- 10.20.193.11:0/4031767205 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f5b701556c0 0x7f5b70166cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:10.729 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.717+0000 7f6b77fff6c0 1 -- 10.20.193.11:0/3123780370 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6b78115440 msgr2=0x7f6b7811b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:10.729 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.717+0000 7f6b77fff6c0 1 --2- 10.20.193.11:0/3123780370 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6b78115440 0x7f6b7811b940 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.729 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.717+0000 7f6b77fff6c0 1 -- 10.20.193.11:0/3123780370 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f6b7810f230 msgr2=0x7f6b7811b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:10.729 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.717+0000 7f6b77fff6c0 1 --2- 10.20.193.11:0/3123780370 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f6b7810f230 0x7f6b7811b400 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.729 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.717+0000 7f6b77fff6c0 1 -- 10.20.193.11:0/3123780370 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b68009590 con 0x7f6b78120d00 2026-02-13T02:19:10.729 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.717+0000 7f6b77fff6c0 1 --2- 10.20.193.11:0/3123780370 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f6b78120d00 0x7f6b781211a0 secure :-1 s=READY pgs=262 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6b6c006ea0 tx=0x7f6b6c00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:10.730 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.717+0000 7f5b6f7fe6c0 1 -- 10.20.193.11:0/4031767205 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f5b701556c0 msgr2=0x7f5b70166cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:10.730 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.717+0000 7f5b6f7fe6c0 1 --2- 10.20.193.11:0/4031767205 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f5b701556c0 0x7f5b70166cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.730 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.717+0000 7f5b6f7fe6c0 1 -- 10.20.193.11:0/4031767205 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f5b70061050 msgr2=0x7f5b701618f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:10.730 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.717+0000 7f5b6f7fe6c0 1 --2- 10.20.193.11:0/4031767205 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f5b70061050 0x7f5b701618f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.730 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.717+0000 7f5b6f7fe6c0 1 -- 10.20.193.11:0/4031767205 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b5c009590 con 0x7f5b70060740 2026-02-13T02:19:10.731 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.717+0000 7f6b74ff96c0 1 -- 10.20.193.11:0/3123780370 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6b6c003a30 con 0x7f6b78120d00 2026-02-13T02:19:10.731 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.717+0000 7f6b7e1476c0 1 -- 10.20.193.11:0/3123780370 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b78161ef0 con 0x7f6b78120d00 2026-02-13T02:19:10.731 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.717+0000 7f6b7e1476c0 1 -- 10.20.193.11:0/3123780370 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b781623d0 con 0x7f6b78120d00 2026-02-13T02:19:10.731 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.717+0000 7f6b74ff96c0 1 -- 10.20.193.11:0/3123780370 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6b6c005510 con 0x7f6b78120d00 2026-02-13T02:19:10.731 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.717+0000 7f6b74ff96c0 1 -- 10.20.193.11:0/3123780370 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6b6c00dd70 con 0x7f6b78120d00 2026-02-13T02:19:10.732 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.717+0000 7f5b6f7fe6c0 1 --2- 10.20.193.11:0/4031767205 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f5b70060740 0x7f5b701613b0 secure :-1 s=READY pgs=263 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5b5c0098c0 tx=0x7f5b5c02fc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:10.732 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.717+0000 7f5b6cff96c0 1 -- 10.20.193.11:0/4031767205 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5b5c002ae0 con 0x7f5b70060740 2026-02-13T02:19:10.732 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.717+0000 7f5b760d36c0 1 -- 10.20.193.11:0/4031767205 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b701678b0 con 0x7f5b70060740 2026-02-13T02:19:10.733 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.717+0000 7f96722e76c0 1 -- 10.20.193.11:0/1488366059 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f966c10dd20 msgr2=0x7f966c10e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:10.733 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.717+0000 7f96722e76c0 1 --2- 10.20.193.11:0/1488366059 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f966c10dd20 0x7f966c10e0f0 secure :-1 s=READY pgs=261 gs=1 cs=0 l=1 c_cookie=3245337899484809663 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9658009970 tx=0x7f965802ed20 comp rx=0 tx=0).stop 2026-02-13T02:19:10.733 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.717+0000 7f5b760d36c0 1 -- 10.20.193.11:0/4031767205 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b701512f0 con 0x7f5b70060740 2026-02-13T02:19:10.734 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.717+0000 7f96722e76c0 1 -- 10.20.193.11:0/1488366059 shutdown_connections 2026-02-13T02:19:10.734 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.717+0000 7f96722e76c0 1 --2- 10.20.193.11:0/1488366059 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f966c10e710 0x7f966c152d00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.734 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.717+0000 7f96722e76c0 1 --2- 10.20.193.11:0/1488366059 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f966c1532d0 0x7f966c173710 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.734 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.717+0000 7f96722e76c0 1 --2- 10.20.193.11:0/1488366059 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f966c10dd20 0x7f966c10e0f0 unknown :-1 s=CLOSED pgs=261 gs=1 cs=0 l=1 c_cookie=3245337899484809663 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.735 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.718+0000 7f6b7e1476c0 1 -- 10.20.193.11:0/3123780370 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6b78052a50 con 0x7f6b78120d00 2026-02-13T02:19:10.735 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.717+0000 7f96722e76c0 1 -- 10.20.193.11:0/1488366059 >> 10.20.193.11:0/1488366059 conn(0x7f966c0e9700 msgr2=0x7f966c109b10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:10.735 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.718+0000 7f96722e76c0 1 -- 10.20.193.11:0/1488366059 shutdown_connections 2026-02-13T02:19:10.735 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.718+0000 7f96722e76c0 1 -- 10.20.193.11:0/1488366059 wait complete. 2026-02-13T02:19:10.736 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.718+0000 7f5b6cff96c0 1 -- 10.20.193.11:0/4031767205 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f5b5c005bc0 con 0x7f5b70060740 2026-02-13T02:19:10.736 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.718+0000 7f5b6cff96c0 1 -- 10.20.193.11:0/4031767205 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5b5c0312b0 con 0x7f5b70060740 2026-02-13T02:19:10.736 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.718+0000 7f5b760d36c0 1 -- 10.20.193.11:0/4031767205 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5b70052a50 con 0x7f5b70060740 2026-02-13T02:19:10.738 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.718+0000 7f96722e76c0 1 Processor -- start 2026-02-13T02:19:10.738 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.718+0000 7f96722e76c0 1 -- start start 2026-02-13T02:19:10.738 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.718+0000 7f96722e76c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f966c10dd20 0x7f966c109820 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:10.738 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.718+0000 7f96722e76c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f966c10e710 0x7f966c103a60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:10.738 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.718+0000 7f96722e76c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f966c1532d0 0x7f966c103fa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:10.739 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.718+0000 7f96722e76c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f966c104510 con 0x7f966c10dd20 2026-02-13T02:19:10.739 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.718+0000 7f96722e76c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f966c104680 con 0x7f966c10e710 2026-02-13T02:19:10.739 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.718+0000 7f96722e76c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f966c104840 con 0x7f966c1532d0 2026-02-13T02:19:10.739 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.718+0000 7f966bfff6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f966c10dd20 0x7f966c109820 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:10.739 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.718+0000 7f966bfff6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f966c10dd20 0x7f966c109820 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:49154/0 (socket says 10.20.193.11:49154) 2026-02-13T02:19:10.739 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.718+0000 7f966bfff6c0 1 -- 10.20.193.11:0/4244227248 learned_addr learned my addr 10.20.193.11:0/4244227248 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:19:10.739 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.718+0000 7f966b7fe6c0 1 --2- 10.20.193.11:0/4244227248 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f966c10e710 0x7f966c103a60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:10.739 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.718+0000 7f96708596c0 1 --2- 10.20.193.11:0/4244227248 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f966c1532d0 0x7f966c103fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:10.739 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.718+0000 7f966bfff6c0 1 -- 10.20.193.11:0/4244227248 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f966c1532d0 msgr2=0x7f966c103fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:10.739 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.718+0000 7f966bfff6c0 1 --2- 10.20.193.11:0/4244227248 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f966c1532d0 0x7f966c103fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.739 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.718+0000 7f966bfff6c0 1 -- 10.20.193.11:0/4244227248 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f966c10e710 msgr2=0x7f966c103a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:10.740 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.718+0000 7f966bfff6c0 1 --2- 10.20.193.11:0/4244227248 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f966c10e710 0x7f966c103a60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.740 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.718+0000 7f966bfff6c0 1 -- 10.20.193.11:0/4244227248 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9658009590 con 0x7f966c10dd20 2026-02-13T02:19:10.740 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.718+0000 7f966b7fe6c0 1 --2- 10.20.193.11:0/4244227248 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f966c10e710 0x7f966c103a60 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T02:19:10.740 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.719+0000 7f966bfff6c0 1 --2- 10.20.193.11:0/4244227248 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f966c10dd20 0x7f966c109820 secure :-1 s=READY pgs=265 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9658009290 tx=0x7f965802fc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:10.740 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.719+0000 7f96697fa6c0 1 -- 10.20.193.11:0/4244227248 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9658002ae0 con 0x7f966c10dd20 2026-02-13T02:19:10.740 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.719+0000 7f96697fa6c0 1 -- 10.20.193.11:0/4244227248 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9658002c40 con 0x7f966c10dd20 2026-02-13T02:19:10.740 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.719+0000 7f96697fa6c0 1 -- 10.20.193.11:0/4244227248 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f96580372f0 con 0x7f966c10dd20 2026-02-13T02:19:10.740 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.719+0000 7f96722e76c0 1 -- 10.20.193.11:0/4244227248 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f966c14ed20 con 0x7f966c10dd20 2026-02-13T02:19:10.740 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.719+0000 7f96722e76c0 1 -- 10.20.193.11:0/4244227248 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f966c14f1b0 con 0x7f966c10dd20 2026-02-13T02:19:10.741 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.719+0000 7f6b74ff96c0 1 -- 10.20.193.11:0/3123780370 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7f6b6c003b90 con 0x7f6b78120d00 2026-02-13T02:19:10.741 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.719+0000 7f9b226d46c0 1 -- 10.20.193.11:0/1615809093 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f9b1c10d9a0 msgr2=0x7f9b1c1129e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:10.741 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.719+0000 7f9b226d46c0 1 --2- 10.20.193.11:0/1615809093 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f9b1c10d9a0 0x7f9b1c1129e0 secure :-1 s=READY pgs=264 gs=1 cs=0 l=1 c_cookie=5780101533180503478 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9b0c0099a0 tx=0x7f9b0c02ed20 comp rx=0 tx=0).stop 2026-02-13T02:19:10.742 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.719+0000 7f9b226d46c0 1 -- 10.20.193.11:0/1615809093 shutdown_connections 2026-02-13T02:19:10.742 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.719+0000 7f9b226d46c0 1 --2- 10.20.193.11:0/1615809093 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f9b1c1131c0 0x7f9b1c173b60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.742 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.719+0000 7f9b226d46c0 1 --2- 10.20.193.11:0/1615809093 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f9b1c10d9a0 0x7f9b1c1129e0 unknown :-1 s=CLOSED pgs=264 gs=1 cs=0 l=1 c_cookie=5780101533180503478 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.742 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.719+0000 7f9b226d46c0 1 --2- 10.20.193.11:0/1615809093 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f9b1c10cfb0 0x7f9b1c10d380 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.742 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.719+0000 7f9b226d46c0 1 -- 10.20.193.11:0/1615809093 >> 10.20.193.11:0/1615809093 conn(0x7f9b1c0ea8b0 msgr2=0x7f9b1c10acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:10.742 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.719+0000 7f9b226d46c0 1 -- 10.20.193.11:0/1615809093 shutdown_connections 2026-02-13T02:19:10.742 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.720+0000 7f96722e76c0 1 -- 10.20.193.11:0/4244227248 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f966c052a50 con 0x7f966c10dd20 2026-02-13T02:19:10.743 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.720+0000 7f5b6cff96c0 1 -- 10.20.193.11:0/4031767205 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7f5b5c0078f0 con 0x7f5b70060740 2026-02-13T02:19:10.743 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.720+0000 7f9b226d46c0 1 -- 10.20.193.11:0/1615809093 wait complete. 2026-02-13T02:19:10.744 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.720+0000 7f6b74ff96c0 1 --2- 10.20.193.11:0/3123780370 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f6b4c0b5710 0x7f6b4c0d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:10.744 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.720+0000 7f6b777fe6c0 1 --2- 10.20.193.11:0/3123780370 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f6b4c0b5710 0x7f6b4c0d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:10.744 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.720+0000 7f9b226d46c0 1 Processor -- start 2026-02-13T02:19:10.745 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.720+0000 7f6b74ff96c0 1 -- 10.20.193.11:0/3123780370 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7762+0+0 (secure 0 0 0) 0x7f6b6c0e4a90 con 0x7f6b78120d00 2026-02-13T02:19:10.745 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.720+0000 7f9b226d46c0 1 -- start start 2026-02-13T02:19:10.746 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.720+0000 7f5b6cff96c0 1 --2- 10.20.193.11:0/4031767205 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f5b440b5790 0x7f5b440d5c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:10.746 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.720+0000 7f96697fa6c0 1 -- 10.20.193.11:0/4244227248 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7f9658007260 con 0x7f966c10dd20 2026-02-13T02:19:10.746 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.720+0000 7f6b74ff96c0 1 --2- 10.20.193.11:0/3123780370 >> [v2:10.20.193.11:6826/132317204,v1:10.20.193.11:6827/132317204] conn(0x7f6b4c0dccf0 0x7f6b4c0fd100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:10.747 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.720+0000 7f6b74ff96c0 1 -- 10.20.193.11:0/3123780370 --> [v2:10.20.193.11:6826/132317204,v1:10.20.193.11:6827/132317204] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6b4c0fd7b0 con 0x7f6b4c0dccf0 2026-02-13T02:19:10.747 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.720+0000 7f6b74ff96c0 1 -- 10.20.193.11:0/3123780370 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7f6b6c0e4eb0 con 0x7f6b78120d00 2026-02-13T02:19:10.748 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.721+0000 7f9b226d46c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f9b1c10cfb0 0x7f9b1c0f2920 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:10.748 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.721+0000 7f9b226d46c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f9b1c1131c0 0x7f9b1c173a60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:10.748 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.721+0000 7f9b226d46c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f9b1c0f2f50 0x7f9b1c0f8220 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:10.748 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.721+0000 7f9b226d46c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f9b1c0f3640 con 0x7f9b1c10cfb0 2026-02-13T02:19:10.748 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.721+0000 7f9b226d46c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9b1c0f8760 con 0x7f9b1c1131c0 2026-02-13T02:19:10.748 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.721+0000 7f9b226d46c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f9b1c0f8920 con 0x7f9b1c0f2f50 2026-02-13T02:19:10.748 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.721+0000 7f9b1bfff6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f9b1c10cfb0 0x7f9b1c0f2920 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:10.749 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.721+0000 7f6b76ffd6c0 1 --2- 10.20.193.11:0/3123780370 >> [v2:10.20.193.11:6826/132317204,v1:10.20.193.11:6827/132317204] conn(0x7f6b4c0dccf0 0x7f6b4c0fd100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:10.749 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.721+0000 7f6b777fe6c0 1 --2- 10.20.193.11:0/3123780370 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f6b4c0b5710 0x7f6b4c0d5bc0 secure :-1 s=READY pgs=186 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6b64004750 tx=0x7f6b64009390 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:10.750 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.721+0000 7f9b1bfff6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f9b1c10cfb0 0x7f9b1c0f2920 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:49176/0 (socket says 10.20.193.11:49176) 2026-02-13T02:19:10.750 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.721+0000 7f9b1bfff6c0 1 -- 10.20.193.11:0/3792190244 learned_addr learned my addr 10.20.193.11:0/3792190244 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:19:10.750 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.721+0000 7f9b1b7fe6c0 1 --2- 10.20.193.11:0/3792190244 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f9b1c1131c0 0x7f9b1c173a60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:10.750 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.721+0000 7f9b20c466c0 1 --2- 10.20.193.11:0/3792190244 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f9b1c0f2f50 0x7f9b1c0f8220 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:10.751 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.721+0000 7f5b6cff96c0 1 -- 10.20.193.11:0/4031767205 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7762+0+0 (secure 0 0 0) 0x7f5b5c107ca0 con 0x7f5b70060740 2026-02-13T02:19:10.751 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.721+0000 7f5b6cff96c0 1 --2- 10.20.193.11:0/4031767205 >> [v2:10.20.193.78:6824/537170494,v1:10.20.193.78:6825/537170494] conn(0x7f5b440dcd70 0x7f5b440fd180 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:10.751 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.721+0000 7f5b6cff96c0 1 -- 10.20.193.11:0/4031767205 --> [v2:10.20.193.78:6824/537170494,v1:10.20.193.78:6825/537170494] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5b440fd830 con 0x7f5b440dcd70 2026-02-13T02:19:10.751 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.721+0000 7f5b6cff96c0 1 -- 10.20.193.11:0/4031767205 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7f5b5c107fd0 con 0x7f5b70060740 2026-02-13T02:19:10.751 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.721+0000 7f5b6ffff6c0 1 --2- 10.20.193.11:0/4031767205 >> [v2:10.20.193.78:6824/537170494,v1:10.20.193.78:6825/537170494] conn(0x7f5b440dcd70 0x7f5b440fd180 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:10.752 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.721+0000 7f9b1bfff6c0 1 -- 10.20.193.11:0/3792190244 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f9b1c0f2f50 msgr2=0x7f9b1c0f8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:10.752 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.721+0000 7f9b1bfff6c0 1 --2- 10.20.193.11:0/3792190244 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f9b1c0f2f50 0x7f9b1c0f8220 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.752 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.721+0000 7f9b1bfff6c0 1 -- 10.20.193.11:0/3792190244 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f9b1c1131c0 msgr2=0x7f9b1c173a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:10.752 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.721+0000 7f9b1bfff6c0 1 --2- 10.20.193.11:0/3792190244 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f9b1c1131c0 0x7f9b1c173a60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.752 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.721+0000 7f9b1bfff6c0 1 -- 10.20.193.11:0/3792190244 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b0c009590 con 0x7f9b1c10cfb0 2026-02-13T02:19:10.752 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.721+0000 7f6b76ffd6c0 1 --2- 10.20.193.11:0/3123780370 >> [v2:10.20.193.11:6826/132317204,v1:10.20.193.11:6827/132317204] conn(0x7f6b4c0dccf0 0x7f6b4c0fd100 crc :-1 s=READY pgs=12 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:10.753 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.721+0000 7f9b1bfff6c0 1 --2- 10.20.193.11:0/3792190244 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f9b1c10cfb0 0x7f9b1c0f2920 secure :-1 s=READY pgs=267 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9b0800b710 tx=0x7f9b0800bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:10.753 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.721+0000 7f9b197fa6c0 1 -- 10.20.193.11:0/3792190244 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9b08004250 con 0x7f9b1c10cfb0 2026-02-13T02:19:10.753 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.721+0000 7f9b197fa6c0 1 -- 10.20.193.11:0/3792190244 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9b08009070 con 0x7f9b1c10cfb0 2026-02-13T02:19:10.753 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.721+0000 7f5b6ffff6c0 1 --2- 10.20.193.11:0/4031767205 >> [v2:10.20.193.78:6824/537170494,v1:10.20.193.78:6825/537170494] conn(0x7f5b440dcd70 0x7f5b440fd180 crc :-1 s=READY pgs=6 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:10.754 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.721+0000 7f9b226d46c0 1 -- 10.20.193.11:0/3792190244 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b1c0f8c00 con 0x7f9b1c10cfb0 2026-02-13T02:19:10.754 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.721+0000 7f96697fa6c0 1 --2- 10.20.193.11:0/4244227248 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f96400b5790 0x7f96400d5c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:10.755 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.721+0000 7f9b226d46c0 1 -- 10.20.193.11:0/3792190244 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b1c0f9390 con 0x7f9b1c10cfb0 2026-02-13T02:19:10.755 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.721+0000 7f9b197fa6c0 1 -- 10.20.193.11:0/3792190244 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9b0800cd70 con 0x7f9b1c10cfb0 2026-02-13T02:19:10.755 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.722+0000 7f96697fa6c0 1 -- 10.20.193.11:0/4244227248 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7762+0+0 (secure 0 0 0) 0x7f9658107c10 con 0x7f966c10dd20 2026-02-13T02:19:10.755 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.722+0000 7faf60be56c0 1 -- 10.20.193.11:0/2147595707 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7faf5c10fbf0 msgr2=0x7faf5c114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:10.756 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.722+0000 7faf60be56c0 1 --2- 10.20.193.11:0/2147595707 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7faf5c10fbf0 0x7faf5c114c30 secure :-1 s=READY pgs=266 gs=1 cs=0 l=1 c_cookie=16860744673464832447 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faf440099a0 tx=0x7faf4402ed00 comp rx=0 tx=0).stop 2026-02-13T02:19:10.756 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.722+0000 7faf60be56c0 1 -- 10.20.193.11:0/2147595707 shutdown_connections 2026-02-13T02:19:10.756 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.722+0000 7faf60be56c0 1 --2- 10.20.193.11:0/2147595707 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7faf5c115410 0x7faf5c175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.756 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.722+0000 7f96697fa6c0 1 --2- 10.20.193.11:0/4244227248 >> [v2:10.20.193.78:6816/242640323,v1:10.20.193.78:6817/242640323] conn(0x7f96400dcd70 0x7f96400fd180 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:10.756 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.722+0000 7f96697fa6c0 1 -- 10.20.193.11:0/4244227248 --> [v2:10.20.193.78:6816/242640323,v1:10.20.193.78:6817/242640323] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f96400fd830 con 0x7f96400dcd70 2026-02-13T02:19:10.756 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.722+0000 7f96697fa6c0 1 -- 10.20.193.11:0/4244227248 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7f965810a1e0 con 0x7f966c10dd20 2026-02-13T02:19:10.756 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.722+0000 7f6b74ff96c0 1 -- 10.20.193.11:0/3123780370 <== osd.9 v2:10.20.193.11:6826/132317204 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7f6b4c0fd7b0 con 0x7f6b4c0dccf0 2026-02-13T02:19:10.757 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.722+0000 7faf60be56c0 1 --2- 10.20.193.11:0/2147595707 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7faf5c10fbf0 0x7faf5c114c30 unknown :-1 s=CLOSED pgs=266 gs=1 cs=0 l=1 c_cookie=16860744673464832447 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.757 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.722+0000 7faf60be56c0 1 --2- 10.20.193.11:0/2147595707 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7faf5c10f200 0x7faf5c10f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.757 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.722+0000 7faf60be56c0 1 -- 10.20.193.11:0/2147595707 >> 10.20.193.11:0/2147595707 conn(0x7faf5c0ecb00 msgr2=0x7faf5c10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:10.757 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.722+0000 7f5b6cff96c0 1 -- 10.20.193.11:0/4031767205 <== osd.11 v2:10.20.193.78:6824/537170494 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7f5b440fd830 con 0x7f5b440dcd70 2026-02-13T02:19:10.757 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.722+0000 7f96708596c0 1 --2- 10.20.193.11:0/4244227248 >> [v2:10.20.193.78:6816/242640323,v1:10.20.193.78:6817/242640323] conn(0x7f96400dcd70 0x7f96400fd180 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:10.758 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.722+0000 7f9b226d46c0 1 -- 10.20.193.11:0/3792190244 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9b1c052a50 con 0x7f9b1c10cfb0 2026-02-13T02:19:10.758 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.722+0000 7faf60be56c0 1 -- 10.20.193.11:0/2147595707 shutdown_connections 2026-02-13T02:19:10.758 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.722+0000 7faf60be56c0 1 -- 10.20.193.11:0/2147595707 wait complete. 2026-02-13T02:19:10.758 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.722+0000 7faf60be56c0 1 Processor -- start 2026-02-13T02:19:10.758 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.722+0000 7faf60be56c0 1 -- start start 2026-02-13T02:19:10.759 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.722+0000 7f96708596c0 1 --2- 10.20.193.11:0/4244227248 >> [v2:10.20.193.78:6816/242640323,v1:10.20.193.78:6817/242640323] conn(0x7f96400dcd70 0x7f96400fd180 crc :-1 s=READY pgs=16 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:10.759 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.723+0000 7faf60be56c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7faf5c10f200 0x7faf5c10d090 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:10.759 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.723+0000 7faf60be56c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7faf5c115410 0x7faf5c175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:10.759 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.723+0000 7f2fb82336c0 1 -- 10.20.193.11:0/2602580053 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f2fb010f230 msgr2=0x7f2fb010f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:10.759 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.723+0000 7f2fb82336c0 1 --2- 10.20.193.11:0/2602580053 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f2fb010f230 0x7f2fb010f600 secure :-1 s=READY pgs=268 gs=1 cs=0 l=1 c_cookie=266914201425011253 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2fa00099a0 tx=0x7f2fa002ed20 comp rx=0 tx=0).stop 2026-02-13T02:19:10.759 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.723+0000 7f2fb82336c0 1 -- 10.20.193.11:0/2602580053 shutdown_connections 2026-02-13T02:19:10.760 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.723+0000 7faf60be56c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7faf5c10a470 0x7faf5c10a8f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:10.760 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.723+0000 7faf60be56c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7faf5c10b080 con 0x7faf5c10f200 2026-02-13T02:19:10.760 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.723+0000 7faf60be56c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7faf5c10b1f0 con 0x7faf5c115410 2026-02-13T02:19:10.760 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.723+0000 7faf60be56c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7faf5c0f0ff0 con 0x7faf5c10a470 2026-02-13T02:19:10.760 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.723+0000 7faf5a5756c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7faf5c10f200 0x7faf5c10d090 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:10.760 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.723+0000 7faf5a5756c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7faf5c10f200 0x7faf5c10d090 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:49182/0 (socket says 10.20.193.11:49182) 2026-02-13T02:19:10.760 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.723+0000 7faf5a5756c0 1 -- 10.20.193.11:0/1154112053 learned_addr learned my addr 10.20.193.11:0/1154112053 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:19:10.760 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.723+0000 7f2fb82336c0 1 --2- 10.20.193.11:0/2602580053 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f2fb010fc20 0x7f2fb0114c60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.761 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.723+0000 7f2fb82336c0 1 --2- 10.20.193.11:0/2602580053 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f2fb0115440 0x7f2fb0175de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.761 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.723+0000 7f2fb82336c0 1 --2- 10.20.193.11:0/2602580053 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f2fb010f230 0x7f2fb010f600 unknown :-1 s=CLOSED pgs=268 gs=1 cs=0 l=1 c_cookie=266914201425011253 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.761 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.723+0000 7f2fb82336c0 1 -- 10.20.193.11:0/2602580053 >> 10.20.193.11:0/2602580053 conn(0x7f2fb00ecb30 msgr2=0x7f2fb010cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:10.761 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.723+0000 7f2fb82336c0 1 -- 10.20.193.11:0/2602580053 shutdown_connections 2026-02-13T02:19:10.761 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.723+0000 7f2fb82336c0 1 -- 10.20.193.11:0/2602580053 wait complete. 2026-02-13T02:19:10.761 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.723+0000 7faf59d746c0 1 --2- 10.20.193.11:0/1154112053 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7faf5c115410 0x7faf5c175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:10.761 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.723+0000 7faf5ad766c0 1 --2- 10.20.193.11:0/1154112053 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7faf5c10a470 0x7faf5c10a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:10.761 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.723+0000 7f96697fa6c0 1 -- 10.20.193.11:0/4244227248 <== osd.8 v2:10.20.193.78:6816/242640323 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7f96400fd830 con 0x7f96400dcd70 2026-02-13T02:19:10.762 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.723+0000 7faf5a5756c0 1 -- 10.20.193.11:0/1154112053 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7faf5c10a470 msgr2=0x7faf5c10a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:10.762 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.723+0000 7faf5a5756c0 1 --2- 10.20.193.11:0/1154112053 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7faf5c10a470 0x7faf5c10a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.762 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.723+0000 7faf5a5756c0 1 -- 10.20.193.11:0/1154112053 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7faf5c115410 msgr2=0x7faf5c175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:10.762 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.723+0000 7faf5a5756c0 1 --2- 10.20.193.11:0/1154112053 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7faf5c115410 0x7faf5c175cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.762 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.723+0000 7faf5a5756c0 1 -- 10.20.193.11:0/1154112053 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf44009590 con 0x7faf5c10f200 2026-02-13T02:19:10.762 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.723+0000 7f2fb82336c0 1 Processor -- start 2026-02-13T02:19:10.762 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.723+0000 7faf5a5756c0 1 --2- 10.20.193.11:0/1154112053 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7faf5c10f200 0x7faf5c10d090 secure :-1 s=READY pgs=269 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faf50009490 tx=0x7faf5000bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:10.763 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.723+0000 7f2fb82336c0 1 -- start start 2026-02-13T02:19:10.763 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.724+0000 7f9b197fa6c0 1 -- 10.20.193.11:0/3792190244 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7f9b080028c0 con 0x7f9b1c10cfb0 2026-02-13T02:19:10.764 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.723+0000 7faf437fe6c0 1 -- 10.20.193.11:0/1154112053 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7faf50004a80 con 0x7faf5c10f200 2026-02-13T02:19:10.764 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.724+0000 7faf437fe6c0 1 -- 10.20.193.11:0/1154112053 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7faf50009030 con 0x7faf5c10f200 2026-02-13T02:19:10.764 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.724+0000 7faf60be56c0 1 -- 10.20.193.11:0/1154112053 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf5c0f12d0 con 0x7faf5c10f200 2026-02-13T02:19:10.764 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.724+0000 7faf437fe6c0 1 -- 10.20.193.11:0/1154112053 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7faf500071c0 con 0x7faf5c10f200 2026-02-13T02:19:10.764 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.724+0000 7faf60be56c0 1 -- 10.20.193.11:0/1154112053 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf5c0f17d0 con 0x7faf5c10f200 2026-02-13T02:19:10.764 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.724+0000 7faf60be56c0 1 -- 10.20.193.11:0/1154112053 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7faf5c052a50 con 0x7faf5c10f200 2026-02-13T02:19:10.764 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.724+0000 7f9b197fa6c0 1 --2- 10.20.193.11:0/3792190244 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f9af00b5710 0x7f9af00d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:10.764 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.724+0000 7f1de51506c0 1 -- 10.20.193.11:0/3161241023 --> [v2:10.20.193.78:6808/3975711592,v1:10.20.193.78:6809/3975711592] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1de01793e0 con 0x7f1db40dccf0 2026-02-13T02:19:10.765 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.724+0000 7f2fb82336c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f2fb010f230 0x7f2fb011d1c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:10.765 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.724+0000 7f2fb82336c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f2fb0115440 0x7f2fb011d700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:10.765 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.724+0000 7f2fb82336c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f2fb0122ac0 0x7f2fb0122f60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:10.765 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.724+0000 7f9b197fa6c0 1 -- 10.20.193.11:0/3792190244 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7762+0+0 (secure 0 0 0) 0x7f9b080e3a40 con 0x7f9b1c10cfb0 2026-02-13T02:19:10.765 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.724+0000 7f9b197fa6c0 1 --2- 10.20.193.11:0/3792190244 >> [v2:10.20.193.78:6800/3723638526,v1:10.20.193.78:6801/3723638526] conn(0x7f9af00dccf0 0x7f9af00fd100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:10.765 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.724+0000 7f2fb82336c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f2fb01234d0 con 0x7f2fb010f230 2026-02-13T02:19:10.765 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.724+0000 7f2fb82336c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f2fb0123640 con 0x7f2fb0115440 2026-02-13T02:19:10.765 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.724+0000 7f2fb82336c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f2fb0123800 con 0x7f2fb0122ac0 2026-02-13T02:19:10.766 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.724+0000 7f9b197fa6c0 1 -- 10.20.193.11:0/3792190244 --> [v2:10.20.193.78:6800/3723638526,v1:10.20.193.78:6801/3723638526] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9af00fd7b0 con 0x7f9af00dccf0 2026-02-13T02:19:10.766 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.724+0000 7f2fb5fa46c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f2fb010f230 0x7f2fb011d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:10.766 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.724+0000 7f1dbffff6c0 1 -- 10.20.193.11:0/3161241023 <== osd.5 v2:10.20.193.78:6808/3975711592 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f1de01793e0 con 0x7f1db40dccf0 2026-02-13T02:19:10.766 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.724+0000 7f9b197fa6c0 1 -- 10.20.193.11:0/3792190244 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7f9b080e3df0 con 0x7f9b1c10cfb0 2026-02-13T02:19:10.767 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.724+0000 7f2fb5fa46c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f2fb010f230 0x7f2fb011d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:49184/0 (socket says 10.20.193.11:49184) 2026-02-13T02:19:10.767 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.724+0000 7f2fb5fa46c0 1 -- 10.20.193.11:0/4191457995 learned_addr learned my addr 10.20.193.11:0/4191457995 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:19:10.767 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.725+0000 7f2fb57a36c0 1 --2- 10.20.193.11:0/4191457995 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f2fb0115440 0x7f2fb011d700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:10.767 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.725+0000 7f2fb67a56c0 1 --2- 10.20.193.11:0/4191457995 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f2fb0122ac0 0x7f2fb0122f60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:10.767 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.725+0000 7f2fb5fa46c0 1 -- 10.20.193.11:0/4191457995 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f2fb0122ac0 msgr2=0x7f2fb0122f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:10.767 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.725+0000 7f2fb5fa46c0 1 --2- 10.20.193.11:0/4191457995 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f2fb0122ac0 0x7f2fb0122f60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.767 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.725+0000 7f2fb5fa46c0 1 -- 10.20.193.11:0/4191457995 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f2fb0115440 msgr2=0x7f2fb011d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:10.767 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.725+0000 7f2fb5fa46c0 1 --2- 10.20.193.11:0/4191457995 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f2fb0115440 0x7f2fb011d700 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.768 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.725+0000 7f9b20c466c0 1 --2- 10.20.193.11:0/3792190244 >> [v2:10.20.193.78:6800/3723638526,v1:10.20.193.78:6801/3723638526] conn(0x7f9af00dccf0 0x7f9af00fd100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:10.768 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.725+0000 7f2fb5fa46c0 1 -- 10.20.193.11:0/4191457995 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fa40094c0 con 0x7f2fb010f230 2026-02-13T02:19:10.768 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.725+0000 7f2fb57a36c0 1 --2- 10.20.193.11:0/4191457995 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f2fb0115440 0x7f2fb011d700 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T02:19:10.768 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.725+0000 7f2fb5fa46c0 1 --2- 10.20.193.11:0/4191457995 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f2fb010f230 0x7f2fb011d1c0 secure :-1 s=READY pgs=270 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2fa0031fd0 tx=0x7f2fa002fc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:10.768 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.725+0000 7f1de51506c0 1 -- 10.20.193.11:0/3161241023 >> [v2:10.20.193.78:6808/3975711592,v1:10.20.193.78:6809/3975711592] conn(0x7f1db40dccf0 msgr2=0x7f1db40fd100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:10.768 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.725+0000 7f1de51506c0 1 --2- 10.20.193.11:0/3161241023 >> [v2:10.20.193.78:6808/3975711592,v1:10.20.193.78:6809/3975711592] conn(0x7f1db40dccf0 0x7f1db40fd100 crc :-1 s=READY pgs=14 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.769 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.725+0000 7f2f96ffd6c0 1 -- 10.20.193.11:0/4191457995 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2fa0002ae0 con 0x7f2fb010f230 2026-02-13T02:19:10.769 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.725+0000 7f1de51506c0 1 -- 10.20.193.11:0/3161241023 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f1db40b5710 msgr2=0x7f1db40d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:10.769 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.725+0000 7f1de51506c0 1 --2- 10.20.193.11:0/3161241023 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f1db40b5710 0x7f1db40d5bc0 secure :-1 s=READY pgs=185 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1de00fb4a0 tx=0x7f1dc80023a0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.769 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.725+0000 7f1de51506c0 1 -- 10.20.193.11:0/3161241023 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f1de010f230 msgr2=0x7f1de00f4b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:10.769 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.725+0000 7f1de51506c0 1 --2- 10.20.193.11:0/3161241023 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f1de010f230 0x7f1de00f4b10 secure :-1 s=READY pgs=258 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1dd4009490 tx=0x7f1dd400bca0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.769 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.725+0000 7f2fb82336c0 1 -- 10.20.193.11:0/4191457995 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fa0009590 con 0x7f2fb010f230 2026-02-13T02:19:10.770 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.725+0000 7f2fb82336c0 1 -- 10.20.193.11:0/4191457995 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fb0163f40 con 0x7f2fb010f230 2026-02-13T02:19:10.770 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.725+0000 7f1ddf5776c0 1 -- 10.20.193.11:0/3161241023 reap_dead start 2026-02-13T02:19:10.770 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.725+0000 7f2f96ffd6c0 1 -- 10.20.193.11:0/4191457995 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2fa00046b0 con 0x7f2fb010f230 2026-02-13T02:19:10.770 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.725+0000 7f2f96ffd6c0 1 -- 10.20.193.11:0/4191457995 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2fa00372f0 con 0x7f2fb010f230 2026-02-13T02:19:10.770 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.725+0000 7f1de51506c0 1 -- 10.20.193.11:0/3161241023 shutdown_connections 2026-02-13T02:19:10.770 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.725+0000 7f1de51506c0 1 -- 10.20.193.11:0/3161241023 >> 10.20.193.11:0/3161241023 conn(0x7f1de00ecb30 msgr2=0x7f1de010d750 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:10.770 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.725+0000 7f9b20c466c0 1 --2- 10.20.193.11:0/3792190244 >> [v2:10.20.193.78:6800/3723638526,v1:10.20.193.78:6801/3723638526] conn(0x7f9af00dccf0 0x7f9af00fd100 crc :-1 s=READY pgs=15 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:10.771 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.725+0000 7f1de51506c0 1 -- 10.20.193.11:0/3161241023 shutdown_connections 2026-02-13T02:19:10.771 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.725+0000 7f1de51506c0 1 -- 10.20.193.11:0/3161241023 wait complete. 2026-02-13T02:19:10.771 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.726+0000 7f2fb82336c0 1 -- 10.20.193.11:0/4191457995 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2fb0052a50 con 0x7f2fb010f230 2026-02-13T02:19:10.771 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.726+0000 7f9b197fa6c0 1 -- 10.20.193.11:0/3792190244 <== osd.2 v2:10.20.193.78:6800/3723638526 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7f9af00fd7b0 con 0x7f9af00dccf0 2026-02-13T02:19:10.772 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.726+0000 7faf437fe6c0 1 -- 10.20.193.11:0/1154112053 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7faf50005020 con 0x7faf5c10f200 2026-02-13T02:19:10.772 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.726+0000 7faf437fe6c0 1 --2- 10.20.193.11:0/1154112053 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7faf340b5790 0x7faf340d5c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:10.772 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.726+0000 7faf437fe6c0 1 -- 10.20.193.11:0/1154112053 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7762+0+0 (secure 0 0 0) 0x7faf500e3ab0 con 0x7faf5c10f200 2026-02-13T02:19:10.772 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.726+0000 7faf437fe6c0 1 --2- 10.20.193.11:0/1154112053 >> [v2:10.20.193.60:6816/2908560893,v1:10.20.193.60:6817/2908560893] conn(0x7faf340dcd60 0x7faf340fd170 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:10.772 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.726+0000 7faf437fe6c0 1 -- 10.20.193.11:0/1154112053 --> [v2:10.20.193.60:6816/2908560893,v1:10.20.193.60:6817/2908560893] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faf340fd820 con 0x7faf340dcd60 2026-02-13T02:19:10.772 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.726+0000 7faf437fe6c0 1 -- 10.20.193.11:0/1154112053 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7faf500e3de0 con 0x7faf5c10f200 2026-02-13T02:19:10.772 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.727+0000 7faf5ad766c0 1 --2- 10.20.193.11:0/1154112053 >> [v2:10.20.193.60:6816/2908560893,v1:10.20.193.60:6817/2908560893] conn(0x7faf340dcd60 0x7faf340fd170 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:10.772 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.727+0000 7f2f96ffd6c0 1 -- 10.20.193.11:0/4191457995 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7f2fa0002c40 con 0x7f2fb010f230 2026-02-13T02:19:10.772 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.728+0000 7faf5ad766c0 1 --2- 10.20.193.11:0/1154112053 >> [v2:10.20.193.60:6816/2908560893,v1:10.20.193.60:6817/2908560893] conn(0x7faf340dcd60 0x7faf340fd170 crc :-1 s=READY pgs=11 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:10.773 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.728+0000 7f2f96ffd6c0 1 --2- 10.20.193.11:0/4191457995 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f2f8c0b5790 0x7f2f8c0d5c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:10.773 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.728+0000 7f2f96ffd6c0 1 -- 10.20.193.11:0/4191457995 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7762+0+0 (secure 0 0 0) 0x7f2fa0107c10 con 0x7f2fb010f230 2026-02-13T02:19:10.773 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.728+0000 7f2f96ffd6c0 1 --2- 10.20.193.11:0/4191457995 >> [v2:10.20.193.11:6810/4224399876,v1:10.20.193.11:6811/4224399876] conn(0x7f2f8c0dcd70 0x7f2f8c0fd180 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:10.773 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.728+0000 7f2f96ffd6c0 1 -- 10.20.193.11:0/4191457995 --> [v2:10.20.193.11:6810/4224399876,v1:10.20.193.11:6811/4224399876] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2f8c0fd830 con 0x7f2f8c0dcd70 2026-02-13T02:19:10.773 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.728+0000 7f2f96ffd6c0 1 -- 10.20.193.11:0/4191457995 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7f2fa0107f40 con 0x7f2fb010f230 2026-02-13T02:19:10.773 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.728+0000 7faf437fe6c0 1 -- 10.20.193.11:0/1154112053 <== osd.7 v2:10.20.193.60:6816/2908560893 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7faf340fd820 con 0x7faf340dcd60 2026-02-13T02:19:10.773 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.728+0000 7f2fb67a56c0 1 --2- 10.20.193.11:0/4191457995 >> [v2:10.20.193.11:6810/4224399876,v1:10.20.193.11:6811/4224399876] conn(0x7f2f8c0dcd70 0x7f2f8c0fd180 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:10.773 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.728+0000 7f2fb67a56c0 1 --2- 10.20.193.11:0/4191457995 >> [v2:10.20.193.11:6810/4224399876,v1:10.20.193.11:6811/4224399876] conn(0x7f2f8c0dcd70 0x7f2f8c0fd180 crc :-1 s=READY pgs=11 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:10.773 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.729+0000 7f2f96ffd6c0 1 -- 10.20.193.11:0/4191457995 <== osd.3 v2:10.20.193.11:6810/4224399876 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7f2f8c0fd830 con 0x7f2f8c0dcd70 2026-02-13T02:19:10.774 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.731+0000 7f6b7e1476c0 1 -- 10.20.193.11:0/3123780370 --> [v2:10.20.193.11:6826/132317204,v1:10.20.193.11:6827/132317204] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6b78063cd0 con 0x7f6b4c0dccf0 2026-02-13T02:19:10.774 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.731+0000 7f6b74ff96c0 1 -- 10.20.193.11:0/3123780370 <== osd.9 v2:10.20.193.11:6826/132317204 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f6b78063cd0 con 0x7f6b4c0dccf0 2026-02-13T02:19:10.774 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.731+0000 7f6b7e1476c0 1 -- 10.20.193.11:0/3123780370 >> [v2:10.20.193.11:6826/132317204,v1:10.20.193.11:6827/132317204] conn(0x7f6b4c0dccf0 msgr2=0x7f6b4c0fd100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:10.774 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.731+0000 7f6b7e1476c0 1 --2- 10.20.193.11:0/3123780370 >> [v2:10.20.193.11:6826/132317204,v1:10.20.193.11:6827/132317204] conn(0x7f6b4c0dccf0 0x7f6b4c0fd100 crc :-1 s=READY pgs=12 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.774 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.731+0000 7f6b7e1476c0 1 -- 10.20.193.11:0/3123780370 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f6b4c0b5710 msgr2=0x7f6b4c0d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:10.774 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.731+0000 7f6b7e1476c0 1 --2- 10.20.193.11:0/3123780370 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f6b4c0b5710 0x7f6b4c0d5bc0 secure :-1 s=READY pgs=186 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6b64004750 tx=0x7f6b64009390 comp rx=0 tx=0).stop 2026-02-13T02:19:10.774 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.731+0000 7f6b7e1476c0 1 -- 10.20.193.11:0/3123780370 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f6b78120d00 msgr2=0x7f6b781211a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:10.774 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.731+0000 7f6b7e1476c0 1 --2- 10.20.193.11:0/3123780370 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f6b78120d00 0x7f6b781211a0 secure :-1 s=READY pgs=262 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6b6c006ea0 tx=0x7f6b6c00cca0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.774 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.731+0000 7f6b77fff6c0 1 -- 10.20.193.11:0/3123780370 reap_dead start 2026-02-13T02:19:10.775 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.731+0000 7f5b760d36c0 1 -- 10.20.193.11:0/4031767205 --> [v2:10.20.193.78:6824/537170494,v1:10.20.193.78:6825/537170494] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5b7015a430 con 0x7f5b440dcd70 2026-02-13T02:19:10.775 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.731+0000 7f96722e76c0 1 -- 10.20.193.11:0/4244227248 --> [v2:10.20.193.78:6816/242640323,v1:10.20.193.78:6817/242640323] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f966c04cca0 con 0x7f96400dcd70 2026-02-13T02:19:10.775 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.731+0000 7f6b7e1476c0 1 -- 10.20.193.11:0/3123780370 shutdown_connections 2026-02-13T02:19:10.775 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.731+0000 7f6b7e1476c0 1 -- 10.20.193.11:0/3123780370 >> 10.20.193.11:0/3123780370 conn(0x7f6b780ecb30 msgr2=0x7f6b7810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:10.775 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.731+0000 7f6b7e1476c0 1 -- 10.20.193.11:0/3123780370 shutdown_connections 2026-02-13T02:19:10.775 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.731+0000 7f5b6cff96c0 1 -- 10.20.193.11:0/4031767205 <== osd.11 v2:10.20.193.78:6824/537170494 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f5b7015a430 con 0x7f5b440dcd70 2026-02-13T02:19:10.775 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.732+0000 7f6b7e1476c0 1 -- 10.20.193.11:0/3123780370 wait complete. 2026-02-13T02:19:10.776 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.732+0000 7f96697fa6c0 1 -- 10.20.193.11:0/4244227248 <== osd.8 v2:10.20.193.78:6816/242640323 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f966c04cca0 con 0x7f96400dcd70 2026-02-13T02:19:10.776 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.732+0000 7f5b760d36c0 1 -- 10.20.193.11:0/4031767205 >> [v2:10.20.193.78:6824/537170494,v1:10.20.193.78:6825/537170494] conn(0x7f5b440dcd70 msgr2=0x7f5b440fd180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:10.776 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.732+0000 7f5b760d36c0 1 --2- 10.20.193.11:0/4031767205 >> [v2:10.20.193.78:6824/537170494,v1:10.20.193.78:6825/537170494] conn(0x7f5b440dcd70 0x7f5b440fd180 crc :-1 s=READY pgs=6 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.776 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.732+0000 7f5b760d36c0 1 -- 10.20.193.11:0/4031767205 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f5b440b5790 msgr2=0x7f5b440d5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:10.776 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.732+0000 7f5b760d36c0 1 --2- 10.20.193.11:0/4031767205 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f5b440b5790 0x7f5b440d5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.776 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.732+0000 7f5b760d36c0 1 -- 10.20.193.11:0/4031767205 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f5b70060740 msgr2=0x7f5b701613b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:10.776 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.732+0000 7f5b760d36c0 1 --2- 10.20.193.11:0/4031767205 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f5b70060740 0x7f5b701613b0 secure :-1 s=READY pgs=263 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5b5c0098c0 tx=0x7f5b5c02fc70 comp rx=0 tx=0).stop 2026-02-13T02:19:10.776 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.732+0000 7f5b6ffff6c0 1 -- 10.20.193.11:0/4031767205 reap_dead start 2026-02-13T02:19:10.777 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.732+0000 7f96722e76c0 1 -- 10.20.193.11:0/4244227248 >> [v2:10.20.193.78:6816/242640323,v1:10.20.193.78:6817/242640323] conn(0x7f96400dcd70 msgr2=0x7f96400fd180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:10.777 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.732+0000 7f96722e76c0 1 --2- 10.20.193.11:0/4244227248 >> [v2:10.20.193.78:6816/242640323,v1:10.20.193.78:6817/242640323] conn(0x7f96400dcd70 0x7f96400fd180 crc :-1 s=READY pgs=16 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.777 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.732+0000 7f5b760d36c0 1 -- 10.20.193.11:0/4031767205 shutdown_connections 2026-02-13T02:19:10.777 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.732+0000 7f5b760d36c0 1 -- 10.20.193.11:0/4031767205 >> 10.20.193.11:0/4031767205 conn(0x7f5b700ea8b0 msgr2=0x7f5b7010ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:10.777 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.732+0000 7f5b760d36c0 1 -- 10.20.193.11:0/4031767205 shutdown_connections 2026-02-13T02:19:10.777 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.732+0000 7f5b760d36c0 1 -- 10.20.193.11:0/4031767205 wait complete. 2026-02-13T02:19:10.777 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.732+0000 7f96722e76c0 1 -- 10.20.193.11:0/4244227248 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f96400b5790 msgr2=0x7f96400d5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:10.777 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.732+0000 7f96722e76c0 1 --2- 10.20.193.11:0/4244227248 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f96400b5790 0x7f96400d5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.777 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.732+0000 7f96722e76c0 1 -- 10.20.193.11:0/4244227248 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f966c10dd20 msgr2=0x7f966c109820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:10.778 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.732+0000 7f96722e76c0 1 --2- 10.20.193.11:0/4244227248 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f966c10dd20 0x7f966c109820 secure :-1 s=READY pgs=265 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9658009290 tx=0x7f965802fc70 comp rx=0 tx=0).stop 2026-02-13T02:19:10.778 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.732+0000 7f96708596c0 1 -- 10.20.193.11:0/4244227248 reap_dead start 2026-02-13T02:19:10.778 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.732+0000 7f96722e76c0 1 -- 10.20.193.11:0/4244227248 shutdown_connections 2026-02-13T02:19:10.778 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.732+0000 7f96722e76c0 1 -- 10.20.193.11:0/4244227248 >> 10.20.193.11:0/4244227248 conn(0x7f966c0e9700 msgr2=0x7f966c10bd40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:10.778 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.732+0000 7f96722e76c0 1 -- 10.20.193.11:0/4244227248 shutdown_connections 2026-02-13T02:19:10.778 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.732+0000 7f96722e76c0 1 -- 10.20.193.11:0/4244227248 wait complete. 2026-02-13T02:19:10.778 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.733+0000 7f9b1b7fe6c0 1 --2- 10.20.193.11:0/3792190244 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f9af00b5710 0x7f9af00d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:10.778 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.733+0000 7faf59d746c0 1 --2- 10.20.193.11:0/1154112053 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7faf340b5790 0x7faf340d5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:10.778 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.733+0000 7f2fb57a36c0 1 --2- 10.20.193.11:0/4191457995 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f2f8c0b5790 0x7f2f8c0d5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:10.778 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.733+0000 7fca2e10b6c0 1 -- 10.20.193.11:0/3762883040 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fca2810f230 msgr2=0x7fca2810f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:10.779 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.733+0000 7fcf56ba46c0 1 -- 10.20.193.11:0/3395855213 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fcf501131c0 msgr2=0x7fcf50173b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:10.779 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.733+0000 7fcf56ba46c0 1 --2- 10.20.193.11:0/3395855213 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fcf501131c0 0x7fcf50173b60 secure :-1 s=READY pgs=57 gs=3 cs=0 l=1 c_cookie=8457094317309617217 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcf4c00a9b0 tx=0x7fcf4c02fd20 comp rx=0 tx=0).stop 2026-02-13T02:19:10.779 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.733+0000 7fca2e10b6c0 1 --2- 10.20.193.11:0/3762883040 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fca2810f230 0x7fca2810f600 secure :-1 s=READY pgs=271 gs=1 cs=0 l=1 c_cookie=15243747983241803485 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fca140099a0 tx=0x7fca1402ed20 comp rx=0 tx=0).stop 2026-02-13T02:19:10.779 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.733+0000 7fca2e10b6c0 1 -- 10.20.193.11:0/3762883040 shutdown_connections 2026-02-13T02:19:10.779 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.733+0000 7fca2e10b6c0 1 --2- 10.20.193.11:0/3762883040 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fca2810fc20 0x7fca28114c60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.779 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.733+0000 7fca2e10b6c0 1 --2- 10.20.193.11:0/3762883040 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fca28115440 0x7fca28175de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.779 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.733+0000 7fca2e10b6c0 1 --2- 10.20.193.11:0/3762883040 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fca2810f230 0x7fca2810f600 unknown :-1 s=CLOSED pgs=271 gs=1 cs=0 l=1 c_cookie=15243747983241803485 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.779 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.733+0000 7fca2e10b6c0 1 -- 10.20.193.11:0/3762883040 >> 10.20.193.11:0/3762883040 conn(0x7fca280ecb30 msgr2=0x7fca2810cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:10.779 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.733+0000 7fcf56ba46c0 1 -- 10.20.193.11:0/3395855213 shutdown_connections 2026-02-13T02:19:10.779 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.733+0000 7fca2e10b6c0 1 -- 10.20.193.11:0/3762883040 shutdown_connections 2026-02-13T02:19:10.780 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.733+0000 7fcf56ba46c0 1 --2- 10.20.193.11:0/3395855213 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fcf501131c0 0x7fcf50173b60 unknown :-1 s=CLOSED pgs=57 gs=3 cs=0 l=1 c_cookie=8457094317309617217 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.780 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.733+0000 7fcf56ba46c0 1 --2- 10.20.193.11:0/3395855213 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fcf5010d9a0 0x7fcf501129e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.780 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.733+0000 7fcf56ba46c0 1 --2- 10.20.193.11:0/3395855213 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fcf5010cfb0 0x7fcf5010d380 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.780 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.733+0000 7fca2e10b6c0 1 -- 10.20.193.11:0/3762883040 wait complete. 2026-02-13T02:19:10.780 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.733+0000 7fcf56ba46c0 1 -- 10.20.193.11:0/3395855213 >> 10.20.193.11:0/3395855213 conn(0x7fcf500ea8b0 msgr2=0x7fcf5010acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:10.780 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.733+0000 7fcf56ba46c0 1 -- 10.20.193.11:0/3395855213 shutdown_connections 2026-02-13T02:19:10.780 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.733+0000 7fcf56ba46c0 1 -- 10.20.193.11:0/3395855213 wait complete. 2026-02-13T02:19:10.780 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.733+0000 7f2fb57a36c0 1 --2- 10.20.193.11:0/4191457995 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f2f8c0b5790 0x7f2f8c0d5c40 secure :-1 s=READY pgs=187 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2fb0123b50 tx=0x7f2fa4009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:10.781 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.733+0000 7faf59d746c0 1 --2- 10.20.193.11:0/1154112053 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7faf340b5790 0x7faf340d5c40 secure :-1 s=READY pgs=189 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faf5c10ce00 tx=0x7faf440023a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:10.781 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.733+0000 7f9b1b7fe6c0 1 --2- 10.20.193.11:0/3792190244 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f9af00b5710 0x7f9af00d5bc0 secure :-1 s=READY pgs=188 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9b1c0f92b0 tx=0x7f9b0c0023a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:10.781 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.734+0000 7fcf56ba46c0 1 Processor -- start 2026-02-13T02:19:10.781 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.734+0000 7fca2e10b6c0 1 Processor -- start 2026-02-13T02:19:10.781 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.734+0000 7fcf56ba46c0 1 -- start start 2026-02-13T02:19:10.781 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.734+0000 7fca2e10b6c0 1 -- start start 2026-02-13T02:19:10.781 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.734+0000 7fca2e10b6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fca2810f230 0x7fca2811d230 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:10.782 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.734+0000 7fcf56ba46c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fcf5010cfb0 0x7fcf50116cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:10.782 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.734+0000 7fcf56ba46c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fcf501131c0 0x7fcf501171f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:10.782 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.734+0000 7fca2e10b6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fca28115440 0x7fca2811d770 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:10.782 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.734+0000 7fcf56ba46c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fcf5011c5b0 0x7fcf5011ca50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:10.782 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.734+0000 7fcf56ba46c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7fcf5011cfc0 con 0x7fcf501131c0 2026-02-13T02:19:10.782 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.734+0000 7fcf56ba46c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7fcf5011d130 con 0x7fcf5011c5b0 2026-02-13T02:19:10.782 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.734+0000 7fcf56ba46c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fcf5011d2f0 con 0x7fcf5010cfb0 2026-02-13T02:19:10.782 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.734+0000 7fca2e10b6c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fca28122b30 0x7fca28122fd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:10.782 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.734+0000 7fca2e10b6c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7fca28123540 con 0x7fca28115440 2026-02-13T02:19:10.782 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.734+0000 7fca2e10b6c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7fca281236b0 con 0x7fca28122b30 2026-02-13T02:19:10.782 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.734+0000 7fca2e10b6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fca28123870 con 0x7fca2810f230 2026-02-13T02:19:10.783 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.734+0000 7fca277fe6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fca2810f230 0x7fca2811d230 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:10.783 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.734+0000 7fca26ffd6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fca28115440 0x7fca2811d770 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:10.783 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.734+0000 7fca277fe6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fca2810f230 0x7fca2811d230 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.78:3300/0 says I am v2:10.20.193.11:60868/0 (socket says 10.20.193.11:60868) 2026-02-13T02:19:10.783 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.734+0000 7fca27fff6c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fca28122b30 0x7fca28122fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:10.783 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.734+0000 7fca26ffd6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fca28115440 0x7fca2811d770 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:49220/0 (socket says 10.20.193.11:49220) 2026-02-13T02:19:10.783 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.734+0000 7fca26ffd6c0 1 -- 10.20.193.11:0/1706897541 learned_addr learned my addr 10.20.193.11:0/1706897541 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:19:10.783 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.734+0000 7fcf551166c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fcf5011c5b0 0x7fcf5011ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:10.783 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.734+0000 7fcf551166c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fcf5011c5b0 0x7fcf5011ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.60:3300/0 says I am v2:10.20.193.11:35270/0 (socket says 10.20.193.11:35270) 2026-02-13T02:19:10.783 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.734+0000 7fcf551166c0 1 -- 10.20.193.11:0/2174259240 learned_addr learned my addr 10.20.193.11:0/2174259240 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:19:10.783 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.734+0000 7fcf47fff6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fcf501131c0 0x7fcf501171f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:10.783 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.734+0000 7fcf549156c0 1 --2- 10.20.193.11:0/2174259240 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fcf5010cfb0 0x7fcf50116cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:10.783 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.734+0000 7fca27fff6c0 1 -- 10.20.193.11:0/1706897541 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fca2810f230 msgr2=0x7fca2811d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:10.783 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.734+0000 7fcf551166c0 1 -- 10.20.193.11:0/2174259240 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fcf5010cfb0 msgr2=0x7fcf50116cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:10.783 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.734+0000 7fca27fff6c0 1 --2- 10.20.193.11:0/1706897541 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fca2810f230 0x7fca2811d230 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.783 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.734+0000 7fca27fff6c0 1 -- 10.20.193.11:0/1706897541 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fca28115440 msgr2=0x7fca2811d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:10.784 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.734+0000 7fca27fff6c0 1 --2- 10.20.193.11:0/1706897541 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fca28115440 0x7fca2811d770 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.784 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.734+0000 7fca27fff6c0 1 -- 10.20.193.11:0/1706897541 --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca14009590 con 0x7fca28122b30 2026-02-13T02:19:10.784 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.734+0000 7fcf551166c0 1 --2- 10.20.193.11:0/2174259240 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fcf5010cfb0 0x7fcf50116cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.784 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.734+0000 7fcf551166c0 1 -- 10.20.193.11:0/2174259240 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fcf501131c0 msgr2=0x7fcf501171f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:10.784 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.734+0000 7fcf551166c0 1 --2- 10.20.193.11:0/2174259240 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fcf501131c0 0x7fcf501171f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.784 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.734+0000 7fcf551166c0 1 -- 10.20.193.11:0/2174259240 --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf38009590 con 0x7fcf5011c5b0 2026-02-13T02:19:10.784 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.734+0000 7fca27fff6c0 1 --2- 10.20.193.11:0/1706897541 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fca28122b30 0x7fca28122fd0 secure :-1 s=READY pgs=50 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fca1c00c6c0 tx=0x7fca1c00cb90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:10.784 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.735+0000 7fca24ff96c0 1 -- 10.20.193.11:0/1706897541 <== mon.2 v2:10.20.193.60:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fca1c005340 con 0x7fca28122b30 2026-02-13T02:19:10.784 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.735+0000 7fca24ff96c0 1 -- 10.20.193.11:0/1706897541 <== mon.2 v2:10.20.193.60:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fca1c003cf0 con 0x7fca28122b30 2026-02-13T02:19:10.784 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.735+0000 7fcf551166c0 1 --2- 10.20.193.11:0/2174259240 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fcf5011c5b0 0x7fcf5011ca50 secure :-1 s=READY pgs=51 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcf4c00a900 tx=0x7fcf4c005570 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:10.784 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.735+0000 7fca24ff96c0 1 -- 10.20.193.11:0/1706897541 <== mon.2 v2:10.20.193.60:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fca1c00dd30 con 0x7fca28122b30 2026-02-13T02:19:10.785 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.735+0000 7fca2e10b6c0 1 -- 10.20.193.11:0/1706897541 --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca28163d20 con 0x7fca28122b30 2026-02-13T02:19:10.785 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.735+0000 7fca2e10b6c0 1 -- 10.20.193.11:0/1706897541 --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca281641b0 con 0x7fca28122b30 2026-02-13T02:19:10.785 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.735+0000 7fcf45ffb6c0 1 -- 10.20.193.11:0/2174259240 <== mon.2 v2:10.20.193.60:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcf4c003a30 con 0x7fcf5011c5b0 2026-02-13T02:19:10.785 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.735+0000 7fcf45ffb6c0 1 -- 10.20.193.11:0/2174259240 <== mon.2 v2:10.20.193.60:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fcf4c0308d0 con 0x7fcf5011c5b0 2026-02-13T02:19:10.785 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.735+0000 7fcf45ffb6c0 1 -- 10.20.193.11:0/2174259240 <== mon.2 v2:10.20.193.60:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcf4c0392f0 con 0x7fcf5011c5b0 2026-02-13T02:19:10.785 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.735+0000 7fcf56ba46c0 1 -- 10.20.193.11:0/2174259240 --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf4c00a5b0 con 0x7fcf5011c5b0 2026-02-13T02:19:10.785 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.735+0000 7fcf56ba46c0 1 -- 10.20.193.11:0/2174259240 --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf5015da00 con 0x7fcf5011c5b0 2026-02-13T02:19:10.785 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.735+0000 7fca2e10b6c0 1 -- 10.20.193.11:0/1706897541 --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fca28052a50 con 0x7fca28122b30 2026-02-13T02:19:10.785 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.735+0000 7fcf56ba46c0 1 -- 10.20.193.11:0/2174259240 --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcf50052a50 con 0x7fcf5011c5b0 2026-02-13T02:19:10.785 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.736+0000 7f9b226d46c0 1 -- 10.20.193.11:0/3792190244 --> [v2:10.20.193.78:6800/3723638526,v1:10.20.193.78:6801/3723638526] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9b1c1794b0 con 0x7f9af00dccf0 2026-02-13T02:19:10.785 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.736+0000 7faf60be56c0 1 -- 10.20.193.11:0/1154112053 --> [v2:10.20.193.60:6816/2908560893,v1:10.20.193.60:6817/2908560893] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7faf5c179390 con 0x7faf340dcd60 2026-02-13T02:19:10.786 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.736+0000 7f9b197fa6c0 1 -- 10.20.193.11:0/3792190244 <== osd.2 v2:10.20.193.78:6800/3723638526 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f9b1c1794b0 con 0x7f9af00dccf0 2026-02-13T02:19:10.786 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.736+0000 7faf437fe6c0 1 -- 10.20.193.11:0/1154112053 <== osd.7 v2:10.20.193.60:6816/2908560893 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7faf5c179390 con 0x7faf340dcd60 2026-02-13T02:19:10.786 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.736+0000 7fca24ff96c0 1 -- 10.20.193.11:0/1706897541 <== mon.2 v2:10.20.193.60:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7fca1c003810 con 0x7fca28122b30 2026-02-13T02:19:10.786 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.737+0000 7faf60be56c0 1 -- 10.20.193.11:0/1154112053 >> [v2:10.20.193.60:6816/2908560893,v1:10.20.193.60:6817/2908560893] conn(0x7faf340dcd60 msgr2=0x7faf340fd170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:10.786 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.737+0000 7faf60be56c0 1 --2- 10.20.193.11:0/1154112053 >> [v2:10.20.193.60:6816/2908560893,v1:10.20.193.60:6817/2908560893] conn(0x7faf340dcd60 0x7faf340fd170 crc :-1 s=READY pgs=11 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.786 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.737+0000 7faf60be56c0 1 -- 10.20.193.11:0/1154112053 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7faf340b5790 msgr2=0x7faf340d5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:10.786 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.737+0000 7faf60be56c0 1 --2- 10.20.193.11:0/1154112053 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7faf340b5790 0x7faf340d5c40 secure :-1 s=READY pgs=189 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faf5c10ce00 tx=0x7faf440023a0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.786 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.737+0000 7faf60be56c0 1 -- 10.20.193.11:0/1154112053 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7faf5c10f200 msgr2=0x7faf5c10d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:10.786 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.737+0000 7faf60be56c0 1 --2- 10.20.193.11:0/1154112053 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7faf5c10f200 0x7faf5c10d090 secure :-1 s=READY pgs=269 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faf50009490 tx=0x7faf5000bca0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.786 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.737+0000 7faf5ad766c0 1 -- 10.20.193.11:0/1154112053 reap_dead start 2026-02-13T02:19:10.787 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.737+0000 7f9b226d46c0 1 -- 10.20.193.11:0/3792190244 >> [v2:10.20.193.78:6800/3723638526,v1:10.20.193.78:6801/3723638526] conn(0x7f9af00dccf0 msgr2=0x7f9af00fd100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:10.787 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.737+0000 7f9b226d46c0 1 --2- 10.20.193.11:0/3792190244 >> [v2:10.20.193.78:6800/3723638526,v1:10.20.193.78:6801/3723638526] conn(0x7f9af00dccf0 0x7f9af00fd100 crc :-1 s=READY pgs=15 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.787 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.737+0000 7f9b226d46c0 1 -- 10.20.193.11:0/3792190244 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f9af00b5710 msgr2=0x7f9af00d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:10.787 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.737+0000 7f9b226d46c0 1 --2- 10.20.193.11:0/3792190244 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f9af00b5710 0x7f9af00d5bc0 secure :-1 s=READY pgs=188 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9b1c0f92b0 tx=0x7f9b0c0023a0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.787 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.737+0000 7f9b226d46c0 1 -- 10.20.193.11:0/3792190244 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f9b1c10cfb0 msgr2=0x7f9b1c0f2920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:10.787 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.737+0000 7f9b226d46c0 1 --2- 10.20.193.11:0/3792190244 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f9b1c10cfb0 0x7f9b1c0f2920 secure :-1 s=READY pgs=267 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9b0800b710 tx=0x7f9b0800bbe0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.787 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.737+0000 7f9b20c466c0 1 -- 10.20.193.11:0/3792190244 reap_dead start 2026-02-13T02:19:10.787 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.737+0000 7faf60be56c0 1 -- 10.20.193.11:0/1154112053 shutdown_connections 2026-02-13T02:19:10.787 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.737+0000 7faf60be56c0 1 -- 10.20.193.11:0/1154112053 >> 10.20.193.11:0/1154112053 conn(0x7faf5c0ecb00 msgr2=0x7faf5c111c70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:10.787 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.737+0000 7fcf45ffb6c0 1 -- 10.20.193.11:0/2174259240 <== mon.2 v2:10.20.193.60:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7fcf4c003b90 con 0x7fcf5011c5b0 2026-02-13T02:19:10.787 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.737+0000 7faf60be56c0 1 -- 10.20.193.11:0/1154112053 shutdown_connections 2026-02-13T02:19:10.787 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.737+0000 7faf60be56c0 1 -- 10.20.193.11:0/1154112053 wait complete. 2026-02-13T02:19:10.788 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.737+0000 7f9b226d46c0 1 -- 10.20.193.11:0/3792190244 shutdown_connections 2026-02-13T02:19:10.788 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.737+0000 7f9b226d46c0 1 -- 10.20.193.11:0/3792190244 >> 10.20.193.11:0/3792190244 conn(0x7f9b1c0ea8b0 msgr2=0x7f9b1c111900 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:10.788 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.737+0000 7fca24ff96c0 1 --2- 10.20.193.11:0/1706897541 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fc9fc0b5690 0x7fc9fc0d5b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:10.788 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.737+0000 7f9b226d46c0 1 -- 10.20.193.11:0/3792190244 shutdown_connections 2026-02-13T02:19:10.788 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.737+0000 7f9b226d46c0 1 -- 10.20.193.11:0/3792190244 wait complete. 2026-02-13T02:19:10.788 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.737+0000 7fca24ff96c0 1 -- 10.20.193.11:0/1706897541 <== mon.2 v2:10.20.193.60:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7762+0+0 (secure 0 0 0) 0x7fca1c0e49b0 con 0x7fca28122b30 2026-02-13T02:19:10.788 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.737+0000 7fca24ff96c0 1 --2- 10.20.193.11:0/1706897541 >> [v2:10.20.193.60:6824/3534951144,v1:10.20.193.60:6825/3534951144] conn(0x7fc9fc0dcc70 0x7fc9fc0fd080 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:10.788 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.737+0000 7fca24ff96c0 1 -- 10.20.193.11:0/1706897541 --> [v2:10.20.193.60:6824/3534951144,v1:10.20.193.60:6825/3534951144] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc9fc0fd730 con 0x7fc9fc0dcc70 2026-02-13T02:19:10.788 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.737+0000 7fca24ff96c0 1 -- 10.20.193.11:0/1706897541 <== mon.2 v2:10.20.193.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7fca1c0e4d60 con 0x7fca28122b30 2026-02-13T02:19:10.788 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.737+0000 7fca277fe6c0 1 --2- 10.20.193.11:0/1706897541 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fc9fc0b5690 0x7fc9fc0d5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:10.788 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.738+0000 7fca26ffd6c0 1 --2- 10.20.193.11:0/1706897541 >> [v2:10.20.193.60:6824/3534951144,v1:10.20.193.60:6825/3534951144] conn(0x7fc9fc0dcc70 0x7fc9fc0fd080 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:10.788 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.738+0000 7fcf45ffb6c0 1 --2- 10.20.193.11:0/2174259240 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fcf2c0b5860 0x7fcf2c0d5d10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:10.788 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.738+0000 7fcf549156c0 1 --2- 10.20.193.11:0/2174259240 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fcf2c0b5860 0x7fcf2c0d5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:10.789 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.738+0000 7fca277fe6c0 1 --2- 10.20.193.11:0/1706897541 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fc9fc0b5690 0x7fc9fc0d5b40 secure :-1 s=READY pgs=190 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fca14005b40 tx=0x7fca140023a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:10.789 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.738+0000 7fcf45ffb6c0 1 -- 10.20.193.11:0/2174259240 <== mon.2 v2:10.20.193.60:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7762+0+0 (secure 0 0 0) 0x7fcf4c108cf0 con 0x7fcf5011c5b0 2026-02-13T02:19:10.789 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.738+0000 7fcf549156c0 1 --2- 10.20.193.11:0/2174259240 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fcf2c0b5860 0x7fcf2c0d5d10 secure :-1 s=READY pgs=191 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcf40004750 tx=0x7fcf40009390 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:10.789 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.738+0000 7fcf45ffb6c0 1 --2- 10.20.193.11:0/2174259240 >> [v2:10.20.193.60:6808/3289387254,v1:10.20.193.60:6809/3289387254] conn(0x7fcf2c0dce40 0x7fcf2c0fd250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:10.789 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.738+0000 7fcf45ffb6c0 1 -- 10.20.193.11:0/2174259240 --> [v2:10.20.193.60:6808/3289387254,v1:10.20.193.60:6809/3289387254] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcf2c0fd900 con 0x7fcf2c0dce40 2026-02-13T02:19:10.789 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.738+0000 7fcf45ffb6c0 1 -- 10.20.193.11:0/2174259240 <== mon.2 v2:10.20.193.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7fcf4c109020 con 0x7fcf5011c5b0 2026-02-13T02:19:10.789 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.738+0000 7fca26ffd6c0 1 --2- 10.20.193.11:0/1706897541 >> [v2:10.20.193.60:6824/3534951144,v1:10.20.193.60:6825/3534951144] conn(0x7fc9fc0dcc70 0x7fc9fc0fd080 crc :-1 s=READY pgs=15 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:10.789 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.738+0000 7fcf47fff6c0 1 --2- 10.20.193.11:0/2174259240 >> [v2:10.20.193.60:6808/3289387254,v1:10.20.193.60:6809/3289387254] conn(0x7fcf2c0dce40 0x7fcf2c0fd250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:10.789 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.739+0000 7fca24ff96c0 1 -- 10.20.193.11:0/1706897541 <== osd.10 v2:10.20.193.60:6824/3534951144 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7fc9fc0fd730 con 0x7fc9fc0dcc70 2026-02-13T02:19:10.789 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.739+0000 7f2fb82336c0 1 -- 10.20.193.11:0/4191457995 --> [v2:10.20.193.11:6810/4224399876,v1:10.20.193.11:6811/4224399876] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2fb0052a50 con 0x7f2f8c0dcd70 2026-02-13T02:19:10.790 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.739+0000 7fcf47fff6c0 1 --2- 10.20.193.11:0/2174259240 >> [v2:10.20.193.60:6808/3289387254,v1:10.20.193.60:6809/3289387254] conn(0x7fcf2c0dce40 0x7fcf2c0fd250 crc :-1 s=READY pgs=15 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:10.790 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.740+0000 7f2f96ffd6c0 1 -- 10.20.193.11:0/4191457995 <== osd.3 v2:10.20.193.11:6810/4224399876 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f2fb0052a50 con 0x7f2f8c0dcd70 2026-02-13T02:19:10.790 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.740+0000 7fcf45ffb6c0 1 -- 10.20.193.11:0/2174259240 <== osd.4 v2:10.20.193.60:6808/3289387254 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7fcf2c0fd900 con 0x7fcf2c0dce40 2026-02-13T02:19:10.790 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.740+0000 7f2fb82336c0 1 -- 10.20.193.11:0/4191457995 >> [v2:10.20.193.11:6810/4224399876,v1:10.20.193.11:6811/4224399876] conn(0x7f2f8c0dcd70 msgr2=0x7f2f8c0fd180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:10.790 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.740+0000 7f2fb82336c0 1 --2- 10.20.193.11:0/4191457995 >> [v2:10.20.193.11:6810/4224399876,v1:10.20.193.11:6811/4224399876] conn(0x7f2f8c0dcd70 0x7f2f8c0fd180 crc :-1 s=READY pgs=11 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.790 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.740+0000 7f2fb82336c0 1 -- 10.20.193.11:0/4191457995 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f2f8c0b5790 msgr2=0x7f2f8c0d5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:10.790 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.740+0000 7f2fb82336c0 1 --2- 10.20.193.11:0/4191457995 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f2f8c0b5790 0x7f2f8c0d5c40 secure :-1 s=READY pgs=187 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2fb0123b50 tx=0x7f2fa4009260 comp rx=0 tx=0).stop 2026-02-13T02:19:10.790 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.740+0000 7f2fb82336c0 1 -- 10.20.193.11:0/4191457995 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f2fb010f230 msgr2=0x7f2fb011d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:10.790 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.740+0000 7f2fb82336c0 1 --2- 10.20.193.11:0/4191457995 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f2fb010f230 0x7f2fb011d1c0 secure :-1 s=READY pgs=270 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2fa0031fd0 tx=0x7f2fa002fc80 comp rx=0 tx=0).stop 2026-02-13T02:19:10.790 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.740+0000 7f2fb67a56c0 1 -- 10.20.193.11:0/4191457995 reap_dead start 2026-02-13T02:19:10.790 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.740+0000 7f2fb82336c0 1 -- 10.20.193.11:0/4191457995 shutdown_connections 2026-02-13T02:19:10.790 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.740+0000 7f2fb82336c0 1 -- 10.20.193.11:0/4191457995 >> 10.20.193.11:0/4191457995 conn(0x7f2fb00ecb30 msgr2=0x7f2fb010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:10.790 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.740+0000 7f2fb82336c0 1 -- 10.20.193.11:0/4191457995 shutdown_connections 2026-02-13T02:19:10.790 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.740+0000 7f2fb82336c0 1 -- 10.20.193.11:0/4191457995 wait complete. 2026-02-13T02:19:10.791 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.747+0000 7fca2e10b6c0 1 -- 10.20.193.11:0/1706897541 --> [v2:10.20.193.60:6824/3534951144,v1:10.20.193.60:6825/3534951144] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fca281794b0 con 0x7fc9fc0dcc70 2026-02-13T02:19:10.791 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.747+0000 7fca24ff96c0 1 -- 10.20.193.11:0/1706897541 <== osd.10 v2:10.20.193.60:6824/3534951144 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fca281794b0 con 0x7fc9fc0dcc70 2026-02-13T02:19:10.791 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.747+0000 7fca2e10b6c0 1 -- 10.20.193.11:0/1706897541 >> [v2:10.20.193.60:6824/3534951144,v1:10.20.193.60:6825/3534951144] conn(0x7fc9fc0dcc70 msgr2=0x7fc9fc0fd080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:10.791 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.747+0000 7fca2e10b6c0 1 --2- 10.20.193.11:0/1706897541 >> [v2:10.20.193.60:6824/3534951144,v1:10.20.193.60:6825/3534951144] conn(0x7fc9fc0dcc70 0x7fc9fc0fd080 crc :-1 s=READY pgs=15 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.791 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.747+0000 7fca2e10b6c0 1 -- 10.20.193.11:0/1706897541 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fc9fc0b5690 msgr2=0x7fc9fc0d5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:10.791 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.747+0000 7fca2e10b6c0 1 --2- 10.20.193.11:0/1706897541 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fc9fc0b5690 0x7fc9fc0d5b40 secure :-1 s=READY pgs=190 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fca14005b40 tx=0x7fca140023a0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.791 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.747+0000 7fca2e10b6c0 1 -- 10.20.193.11:0/1706897541 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fca28122b30 msgr2=0x7fca28122fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:10.791 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.747+0000 7fca2e10b6c0 1 --2- 10.20.193.11:0/1706897541 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fca28122b30 0x7fca28122fd0 secure :-1 s=READY pgs=50 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fca1c00c6c0 tx=0x7fca1c00cb90 comp rx=0 tx=0).stop 2026-02-13T02:19:10.791 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.748+0000 7fca27fff6c0 1 -- 10.20.193.11:0/1706897541 reap_dead start 2026-02-13T02:19:10.791 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.748+0000 7fca2e10b6c0 1 -- 10.20.193.11:0/1706897541 shutdown_connections 2026-02-13T02:19:10.791 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.748+0000 7fca2e10b6c0 1 -- 10.20.193.11:0/1706897541 >> 10.20.193.11:0/1706897541 conn(0x7fca280ecb30 msgr2=0x7fca2810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:10.791 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.748+0000 7fca2e10b6c0 1 -- 10.20.193.11:0/1706897541 shutdown_connections 2026-02-13T02:19:10.791 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.748+0000 7fca2e10b6c0 1 -- 10.20.193.11:0/1706897541 wait complete. 2026-02-13T02:19:10.791 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.749+0000 7fcf56ba46c0 1 -- 10.20.193.11:0/2174259240 --> [v2:10.20.193.60:6808/3289387254,v1:10.20.193.60:6809/3289387254] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fcf50061920 con 0x7fcf2c0dce40 2026-02-13T02:19:10.791 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.749+0000 7fcf45ffb6c0 1 -- 10.20.193.11:0/2174259240 <== osd.4 v2:10.20.193.60:6808/3289387254 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fcf50061920 con 0x7fcf2c0dce40 2026-02-13T02:19:10.792 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.750+0000 7fcf56ba46c0 1 -- 10.20.193.11:0/2174259240 >> [v2:10.20.193.60:6808/3289387254,v1:10.20.193.60:6809/3289387254] conn(0x7fcf2c0dce40 msgr2=0x7fcf2c0fd250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:10.792 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.750+0000 7fcf56ba46c0 1 --2- 10.20.193.11:0/2174259240 >> [v2:10.20.193.60:6808/3289387254,v1:10.20.193.60:6809/3289387254] conn(0x7fcf2c0dce40 0x7fcf2c0fd250 crc :-1 s=READY pgs=15 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.792 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.750+0000 7fcf56ba46c0 1 -- 10.20.193.11:0/2174259240 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fcf2c0b5860 msgr2=0x7fcf2c0d5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:10.792 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.750+0000 7fcf56ba46c0 1 --2- 10.20.193.11:0/2174259240 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fcf2c0b5860 0x7fcf2c0d5d10 secure :-1 s=READY pgs=191 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcf40004750 tx=0x7fcf40009390 comp rx=0 tx=0).stop 2026-02-13T02:19:10.792 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.750+0000 7fcf56ba46c0 1 -- 10.20.193.11:0/2174259240 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fcf5011c5b0 msgr2=0x7fcf5011ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:10.792 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.750+0000 7fcf56ba46c0 1 --2- 10.20.193.11:0/2174259240 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fcf5011c5b0 0x7fcf5011ca50 secure :-1 s=READY pgs=51 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcf4c00a900 tx=0x7fcf4c005570 comp rx=0 tx=0).stop 2026-02-13T02:19:10.792 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.750+0000 7fcf551166c0 1 -- 10.20.193.11:0/2174259240 reap_dead start 2026-02-13T02:19:10.792 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.750+0000 7fcf56ba46c0 1 -- 10.20.193.11:0/2174259240 shutdown_connections 2026-02-13T02:19:10.792 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.750+0000 7fcf56ba46c0 1 -- 10.20.193.11:0/2174259240 >> 10.20.193.11:0/2174259240 conn(0x7fcf500ea8b0 msgr2=0x7fcf5010ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:10.792 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.750+0000 7fcf56ba46c0 1 -- 10.20.193.11:0/2174259240 shutdown_connections 2026-02-13T02:19:10.792 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.750+0000 7fcf56ba46c0 1 -- 10.20.193.11:0/2174259240 wait complete. 2026-02-13T02:19:10.793 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.750+0000 7f5db2e116c0 1 -- 10.20.193.11:0/3423472091 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f5dac10f230 msgr2=0x7f5dac10f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:10.793 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.750+0000 7f5db2e116c0 1 --2- 10.20.193.11:0/3423472091 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f5dac10f230 0x7f5dac10f600 secure :-1 s=READY pgs=52 gs=2 cs=0 l=1 c_cookie=5225455213692811752 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5d9c0098a0 tx=0x7f5d9c02ec40 comp rx=0 tx=0).stop 2026-02-13T02:19:10.793 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.750+0000 7f5db2e116c0 1 -- 10.20.193.11:0/3423472091 shutdown_connections 2026-02-13T02:19:10.793 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.750+0000 7f5db2e116c0 1 --2- 10.20.193.11:0/3423472091 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f5dac115440 0x7f5dac175de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.793 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.750+0000 7f5db2e116c0 1 --2- 10.20.193.11:0/3423472091 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f5dac10fc20 0x7f5dac114c60 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.793 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.750+0000 7f5db2e116c0 1 --2- 10.20.193.11:0/3423472091 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f5dac10f230 0x7f5dac10f600 unknown :-1 s=CLOSED pgs=52 gs=2 cs=0 l=1 c_cookie=5225455213692811752 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.793 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.750+0000 7f5db2e116c0 1 -- 10.20.193.11:0/3423472091 >> 10.20.193.11:0/3423472091 conn(0x7f5dac0ecb30 msgr2=0x7f5dac10cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:10.793 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.751+0000 7f5db2e116c0 1 -- 10.20.193.11:0/3423472091 shutdown_connections 2026-02-13T02:19:10.793 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.751+0000 7f5db2e116c0 1 -- 10.20.193.11:0/3423472091 wait complete. 2026-02-13T02:19:10.793 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.751+0000 7f5db2e116c0 1 Processor -- start 2026-02-13T02:19:10.794 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.751+0000 7f5db2e116c0 1 -- start start 2026-02-13T02:19:10.794 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.751+0000 7f5db2e116c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f5dac10f230 0x7f5dac11d190 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:10.794 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.751+0000 7f5db2e116c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f5dac115440 0x7f5dac11d6d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:10.794 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.751+0000 7f5db2e116c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f5dac122a90 0x7f5dac122f30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:10.794 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.751+0000 7f5db2e116c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f5dac1234a0 con 0x7f5dac122a90 2026-02-13T02:19:10.794 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.751+0000 7f5db2e116c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f5dac123610 con 0x7f5dac10f230 2026-02-13T02:19:10.794 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.751+0000 7f5db2e116c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f5dac1237d0 con 0x7f5dac115440 2026-02-13T02:19:10.794 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.751+0000 7f5db13836c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f5dac122a90 0x7f5dac122f30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:10.794 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.751+0000 7f5db13836c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f5dac122a90 0x7f5dac122f30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:49240/0 (socket says 10.20.193.11:49240) 2026-02-13T02:19:10.794 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.751+0000 7f5db13836c0 1 -- 10.20.193.11:0/618955970 learned_addr learned my addr 10.20.193.11:0/618955970 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:19:10.794 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.751+0000 7f5da3fff6c0 1 --2- 10.20.193.11:0/618955970 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f5dac115440 0x7f5dac11d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:10.794 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.751+0000 7f5db0b826c0 1 --2- 10.20.193.11:0/618955970 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f5dac10f230 0x7f5dac11d190 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:10.794 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.752+0000 7f5da3fff6c0 1 -- 10.20.193.11:0/618955970 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f5dac10f230 msgr2=0x7f5dac11d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:10.794 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.752+0000 7f5da3fff6c0 1 --2- 10.20.193.11:0/618955970 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f5dac10f230 0x7f5dac11d190 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.794 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.752+0000 7f5da3fff6c0 1 -- 10.20.193.11:0/618955970 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f5dac122a90 msgr2=0x7f5dac122f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:10.794 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.752+0000 7f5da3fff6c0 1 --2- 10.20.193.11:0/618955970 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f5dac122a90 0x7f5dac122f30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.794 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.752+0000 7f5da3fff6c0 1 -- 10.20.193.11:0/618955970 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d94009590 con 0x7f5dac115440 2026-02-13T02:19:10.794 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.752+0000 7f5db13836c0 1 --2- 10.20.193.11:0/618955970 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f5dac122a90 0x7f5dac122f30 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T02:19:10.794 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.752+0000 7f5da3fff6c0 1 --2- 10.20.193.11:0/618955970 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f5dac115440 0x7f5dac11d6d0 secure :-1 s=READY pgs=58 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5d94004750 tx=0x7f5d9400bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:10.794 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.752+0000 7f5da1ffb6c0 1 -- 10.20.193.11:0/618955970 <== mon.1 v2:10.20.193.78:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5d94004250 con 0x7f5dac115440 2026-02-13T02:19:10.794 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.752+0000 7f5db2e116c0 1 -- 10.20.193.11:0/618955970 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d9c0094c0 con 0x7f5dac115440 2026-02-13T02:19:10.794 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.752+0000 7f5da1ffb6c0 1 -- 10.20.193.11:0/618955970 <== mon.1 v2:10.20.193.78:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f5d94002da0 con 0x7f5dac115440 2026-02-13T02:19:10.794 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.752+0000 7f5da1ffb6c0 1 -- 10.20.193.11:0/618955970 <== mon.1 v2:10.20.193.78:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5d940071c0 con 0x7f5dac115440 2026-02-13T02:19:10.794 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.752+0000 7f5db2e116c0 1 -- 10.20.193.11:0/618955970 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5dac163fd0 con 0x7f5dac115440 2026-02-13T02:19:10.794 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.753+0000 7f5db2e116c0 1 -- 10.20.193.11:0/618955970 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5dac052a50 con 0x7f5dac115440 2026-02-13T02:19:10.794 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.754+0000 7f5da1ffb6c0 1 -- 10.20.193.11:0/618955970 <== mon.1 v2:10.20.193.78:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7f5d940028c0 con 0x7f5dac115440 2026-02-13T02:19:10.794 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.754+0000 7f5da1ffb6c0 1 --2- 10.20.193.11:0/618955970 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f5d880b5710 0x7f5d880d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:10.794 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.754+0000 7f5da1ffb6c0 1 -- 10.20.193.11:0/618955970 <== mon.1 v2:10.20.193.78:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7762+0+0 (secure 0 0 0) 0x7f5d940e3d10 con 0x7f5dac115440 2026-02-13T02:19:10.794 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.755+0000 7f5da1ffb6c0 1 --2- 10.20.193.11:0/618955970 >> [v2:10.20.193.11:6802/1061379396,v1:10.20.193.11:6803/1061379396] conn(0x7f5d880dccf0 0x7f5d880fd100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:10.794 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.755+0000 7f5da1ffb6c0 1 -- 10.20.193.11:0/618955970 --> [v2:10.20.193.11:6802/1061379396,v1:10.20.193.11:6803/1061379396] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5d880fd7b0 con 0x7f5d880dccf0 2026-02-13T02:19:10.794 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.755+0000 7f5da1ffb6c0 1 -- 10.20.193.11:0/618955970 <== mon.1 v2:10.20.193.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7f5d940e6350 con 0x7f5dac115440 2026-02-13T02:19:10.794 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.755+0000 7f5db13836c0 1 --2- 10.20.193.11:0/618955970 >> [v2:10.20.193.11:6802/1061379396,v1:10.20.193.11:6803/1061379396] conn(0x7f5d880dccf0 0x7f5d880fd100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:10.794 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.755+0000 7f5db0b826c0 1 --2- 10.20.193.11:0/618955970 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f5d880b5710 0x7f5d880d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:10.794 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.755+0000 7f5db13836c0 1 --2- 10.20.193.11:0/618955970 >> [v2:10.20.193.11:6802/1061379396,v1:10.20.193.11:6803/1061379396] conn(0x7f5d880dccf0 0x7f5d880fd100 crc :-1 s=READY pgs=7 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:10.795 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.755+0000 7f5db0b826c0 1 --2- 10.20.193.11:0/618955970 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f5d880b5710 0x7f5d880d5bc0 secure :-1 s=READY pgs=192 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5d9c0097f0 tx=0x7f5d9c0023a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:10.795 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.756+0000 7f5da1ffb6c0 1 -- 10.20.193.11:0/618955970 <== osd.0 v2:10.20.193.11:6802/1061379396 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7f5d880fd7b0 con 0x7f5d880dccf0 2026-02-13T02:19:10.795 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.767+0000 7f5db2e116c0 1 -- 10.20.193.11:0/618955970 --> [v2:10.20.193.11:6802/1061379396,v1:10.20.193.11:6803/1061379396] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5dac179490 con 0x7f5d880dccf0 2026-02-13T02:19:10.795 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.767+0000 7f5da1ffb6c0 1 -- 10.20.193.11:0/618955970 <== osd.0 v2:10.20.193.11:6802/1061379396 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f5da8003810 con 0x7f5d880dccf0 2026-02-13T02:19:10.795 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.768+0000 7f5db2e116c0 1 -- 10.20.193.11:0/618955970 >> [v2:10.20.193.11:6802/1061379396,v1:10.20.193.11:6803/1061379396] conn(0x7f5d880dccf0 msgr2=0x7f5d880fd100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:10.795 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.768+0000 7f5db2e116c0 1 --2- 10.20.193.11:0/618955970 >> [v2:10.20.193.11:6802/1061379396,v1:10.20.193.11:6803/1061379396] conn(0x7f5d880dccf0 0x7f5d880fd100 crc :-1 s=READY pgs=7 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.795 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.768+0000 7f5db2e116c0 1 -- 10.20.193.11:0/618955970 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f5d880b5710 msgr2=0x7f5d880d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:10.795 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.768+0000 7f5db2e116c0 1 --2- 10.20.193.11:0/618955970 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f5d880b5710 0x7f5d880d5bc0 secure :-1 s=READY pgs=192 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5d9c0097f0 tx=0x7f5d9c0023a0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.795 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.768+0000 7f5db2e116c0 1 -- 10.20.193.11:0/618955970 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f5dac115440 msgr2=0x7f5dac11d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:10.795 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.768+0000 7f5db2e116c0 1 --2- 10.20.193.11:0/618955970 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f5dac115440 0x7f5dac11d6d0 secure :-1 s=READY pgs=58 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5d94004750 tx=0x7f5d9400bed0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.795 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.768+0000 7f5db13836c0 1 -- 10.20.193.11:0/618955970 reap_dead start 2026-02-13T02:19:10.795 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.768+0000 7f5db2e116c0 1 -- 10.20.193.11:0/618955970 shutdown_connections 2026-02-13T02:19:10.795 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.768+0000 7f5db2e116c0 1 -- 10.20.193.11:0/618955970 >> 10.20.193.11:0/618955970 conn(0x7f5dac0ecb30 msgr2=0x7f5dac10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:10.795 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.768+0000 7f5db2e116c0 1 -- 10.20.193.11:0/618955970 shutdown_connections 2026-02-13T02:19:10.795 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.768+0000 7f5db2e116c0 1 -- 10.20.193.11:0/618955970 wait complete. 2026-02-13T02:19:10.796 INFO:teuthology.orchestra.run.trial011.stdout:240518168587 2026-02-13T02:19:10.796 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph osd last-stat-seq osd.9 2026-02-13T02:19:10.802 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.800+0000 7f4adf7fe6c0 1 -- 10.20.193.11:0/3389193248 <== mon.1 v2:10.20.193.78:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4ae40081c0 con 0x7f4ae81521a0 2026-02-13T02:19:10.802 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.801+0000 7f4aeec216c0 1 -- 10.20.193.11:0/3389193248 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f4ae81521a0 msgr2=0x7f4ae81725e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:10.802 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.801+0000 7f4aeec216c0 1 --2- 10.20.193.11:0/3389193248 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f4ae81521a0 0x7f4ae81725e0 secure :-1 s=READY pgs=59 gs=1 cs=0 l=1 c_cookie=4415196820159901485 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4ae4006fd0 tx=0x7f4ae402fd20 comp rx=0 tx=0).stop 2026-02-13T02:19:10.803 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.801+0000 7f4aeec216c0 1 -- 10.20.193.11:0/3389193248 shutdown_connections 2026-02-13T02:19:10.803 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.801+0000 7f4aeec216c0 1 --2- 10.20.193.11:0/3389193248 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f4ae81521a0 0x7f4ae81725e0 unknown :-1 s=CLOSED pgs=59 gs=1 cs=0 l=1 c_cookie=4415196820159901485 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.803 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.801+0000 7f4aeec216c0 1 --2- 10.20.193.11:0/3389193248 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f4ae810d5e0 0x7f4ae8151c60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.803 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.801+0000 7f4aeec216c0 1 --2- 10.20.193.11:0/3389193248 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f4ae810cbf0 0x7f4ae810cfc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.803 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.801+0000 7f4aeec216c0 1 -- 10.20.193.11:0/3389193248 >> 10.20.193.11:0/3389193248 conn(0x7f4ae8063af0 msgr2=0x7f4ae80642b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:10.803 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.801+0000 7f4aeec216c0 1 -- 10.20.193.11:0/3389193248 shutdown_connections 2026-02-13T02:19:10.803 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.801+0000 7f4aeec216c0 1 -- 10.20.193.11:0/3389193248 wait complete. 2026-02-13T02:19:10.803 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.801+0000 7fa3fd8c56c0 1 -- 10.20.193.11:0/453838058 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fa3f810ed10 msgr2=0x7fa3f810f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:10.803 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.801+0000 7fa3fd8c56c0 1 --2- 10.20.193.11:0/453838058 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fa3f810ed10 0x7fa3f810f1b0 secure :-1 s=READY pgs=272 gs=1 cs=0 l=1 c_cookie=13208945154114935218 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa3e8006fd0 tx=0x7fa3e802fd20 comp rx=0 tx=0).stop 2026-02-13T02:19:10.803 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.801+0000 7f4aeec216c0 1 Processor -- start 2026-02-13T02:19:10.803 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.801+0000 7fa3fd8c56c0 1 -- 10.20.193.11:0/453838058 shutdown_connections 2026-02-13T02:19:10.803 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.801+0000 7fa3fd8c56c0 1 --2- 10.20.193.11:0/453838058 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fa3f810bc70 0x7fa3f810e640 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.803 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.801+0000 7fa3fd8c56c0 1 --2- 10.20.193.11:0/453838058 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fa3f810ed10 0x7fa3f810f1b0 unknown :-1 s=CLOSED pgs=272 gs=1 cs=0 l=1 c_cookie=13208945154114935218 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.803 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.801+0000 7fa3fd8c56c0 1 --2- 10.20.193.11:0/453838058 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa3f810b360 0x7fa3f810b730 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.803 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.801+0000 7fa3fd8c56c0 1 -- 10.20.193.11:0/453838058 >> 10.20.193.11:0/453838058 conn(0x7fa3f8062e00 msgr2=0x7fa3f8109660 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:10.803 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.801+0000 7fa3fd8c56c0 1 -- 10.20.193.11:0/453838058 shutdown_connections 2026-02-13T02:19:10.803 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.802+0000 7f4aeec216c0 1 -- start start 2026-02-13T02:19:10.804 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.801+0000 7fa3fd8c56c0 1 -- 10.20.193.11:0/453838058 wait complete. 2026-02-13T02:19:10.804 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.802+0000 7f4aeec216c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f4ae810cbf0 0x7f4ae81612a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:10.804 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.802+0000 7f4aeec216c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f4ae810d5e0 0x7f4ae81617e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:10.804 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.802+0000 7f4aeec216c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f4ae81521a0 0x7f4ae8166ba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:10.804 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.802+0000 7f4aeec216c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae81671f0 con 0x7f4ae81521a0 2026-02-13T02:19:10.804 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.802+0000 7f4aeec216c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae8167360 con 0x7f4ae810d5e0 2026-02-13T02:19:10.804 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.802+0000 7fa3fd8c56c0 1 Processor -- start 2026-02-13T02:19:10.804 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.802+0000 7fa3fd8c56c0 1 -- start start 2026-02-13T02:19:10.804 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.802+0000 7f4aeec216c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae8167520 con 0x7f4ae810cbf0 2026-02-13T02:19:10.804 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.802+0000 7fa3fd8c56c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fa3f810b360 0x7fa3f8122230 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:10.804 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.802+0000 7fa3fd8c56c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fa3f810bc70 0x7fa3f8122770 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:10.804 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.802+0000 7fa3fd8c56c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa3f810ed10 0x7fa3f8127b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:10.805 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.802+0000 7fa3fd8c56c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7fa3f8128180 con 0x7fa3f810bc70 2026-02-13T02:19:10.805 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.802+0000 7fa3fd8c56c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa3f81282f0 con 0x7fa3f810b360 2026-02-13T02:19:10.805 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.802+0000 7fa3fd8c56c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa3f81284b0 con 0x7fa3f810ed10 2026-02-13T02:19:10.805 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.802+0000 7f4aed1936c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f4ae81521a0 0x7f4ae8166ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:10.805 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.802+0000 7f4adffff6c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f4ae810d5e0 0x7f4ae81617e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:10.805 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.802+0000 7f4aec9926c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f4ae810cbf0 0x7f4ae81612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:10.805 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.802+0000 7f4aed1936c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f4ae81521a0 0x7f4ae8166ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:49252/0 (socket says 10.20.193.11:49252) 2026-02-13T02:19:10.805 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.802+0000 7f4aec9926c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f4ae810cbf0 0x7f4ae81612a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.78:3300/0 says I am v2:10.20.193.11:60922/0 (socket says 10.20.193.11:60922) 2026-02-13T02:19:10.805 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.802+0000 7f4aec9926c0 1 -- 10.20.193.11:0/1867140796 learned_addr learned my addr 10.20.193.11:0/1867140796 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:19:10.805 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.802+0000 7f4adffff6c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f4ae810d5e0 0x7f4ae81617e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.60:3300/0 says I am v2:10.20.193.11:35322/0 (socket says 10.20.193.11:35322) 2026-02-13T02:19:10.805 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.802+0000 7f4adffff6c0 1 -- 10.20.193.11:0/1867140796 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f4ae810cbf0 msgr2=0x7f4ae81612a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:10.805 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.802+0000 7f4adffff6c0 1 --2- 10.20.193.11:0/1867140796 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f4ae810cbf0 0x7f4ae81612a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.805 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.802+0000 7f4adffff6c0 1 -- 10.20.193.11:0/1867140796 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f4ae81521a0 msgr2=0x7f4ae8166ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:10.805 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.802+0000 7f4adffff6c0 1 --2- 10.20.193.11:0/1867140796 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f4ae81521a0 0x7f4ae8166ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.805 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.802+0000 7f4adffff6c0 1 -- 10.20.193.11:0/1867140796 --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ae400a5b0 con 0x7f4ae810d5e0 2026-02-13T02:19:10.805 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.802+0000 7f4aec9926c0 1 --2- 10.20.193.11:0/1867140796 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f4ae810cbf0 0x7f4ae81612a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T02:19:10.805 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.802+0000 7f4adffff6c0 1 --2- 10.20.193.11:0/1867140796 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f4ae810d5e0 0x7f4ae81617e0 secure :-1 s=READY pgs=53 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4ad4004750 tx=0x7f4ad400bbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:10.805 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.802+0000 7fa3f67fc6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fa3f810bc70 0x7fa3f8122770 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:10.805 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.802+0000 7fa3f67fc6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fa3f810bc70 0x7fa3f8122770 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:49260/0 (socket says 10.20.193.11:49260) 2026-02-13T02:19:10.805 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.802+0000 7fa3f67fc6c0 1 -- 10.20.193.11:0/2708903671 learned_addr learned my addr 10.20.193.11:0/2708903671 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:19:10.805 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.802+0000 7fa3f77fe6c0 1 --2- 10.20.193.11:0/2708903671 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa3f810ed10 0x7fa3f8127b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:10.805 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.802+0000 7fa3f6ffd6c0 1 --2- 10.20.193.11:0/2708903671 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fa3f810b360 0x7fa3f8122230 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:10.806 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.802+0000 7f4addffb6c0 1 -- 10.20.193.11:0/1867140796 <== mon.2 v2:10.20.193.60:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4ad4004a80 con 0x7f4ae810d5e0 2026-02-13T02:19:10.806 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.803+0000 7f4addffb6c0 1 -- 10.20.193.11:0/1867140796 <== mon.2 v2:10.20.193.60:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4ad4009030 con 0x7f4ae810d5e0 2026-02-13T02:19:10.806 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.803+0000 7f4aeec216c0 1 -- 10.20.193.11:0/1867140796 --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ae8167800 con 0x7f4ae810d5e0 2026-02-13T02:19:10.806 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.803+0000 7fa3f67fc6c0 1 -- 10.20.193.11:0/2708903671 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa3f810ed10 msgr2=0x7fa3f8127b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:10.806 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.803+0000 7f4aeec216c0 1 -- 10.20.193.11:0/1867140796 --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ae814ddb0 con 0x7f4ae810d5e0 2026-02-13T02:19:10.806 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.803+0000 7f4addffb6c0 1 -- 10.20.193.11:0/1867140796 <== mon.2 v2:10.20.193.60:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4ad4005680 con 0x7f4ae810d5e0 2026-02-13T02:19:10.806 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.803+0000 7fa3f67fc6c0 1 --2- 10.20.193.11:0/2708903671 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa3f810ed10 0x7fa3f8127b30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.806 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.803+0000 7fa3f67fc6c0 1 -- 10.20.193.11:0/2708903671 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fa3f810b360 msgr2=0x7fa3f8122230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:10.806 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.803+0000 7fa3f67fc6c0 1 --2- 10.20.193.11:0/2708903671 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fa3f810b360 0x7fa3f8122230 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.806 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.803+0000 7fa3f67fc6c0 1 -- 10.20.193.11:0/2708903671 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3e0009590 con 0x7fa3f810bc70 2026-02-13T02:19:10.806 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.803+0000 7fa3f67fc6c0 1 --2- 10.20.193.11:0/2708903671 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fa3f810bc70 0x7fa3f8122770 secure :-1 s=READY pgs=273 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa3e0004750 tx=0x7fa3e000be00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:10.806 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.803+0000 7fa3fc8bf6c0 1 -- 10.20.193.11:0/2708903671 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa3e00044a0 con 0x7fa3f810bc70 2026-02-13T02:19:10.806 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.803+0000 7fa3fc8bf6c0 1 -- 10.20.193.11:0/2708903671 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa3e0009030 con 0x7fa3f810bc70 2026-02-13T02:19:10.806 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.803+0000 7fa3fd8c56c0 1 -- 10.20.193.11:0/2708903671 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3e800a5b0 con 0x7fa3f810bc70 2026-02-13T02:19:10.807 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.803+0000 7fa3fd8c56c0 1 -- 10.20.193.11:0/2708903671 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3f8168cc0 con 0x7fa3f810bc70 2026-02-13T02:19:10.807 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.803+0000 7fa3fc8bf6c0 1 -- 10.20.193.11:0/2708903671 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa3e00071c0 con 0x7fa3f810bc70 2026-02-13T02:19:10.807 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.803+0000 7f4aeec216c0 1 -- 10.20.193.11:0/1867140796 --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4ae8052a50 con 0x7f4ae810d5e0 2026-02-13T02:19:10.807 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.804+0000 7fa3fd8c56c0 1 -- 10.20.193.11:0/2708903671 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa3f8052a50 con 0x7fa3f810bc70 2026-02-13T02:19:10.807 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.804+0000 7f4addffb6c0 1 -- 10.20.193.11:0/1867140796 <== mon.2 v2:10.20.193.60:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7f4ad400c7a0 con 0x7f4ae810d5e0 2026-02-13T02:19:10.807 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.805+0000 7fa3fc8bf6c0 1 -- 10.20.193.11:0/2708903671 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7fa3e00026b0 con 0x7fa3f810bc70 2026-02-13T02:19:10.807 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.805+0000 7f4addffb6c0 1 --2- 10.20.193.11:0/1867140796 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f4abc0b5710 0x7f4abc0d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:10.808 INFO:teuthology.orchestra.run.trial011.stdout:137438953489 2026-02-13T02:19:10.808 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph osd last-stat-seq osd.5 2026-02-13T02:19:10.808 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.805+0000 7f4addffb6c0 1 -- 10.20.193.11:0/1867140796 <== mon.2 v2:10.20.193.60:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7762+0+0 (secure 0 0 0) 0x7f4ad40e3950 con 0x7f4ae810d5e0 2026-02-13T02:19:10.808 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.805+0000 7f4aec9926c0 1 --2- 10.20.193.11:0/1867140796 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f4abc0b5710 0x7f4abc0d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:10.808 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.805+0000 7f4addffb6c0 1 --2- 10.20.193.11:0/1867140796 >> [v2:10.20.193.60:6800/2198425396,v1:10.20.193.60:6801/2198425396] conn(0x7f4abc0dcce0 0x7f4abc0fd0f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:10.808 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.805+0000 7f4addffb6c0 1 -- 10.20.193.11:0/1867140796 --> [v2:10.20.193.60:6800/2198425396,v1:10.20.193.60:6801/2198425396] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4abc0fd7a0 con 0x7f4abc0dcce0 2026-02-13T02:19:10.808 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.805+0000 7f4addffb6c0 1 -- 10.20.193.11:0/1867140796 <== mon.2 v2:10.20.193.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7f4ad40e3d00 con 0x7f4ae810d5e0 2026-02-13T02:19:10.808 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.806+0000 7fa3fc8bf6c0 1 --2- 10.20.193.11:0/2708903671 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fa3cc0b5690 0x7fa3cc0d5b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:10.809 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.806+0000 7f4aed1936c0 1 --2- 10.20.193.11:0/1867140796 >> [v2:10.20.193.60:6800/2198425396,v1:10.20.193.60:6801/2198425396] conn(0x7f4abc0dcce0 0x7f4abc0fd0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:10.809 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.806+0000 7f4aec9926c0 1 --2- 10.20.193.11:0/1867140796 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f4abc0b5710 0x7f4abc0d5bc0 secure :-1 s=READY pgs=193 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4ad80095e0 tx=0x7f4ad8009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:10.809 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.806+0000 7fa3f6ffd6c0 1 --2- 10.20.193.11:0/2708903671 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fa3cc0b5690 0x7fa3cc0d5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:10.809 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.806+0000 7fa3fc8bf6c0 1 -- 10.20.193.11:0/2708903671 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7762+0+0 (secure 0 0 0) 0x7fa3e00e3cf0 con 0x7fa3f810bc70 2026-02-13T02:19:10.809 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.806+0000 7fa3fc8bf6c0 1 --2- 10.20.193.11:0/2708903671 >> [v2:10.20.193.11:6818/2393344644,v1:10.20.193.11:6819/2393344644] conn(0x7fa3cc0dcc70 0x7fa3cc0fd080 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:10.809 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.806+0000 7fa3fc8bf6c0 1 -- 10.20.193.11:0/2708903671 --> [v2:10.20.193.11:6818/2393344644,v1:10.20.193.11:6819/2393344644] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa3cc0fd730 con 0x7fa3cc0dcc70 2026-02-13T02:19:10.809 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.806+0000 7fa3fc8bf6c0 1 -- 10.20.193.11:0/2708903671 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7fa3e00e40a0 con 0x7fa3f810bc70 2026-02-13T02:19:10.809 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.806+0000 7fa3f6ffd6c0 1 --2- 10.20.193.11:0/2708903671 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fa3cc0b5690 0x7fa3cc0d5b40 secure :-1 s=READY pgs=194 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa3ec004750 tx=0x7fa3ec009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:10.809 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.806+0000 7f4aed1936c0 1 --2- 10.20.193.11:0/1867140796 >> [v2:10.20.193.60:6800/2198425396,v1:10.20.193.60:6801/2198425396] conn(0x7f4abc0dcce0 0x7f4abc0fd0f0 crc :-1 s=READY pgs=10 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:10.809 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.806+0000 7fa3f77fe6c0 1 --2- 10.20.193.11:0/2708903671 >> [v2:10.20.193.11:6818/2393344644,v1:10.20.193.11:6819/2393344644] conn(0x7fa3cc0dcc70 0x7fa3cc0fd080 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:10.809 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.807+0000 7fa3f77fe6c0 1 --2- 10.20.193.11:0/2708903671 >> [v2:10.20.193.11:6818/2393344644,v1:10.20.193.11:6819/2393344644] conn(0x7fa3cc0dcc70 0x7fa3cc0fd080 crc :-1 s=READY pgs=13 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:10.809 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.807+0000 7f4addffb6c0 1 -- 10.20.193.11:0/1867140796 <== osd.1 v2:10.20.193.60:6800/2198425396 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7f4abc0fd7a0 con 0x7f4abc0dcce0 2026-02-13T02:19:10.810 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.807+0000 7fa3fc8bf6c0 1 -- 10.20.193.11:0/2708903671 <== osd.6 v2:10.20.193.11:6818/2393344644 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7fa3cc0fd730 con 0x7fa3cc0dcc70 2026-02-13T02:19:10.816 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.815+0000 7f4aeec216c0 1 -- 10.20.193.11:0/1867140796 --> [v2:10.20.193.60:6800/2198425396,v1:10.20.193.60:6801/2198425396] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4ae810bcd0 con 0x7f4abc0dcce0 2026-02-13T02:19:10.816 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.815+0000 7f4addffb6c0 1 -- 10.20.193.11:0/1867140796 <== osd.1 v2:10.20.193.60:6800/2198425396 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f4ae810bcd0 con 0x7f4abc0dcce0 2026-02-13T02:19:10.817 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.815+0000 7fa3fd8c56c0 1 -- 10.20.193.11:0/2708903671 --> [v2:10.20.193.11:6818/2393344644,v1:10.20.193.11:6819/2393344644] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa3f810e070 con 0x7fa3cc0dcc70 2026-02-13T02:19:10.817 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.816+0000 7f4aeec216c0 1 -- 10.20.193.11:0/1867140796 >> [v2:10.20.193.60:6800/2198425396,v1:10.20.193.60:6801/2198425396] conn(0x7f4abc0dcce0 msgr2=0x7f4abc0fd0f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:10.817 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.816+0000 7f4aeec216c0 1 --2- 10.20.193.11:0/1867140796 >> [v2:10.20.193.60:6800/2198425396,v1:10.20.193.60:6801/2198425396] conn(0x7f4abc0dcce0 0x7f4abc0fd0f0 crc :-1 s=READY pgs=10 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.817 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.816+0000 7f4aeec216c0 1 -- 10.20.193.11:0/1867140796 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f4abc0b5710 msgr2=0x7f4abc0d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:10.817 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.816+0000 7f4aeec216c0 1 --2- 10.20.193.11:0/1867140796 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f4abc0b5710 0x7f4abc0d5bc0 secure :-1 s=READY pgs=193 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4ad80095e0 tx=0x7f4ad8009260 comp rx=0 tx=0).stop 2026-02-13T02:19:10.817 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.816+0000 7f4aeec216c0 1 -- 10.20.193.11:0/1867140796 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f4ae810d5e0 msgr2=0x7f4ae81617e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:10.817 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.816+0000 7f4aeec216c0 1 --2- 10.20.193.11:0/1867140796 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f4ae810d5e0 0x7f4ae81617e0 secure :-1 s=READY pgs=53 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4ad4004750 tx=0x7f4ad400bbf0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.817 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.816+0000 7f4aed1936c0 1 -- 10.20.193.11:0/1867140796 reap_dead start 2026-02-13T02:19:10.817 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.816+0000 7fa3fc8bf6c0 1 -- 10.20.193.11:0/2708903671 <== osd.6 v2:10.20.193.11:6818/2393344644 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fa3f810e070 con 0x7fa3cc0dcc70 2026-02-13T02:19:10.818 INFO:teuthology.orchestra.run.trial011.stdout:283467841544 2026-02-13T02:19:10.818 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph osd last-stat-seq osd.11 2026-02-13T02:19:10.818 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.816+0000 7f4aeec216c0 1 -- 10.20.193.11:0/1867140796 shutdown_connections 2026-02-13T02:19:10.818 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.816+0000 7f4aeec216c0 1 -- 10.20.193.11:0/1867140796 >> 10.20.193.11:0/1867140796 conn(0x7f4ae8063af0 msgr2=0x7f4ae81546a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:10.818 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.816+0000 7f4aeec216c0 1 -- 10.20.193.11:0/1867140796 shutdown_connections 2026-02-13T02:19:10.818 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.816+0000 7f4aeec216c0 1 -- 10.20.193.11:0/1867140796 wait complete. 2026-02-13T02:19:10.819 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.816+0000 7fa3fd8c56c0 1 -- 10.20.193.11:0/2708903671 >> [v2:10.20.193.11:6818/2393344644,v1:10.20.193.11:6819/2393344644] conn(0x7fa3cc0dcc70 msgr2=0x7fa3cc0fd080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:10.819 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.816+0000 7fa3fd8c56c0 1 --2- 10.20.193.11:0/2708903671 >> [v2:10.20.193.11:6818/2393344644,v1:10.20.193.11:6819/2393344644] conn(0x7fa3cc0dcc70 0x7fa3cc0fd080 crc :-1 s=READY pgs=13 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:10.819 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.816+0000 7fa3fd8c56c0 1 -- 10.20.193.11:0/2708903671 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fa3cc0b5690 msgr2=0x7fa3cc0d5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:10.819 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.816+0000 7fa3fd8c56c0 1 --2- 10.20.193.11:0/2708903671 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fa3cc0b5690 0x7fa3cc0d5b40 secure :-1 s=READY pgs=194 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa3ec004750 tx=0x7fa3ec009260 comp rx=0 tx=0).stop 2026-02-13T02:19:10.819 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.816+0000 7fa3fd8c56c0 1 -- 10.20.193.11:0/2708903671 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fa3f810bc70 msgr2=0x7fa3f8122770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:10.819 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.816+0000 7fa3fd8c56c0 1 --2- 10.20.193.11:0/2708903671 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fa3f810bc70 0x7fa3f8122770 secure :-1 s=READY pgs=273 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa3e0004750 tx=0x7fa3e000be00 comp rx=0 tx=0).stop 2026-02-13T02:19:10.819 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.816+0000 7fa3f77fe6c0 1 -- 10.20.193.11:0/2708903671 reap_dead start 2026-02-13T02:19:10.819 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.816+0000 7fa3fd8c56c0 1 -- 10.20.193.11:0/2708903671 shutdown_connections 2026-02-13T02:19:10.819 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.816+0000 7fa3fd8c56c0 1 -- 10.20.193.11:0/2708903671 >> 10.20.193.11:0/2708903671 conn(0x7fa3f8062e00 msgr2=0x7fa3f810d710 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:10.819 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.816+0000 7fa3fd8c56c0 1 -- 10.20.193.11:0/2708903671 shutdown_connections 2026-02-13T02:19:10.819 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:10.816+0000 7fa3fd8c56c0 1 -- 10.20.193.11:0/2708903671 wait complete. 2026-02-13T02:19:10.828 INFO:teuthology.orchestra.run.trial011.stdout:253403070472 2026-02-13T02:19:10.828 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph osd last-stat-seq osd.10 2026-02-13T02:19:10.829 INFO:teuthology.orchestra.run.trial011.stdout:210453397516 2026-02-13T02:19:10.829 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph osd last-stat-seq osd.8 2026-02-13T02:19:10.848 INFO:teuthology.orchestra.run.trial011.stdout:120259084306 2026-02-13T02:19:10.848 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph osd last-stat-seq osd.4 2026-02-13T02:19:10.856 INFO:teuthology.orchestra.run.trial011.stdout:30064771095 2026-02-13T02:19:10.856 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph osd last-stat-seq osd.0 2026-02-13T02:19:10.870 INFO:teuthology.orchestra.run.trial011.stdout:42949672981 2026-02-13T02:19:10.870 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph osd last-stat-seq osd.1 2026-02-13T02:19:10.871 INFO:teuthology.orchestra.run.trial011.stdout:167503724559 2026-02-13T02:19:10.871 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph osd last-stat-seq osd.6 2026-02-13T02:19:10.877 INFO:teuthology.orchestra.run.trial011.stdout:90194313236 2026-02-13T02:19:10.877 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph osd last-stat-seq osd.3 2026-02-13T02:19:10.879 INFO:teuthology.orchestra.run.trial011.stdout:180388626445 2026-02-13T02:19:10.879 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph osd last-stat-seq osd.7 2026-02-13T02:19:10.883 INFO:teuthology.orchestra.run.trial011.stdout:60129542165 2026-02-13T02:19:10.883 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph osd last-stat-seq osd.2 2026-02-13T02:19:10.945 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:19:10.956 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:19:10.976 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:19:10.977 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:19:10.984 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:19:11.013 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:19:11.024 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:19:11.025 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:19:11.032 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:19:11.033 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:19:11.040 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:19:11.070 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:19:11.088 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.085+0000 7fdb219986c0 1 -- 10.20.193.11:0/1889812038 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fdb1c10cfb0 msgr2=0x7fdb1c10d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:11.088 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.085+0000 7fdb219986c0 1 --2- 10.20.193.11:0/1889812038 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fdb1c10cfb0 0x7fdb1c10d380 secure :-1 s=READY pgs=54 gs=2 cs=0 l=1 c_cookie=226023400481882517 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdb10009970 tx=0x7fdb1002ed20 comp rx=0 tx=0).stop 2026-02-13T02:19:11.088 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.085+0000 7fdb219986c0 1 -- 10.20.193.11:0/1889812038 shutdown_connections 2026-02-13T02:19:11.089 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.085+0000 7fdb219986c0 1 --2- 10.20.193.11:0/1889812038 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fdb1c1131c0 0x7fdb1c173b60 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.089 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.085+0000 7fdb219986c0 1 --2- 10.20.193.11:0/1889812038 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fdb1c10d9a0 0x7fdb1c1129e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.089 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.085+0000 7fdb219986c0 1 --2- 10.20.193.11:0/1889812038 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fdb1c10cfb0 0x7fdb1c10d380 unknown :-1 s=CLOSED pgs=54 gs=2 cs=0 l=1 c_cookie=226023400481882517 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.089 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.085+0000 7fdb219986c0 1 -- 10.20.193.11:0/1889812038 >> 10.20.193.11:0/1889812038 conn(0x7fdb1c0ea8b0 msgr2=0x7fdb1c10acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:11.089 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.085+0000 7fdb219986c0 1 -- 10.20.193.11:0/1889812038 shutdown_connections 2026-02-13T02:19:11.089 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.085+0000 7fdb219986c0 1 -- 10.20.193.11:0/1889812038 wait complete. 2026-02-13T02:19:11.089 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.085+0000 7fdb219986c0 1 Processor -- start 2026-02-13T02:19:11.089 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.085+0000 7fdb219986c0 1 -- start start 2026-02-13T02:19:11.089 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.085+0000 7fdb219986c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fdb1c10cfb0 0x7fdb1c0f9060 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:11.090 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.085+0000 7fdb219986c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fdb1c1131c0 0x7fdb1c173a60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:11.090 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.085+0000 7fdb219986c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fdb1c0f9690 0x7fdb1c0fe960 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:11.090 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.085+0000 7fdb219986c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7fdb1c0f9d80 con 0x7fdb1c0f9690 2026-02-13T02:19:11.090 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.085+0000 7fdb219986c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7fdb1c0feea0 con 0x7fdb1c10cfb0 2026-02-13T02:19:11.090 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.085+0000 7fdb219986c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fdb1c0ff060 con 0x7fdb1c1131c0 2026-02-13T02:19:11.090 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.085+0000 7fdb1b7fe6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fdb1c0f9690 0x7fdb1c0fe960 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:11.090 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.085+0000 7fdb1a7fc6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fdb1c1131c0 0x7fdb1c173a60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:11.090 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.085+0000 7fdb1b7fe6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fdb1c0f9690 0x7fdb1c0fe960 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:38010/0 (socket says 10.20.193.11:38010) 2026-02-13T02:19:11.090 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.085+0000 7fdb1b7fe6c0 1 -- 10.20.193.11:0/703108575 learned_addr learned my addr 10.20.193.11:0/703108575 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:19:11.090 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.085+0000 7fdb1affd6c0 1 --2- 10.20.193.11:0/703108575 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fdb1c10cfb0 0x7fdb1c0f9060 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:11.090 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.086+0000 7fdb1b7fe6c0 1 -- 10.20.193.11:0/703108575 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fdb1c1131c0 msgr2=0x7fdb1c173a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:11.091 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.086+0000 7fdb1b7fe6c0 1 --2- 10.20.193.11:0/703108575 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fdb1c1131c0 0x7fdb1c173a60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.091 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.086+0000 7fdb1b7fe6c0 1 -- 10.20.193.11:0/703108575 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fdb1c10cfb0 msgr2=0x7fdb1c0f9060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:11.091 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.086+0000 7fdb1b7fe6c0 1 --2- 10.20.193.11:0/703108575 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fdb1c10cfb0 0x7fdb1c0f9060 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.091 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.086+0000 7fdb1b7fe6c0 1 -- 10.20.193.11:0/703108575 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb0c00a5b0 con 0x7fdb1c0f9690 2026-02-13T02:19:11.091 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.086+0000 7fdb1b7fe6c0 1 --2- 10.20.193.11:0/703108575 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fdb1c0f9690 0x7fdb1c0fe960 secure :-1 s=READY pgs=274 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdb0c00a820 tx=0x7fdb0c00ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:11.091 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.086+0000 7fdb209926c0 1 -- 10.20.193.11:0/703108575 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdb0c003c40 con 0x7fdb1c0f9690 2026-02-13T02:19:11.091 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.086+0000 7fdb219986c0 1 -- 10.20.193.11:0/703108575 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb10009590 con 0x7fdb1c0f9690 2026-02-13T02:19:11.091 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.086+0000 7fdb209926c0 1 -- 10.20.193.11:0/703108575 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fdb0c00a070 con 0x7fdb1c0f9690 2026-02-13T02:19:11.091 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.086+0000 7fdb209926c0 1 -- 10.20.193.11:0/703108575 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdb0c0081c0 con 0x7fdb1c0f9690 2026-02-13T02:19:11.091 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.086+0000 7fdb219986c0 1 -- 10.20.193.11:0/703108575 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb1c0ff690 con 0x7fdb1c0f9690 2026-02-13T02:19:11.093 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.087+0000 7fdb219986c0 1 -- 10.20.193.11:0/703108575 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb1c10e280 con 0x7fdb1c0f9690 2026-02-13T02:19:11.093 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.088+0000 7fdb209926c0 1 -- 10.20.193.11:0/703108575 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7fdb0c005030 con 0x7fdb1c0f9690 2026-02-13T02:19:11.093 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.089+0000 7fdb209926c0 1 --2- 10.20.193.11:0/703108575 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fdaf00b5790 0x7fdaf00d5c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:11.093 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.089+0000 7fdb209926c0 1 -- 10.20.193.11:0/703108575 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7762+0+0 (secure 0 0 0) 0x7fdb0c0e4b80 con 0x7fdb1c0f9690 2026-02-13T02:19:11.093 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.089+0000 7fdb1affd6c0 1 --2- 10.20.193.11:0/703108575 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fdaf00b5790 0x7fdaf00d5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:11.093 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.090+0000 7fdb1affd6c0 1 --2- 10.20.193.11:0/703108575 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fdaf00b5790 0x7fdaf00d5c40 secure :-1 s=READY pgs=195 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdb100098c0 tx=0x7fdb100023a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:11.093 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.090+0000 7fdb209926c0 1 -- 10.20.193.11:0/703108575 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fdb0c0a75a0 con 0x7fdb1c0f9690 2026-02-13T02:19:11.095 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.091+0000 7fc8d42e86c0 1 -- 10.20.193.11:0/4258490938 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fc8cc10fc20 msgr2=0x7fc8cc114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:11.095 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.091+0000 7fc8d42e86c0 1 --2- 10.20.193.11:0/4258490938 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fc8cc10fc20 0x7fc8cc114c60 secure :-1 s=READY pgs=275 gs=1 cs=0 l=1 c_cookie=15057060786650034445 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc8c00099a0 tx=0x7fc8c002ed00 comp rx=0 tx=0).stop 2026-02-13T02:19:11.095 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.091+0000 7fc8d42e86c0 1 -- 10.20.193.11:0/4258490938 shutdown_connections 2026-02-13T02:19:11.095 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.091+0000 7fc8d42e86c0 1 --2- 10.20.193.11:0/4258490938 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fc8cc115440 0x7fc8cc175de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.095 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.091+0000 7fc8d42e86c0 1 --2- 10.20.193.11:0/4258490938 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fc8cc10fc20 0x7fc8cc114c60 unknown :-1 s=CLOSED pgs=275 gs=1 cs=0 l=1 c_cookie=15057060786650034445 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.096 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.091+0000 7fc8d42e86c0 1 --2- 10.20.193.11:0/4258490938 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fc8cc10f230 0x7fc8cc10f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.096 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.091+0000 7fc8d42e86c0 1 -- 10.20.193.11:0/4258490938 >> 10.20.193.11:0/4258490938 conn(0x7fc8cc0ecb30 msgr2=0x7fc8cc10cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:11.096 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.091+0000 7fc8d42e86c0 1 -- 10.20.193.11:0/4258490938 shutdown_connections 2026-02-13T02:19:11.096 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.091+0000 7fc8d42e86c0 1 -- 10.20.193.11:0/4258490938 wait complete. 2026-02-13T02:19:11.096 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.091+0000 7fc8d42e86c0 1 Processor -- start 2026-02-13T02:19:11.096 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.091+0000 7fc8d42e86c0 1 -- start start 2026-02-13T02:19:11.096 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.092+0000 7fc8d42e86c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fc8cc10f230 0x7fc8cc11adb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:11.096 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.092+0000 7fc8d42e86c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fc8cc115440 0x7fc8cc11b2f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:11.096 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.092+0000 7fc8d42e86c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fc8cc1206b0 0x7fc8cc120b50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:11.097 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.092+0000 7fc8d42e86c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7fc8cc121090 con 0x7fc8cc115440 2026-02-13T02:19:11.097 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.092+0000 7fc8d42e86c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc8cc121200 con 0x7fc8cc10f230 2026-02-13T02:19:11.097 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.092+0000 7fc8d42e86c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc8cc1213c0 con 0x7fc8cc1206b0 2026-02-13T02:19:11.097 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.092+0000 7fc8d18586c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fc8cc115440 0x7fc8cc11b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:11.097 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.092+0000 7fc8d18586c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fc8cc115440 0x7fc8cc11b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:38028/0 (socket says 10.20.193.11:38028) 2026-02-13T02:19:11.097 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.092+0000 7fc8d285a6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fc8cc1206b0 0x7fc8cc120b50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:11.097 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.092+0000 7fc8d18586c0 1 -- 10.20.193.11:0/4161908006 learned_addr learned my addr 10.20.193.11:0/4161908006 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:19:11.097 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.092+0000 7fc8d20596c0 1 --2- 10.20.193.11:0/4161908006 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fc8cc10f230 0x7fc8cc11adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:11.097 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.092+0000 7fc8d18586c0 1 -- 10.20.193.11:0/4161908006 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fc8cc1206b0 msgr2=0x7fc8cc120b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:11.097 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.092+0000 7fc8d18586c0 1 --2- 10.20.193.11:0/4161908006 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fc8cc1206b0 0x7fc8cc120b50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.097 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.092+0000 7fc8d18586c0 1 -- 10.20.193.11:0/4161908006 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fc8cc10f230 msgr2=0x7fc8cc11adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:11.098 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.092+0000 7fc8d18586c0 1 --2- 10.20.193.11:0/4161908006 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fc8cc10f230 0x7fc8cc11adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.098 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.092+0000 7fc8d18586c0 1 -- 10.20.193.11:0/4161908006 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8c0009590 con 0x7fc8cc115440 2026-02-13T02:19:11.098 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.092+0000 7fc8d18586c0 1 --2- 10.20.193.11:0/4161908006 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fc8cc115440 0x7fc8cc11b2f0 secure :-1 s=READY pgs=276 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc8c00023e0 tx=0x7fc8c002fd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:11.098 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.092+0000 7fc8b37fe6c0 1 -- 10.20.193.11:0/4161908006 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc8c0002ba0 con 0x7fc8cc115440 2026-02-13T02:19:11.098 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.092+0000 7fc8d42e86c0 1 -- 10.20.193.11:0/4161908006 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8cc161840 con 0x7fc8cc115440 2026-02-13T02:19:11.098 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.092+0000 7fc8b37fe6c0 1 -- 10.20.193.11:0/4161908006 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fc8c0007740 con 0x7fc8cc115440 2026-02-13T02:19:11.098 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.092+0000 7fc8b37fe6c0 1 -- 10.20.193.11:0/4161908006 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc8c0037630 con 0x7fc8cc115440 2026-02-13T02:19:11.098 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.092+0000 7fc8d42e86c0 1 -- 10.20.193.11:0/4161908006 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8cc161d10 con 0x7fc8cc115440 2026-02-13T02:19:11.098 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.093+0000 7fc8d42e86c0 1 -- 10.20.193.11:0/4161908006 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8cc110500 con 0x7fc8cc115440 2026-02-13T02:19:11.099 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.094+0000 7fc8b37fe6c0 1 -- 10.20.193.11:0/4161908006 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7fc8c00078b0 con 0x7fc8cc115440 2026-02-13T02:19:11.100 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.095+0000 7fc8b37fe6c0 1 --2- 10.20.193.11:0/4161908006 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fc8a80b5710 0x7fc8a80d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:11.100 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.095+0000 7fc8b37fe6c0 1 -- 10.20.193.11:0/4161908006 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7762+0+0 (secure 0 0 0) 0x7fc8c0107d80 con 0x7fc8cc115440 2026-02-13T02:19:11.100 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.095+0000 7fc8d20596c0 1 --2- 10.20.193.11:0/4161908006 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fc8a80b5710 0x7fc8a80d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:11.100 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.095+0000 7fc8d20596c0 1 --2- 10.20.193.11:0/4161908006 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fc8a80b5710 0x7fc8a80d5bc0 secure :-1 s=READY pgs=196 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc8bc004750 tx=0x7fc8bc005e60 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:11.100 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.096+0000 7fc8b37fe6c0 1 -- 10.20.193.11:0/4161908006 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fc8c00ca7e0 con 0x7fc8cc115440 2026-02-13T02:19:11.104 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.102+0000 7f61a11d06c0 1 -- 10.20.193.11:0/1793971826 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f619c1198f0 msgr2=0x7f619c17a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:11.104 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.102+0000 7f61a11d06c0 1 --2- 10.20.193.11:0/1793971826 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f619c1198f0 0x7f619c17a2c0 secure :-1 s=READY pgs=277 gs=1 cs=0 l=1 c_cookie=12836330355464161833 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f618c00aa40 tx=0x7f618c02fde0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.105 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.103+0000 7f61a11d06c0 1 -- 10.20.193.11:0/1793971826 shutdown_connections 2026-02-13T02:19:11.105 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.103+0000 7f61a11d06c0 1 --2- 10.20.193.11:0/1793971826 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f619c114190 0x7f619c119140 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.105 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.103+0000 7f61a11d06c0 1 --2- 10.20.193.11:0/1793971826 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f619c1198f0 0x7f619c17a2c0 unknown :-1 s=CLOSED pgs=277 gs=1 cs=0 l=1 c_cookie=12836330355464161833 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.105 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.103+0000 7f61a11d06c0 1 --2- 10.20.193.11:0/1793971826 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f619c1137a0 0x7f619c113b70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.105 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.103+0000 7f61a11d06c0 1 -- 10.20.193.11:0/1793971826 >> 10.20.193.11:0/1793971826 conn(0x7f619c060760 msgr2=0x7f619c060d00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:11.105 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.103+0000 7f61a11d06c0 1 -- 10.20.193.11:0/1793971826 shutdown_connections 2026-02-13T02:19:11.105 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.103+0000 7f61a11d06c0 1 -- 10.20.193.11:0/1793971826 wait complete. 2026-02-13T02:19:11.107 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.103+0000 7f61a11d06c0 1 Processor -- start 2026-02-13T02:19:11.107 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.103+0000 7f61a11d06c0 1 -- start start 2026-02-13T02:19:11.107 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.103+0000 7f61a11d06c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f619c1137a0 0x7f619c121650 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:11.107 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.103+0000 7f61a11d06c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f619c1198f0 0x7f619c121b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:11.107 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.103+0000 7f61a11d06c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f619c126f50 0x7f619c1273f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:11.107 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.103+0000 7f61a11d06c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f619c127960 con 0x7f619c1198f0 2026-02-13T02:19:11.107 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.103+0000 7f61a11d06c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f619c127ad0 con 0x7f619c126f50 2026-02-13T02:19:11.107 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.103+0000 7f61a11d06c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f619c127c90 con 0x7f619c1137a0 2026-02-13T02:19:11.107 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.103+0000 7f619a5756c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f619c1198f0 0x7f619c121b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:11.108 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.103+0000 7f619a5756c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f619c1198f0 0x7f619c121b90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:38042/0 (socket says 10.20.193.11:38042) 2026-02-13T02:19:11.108 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.103+0000 7f619a5756c0 1 -- 10.20.193.11:0/176805436 learned_addr learned my addr 10.20.193.11:0/176805436 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:19:11.108 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.103+0000 7f619ad766c0 1 --2- 10.20.193.11:0/176805436 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f619c1137a0 0x7f619c121650 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:11.108 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.103+0000 7f619b5776c0 1 --2- 10.20.193.11:0/176805436 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f619c126f50 0x7f619c1273f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:11.108 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.103+0000 7f619a5756c0 1 -- 10.20.193.11:0/176805436 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f619c1137a0 msgr2=0x7f619c121650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:11.108 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.103+0000 7f619a5756c0 1 --2- 10.20.193.11:0/176805436 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f619c1137a0 0x7f619c121650 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.108 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.103+0000 7f619a5756c0 1 -- 10.20.193.11:0/176805436 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f619c126f50 msgr2=0x7f619c1273f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:11.108 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.103+0000 7f619a5756c0 1 --2- 10.20.193.11:0/176805436 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f619c126f50 0x7f619c1273f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.108 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.103+0000 7f619a5756c0 1 -- 10.20.193.11:0/176805436 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f618c00a660 con 0x7f619c1198f0 2026-02-13T02:19:11.108 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.104+0000 7f619b5776c0 1 --2- 10.20.193.11:0/176805436 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f619c126f50 0x7f619c1273f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T02:19:11.108 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.104+0000 7f619a5756c0 1 --2- 10.20.193.11:0/176805436 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f619c1198f0 0x7f619c121b90 secure :-1 s=READY pgs=278 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f618400b710 tx=0x7f618400bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:11.109 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.104+0000 7f6173fff6c0 1 -- 10.20.193.11:0/176805436 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6184004250 con 0x7f619c1198f0 2026-02-13T02:19:11.109 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.104+0000 7f6173fff6c0 1 -- 10.20.193.11:0/176805436 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6184009070 con 0x7f619c1198f0 2026-02-13T02:19:11.109 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.104+0000 7f6173fff6c0 1 -- 10.20.193.11:0/176805436 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f618400cd70 con 0x7f619c1198f0 2026-02-13T02:19:11.109 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.104+0000 7f61a11d06c0 1 -- 10.20.193.11:0/176805436 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f619c168140 con 0x7f619c1198f0 2026-02-13T02:19:11.109 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.104+0000 7f61a11d06c0 1 -- 10.20.193.11:0/176805436 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f619c1685d0 con 0x7f619c1198f0 2026-02-13T02:19:11.109 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.104+0000 7f61a11d06c0 1 -- 10.20.193.11:0/176805436 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f619c1149e0 con 0x7f619c1198f0 2026-02-13T02:19:11.110 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.106+0000 7f195233b6c0 1 -- 10.20.193.11:0/3387863035 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f194c10f050 msgr2=0x7f194c10f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:11.110 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.106+0000 7f195233b6c0 1 --2- 10.20.193.11:0/3387863035 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f194c10f050 0x7f194c10f420 secure :-1 s=READY pgs=60 gs=1 cs=0 l=1 c_cookie=7180988574078490482 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f193c0099a0 tx=0x7f193c02ed00 comp rx=0 tx=0).stop 2026-02-13T02:19:11.110 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.106+0000 7f6173fff6c0 1 -- 10.20.193.11:0/176805436 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7f61840028c0 con 0x7f619c1198f0 2026-02-13T02:19:11.111 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.106+0000 7f195233b6c0 1 -- 10.20.193.11:0/3387863035 shutdown_connections 2026-02-13T02:19:11.111 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.106+0000 7f195233b6c0 1 --2- 10.20.193.11:0/3387863035 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f194c115260 0x7f194c175c00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.111 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.106+0000 7f195233b6c0 1 --2- 10.20.193.11:0/3387863035 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f194c10fa40 0x7f194c114a80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.111 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.106+0000 7f195233b6c0 1 --2- 10.20.193.11:0/3387863035 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f194c10f050 0x7f194c10f420 unknown :-1 s=CLOSED pgs=60 gs=1 cs=0 l=1 c_cookie=7180988574078490482 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.112 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.106+0000 7f195233b6c0 1 -- 10.20.193.11:0/3387863035 >> 10.20.193.11:0/3387863035 conn(0x7f194c0ec950 msgr2=0x7f194c10cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:11.112 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.106+0000 7f195233b6c0 1 -- 10.20.193.11:0/3387863035 shutdown_connections 2026-02-13T02:19:11.112 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.106+0000 7f195233b6c0 1 -- 10.20.193.11:0/3387863035 wait complete. 2026-02-13T02:19:11.112 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.106+0000 7f195233b6c0 1 Processor -- start 2026-02-13T02:19:11.112 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.106+0000 7f195233b6c0 1 -- start start 2026-02-13T02:19:11.113 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.106+0000 7f6173fff6c0 1 --2- 10.20.193.11:0/176805436 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f616c0b5790 0x7f616c0d5c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:11.113 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.106+0000 7f6173fff6c0 1 -- 10.20.193.11:0/176805436 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7762+0+0 (secure 0 0 0) 0x7f61840e3ab0 con 0x7f619c1198f0 2026-02-13T02:19:11.113 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.107+0000 7f619ad766c0 1 --2- 10.20.193.11:0/176805436 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f616c0b5790 0x7f616c0d5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:11.114 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.107+0000 7f195233b6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f194c10f050 0x7f194c11cfe0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:11.114 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.107+0000 7f195233b6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f194c115260 0x7f194c11d520 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:11.114 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.107+0000 7f195233b6c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f194c1228e0 0x7f194c122d80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:11.114 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.107+0000 7f195233b6c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f194c1232f0 con 0x7f194c115260 2026-02-13T02:19:11.114 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.107+0000 7f195233b6c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f194c123460 con 0x7f194c1228e0 2026-02-13T02:19:11.114 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.107+0000 7f195233b6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f194c123620 con 0x7f194c10f050 2026-02-13T02:19:11.114 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.107+0000 7f1950b386c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f194c115260 0x7f194c11d520 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:11.115 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.107+0000 7f1950b386c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f194c115260 0x7f194c11d520 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:38060/0 (socket says 10.20.193.11:38060) 2026-02-13T02:19:11.115 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.107+0000 7f1950b386c0 1 -- 10.20.193.11:0/2247458172 learned_addr learned my addr 10.20.193.11:0/2247458172 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:19:11.115 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.107+0000 7f19513396c0 1 --2- 10.20.193.11:0/2247458172 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f194c10f050 0x7f194c11cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:11.115 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.107+0000 7f1951b3a6c0 1 --2- 10.20.193.11:0/2247458172 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f194c1228e0 0x7f194c122d80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:11.115 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.107+0000 7f619ad766c0 1 --2- 10.20.193.11:0/176805436 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f616c0b5790 0x7f616c0d5c40 secure :-1 s=READY pgs=197 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6190004750 tx=0x7f6190009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:11.116 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.107+0000 7f1950b386c0 1 -- 10.20.193.11:0/2247458172 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f194c10f050 msgr2=0x7f194c11cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:11.116 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.107+0000 7f1950b386c0 1 --2- 10.20.193.11:0/2247458172 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f194c10f050 0x7f194c11cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.116 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.107+0000 7f1950b386c0 1 -- 10.20.193.11:0/2247458172 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f194c1228e0 msgr2=0x7f194c122d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:11.116 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.107+0000 7f1950b386c0 1 --2- 10.20.193.11:0/2247458172 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f194c1228e0 0x7f194c122d80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.116 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.107+0000 7f1950b386c0 1 -- 10.20.193.11:0/2247458172 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19400094c0 con 0x7f194c115260 2026-02-13T02:19:11.116 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.107+0000 7f1950b386c0 1 --2- 10.20.193.11:0/2247458172 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f194c115260 0x7f194c11d520 secure :-1 s=READY pgs=279 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f194000ba30 tx=0x7f194000bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:11.116 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.108+0000 7f193a7fc6c0 1 -- 10.20.193.11:0/2247458172 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f19400044a0 con 0x7f194c115260 2026-02-13T02:19:11.117 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.108+0000 7f6173fff6c0 1 -- 10.20.193.11:0/176805436 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f61840a64d0 con 0x7f619c1198f0 2026-02-13T02:19:11.118 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.108+0000 7f193a7fc6c0 1 -- 10.20.193.11:0/2247458172 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1940009030 con 0x7f194c115260 2026-02-13T02:19:11.118 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.108+0000 7f193a7fc6c0 1 -- 10.20.193.11:0/2247458172 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f19400071c0 con 0x7f194c115260 2026-02-13T02:19:11.118 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.108+0000 7f195233b6c0 1 -- 10.20.193.11:0/2247458172 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f194800a5b0 con 0x7f194c115260 2026-02-13T02:19:11.118 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.108+0000 7f195233b6c0 1 -- 10.20.193.11:0/2247458172 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f193c009590 con 0x7f194c115260 2026-02-13T02:19:11.119 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.109+0000 7f195233b6c0 1 -- 10.20.193.11:0/2247458172 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f194c110320 con 0x7f194c115260 2026-02-13T02:19:11.119 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.110+0000 7f193a7fc6c0 1 -- 10.20.193.11:0/2247458172 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7f19400026b0 con 0x7f194c115260 2026-02-13T02:19:11.119 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.110+0000 7f193a7fc6c0 1 --2- 10.20.193.11:0/2247458172 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f19200b5710 0x7f19200d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:11.119 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.111+0000 7f19513396c0 1 --2- 10.20.193.11:0/2247458172 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f19200b5710 0x7f19200d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:11.119 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.111+0000 7f193a7fc6c0 1 -- 10.20.193.11:0/2247458172 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7762+0+0 (secure 0 0 0) 0x7f19400e3b80 con 0x7f194c115260 2026-02-13T02:19:11.119 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.111+0000 7f19513396c0 1 --2- 10.20.193.11:0/2247458172 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f19200b5710 0x7f19200d5bc0 secure :-1 s=READY pgs=198 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f193c005b40 tx=0x7f193c0023a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:11.119 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.112+0000 7f193a7fc6c0 1 -- 10.20.193.11:0/2247458172 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f19400a65e0 con 0x7f194c115260 2026-02-13T02:19:11.122 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.113+0000 7ff9bb57b6c0 1 -- 10.20.193.11:0/2741858281 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7ff9b410ad40 msgr2=0x7ff9b410b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:11.122 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.113+0000 7ff9bb57b6c0 1 --2- 10.20.193.11:0/2741858281 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7ff9b410ad40 0x7ff9b410b110 secure :-1 s=READY pgs=280 gs=1 cs=0 l=1 c_cookie=16427902183068273843 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff9ac009970 tx=0x7ff9ac02ed70 comp rx=0 tx=0).stop 2026-02-13T02:19:11.122 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.113+0000 7ff9bb57b6c0 1 -- 10.20.193.11:0/2741858281 shutdown_connections 2026-02-13T02:19:11.122 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.113+0000 7ff9bb57b6c0 1 --2- 10.20.193.11:0/2741858281 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7ff9b4110d40 0x7ff9b4111700 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.122 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.113+0000 7ff9bb57b6c0 1 --2- 10.20.193.11:0/2741858281 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff9b410b730 0x7ff9b4110590 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.122 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.113+0000 7ff9bb57b6c0 1 --2- 10.20.193.11:0/2741858281 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7ff9b410ad40 0x7ff9b410b110 unknown :-1 s=CLOSED pgs=280 gs=1 cs=0 l=1 c_cookie=16427902183068273843 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.122 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.113+0000 7ff9bb57b6c0 1 -- 10.20.193.11:0/2741858281 >> 10.20.193.11:0/2741858281 conn(0x7ff9b40638a0 msgr2=0x7ff9b4109040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:11.122 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.113+0000 7ff9bb57b6c0 1 -- 10.20.193.11:0/2741858281 shutdown_connections 2026-02-13T02:19:11.122 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.113+0000 7ff9bb57b6c0 1 -- 10.20.193.11:0/2741858281 wait complete. 2026-02-13T02:19:11.123 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.114+0000 7ff9bb57b6c0 1 Processor -- start 2026-02-13T02:19:11.123 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.114+0000 7ff9bb57b6c0 1 -- start start 2026-02-13T02:19:11.123 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.114+0000 7ff9bb57b6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7ff9b410ad40 0x7ff9b4122710 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:11.123 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.114+0000 7ff9bb57b6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff9b4110d40 0x7ff9b4122c50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:11.123 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.114+0000 7ff9bb57b6c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7ff9b4128010 0x7ff9b41284b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:11.123 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.114+0000 7ff9bb57b6c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7ff9b4128a20 con 0x7ff9b410ad40 2026-02-13T02:19:11.123 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.114+0000 7ff9bb57b6c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff9b4128b90 con 0x7ff9b4128010 2026-02-13T02:19:11.123 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.114+0000 7ff9bb57b6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7ff9b4128d50 con 0x7ff9b4110d40 2026-02-13T02:19:11.123 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.114+0000 7ff9ba5796c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7ff9b410ad40 0x7ff9b4122710 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:11.123 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.114+0000 7ff9bad7a6c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7ff9b4128010 0x7ff9b41284b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:11.124 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.114+0000 7ff9bad7a6c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7ff9b4128010 0x7ff9b41284b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.60:3300/0 says I am v2:10.20.193.11:47592/0 (socket says 10.20.193.11:47592) 2026-02-13T02:19:11.124 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.114+0000 7ff9bad7a6c0 1 -- 10.20.193.11:0/3323114477 learned_addr learned my addr 10.20.193.11:0/3323114477 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:19:11.124 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.114+0000 7ff9b9d786c0 1 --2- 10.20.193.11:0/3323114477 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff9b4110d40 0x7ff9b4122c50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:11.124 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.114+0000 7ff9bad7a6c0 1 -- 10.20.193.11:0/3323114477 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff9b4110d40 msgr2=0x7ff9b4122c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:11.124 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.114+0000 7ff9bad7a6c0 1 --2- 10.20.193.11:0/3323114477 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff9b4110d40 0x7ff9b4122c50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.124 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.114+0000 7ff9bad7a6c0 1 -- 10.20.193.11:0/3323114477 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7ff9b410ad40 msgr2=0x7ff9b4122710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:11.124 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.114+0000 7ff9bad7a6c0 1 --2- 10.20.193.11:0/3323114477 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7ff9b410ad40 0x7ff9b4122710 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.124 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.114+0000 7ff9bad7a6c0 1 -- 10.20.193.11:0/3323114477 --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9ac009590 con 0x7ff9b4128010 2026-02-13T02:19:11.124 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.114+0000 7ff9ba5796c0 1 --2- 10.20.193.11:0/3323114477 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7ff9b410ad40 0x7ff9b4122710 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T02:19:11.124 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.114+0000 7ff9bad7a6c0 1 --2- 10.20.193.11:0/3323114477 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7ff9b4128010 0x7ff9b41284b0 secure :-1 s=READY pgs=55 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff9a8006ea0 tx=0x7ff9a800cca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:11.124 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.115+0000 7ff99f7fe6c0 1 -- 10.20.193.11:0/3323114477 <== mon.2 v2:10.20.193.60:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff9a8003a30 con 0x7ff9b4128010 2026-02-13T02:19:11.125 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.115+0000 7ff99f7fe6c0 1 -- 10.20.193.11:0/3323114477 <== mon.2 v2:10.20.193.60:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff9a8005510 con 0x7ff9b4128010 2026-02-13T02:19:11.125 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.115+0000 7ff99f7fe6c0 1 -- 10.20.193.11:0/3323114477 <== mon.2 v2:10.20.193.60:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff9a800dd70 con 0x7ff9b4128010 2026-02-13T02:19:11.125 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.115+0000 7ff9bb57b6c0 1 -- 10.20.193.11:0/3323114477 --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9b4169200 con 0x7ff9b4128010 2026-02-13T02:19:11.125 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.115+0000 7ff9bb57b6c0 1 -- 10.20.193.11:0/3323114477 --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9b4169690 con 0x7ff9b4128010 2026-02-13T02:19:11.125 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.115+0000 7ff9bb57b6c0 1 -- 10.20.193.11:0/3323114477 --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9b410be30 con 0x7ff9b4128010 2026-02-13T02:19:11.125 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.117+0000 7ff99f7fe6c0 1 -- 10.20.193.11:0/3323114477 <== mon.2 v2:10.20.193.60:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7ff9a8003b90 con 0x7ff9b4128010 2026-02-13T02:19:11.125 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.118+0000 7ff99f7fe6c0 1 --2- 10.20.193.11:0/3323114477 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7ff9900b5710 0x7ff9900d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:11.125 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.118+0000 7ff99f7fe6c0 1 -- 10.20.193.11:0/3323114477 <== mon.2 v2:10.20.193.60:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7762+0+0 (secure 0 0 0) 0x7ff9a80e4a40 con 0x7ff9b4128010 2026-02-13T02:19:11.125 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.118+0000 7ff9ba5796c0 1 --2- 10.20.193.11:0/3323114477 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7ff9900b5710 0x7ff9900d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:11.125 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.118+0000 7ff9ba5796c0 1 --2- 10.20.193.11:0/3323114477 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7ff9900b5710 0x7ff9900d5bc0 secure :-1 s=READY pgs=199 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff9ac005b40 tx=0x7ff9ac0023a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:11.126 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.119+0000 7ff99f7fe6c0 1 -- 10.20.193.11:0/3323114477 <== mon.2 v2:10.20.193.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7ff9a80a7460 con 0x7ff9b4128010 2026-02-13T02:19:11.163 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.161+0000 7f47bbb4c6c0 1 -- 10.20.193.11:0/3465866618 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f47b410f230 msgr2=0x7f47b410f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:11.163 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.161+0000 7f47bbb4c6c0 1 --2- 10.20.193.11:0/3465866618 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f47b410f230 0x7f47b410f600 secure :-1 s=READY pgs=56 gs=2 cs=0 l=1 c_cookie=10504240418543484327 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f47a800aa40 tx=0x7f47a802fde0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.164 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.161+0000 7f47bbb4c6c0 1 -- 10.20.193.11:0/3465866618 shutdown_connections 2026-02-13T02:19:11.164 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.161+0000 7f47bbb4c6c0 1 --2- 10.20.193.11:0/3465866618 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f47b4115440 0x7f47b4175de0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.164 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.161+0000 7f47bbb4c6c0 1 --2- 10.20.193.11:0/3465866618 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f47b410fc20 0x7f47b4114c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.164 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.161+0000 7f47bbb4c6c0 1 --2- 10.20.193.11:0/3465866618 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f47b410f230 0x7f47b410f600 unknown :-1 s=CLOSED pgs=56 gs=2 cs=0 l=1 c_cookie=10504240418543484327 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.164 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.161+0000 7f47bbb4c6c0 1 -- 10.20.193.11:0/3465866618 >> 10.20.193.11:0/3465866618 conn(0x7f47b40ecb30 msgr2=0x7f47b410cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:11.164 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.161+0000 7f47bbb4c6c0 1 -- 10.20.193.11:0/3465866618 shutdown_connections 2026-02-13T02:19:11.164 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.161+0000 7f47bbb4c6c0 1 -- 10.20.193.11:0/3465866618 wait complete. 2026-02-13T02:19:11.165 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.161+0000 7fded7b906c0 1 -- 10.20.193.11:0/3322748946 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fded010cfb0 msgr2=0x7fded010d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:11.166 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.161+0000 7fded7b906c0 1 --2- 10.20.193.11:0/3322748946 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fded010cfb0 0x7fded010d380 secure :-1 s=READY pgs=281 gs=1 cs=0 l=1 c_cookie=6300714752969553285 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdec00099a0 tx=0x7fdec002ed70 comp rx=0 tx=0).stop 2026-02-13T02:19:11.166 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.161+0000 7fded7b906c0 1 -- 10.20.193.11:0/3322748946 shutdown_connections 2026-02-13T02:19:11.166 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.161+0000 7fded7b906c0 1 --2- 10.20.193.11:0/3322748946 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fded010d9a0 0x7fded01129e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.166 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.161+0000 7fded7b906c0 1 --2- 10.20.193.11:0/3322748946 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fded01131c0 0x7fded0173b60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.166 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.161+0000 7fded7b906c0 1 --2- 10.20.193.11:0/3322748946 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fded010cfb0 0x7fded010d380 unknown :-1 s=CLOSED pgs=281 gs=1 cs=0 l=1 c_cookie=6300714752969553285 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.166 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.161+0000 7fded7b906c0 1 -- 10.20.193.11:0/3322748946 >> 10.20.193.11:0/3322748946 conn(0x7fded00ea8b0 msgr2=0x7fded010acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:11.166 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.161+0000 7fded7b906c0 1 -- 10.20.193.11:0/3322748946 shutdown_connections 2026-02-13T02:19:11.166 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.161+0000 7fded7b906c0 1 -- 10.20.193.11:0/3322748946 wait complete. 2026-02-13T02:19:11.167 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.162+0000 7f47bbb4c6c0 1 Processor -- start 2026-02-13T02:19:11.167 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.162+0000 7f47bbb4c6c0 1 -- start start 2026-02-13T02:19:11.167 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.162+0000 7fded7b906c0 1 Processor -- start 2026-02-13T02:19:11.168 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.162+0000 7fded7b906c0 1 -- start start 2026-02-13T02:19:11.168 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.162+0000 7fded7b906c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fded010cfb0 0x7fded00f0020 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:11.168 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.162+0000 7fded7b906c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fded01131c0 0x7fded0173a60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:11.168 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.162+0000 7fded7b906c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fded00f0560 0x7fded00f0a00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:11.168 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.162+0000 7fded7b906c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7fded00f5150 con 0x7fded010cfb0 2026-02-13T02:19:11.168 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.162+0000 7fded7b906c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7fded00f52c0 con 0x7fded00f0560 2026-02-13T02:19:11.168 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.162+0000 7fded7b906c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fded00f5480 con 0x7fded01131c0 2026-02-13T02:19:11.168 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.162+0000 7fded59056c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fded010cfb0 0x7fded00f0020 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:11.168 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.162+0000 7fded59056c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fded010cfb0 0x7fded00f0020 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:38120/0 (socket says 10.20.193.11:38120) 2026-02-13T02:19:11.168 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.162+0000 7fded59056c0 1 -- 10.20.193.11:0/530309646 learned_addr learned my addr 10.20.193.11:0/530309646 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:19:11.169 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.162+0000 7fded61066c0 1 --2- 10.20.193.11:0/530309646 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fded00f0560 0x7fded00f0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:11.169 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.162+0000 7f47bbb4c6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f47b410f230 0x7f47b411d190 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:11.169 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.162+0000 7f47bbb4c6c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f47b4115440 0x7f47b411d6d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:11.169 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.162+0000 7f47bbb4c6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f47b4122a90 0x7f47b4122f30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:11.169 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.162+0000 7f47bbb4c6c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f47b41234a0 con 0x7f47b4122a90 2026-02-13T02:19:11.169 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.162+0000 7f47bbb4c6c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f47b4123610 con 0x7f47b4115440 2026-02-13T02:19:11.169 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.162+0000 7f47bbb4c6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f47b41237d0 con 0x7f47b410f230 2026-02-13T02:19:11.170 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.162+0000 7fded59056c0 1 -- 10.20.193.11:0/530309646 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fded01131c0 msgr2=0x7fded0173a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:11.170 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.162+0000 7fded59056c0 1 --2- 10.20.193.11:0/530309646 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fded01131c0 0x7fded0173a60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.170 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.162+0000 7fded59056c0 1 -- 10.20.193.11:0/530309646 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fded00f0560 msgr2=0x7fded00f0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:11.170 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.162+0000 7fded59056c0 1 --2- 10.20.193.11:0/530309646 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fded00f0560 0x7fded00f0a00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.171 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.162+0000 7f47ba0c26c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f47b4122a90 0x7f47b4122f30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:11.171 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.162+0000 7fded59056c0 1 -- 10.20.193.11:0/530309646 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdec0009590 con 0x7fded010cfb0 2026-02-13T02:19:11.171 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.163+0000 7f47ba0c26c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f47b4122a90 0x7f47b4122f30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:38134/0 (socket says 10.20.193.11:38134) 2026-02-13T02:19:11.172 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.163+0000 7f47ba0c26c0 1 -- 10.20.193.11:0/2252238137 learned_addr learned my addr 10.20.193.11:0/2252238137 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:19:11.172 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.163+0000 7f47b90c06c0 1 --2- 10.20.193.11:0/2252238137 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f47b4115440 0x7f47b411d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:11.172 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.163+0000 7f47b98c16c0 1 --2- 10.20.193.11:0/2252238137 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f47b410f230 0x7f47b411d190 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:11.172 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.163+0000 7f47ba0c26c0 1 -- 10.20.193.11:0/2252238137 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f47b410f230 msgr2=0x7f47b411d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:11.172 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.163+0000 7fded59056c0 1 --2- 10.20.193.11:0/530309646 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fded010cfb0 0x7fded00f0020 secure :-1 s=READY pgs=282 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdec0005ae0 tx=0x7fdec002fcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:11.173 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.163+0000 7f47ba0c26c0 1 --2- 10.20.193.11:0/2252238137 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f47b410f230 0x7f47b411d190 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.173 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.163+0000 7f47ba0c26c0 1 -- 10.20.193.11:0/2252238137 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f47b4115440 msgr2=0x7f47b411d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:11.173 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.163+0000 7f47ba0c26c0 1 --2- 10.20.193.11:0/2252238137 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f47b4115440 0x7f47b411d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.174 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.163+0000 7fdebeffd6c0 1 -- 10.20.193.11:0/530309646 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdec0052be0 con 0x7fded010cfb0 2026-02-13T02:19:11.174 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.163+0000 7f47ba0c26c0 1 -- 10.20.193.11:0/2252238137 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47a800a660 con 0x7f47b4122a90 2026-02-13T02:19:11.174 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.163+0000 7fdebeffd6c0 1 -- 10.20.193.11:0/530309646 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fdec0005730 con 0x7fded010cfb0 2026-02-13T02:19:11.174 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.163+0000 7fdebeffd6c0 1 -- 10.20.193.11:0/530309646 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdec0007950 con 0x7fded010cfb0 2026-02-13T02:19:11.175 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.163+0000 7f47ba0c26c0 1 --2- 10.20.193.11:0/2252238137 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f47b4122a90 0x7f47b4122f30 secure :-1 s=READY pgs=283 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f47b0009490 tx=0x7f47b000bbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:11.175 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.163+0000 7fded7b906c0 1 -- 10.20.193.11:0/530309646 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fded00f5700 con 0x7fded010cfb0 2026-02-13T02:19:11.175 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.163+0000 7fded7b906c0 1 -- 10.20.193.11:0/530309646 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fded00f5b30 con 0x7fded010cfb0 2026-02-13T02:19:11.176 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.163+0000 7f47a6ffd6c0 1 -- 10.20.193.11:0/2252238137 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f47b0004a80 con 0x7f47b4122a90 2026-02-13T02:19:11.176 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.163+0000 7f47bbb4c6c0 1 -- 10.20.193.11:0/2252238137 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47b4163c80 con 0x7f47b4122a90 2026-02-13T02:19:11.176 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.163+0000 7f47bbb4c6c0 1 -- 10.20.193.11:0/2252238137 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47b4164110 con 0x7f47b4122a90 2026-02-13T02:19:11.176 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.163+0000 7fded7b906c0 1 -- 10.20.193.11:0/530309646 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fded010e280 con 0x7fded010cfb0 2026-02-13T02:19:11.177 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.164+0000 7f47a6ffd6c0 1 -- 10.20.193.11:0/2252238137 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f47b0009030 con 0x7f47b4122a90 2026-02-13T02:19:11.177 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.164+0000 7f47a6ffd6c0 1 -- 10.20.193.11:0/2252238137 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f47b0005570 con 0x7f47b4122a90 2026-02-13T02:19:11.177 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.164+0000 7f47bbb4c6c0 1 -- 10.20.193.11:0/2252238137 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47b4110500 con 0x7f47b4122a90 2026-02-13T02:19:11.178 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.165+0000 7fdebeffd6c0 1 -- 10.20.193.11:0/530309646 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7fdec0002d20 con 0x7fded010cfb0 2026-02-13T02:19:11.178 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.166+0000 7fdebeffd6c0 1 --2- 10.20.193.11:0/530309646 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fdeac0b5710 0x7fdeac0d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:11.178 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.166+0000 7fdebeffd6c0 1 -- 10.20.193.11:0/530309646 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7762+0+0 (secure 0 0 0) 0x7fdec012a390 con 0x7fded010cfb0 2026-02-13T02:19:11.179 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.166+0000 7f4b559186c0 1 -- 10.20.193.11:0/20912327 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f4b5010f230 msgr2=0x7f4b5010f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:11.179 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.166+0000 7f4b559186c0 1 --2- 10.20.193.11:0/20912327 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f4b5010f230 0x7f4b5010f600 secure :-1 s=READY pgs=61 gs=2 cs=0 l=1 c_cookie=6030307251212453415 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4b440098d0 tx=0x7f4b4402ec40 comp rx=0 tx=0).stop 2026-02-13T02:19:11.179 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.166+0000 7f4b559186c0 1 -- 10.20.193.11:0/20912327 shutdown_connections 2026-02-13T02:19:11.179 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.166+0000 7f4b559186c0 1 --2- 10.20.193.11:0/20912327 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f4b5010fc20 0x7f4b50114c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.179 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.166+0000 7f4b559186c0 1 --2- 10.20.193.11:0/20912327 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f4b50115440 0x7f4b50175de0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.179 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.166+0000 7f4b559186c0 1 --2- 10.20.193.11:0/20912327 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f4b5010f230 0x7f4b5010f600 unknown :-1 s=CLOSED pgs=61 gs=2 cs=0 l=1 c_cookie=6030307251212453415 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.179 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.166+0000 7f4b559186c0 1 -- 10.20.193.11:0/20912327 >> 10.20.193.11:0/20912327 conn(0x7f4b500ecb30 msgr2=0x7f4b5010cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:11.179 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.166+0000 7f4b559186c0 1 -- 10.20.193.11:0/20912327 shutdown_connections 2026-02-13T02:19:11.180 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.166+0000 7f01b67fc6c0 1 -- 10.20.193.11:0/499126890 <== mon.2 v2:10.20.193.60:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f01a802fdd0 con 0x7f01b810bb00 2026-02-13T02:19:11.180 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.166+0000 7f47a6ffd6c0 1 -- 10.20.193.11:0/2252238137 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7f47b0004080 con 0x7f47b4122a90 2026-02-13T02:19:11.180 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.167+0000 7f4b559186c0 1 -- 10.20.193.11:0/20912327 wait complete. 2026-02-13T02:19:11.181 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.167+0000 7fded51046c0 1 --2- 10.20.193.11:0/530309646 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fdeac0b5710 0x7fdeac0d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:11.181 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.167+0000 7f01bdac56c0 1 -- 10.20.193.11:0/499126890 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f01b810bb00 msgr2=0x7f01b8152ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:11.181 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.167+0000 7f01bdac56c0 1 --2- 10.20.193.11:0/499126890 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f01b810bb00 0x7f01b8152ee0 secure :-1 s=READY pgs=57 gs=3 cs=0 l=1 c_cookie=6894132275420625128 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f01a8009970 tx=0x7f01a802ed50 comp rx=0 tx=0).stop 2026-02-13T02:19:11.181 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.167+0000 7fded51046c0 1 --2- 10.20.193.11:0/530309646 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fdeac0b5710 0x7fdeac0d5bc0 secure :-1 s=READY pgs=200 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fded010afd0 tx=0x7fdec40096a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:11.182 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.167+0000 7f01bdac56c0 1 -- 10.20.193.11:0/499126890 shutdown_connections 2026-02-13T02:19:11.182 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.167+0000 7f01bdac56c0 1 --2- 10.20.193.11:0/499126890 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f01b810bb00 0x7f01b8152ee0 unknown :-1 s=CLOSED pgs=57 gs=3 cs=0 l=1 c_cookie=6894132275420625128 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.182 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.167+0000 7f01bdac56c0 1 --2- 10.20.193.11:0/499126890 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f01b8153420 0x7f01b8173800 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.182 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.167+0000 7f01bdac56c0 1 --2- 10.20.193.11:0/499126890 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f01b810b1f0 0x7f01b810b5c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.183 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.167+0000 7f01bdac56c0 1 -- 10.20.193.11:0/499126890 >> 10.20.193.11:0/499126890 conn(0x7f01b8063af0 msgr2=0x7f01b80642b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:11.183 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.167+0000 7f01bdac56c0 1 -- 10.20.193.11:0/499126890 shutdown_connections 2026-02-13T02:19:11.183 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.167+0000 7f4b559186c0 1 Processor -- start 2026-02-13T02:19:11.183 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.167+0000 7f01bdac56c0 1 -- 10.20.193.11:0/499126890 wait complete. 2026-02-13T02:19:11.184 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.167+0000 7f47a6ffd6c0 1 --2- 10.20.193.11:0/2252238137 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f47900b5690 0x7f47900d5b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:11.184 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.167+0000 7f4b559186c0 1 -- start start 2026-02-13T02:19:11.184 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.167+0000 7fedec3886c0 1 -- 10.20.193.11:0/2059401841 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fede410f230 msgr2=0x7fede410f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:11.185 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.167+0000 7fedec3886c0 1 --2- 10.20.193.11:0/2059401841 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fede410f230 0x7fede410f600 secure :-1 s=READY pgs=58 gs=1 cs=0 l=1 c_cookie=6571230825907072282 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fedd4009970 tx=0x7fedd402ed50 comp rx=0 tx=0).stop 2026-02-13T02:19:11.185 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.167+0000 7fdebeffd6c0 1 -- 10.20.193.11:0/530309646 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fdec00ecdb0 con 0x7fded010cfb0 2026-02-13T02:19:11.185 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.167+0000 7f47a6ffd6c0 1 -- 10.20.193.11:0/2252238137 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7762+0+0 (secure 0 0 0) 0x7f47b00e3ab0 con 0x7f47b4122a90 2026-02-13T02:19:11.185 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.167+0000 7f47b98c16c0 1 --2- 10.20.193.11:0/2252238137 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f47900b5690 0x7f47900d5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:11.186 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.167+0000 7fedec3886c0 1 -- 10.20.193.11:0/2059401841 shutdown_connections 2026-02-13T02:19:11.186 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.167+0000 7fedec3886c0 1 --2- 10.20.193.11:0/2059401841 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fede4115440 0x7fede4175de0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.186 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.167+0000 7fedec3886c0 1 --2- 10.20.193.11:0/2059401841 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fede410fc20 0x7fede4114c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.186 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.167+0000 7fedec3886c0 1 --2- 10.20.193.11:0/2059401841 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fede410f230 0x7fede410f600 unknown :-1 s=CLOSED pgs=58 gs=1 cs=0 l=1 c_cookie=6571230825907072282 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.187 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.167+0000 7f4b559186c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f4b5010f230 0x7f4b500f90d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:11.187 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.167+0000 7f4b559186c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f4b50115440 0x7f4b50175ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:11.187 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.167+0000 7f4b559186c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f4b500f9700 0x7f4b500fe9d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:11.187 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.167+0000 7f4b559186c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f4b500f9df0 con 0x7f4b50115440 2026-02-13T02:19:11.187 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.167+0000 7f4b559186c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f4b500fef10 con 0x7f4b500f9700 2026-02-13T02:19:11.187 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.167+0000 7f4b559186c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f4b500ff0d0 con 0x7f4b5010f230 2026-02-13T02:19:11.187 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.168+0000 7f4b4e7fc6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f4b50115440 0x7f4b50175ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:11.187 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.168+0000 7f4b4e7fc6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f4b50115440 0x7f4b50175ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:38182/0 (socket says 10.20.193.11:38182) 2026-02-13T02:19:11.187 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.168+0000 7f4b4e7fc6c0 1 -- 10.20.193.11:0/2152226122 learned_addr learned my addr 10.20.193.11:0/2152226122 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:19:11.188 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.167+0000 7fedec3886c0 1 -- 10.20.193.11:0/2059401841 >> 10.20.193.11:0/2059401841 conn(0x7fede40ecb30 msgr2=0x7fede410cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:11.188 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.168+0000 7fedec3886c0 1 -- 10.20.193.11:0/2059401841 shutdown_connections 2026-02-13T02:19:11.188 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.168+0000 7fedec3886c0 1 -- 10.20.193.11:0/2059401841 wait complete. 2026-02-13T02:19:11.188 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.168+0000 7f4b4f7fe6c0 1 --2- 10.20.193.11:0/2152226122 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f4b500f9700 0x7f4b500fe9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:11.189 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.168+0000 7f01bdac56c0 1 Processor -- start 2026-02-13T02:19:11.189 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.168+0000 7f4b4effd6c0 1 --2- 10.20.193.11:0/2152226122 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f4b5010f230 0x7f4b500f90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:11.189 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.168+0000 7f01bdac56c0 1 -- start start 2026-02-13T02:19:11.190 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.168+0000 7f47b98c16c0 1 --2- 10.20.193.11:0/2252238137 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f47900b5690 0x7f47900d5b40 secure :-1 s=READY pgs=201 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f47a800a990 tx=0x7f47a8002470 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:11.190 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.168+0000 7f4b4e7fc6c0 1 -- 10.20.193.11:0/2152226122 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f4b5010f230 msgr2=0x7f4b500f90d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:11.190 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.168+0000 7f4b4e7fc6c0 1 --2- 10.20.193.11:0/2152226122 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f4b5010f230 0x7f4b500f90d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.190 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.168+0000 7f01bdac56c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f01b810b1f0 0x7f01b80fb800 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:11.190 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.168+0000 7f01bdac56c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f01b810bb00 0x7f01b80fbd40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:11.190 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.168+0000 7f01bdac56c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f01b8153420 0x7f01b81010b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:11.191 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.168+0000 7f4b4e7fc6c0 1 -- 10.20.193.11:0/2152226122 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f4b500f9700 msgr2=0x7f4b500fe9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:11.191 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.168+0000 7f01bdac56c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f01b8101700 con 0x7f01b810bb00 2026-02-13T02:19:11.191 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.168+0000 7f01bdac56c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f01b8101870 con 0x7f01b8153420 2026-02-13T02:19:11.191 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.168+0000 7f01bdac56c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f01b8101a30 con 0x7f01b810b1f0 2026-02-13T02:19:11.192 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.168+0000 7f4b4e7fc6c0 1 --2- 10.20.193.11:0/2152226122 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f4b500f9700 0x7f4b500fe9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.192 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.168+0000 7f4b4e7fc6c0 1 -- 10.20.193.11:0/2152226122 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b380094c0 con 0x7f4b50115440 2026-02-13T02:19:11.192 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.168+0000 7f4b4effd6c0 1 --2- 10.20.193.11:0/2152226122 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f4b5010f230 0x7f4b500f90d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T02:19:11.192 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.168+0000 7f4b4e7fc6c0 1 --2- 10.20.193.11:0/2152226122 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f4b50115440 0x7f4b50175ce0 secure :-1 s=READY pgs=284 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4b3800ba30 tx=0x7f4b3800bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:11.192 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.168+0000 7fedec3886c0 1 Processor -- start 2026-02-13T02:19:11.193 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.168+0000 7f01b6ffd6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f01b810bb00 0x7f01b80fbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:11.193 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.168+0000 7f01b6ffd6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f01b810bb00 0x7f01b80fbd40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:38190/0 (socket says 10.20.193.11:38190) 2026-02-13T02:19:11.193 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.168+0000 7f01b6ffd6c0 1 -- 10.20.193.11:0/2095418547 learned_addr learned my addr 10.20.193.11:0/2095418547 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:19:11.193 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.168+0000 7f01b77fe6c0 1 --2- 10.20.193.11:0/2095418547 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f01b810b1f0 0x7f01b80fb800 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:11.193 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.168+0000 7f01b7fff6c0 1 --2- 10.20.193.11:0/2095418547 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f01b8153420 0x7f01b81010b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:11.193 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.168+0000 7f01b6ffd6c0 1 -- 10.20.193.11:0/2095418547 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f01b810b1f0 msgr2=0x7f01b80fb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:11.193 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.168+0000 7f01b6ffd6c0 1 --2- 10.20.193.11:0/2095418547 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f01b810b1f0 0x7f01b80fb800 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.193 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.168+0000 7f01b6ffd6c0 1 -- 10.20.193.11:0/2095418547 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f01b8153420 msgr2=0x7f01b81010b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:11.194 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.168+0000 7f01b6ffd6c0 1 --2- 10.20.193.11:0/2095418547 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f01b8153420 0x7f01b81010b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.194 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.168+0000 7f01b6ffd6c0 1 -- 10.20.193.11:0/2095418547 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01a8009590 con 0x7f01b810bb00 2026-02-13T02:19:11.194 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.168+0000 7fedec3886c0 1 -- start start 2026-02-13T02:19:11.194 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.168+0000 7fedec3886c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fede410f230 0x7fede40f8db0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:11.194 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.168+0000 7fedec3886c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fede4115440 0x7fede4175ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:11.195 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.168+0000 7fedec3886c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fede40f93e0 0x7fede40fe6b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:11.195 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.168+0000 7fedec3886c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7fede40f9ad0 con 0x7fede4115440 2026-02-13T02:19:11.195 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.168+0000 7fedec3886c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7fede40febf0 con 0x7fede410f230 2026-02-13T02:19:11.195 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.168+0000 7fedec3886c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fede40fedb0 con 0x7fede40f93e0 2026-02-13T02:19:11.195 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.169+0000 7fedea0f96c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fede410f230 0x7fede40f8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:11.195 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.169+0000 7fedea8fa6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fede40f93e0 0x7fede40fe6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:11.195 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.169+0000 7fedea8fa6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fede40f93e0 0x7fede40fe6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.78:3300/0 says I am v2:10.20.193.11:49210/0 (socket says 10.20.193.11:49210) 2026-02-13T02:19:11.195 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.169+0000 7fedea0f96c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fede410f230 0x7fede40f8db0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.60:3300/0 says I am v2:10.20.193.11:47676/0 (socket says 10.20.193.11:47676) 2026-02-13T02:19:11.195 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.169+0000 7fedea8fa6c0 1 -- 10.20.193.11:0/2810223595 learned_addr learned my addr 10.20.193.11:0/2810223595 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:19:11.195 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.169+0000 7fedea8fa6c0 1 -- 10.20.193.11:0/2810223595 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fede410f230 msgr2=0x7fede40f8db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:11.195 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.169+0000 7fedea8fa6c0 1 --2- 10.20.193.11:0/2810223595 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fede410f230 0x7fede40f8db0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.195 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.169+0000 7fedea8fa6c0 1 -- 10.20.193.11:0/2810223595 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fede4115440 msgr2=0x7fede4175ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:11.195 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.169+0000 7fedea8fa6c0 1 --2- 10.20.193.11:0/2810223595 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fede4115440 0x7fede4175ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.196 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.169+0000 7fedea8fa6c0 1 -- 10.20.193.11:0/2810223595 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedd80094c0 con 0x7fede40f93e0 2026-02-13T02:19:11.196 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.169+0000 7fedea8fa6c0 1 --2- 10.20.193.11:0/2810223595 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fede40f93e0 0x7fede40fe6b0 secure :-1 s=READY pgs=62 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fede000c9b0 tx=0x7fede000ce80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:11.196 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.169+0000 7f01b6ffd6c0 1 --2- 10.20.193.11:0/2095418547 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f01b810bb00 0x7f01b80fbd40 secure :-1 s=READY pgs=285 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f01a80098c0 tx=0x7f01a80047f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:11.196 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.169+0000 7fedcb7fe6c0 1 -- 10.20.193.11:0/2810223595 <== mon.1 v2:10.20.193.78:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fede0003c40 con 0x7fede40f93e0 2026-02-13T02:19:11.196 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.169+0000 7fedcb7fe6c0 1 -- 10.20.193.11:0/2810223595 <== mon.1 v2:10.20.193.78:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fede0003da0 con 0x7fede40f93e0 2026-02-13T02:19:11.197 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.169+0000 7fedcb7fe6c0 1 -- 10.20.193.11:0/2810223595 <== mon.1 v2:10.20.193.78:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fede00081c0 con 0x7fede40f93e0 2026-02-13T02:19:11.197 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.169+0000 7fedec3886c0 1 -- 10.20.193.11:0/2810223595 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedd4009590 con 0x7fede40f93e0 2026-02-13T02:19:11.197 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.169+0000 7fedec3886c0 1 -- 10.20.193.11:0/2810223595 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fede40ff390 con 0x7fede40f93e0 2026-02-13T02:19:11.197 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.169+0000 7f4b549126c0 1 -- 10.20.193.11:0/2152226122 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4b380044a0 con 0x7f4b50115440 2026-02-13T02:19:11.197 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.170+0000 7f4b549126c0 1 -- 10.20.193.11:0/2152226122 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4b38009030 con 0x7f4b50115440 2026-02-13T02:19:11.197 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.170+0000 7f01b4ff96c0 1 -- 10.20.193.11:0/2095418547 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f01a8002ae0 con 0x7f01b810bb00 2026-02-13T02:19:11.198 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.170+0000 7f47a6ffd6c0 1 -- 10.20.193.11:0/2252238137 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f47b00a6510 con 0x7f47b4122a90 2026-02-13T02:19:11.198 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.170+0000 7f4b559186c0 1 -- 10.20.193.11:0/2152226122 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b440094c0 con 0x7f4b50115440 2026-02-13T02:19:11.198 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.170+0000 7f4b549126c0 1 -- 10.20.193.11:0/2152226122 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4b380071c0 con 0x7f4b50115440 2026-02-13T02:19:11.198 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.170+0000 7f01b4ff96c0 1 -- 10.20.193.11:0/2095418547 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f01a8002c40 con 0x7f01b810bb00 2026-02-13T02:19:11.199 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.170+0000 7f01bdac56c0 1 -- 10.20.193.11:0/2095418547 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01b8101cb0 con 0x7f01b810bb00 2026-02-13T02:19:11.199 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.170+0000 7f01b4ff96c0 1 -- 10.20.193.11:0/2095418547 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f01a80312b0 con 0x7f01b810bb00 2026-02-13T02:19:11.199 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.170+0000 7f01bdac56c0 1 -- 10.20.193.11:0/2095418547 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01b814eee0 con 0x7f01b810bb00 2026-02-13T02:19:11.199 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.170+0000 7f4b559186c0 1 -- 10.20.193.11:0/2152226122 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b500ff750 con 0x7f4b50115440 2026-02-13T02:19:11.199 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.170+0000 7fedec3886c0 1 -- 10.20.193.11:0/2810223595 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fede4110500 con 0x7fede40f93e0 2026-02-13T02:19:11.199 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.170+0000 7f4b559186c0 1 -- 10.20.193.11:0/2152226122 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b50110500 con 0x7f4b50115440 2026-02-13T02:19:11.200 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.171+0000 7f01bdac56c0 1 -- 10.20.193.11:0/2095418547 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01b8065120 con 0x7f01b810bb00 2026-02-13T02:19:11.200 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.171+0000 7fedcb7fe6c0 1 -- 10.20.193.11:0/2810223595 <== mon.1 v2:10.20.193.78:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7fede000d5c0 con 0x7fede40f93e0 2026-02-13T02:19:11.200 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.172+0000 7fedcb7fe6c0 1 --2- 10.20.193.11:0/2810223595 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fedc00b5710 0x7fedc00d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:11.200 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.172+0000 7fedcb7fe6c0 1 -- 10.20.193.11:0/2810223595 <== mon.1 v2:10.20.193.78:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7762+0+0 (secure 0 0 0) 0x7fede00e4b80 con 0x7fede40f93e0 2026-02-13T02:19:11.201 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.172+0000 7f4b549126c0 1 -- 10.20.193.11:0/2152226122 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7f4b380026b0 con 0x7f4b50115440 2026-02-13T02:19:11.201 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.172+0000 7fedea0f96c0 1 --2- 10.20.193.11:0/2810223595 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fedc00b5710 0x7fedc00d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:11.201 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.172+0000 7fedea0f96c0 1 --2- 10.20.193.11:0/2810223595 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fedc00b5710 0x7fedc00d5bc0 secure :-1 s=READY pgs=202 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fedd4031fd0 tx=0x7fedd4005ae0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:11.201 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.173+0000 7f01b4ff96c0 1 -- 10.20.193.11:0/2095418547 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7f01a8007860 con 0x7f01b810bb00 2026-02-13T02:19:11.201 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.173+0000 7f4b549126c0 1 --2- 10.20.193.11:0/2152226122 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f4b240b5790 0x7f4b240d5c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:11.202 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.173+0000 7f4b4effd6c0 1 --2- 10.20.193.11:0/2152226122 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f4b240b5790 0x7f4b240d5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:11.202 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.173+0000 7f4b549126c0 1 -- 10.20.193.11:0/2152226122 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7762+0+0 (secure 0 0 0) 0x7f4b380e3b10 con 0x7f4b50115440 2026-02-13T02:19:11.202 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.173+0000 7fedcb7fe6c0 1 -- 10.20.193.11:0/2810223595 <== mon.1 v2:10.20.193.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fede00a75a0 con 0x7fede40f93e0 2026-02-13T02:19:11.202 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.173+0000 7f4b4effd6c0 1 --2- 10.20.193.11:0/2152226122 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f4b240b5790 0x7f4b240d5c40 secure :-1 s=READY pgs=203 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4b440098d0 tx=0x7f4b440023a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:11.202 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.174+0000 7f01b4ff96c0 1 --2- 10.20.193.11:0/2095418547 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f018c0b5710 0x7f018c0d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:11.203 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.174+0000 7f01b77fe6c0 1 --2- 10.20.193.11:0/2095418547 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f018c0b5710 0x7f018c0d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:11.203 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.174+0000 7f4b549126c0 1 -- 10.20.193.11:0/2152226122 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f4b380a65c0 con 0x7f4b50115440 2026-02-13T02:19:11.203 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.174+0000 7f01b4ff96c0 1 -- 10.20.193.11:0/2095418547 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7762+0+0 (secure 0 0 0) 0x7f01a8107c70 con 0x7f01b810bb00 2026-02-13T02:19:11.203 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.174+0000 7f01b77fe6c0 1 --2- 10.20.193.11:0/2095418547 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f018c0b5710 0x7f018c0d5bc0 secure :-1 s=READY pgs=204 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f01a4005980 tx=0x7f01a4005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:11.203 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.175+0000 7f01b4ff96c0 1 -- 10.20.193.11:0/2095418547 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f01a80ca690 con 0x7f01b810bb00 2026-02-13T02:19:11.205 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.179+0000 7f99d13066c0 1 -- 10.20.193.11:0/3304427491 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f99cc10ad40 msgr2=0x7f99cc10b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:11.205 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.179+0000 7f99d13066c0 1 --2- 10.20.193.11:0/3304427491 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f99cc10ad40 0x7f99cc10b110 secure :-1 s=READY pgs=286 gs=1 cs=0 l=1 c_cookie=3416565414262027260 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f99b80099a0 tx=0x7f99b802ed50 comp rx=0 tx=0).stop 2026-02-13T02:19:11.205 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.179+0000 7f99d13066c0 1 -- 10.20.193.11:0/3304427491 shutdown_connections 2026-02-13T02:19:11.205 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.179+0000 7f99d13066c0 1 --2- 10.20.193.11:0/3304427491 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f99cc113020 0x7f99cc1739a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.205 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.179+0000 7f99d13066c0 1 --2- 10.20.193.11:0/3304427491 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f99cc10b730 0x7f99cc112840 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.205 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.179+0000 7f99d13066c0 1 --2- 10.20.193.11:0/3304427491 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f99cc10ad40 0x7f99cc10b110 unknown :-1 s=CLOSED pgs=286 gs=1 cs=0 l=1 c_cookie=3416565414262027260 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.206 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.179+0000 7f99d13066c0 1 -- 10.20.193.11:0/3304427491 >> 10.20.193.11:0/3304427491 conn(0x7f99cc0638a0 msgr2=0x7f99cc109040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:11.206 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.179+0000 7f99d13066c0 1 -- 10.20.193.11:0/3304427491 shutdown_connections 2026-02-13T02:19:11.206 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.179+0000 7f99d13066c0 1 -- 10.20.193.11:0/3304427491 wait complete. 2026-02-13T02:19:11.206 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.180+0000 7f99d13066c0 1 Processor -- start 2026-02-13T02:19:11.206 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.180+0000 7f99d13066c0 1 -- start start 2026-02-13T02:19:11.206 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.180+0000 7f99d13066c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f99cc10ad40 0x7f99cc10c620 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:11.206 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.180+0000 7f99d13066c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f99cc113020 0x7f99cc10cb60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:11.206 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.180+0000 7f99d13066c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f99cc10d0a0 0x7f99cc162fe0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:11.206 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.180+0000 7f99d13066c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f99cc163520 con 0x7f99cc10ad40 2026-02-13T02:19:11.206 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.180+0000 7f99d13066c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f99cc163690 con 0x7f99cc10d0a0 2026-02-13T02:19:11.206 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.180+0000 7f99d13066c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f99cc163850 con 0x7f99cc113020 2026-02-13T02:19:11.206 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.180+0000 7f99cbfff6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f99cc10ad40 0x7f99cc10c620 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:11.206 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.180+0000 7f99cbfff6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f99cc10ad40 0x7f99cc10c620 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:38204/0 (socket says 10.20.193.11:38204) 2026-02-13T02:19:11.206 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.180+0000 7f99cbfff6c0 1 -- 10.20.193.11:0/1589920223 learned_addr learned my addr 10.20.193.11:0/1589920223 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:19:11.206 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.180+0000 7f99cb7fe6c0 1 --2- 10.20.193.11:0/1589920223 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f99cc113020 0x7f99cc10cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:11.206 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.180+0000 7f99d0b056c0 1 --2- 10.20.193.11:0/1589920223 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f99cc10d0a0 0x7f99cc162fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:11.206 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.181+0000 7f99cb7fe6c0 1 -- 10.20.193.11:0/1589920223 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f99cc10d0a0 msgr2=0x7f99cc162fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:11.206 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.181+0000 7f99cb7fe6c0 1 --2- 10.20.193.11:0/1589920223 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f99cc10d0a0 0x7f99cc162fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.206 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.181+0000 7f99cb7fe6c0 1 -- 10.20.193.11:0/1589920223 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f99cc10ad40 msgr2=0x7f99cc10c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:11.207 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.181+0000 7f99cb7fe6c0 1 --2- 10.20.193.11:0/1589920223 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f99cc10ad40 0x7f99cc10c620 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.207 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.181+0000 7f99cb7fe6c0 1 -- 10.20.193.11:0/1589920223 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99b8009590 con 0x7f99cc113020 2026-02-13T02:19:11.207 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.181+0000 7f99d0b056c0 1 --2- 10.20.193.11:0/1589920223 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f99cc10d0a0 0x7f99cc162fe0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T02:19:11.207 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.181+0000 7f99cbfff6c0 1 --2- 10.20.193.11:0/1589920223 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f99cc10ad40 0x7f99cc10c620 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T02:19:11.207 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.181+0000 7f99cb7fe6c0 1 --2- 10.20.193.11:0/1589920223 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f99cc113020 0x7f99cc10cb60 secure :-1 s=READY pgs=63 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f99bc004750 tx=0x7f99bc00bb80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:11.207 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.181+0000 7f99c97fa6c0 1 -- 10.20.193.11:0/1589920223 <== mon.1 v2:10.20.193.78:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f99bc004a80 con 0x7f99cc113020 2026-02-13T02:19:11.207 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.181+0000 7f99c97fa6c0 1 -- 10.20.193.11:0/1589920223 <== mon.1 v2:10.20.193.78:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f99bc009030 con 0x7f99cc113020 2026-02-13T02:19:11.207 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.181+0000 7f99d13066c0 1 -- 10.20.193.11:0/1589920223 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99cc163b30 con 0x7f99cc113020 2026-02-13T02:19:11.207 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.181+0000 7f99c97fa6c0 1 -- 10.20.193.11:0/1589920223 <== mon.1 v2:10.20.193.78:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f99bc00cda0 con 0x7f99cc113020 2026-02-13T02:19:11.207 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.181+0000 7f99d13066c0 1 -- 10.20.193.11:0/1589920223 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99cc164060 con 0x7f99cc113020 2026-02-13T02:19:11.207 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.182+0000 7f99d13066c0 1 -- 10.20.193.11:0/1589920223 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99cc10be30 con 0x7f99cc113020 2026-02-13T02:19:11.207 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.183+0000 7f99c97fa6c0 1 -- 10.20.193.11:0/1589920223 <== mon.1 v2:10.20.193.78:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7f99bc005020 con 0x7f99cc113020 2026-02-13T02:19:11.207 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.183+0000 7f99c97fa6c0 1 --2- 10.20.193.11:0/1589920223 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f99a00b5710 0x7f99a00d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:11.207 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.184+0000 7f99cbfff6c0 1 --2- 10.20.193.11:0/1589920223 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f99a00b5710 0x7f99a00d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:11.207 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.184+0000 7f99c97fa6c0 1 -- 10.20.193.11:0/1589920223 <== mon.1 v2:10.20.193.78:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7762+0+0 (secure 0 0 0) 0x7f99bc0e3ab0 con 0x7f99cc113020 2026-02-13T02:19:11.207 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.184+0000 7f99cbfff6c0 1 --2- 10.20.193.11:0/1589920223 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f99a00b5710 0x7f99a00d5bc0 secure :-1 s=READY pgs=205 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f99b802f960 tx=0x7f99b8005ae0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:11.207 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.185+0000 7f99c97fa6c0 1 -- 10.20.193.11:0/1589920223 <== mon.1 v2:10.20.193.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f99bc0a64d0 con 0x7f99cc113020 2026-02-13T02:19:11.208 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.204+0000 7fdb219986c0 1 -- 10.20.193.11:0/703108575 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7fdb1c10d380 con 0x7fdb1c0f9690 2026-02-13T02:19:11.208 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.204+0000 7fdb209926c0 1 -- 10.20.193.11:0/703108575 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fdb0c0aa750 con 0x7fdb1c0f9690 2026-02-13T02:19:11.208 INFO:teuthology.orchestra.run.trial011.stdout:240518168587 2026-02-13T02:19:11.208 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.206+0000 7fdb219986c0 1 -- 10.20.193.11:0/703108575 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fdaf00b5790 msgr2=0x7fdaf00d5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:11.209 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.206+0000 7fdb219986c0 1 --2- 10.20.193.11:0/703108575 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fdaf00b5790 0x7fdaf00d5c40 secure :-1 s=READY pgs=195 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdb100098c0 tx=0x7fdb100023a0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.209 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.206+0000 7fdb219986c0 1 -- 10.20.193.11:0/703108575 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fdb1c0f9690 msgr2=0x7fdb1c0fe960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:11.209 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.206+0000 7fdb219986c0 1 --2- 10.20.193.11:0/703108575 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fdb1c0f9690 0x7fdb1c0fe960 secure :-1 s=READY pgs=274 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdb0c00a820 tx=0x7fdb0c00ce50 comp rx=0 tx=0).stop 2026-02-13T02:19:11.209 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.207+0000 7fdb219986c0 1 -- 10.20.193.11:0/703108575 shutdown_connections 2026-02-13T02:19:11.209 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.207+0000 7fdb219986c0 1 --2- 10.20.193.11:0/703108575 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fdaf00b5790 0x7fdaf00d5c40 unknown :-1 s=CLOSED pgs=195 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.209 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.207+0000 7fdb219986c0 1 --2- 10.20.193.11:0/703108575 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fdb1c0f9690 0x7fdb1c0fe960 unknown :-1 s=CLOSED pgs=274 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.209 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.207+0000 7fdb219986c0 1 --2- 10.20.193.11:0/703108575 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fdb1c1131c0 0x7fdb1c173a60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.209 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.207+0000 7fdb219986c0 1 --2- 10.20.193.11:0/703108575 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fdb1c10cfb0 0x7fdb1c0f9060 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.209 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.207+0000 7fdb219986c0 1 -- 10.20.193.11:0/703108575 >> 10.20.193.11:0/703108575 conn(0x7fdb1c0ea8b0 msgr2=0x7fdb1c10b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:11.209 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.207+0000 7fdb219986c0 1 -- 10.20.193.11:0/703108575 shutdown_connections 2026-02-13T02:19:11.209 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.207+0000 7fdb219986c0 1 -- 10.20.193.11:0/703108575 wait complete. 2026-02-13T02:19:11.213 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.211+0000 7fc8d42e86c0 1 -- 10.20.193.11:0/4161908006 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fc8cc11bf00 con 0x7fc8cc115440 2026-02-13T02:19:11.213 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.211+0000 7fc8b37fe6c0 1 -- 10.20.193.11:0/4161908006 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fc8c00cd990 con 0x7fc8cc115440 2026-02-13T02:19:11.213 INFO:teuthology.orchestra.run.trial011.stdout:137438953489 2026-02-13T02:19:11.215 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.214+0000 7fc8d42e86c0 1 -- 10.20.193.11:0/4161908006 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fc8a80b5710 msgr2=0x7fc8a80d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:11.215 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.214+0000 7fc8d42e86c0 1 --2- 10.20.193.11:0/4161908006 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fc8a80b5710 0x7fc8a80d5bc0 secure :-1 s=READY pgs=196 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc8bc004750 tx=0x7fc8bc005e60 comp rx=0 tx=0).stop 2026-02-13T02:19:11.215 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.214+0000 7fc8d42e86c0 1 -- 10.20.193.11:0/4161908006 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fc8cc115440 msgr2=0x7fc8cc11b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:11.215 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.214+0000 7fc8d42e86c0 1 --2- 10.20.193.11:0/4161908006 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fc8cc115440 0x7fc8cc11b2f0 secure :-1 s=READY pgs=276 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc8c00023e0 tx=0x7fc8c002fd20 comp rx=0 tx=0).stop 2026-02-13T02:19:11.216 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.215+0000 7fc8d42e86c0 1 -- 10.20.193.11:0/4161908006 shutdown_connections 2026-02-13T02:19:11.216 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.215+0000 7fc8d42e86c0 1 --2- 10.20.193.11:0/4161908006 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fc8a80b5710 0x7fc8a80d5bc0 unknown :-1 s=CLOSED pgs=196 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.216 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.215+0000 7fc8d42e86c0 1 --2- 10.20.193.11:0/4161908006 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fc8cc1206b0 0x7fc8cc120b50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.216 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.215+0000 7fc8d42e86c0 1 --2- 10.20.193.11:0/4161908006 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fc8cc115440 0x7fc8cc11b2f0 unknown :-1 s=CLOSED pgs=276 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.216 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.215+0000 7fc8d42e86c0 1 --2- 10.20.193.11:0/4161908006 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fc8cc10f230 0x7fc8cc11adb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.217 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.215+0000 7fc8d42e86c0 1 -- 10.20.193.11:0/4161908006 >> 10.20.193.11:0/4161908006 conn(0x7fc8cc0ecb30 msgr2=0x7fc8cc10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:11.217 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.215+0000 7fc8d42e86c0 1 -- 10.20.193.11:0/4161908006 shutdown_connections 2026-02-13T02:19:11.217 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.215+0000 7fc8d42e86c0 1 -- 10.20.193.11:0/4161908006 wait complete. 2026-02-13T02:19:11.218 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.217+0000 7f61a11d06c0 1 -- 10.20.193.11:0/176805436 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f619c114190 con 0x7f619c1198f0 2026-02-13T02:19:11.219 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.218+0000 7f6173fff6c0 1 -- 10.20.193.11:0/176805436 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f61840a9680 con 0x7f619c1198f0 2026-02-13T02:19:11.219 INFO:teuthology.orchestra.run.trial011.stdout:283467841544 2026-02-13T02:19:11.222 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.220+0000 7f61a11d06c0 1 -- 10.20.193.11:0/176805436 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f616c0b5790 msgr2=0x7f616c0d5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:11.222 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.220+0000 7f61a11d06c0 1 --2- 10.20.193.11:0/176805436 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f616c0b5790 0x7f616c0d5c40 secure :-1 s=READY pgs=197 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6190004750 tx=0x7f6190009260 comp rx=0 tx=0).stop 2026-02-13T02:19:11.222 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.220+0000 7f61a11d06c0 1 -- 10.20.193.11:0/176805436 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f619c1198f0 msgr2=0x7f619c121b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:11.222 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.220+0000 7f61a11d06c0 1 --2- 10.20.193.11:0/176805436 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f619c1198f0 0x7f619c121b90 secure :-1 s=READY pgs=278 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f618400b710 tx=0x7f618400bbe0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.223 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:11 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/2308964302' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T02:19:11.223 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.220+0000 7f61a11d06c0 1 -- 10.20.193.11:0/176805436 shutdown_connections 2026-02-13T02:19:11.223 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.220+0000 7f61a11d06c0 1 --2- 10.20.193.11:0/176805436 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f616c0b5790 0x7f616c0d5c40 unknown :-1 s=CLOSED pgs=197 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.224 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.220+0000 7f61a11d06c0 1 --2- 10.20.193.11:0/176805436 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f619c126f50 0x7f619c1273f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.224 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.220+0000 7f61a11d06c0 1 --2- 10.20.193.11:0/176805436 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f619c1198f0 0x7f619c121b90 unknown :-1 s=CLOSED pgs=278 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.224 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.220+0000 7f61a11d06c0 1 --2- 10.20.193.11:0/176805436 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f619c1137a0 0x7f619c121650 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.224 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.220+0000 7f61a11d06c0 1 -- 10.20.193.11:0/176805436 >> 10.20.193.11:0/176805436 conn(0x7f619c060760 msgr2=0x7f619c117840 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:11.224 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.220+0000 7f61a11d06c0 1 -- 10.20.193.11:0/176805436 shutdown_connections 2026-02-13T02:19:11.224 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.220+0000 7f61a11d06c0 1 -- 10.20.193.11:0/176805436 wait complete. 2026-02-13T02:19:11.226 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.221+0000 7f19922d86c0 1 -- 10.20.193.11:0/826885831 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f198c10e740 msgr2=0x7f198c152d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:11.227 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.221+0000 7f19922d86c0 1 --2- 10.20.193.11:0/826885831 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f198c10e740 0x7f198c152d30 secure :-1 s=READY pgs=287 gs=2 cs=0 l=1 c_cookie=3503600624749315545 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f197c0098a0 tx=0x7f197c02ec40 comp rx=0 tx=0).stop 2026-02-13T02:19:11.227 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.221+0000 7f19922d86c0 1 -- 10.20.193.11:0/826885831 shutdown_connections 2026-02-13T02:19:11.227 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.221+0000 7f19922d86c0 1 --2- 10.20.193.11:0/826885831 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f198c153300 0x7f198c173740 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.227 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.221+0000 7f19922d86c0 1 --2- 10.20.193.11:0/826885831 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f198c10e740 0x7f198c152d30 unknown :-1 s=CLOSED pgs=287 gs=2 cs=0 l=1 c_cookie=3503600624749315545 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.227 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.221+0000 7f19922d86c0 1 --2- 10.20.193.11:0/826885831 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f198c10dd50 0x7f198c10e120 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.227 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.221+0000 7f19922d86c0 1 -- 10.20.193.11:0/826885831 >> 10.20.193.11:0/826885831 conn(0x7f198c0e9770 msgr2=0x7f198c109b80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:11.227 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.221+0000 7f19922d86c0 1 -- 10.20.193.11:0/826885831 shutdown_connections 2026-02-13T02:19:11.227 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.221+0000 7f19922d86c0 1 -- 10.20.193.11:0/826885831 wait complete. 2026-02-13T02:19:11.227 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.222+0000 7f19922d86c0 1 Processor -- start 2026-02-13T02:19:11.227 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.222+0000 7f19922d86c0 1 -- start start 2026-02-13T02:19:11.227 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.222+0000 7f19922d86c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f198c10dd50 0x7f198c15f050 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:11.227 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.222+0000 7f19922d86c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f198c10e740 0x7f198c15f590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:11.228 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.222+0000 7f19922d86c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f198c153300 0x7f198c164950 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:11.228 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.222+0000 7f19922d86c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f198c164fa0 con 0x7f198c10dd50 2026-02-13T02:19:11.228 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.222+0000 7f19922d86c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f198c165110 con 0x7f198c10e740 2026-02-13T02:19:11.228 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.222+0000 7f19922d86c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f198c1652d0 con 0x7f198c153300 2026-02-13T02:19:11.228 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.222+0000 7f198bfff6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f198c10dd50 0x7f198c15f050 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:11.228 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.222+0000 7f198bfff6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f198c10dd50 0x7f198c15f050 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:38216/0 (socket says 10.20.193.11:38216) 2026-02-13T02:19:11.228 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.222+0000 7f198bfff6c0 1 -- 10.20.193.11:0/4189343092 learned_addr learned my addr 10.20.193.11:0/4189343092 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:19:11.228 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.222+0000 7f199084e6c0 1 --2- 10.20.193.11:0/4189343092 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f198c153300 0x7f198c164950 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:11.228 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.222+0000 7f198b7fe6c0 1 --2- 10.20.193.11:0/4189343092 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f198c10e740 0x7f198c15f590 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:11.228 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.222+0000 7f198bfff6c0 1 -- 10.20.193.11:0/4189343092 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f198c153300 msgr2=0x7f198c164950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:11.228 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.222+0000 7f198bfff6c0 1 --2- 10.20.193.11:0/4189343092 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f198c153300 0x7f198c164950 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.228 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.222+0000 7f198bfff6c0 1 -- 10.20.193.11:0/4189343092 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f198c10e740 msgr2=0x7f198c15f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:11.229 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.222+0000 7f198bfff6c0 1 --2- 10.20.193.11:0/4189343092 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f198c10e740 0x7f198c15f590 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.229 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.222+0000 7f198bfff6c0 1 -- 10.20.193.11:0/4189343092 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1978009590 con 0x7f198c10dd50 2026-02-13T02:19:11.229 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.222+0000 7f198bfff6c0 1 --2- 10.20.193.11:0/4189343092 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f198c10dd50 0x7f198c15f050 secure :-1 s=READY pgs=288 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1978004750 tx=0x7f197800be00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:11.229 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.223+0000 7f19897fa6c0 1 -- 10.20.193.11:0/4189343092 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f19780044a0 con 0x7f198c10dd50 2026-02-13T02:19:11.229 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.223+0000 7f19897fa6c0 1 -- 10.20.193.11:0/4189343092 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1978009030 con 0x7f198c10dd50 2026-02-13T02:19:11.229 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.223+0000 7f19922d86c0 1 -- 10.20.193.11:0/4189343092 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f197c0094c0 con 0x7f198c10dd50 2026-02-13T02:19:11.229 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.223+0000 7f19897fa6c0 1 -- 10.20.193.11:0/4189343092 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f19780071c0 con 0x7f198c10dd50 2026-02-13T02:19:11.229 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.223+0000 7f19922d86c0 1 -- 10.20.193.11:0/4189343092 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f198c14ecd0 con 0x7f198c10dd50 2026-02-13T02:19:11.229 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.224+0000 7f19922d86c0 1 -- 10.20.193.11:0/4189343092 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f198c05fb90 con 0x7f198c10dd50 2026-02-13T02:19:11.230 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.225+0000 7f19897fa6c0 1 -- 10.20.193.11:0/4189343092 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7f19780026b0 con 0x7f198c10dd50 2026-02-13T02:19:11.230 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.226+0000 7f19897fa6c0 1 --2- 10.20.193.11:0/4189343092 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f19540b5710 0x7f19540d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:11.230 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.226+0000 7f19897fa6c0 1 -- 10.20.193.11:0/4189343092 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7762+0+0 (secure 0 0 0) 0x7f19780e3ca0 con 0x7f198c10dd50 2026-02-13T02:19:11.231 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.226+0000 7f198b7fe6c0 1 --2- 10.20.193.11:0/4189343092 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f19540b5710 0x7f19540d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:11.231 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.226+0000 7f198b7fe6c0 1 --2- 10.20.193.11:0/4189343092 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f19540b5710 0x7f19540d5bc0 secure :-1 s=READY pgs=206 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f198c1659e0 tx=0x7f197c0023a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:11.231 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.228+0000 7f19897fa6c0 1 -- 10.20.193.11:0/4189343092 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f19780a6790 con 0x7f198c10dd50 2026-02-13T02:19:11.231 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.229+0000 7f195233b6c0 1 -- 10.20.193.11:0/2247458172 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f194c11e180 con 0x7f194c115260 2026-02-13T02:19:11.231 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.229+0000 7f193a7fc6c0 1 -- 10.20.193.11:0/2247458172 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f19400a9790 con 0x7f194c115260 2026-02-13T02:19:11.232 INFO:teuthology.orchestra.run.trial011.stdout:253403070472 2026-02-13T02:19:11.234 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.233+0000 7ff9bb57b6c0 1 -- 10.20.193.11:0/3323114477 --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7ff9b41238c0 con 0x7ff9b4128010 2026-02-13T02:19:11.235 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.233+0000 7f195233b6c0 1 -- 10.20.193.11:0/2247458172 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f19200b5710 msgr2=0x7f19200d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:11.235 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.233+0000 7f195233b6c0 1 --2- 10.20.193.11:0/2247458172 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f19200b5710 0x7f19200d5bc0 secure :-1 s=READY pgs=198 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f193c005b40 tx=0x7f193c0023a0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.235 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.233+0000 7f195233b6c0 1 -- 10.20.193.11:0/2247458172 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f194c115260 msgr2=0x7f194c11d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:11.235 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.233+0000 7f195233b6c0 1 --2- 10.20.193.11:0/2247458172 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f194c115260 0x7f194c11d520 secure :-1 s=READY pgs=279 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f194000ba30 tx=0x7f194000bf00 comp rx=0 tx=0).stop 2026-02-13T02:19:11.235 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.233+0000 7ff99f7fe6c0 1 -- 10.20.193.11:0/3323114477 <== mon.2 v2:10.20.193.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7ff9a80aa610 con 0x7ff9b4128010 2026-02-13T02:19:11.236 INFO:teuthology.orchestra.run.trial011.stdout:210453397516 2026-02-13T02:19:11.236 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.233+0000 7f195233b6c0 1 -- 10.20.193.11:0/2247458172 shutdown_connections 2026-02-13T02:19:11.236 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.233+0000 7f195233b6c0 1 --2- 10.20.193.11:0/2247458172 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f19200b5710 0x7f19200d5bc0 unknown :-1 s=CLOSED pgs=198 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.236 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.233+0000 7f195233b6c0 1 --2- 10.20.193.11:0/2247458172 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f194c1228e0 0x7f194c122d80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.236 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.233+0000 7f195233b6c0 1 --2- 10.20.193.11:0/2247458172 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f194c115260 0x7f194c11d520 unknown :-1 s=CLOSED pgs=279 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.236 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.233+0000 7f195233b6c0 1 --2- 10.20.193.11:0/2247458172 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f194c10f050 0x7f194c11cfe0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.237 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.233+0000 7f195233b6c0 1 -- 10.20.193.11:0/2247458172 >> 10.20.193.11:0/2247458172 conn(0x7f194c0ec950 msgr2=0x7f194c10cd30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:11.237 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.234+0000 7f195233b6c0 1 -- 10.20.193.11:0/2247458172 shutdown_connections 2026-02-13T02:19:11.237 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.234+0000 7f195233b6c0 1 -- 10.20.193.11:0/2247458172 wait complete. 2026-02-13T02:19:11.239 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.237+0000 7ff9bb57b6c0 1 -- 10.20.193.11:0/3323114477 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7ff9900b5710 msgr2=0x7ff9900d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:11.239 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.237+0000 7ff9bb57b6c0 1 --2- 10.20.193.11:0/3323114477 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7ff9900b5710 0x7ff9900d5bc0 secure :-1 s=READY pgs=199 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff9ac005b40 tx=0x7ff9ac0023a0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.239 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.237+0000 7ff9bb57b6c0 1 -- 10.20.193.11:0/3323114477 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7ff9b4128010 msgr2=0x7ff9b41284b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:11.239 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.237+0000 7ff9bb57b6c0 1 --2- 10.20.193.11:0/3323114477 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7ff9b4128010 0x7ff9b41284b0 secure :-1 s=READY pgs=55 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff9a8006ea0 tx=0x7ff9a800cca0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.239 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.237+0000 7ff9bb57b6c0 1 -- 10.20.193.11:0/3323114477 shutdown_connections 2026-02-13T02:19:11.239 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.237+0000 7ff9bb57b6c0 1 --2- 10.20.193.11:0/3323114477 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7ff9900b5710 0x7ff9900d5bc0 unknown :-1 s=CLOSED pgs=199 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.239 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.237+0000 7ff9bb57b6c0 1 --2- 10.20.193.11:0/3323114477 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7ff9b4128010 0x7ff9b41284b0 unknown :-1 s=CLOSED pgs=55 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.239 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.237+0000 7ff9bb57b6c0 1 --2- 10.20.193.11:0/3323114477 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff9b4110d40 0x7ff9b4122c50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.239 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.237+0000 7ff9bb57b6c0 1 --2- 10.20.193.11:0/3323114477 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7ff9b410ad40 0x7ff9b4122710 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.239 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.237+0000 7ff9bb57b6c0 1 -- 10.20.193.11:0/3323114477 >> 10.20.193.11:0/3323114477 conn(0x7ff9b40638a0 msgr2=0x7ff9b410cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:11.239 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.237+0000 7ff9bb57b6c0 1 -- 10.20.193.11:0/3323114477 shutdown_connections 2026-02-13T02:19:11.239 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.237+0000 7ff9bb57b6c0 1 -- 10.20.193.11:0/3323114477 wait complete. 2026-02-13T02:19:11.250 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:11 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/2308964302' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T02:19:11.269 INFO:tasks.cephadm.ceph_manager.ceph:need seq 240518168587 got 240518168587 for osd.9 2026-02-13T02:19:11.270 DEBUG:teuthology.parallel:result is None 2026-02-13T02:19:11.271 INFO:tasks.cephadm.ceph_manager.ceph:need seq 137438953489 got 137438953489 for osd.5 2026-02-13T02:19:11.271 DEBUG:teuthology.parallel:result is None 2026-02-13T02:19:11.281 INFO:tasks.cephadm.ceph_manager.ceph:need seq 283467841544 got 283467841544 for osd.11 2026-02-13T02:19:11.282 DEBUG:teuthology.parallel:result is None 2026-02-13T02:19:11.283 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.281+0000 7f47bbb4c6c0 1 -- 10.20.193.11:0/2252238137 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f47b411e2e0 con 0x7f47b4122a90 2026-02-13T02:19:11.284 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.282+0000 7f47a6ffd6c0 1 -- 10.20.193.11:0/2252238137 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f47b00a96c0 con 0x7f47b4122a90 2026-02-13T02:19:11.284 INFO:teuthology.orchestra.run.trial011.stdout:30064771095 2026-02-13T02:19:11.286 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.284+0000 7f47bbb4c6c0 1 -- 10.20.193.11:0/2252238137 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f47900b5690 msgr2=0x7f47900d5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:11.286 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.284+0000 7f47bbb4c6c0 1 --2- 10.20.193.11:0/2252238137 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f47900b5690 0x7f47900d5b40 secure :-1 s=READY pgs=201 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f47a800a990 tx=0x7f47a8002470 comp rx=0 tx=0).stop 2026-02-13T02:19:11.286 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.284+0000 7f47bbb4c6c0 1 -- 10.20.193.11:0/2252238137 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f47b4122a90 msgr2=0x7f47b4122f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:11.286 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.284+0000 7f47bbb4c6c0 1 --2- 10.20.193.11:0/2252238137 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f47b4122a90 0x7f47b4122f30 secure :-1 s=READY pgs=283 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f47b0009490 tx=0x7f47b000bbd0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.286 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.284+0000 7f47bbb4c6c0 1 -- 10.20.193.11:0/2252238137 shutdown_connections 2026-02-13T02:19:11.287 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.284+0000 7f47bbb4c6c0 1 --2- 10.20.193.11:0/2252238137 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f47900b5690 0x7f47900d5b40 unknown :-1 s=CLOSED pgs=201 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.287 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.284+0000 7f47bbb4c6c0 1 --2- 10.20.193.11:0/2252238137 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f47b4115440 0x7f47b411d6d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.287 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.284+0000 7f47bbb4c6c0 1 --2- 10.20.193.11:0/2252238137 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f47b4122a90 0x7f47b4122f30 unknown :-1 s=CLOSED pgs=283 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.287 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.284+0000 7f47bbb4c6c0 1 --2- 10.20.193.11:0/2252238137 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f47b410f230 0x7f47b411d190 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.287 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.284+0000 7f47bbb4c6c0 1 -- 10.20.193.11:0/2252238137 >> 10.20.193.11:0/2252238137 conn(0x7f47b40ecb30 msgr2=0x7f47b410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:11.287 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.284+0000 7f47bbb4c6c0 1 -- 10.20.193.11:0/2252238137 shutdown_connections 2026-02-13T02:19:11.287 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.284+0000 7f47bbb4c6c0 1 -- 10.20.193.11:0/2252238137 wait complete. 2026-02-13T02:19:11.288 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.284+0000 7fded7b906c0 1 -- 10.20.193.11:0/530309646 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fded010a810 con 0x7fded010cfb0 2026-02-13T02:19:11.288 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.285+0000 7fdebeffd6c0 1 -- 10.20.193.11:0/530309646 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fdec00eff60 con 0x7fded010cfb0 2026-02-13T02:19:11.288 INFO:teuthology.orchestra.run.trial011.stdout:167503724559 2026-02-13T02:19:11.289 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.286+0000 7fedec3886c0 1 -- 10.20.193.11:0/2810223595 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fede40f9f00 con 0x7fede40f93e0 2026-02-13T02:19:11.289 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.286+0000 7f4b559186c0 1 -- 10.20.193.11:0/2152226122 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f4b5010f600 con 0x7f4b50115440 2026-02-13T02:19:11.289 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.286+0000 7fedcb7fe6c0 1 -- 10.20.193.11:0/2810223595 <== mon.1 v2:10.20.193.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fede00aa750 con 0x7fede40f93e0 2026-02-13T02:19:11.290 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.286+0000 7f4b549126c0 1 -- 10.20.193.11:0/2152226122 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4b380a96e0 con 0x7f4b50115440 2026-02-13T02:19:11.290 INFO:teuthology.orchestra.run.trial011.stdout:180388626445 2026-02-13T02:19:11.291 INFO:teuthology.orchestra.run.trial011.stdout:42949672981 2026-02-13T02:19:11.291 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.288+0000 7fded7b906c0 1 -- 10.20.193.11:0/530309646 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fdeac0b5710 msgr2=0x7fdeac0d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:11.292 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.288+0000 7fded7b906c0 1 --2- 10.20.193.11:0/530309646 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fdeac0b5710 0x7fdeac0d5bc0 secure :-1 s=READY pgs=200 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fded010afd0 tx=0x7fdec40096a0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.292 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.288+0000 7fded7b906c0 1 -- 10.20.193.11:0/530309646 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fded010cfb0 msgr2=0x7fded00f0020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:11.292 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.288+0000 7fded7b906c0 1 --2- 10.20.193.11:0/530309646 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fded010cfb0 0x7fded00f0020 secure :-1 s=READY pgs=282 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdec0005ae0 tx=0x7fdec002fcb0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.292 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.288+0000 7fded7b906c0 1 -- 10.20.193.11:0/530309646 shutdown_connections 2026-02-13T02:19:11.292 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.288+0000 7fded7b906c0 1 --2- 10.20.193.11:0/530309646 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fdeac0b5710 0x7fdeac0d5bc0 unknown :-1 s=CLOSED pgs=200 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.292 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.288+0000 7fded7b906c0 1 --2- 10.20.193.11:0/530309646 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fded00f0560 0x7fded00f0a00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.292 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.288+0000 7fded7b906c0 1 --2- 10.20.193.11:0/530309646 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fded01131c0 0x7fded0173a60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.292 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.288+0000 7fded7b906c0 1 --2- 10.20.193.11:0/530309646 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fded010cfb0 0x7fded00f0020 unknown :-1 s=CLOSED pgs=282 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.292 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.288+0000 7fded7b906c0 1 -- 10.20.193.11:0/530309646 >> 10.20.193.11:0/530309646 conn(0x7fded00ea8b0 msgr2=0x7fded010f900 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:11.293 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.288+0000 7fded7b906c0 1 -- 10.20.193.11:0/530309646 shutdown_connections 2026-02-13T02:19:11.293 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.288+0000 7fded7b906c0 1 -- 10.20.193.11:0/530309646 wait complete. 2026-02-13T02:19:11.293 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.289+0000 7fedec3886c0 1 -- 10.20.193.11:0/2810223595 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fedc00b5710 msgr2=0x7fedc00d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:11.293 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.289+0000 7fedec3886c0 1 --2- 10.20.193.11:0/2810223595 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fedc00b5710 0x7fedc00d5bc0 secure :-1 s=READY pgs=202 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fedd4031fd0 tx=0x7fedd4005ae0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.293 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.289+0000 7fedec3886c0 1 -- 10.20.193.11:0/2810223595 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fede40f93e0 msgr2=0x7fede40fe6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:11.293 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.289+0000 7fedec3886c0 1 --2- 10.20.193.11:0/2810223595 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fede40f93e0 0x7fede40fe6b0 secure :-1 s=READY pgs=62 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fede000c9b0 tx=0x7fede000ce80 comp rx=0 tx=0).stop 2026-02-13T02:19:11.294 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.289+0000 7f4b559186c0 1 -- 10.20.193.11:0/2152226122 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f4b240b5790 msgr2=0x7f4b240d5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:11.294 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.289+0000 7f4b559186c0 1 --2- 10.20.193.11:0/2152226122 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f4b240b5790 0x7f4b240d5c40 secure :-1 s=READY pgs=203 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4b440098d0 tx=0x7f4b440023a0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.294 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.289+0000 7f4b559186c0 1 -- 10.20.193.11:0/2152226122 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f4b50115440 msgr2=0x7f4b50175ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:11.294 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.289+0000 7f4b559186c0 1 --2- 10.20.193.11:0/2152226122 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f4b50115440 0x7f4b50175ce0 secure :-1 s=READY pgs=284 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4b3800ba30 tx=0x7f4b3800bf00 comp rx=0 tx=0).stop 2026-02-13T02:19:11.295 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.289+0000 7fedec3886c0 1 -- 10.20.193.11:0/2810223595 shutdown_connections 2026-02-13T02:19:11.295 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.289+0000 7fedec3886c0 1 --2- 10.20.193.11:0/2810223595 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fedc00b5710 0x7fedc00d5bc0 unknown :-1 s=CLOSED pgs=202 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.295 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.289+0000 7fedec3886c0 1 --2- 10.20.193.11:0/2810223595 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fede40f93e0 0x7fede40fe6b0 unknown :-1 s=CLOSED pgs=62 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.295 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.289+0000 7fedec3886c0 1 --2- 10.20.193.11:0/2810223595 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fede4115440 0x7fede4175ce0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.295 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.289+0000 7fedec3886c0 1 --2- 10.20.193.11:0/2810223595 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fede410f230 0x7fede40f8db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.295 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.289+0000 7fedec3886c0 1 -- 10.20.193.11:0/2810223595 >> 10.20.193.11:0/2810223595 conn(0x7fede40ecb30 msgr2=0x7fede410d6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:11.296 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.289+0000 7f4b559186c0 1 -- 10.20.193.11:0/2152226122 shutdown_connections 2026-02-13T02:19:11.296 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.289+0000 7f4b559186c0 1 --2- 10.20.193.11:0/2152226122 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f4b240b5790 0x7f4b240d5c40 unknown :-1 s=CLOSED pgs=203 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.296 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.289+0000 7f4b559186c0 1 --2- 10.20.193.11:0/2152226122 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f4b500f9700 0x7f4b500fe9d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.296 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.289+0000 7f4b559186c0 1 --2- 10.20.193.11:0/2152226122 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f4b50115440 0x7f4b50175ce0 unknown :-1 s=CLOSED pgs=284 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.296 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.289+0000 7f4b559186c0 1 --2- 10.20.193.11:0/2152226122 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f4b5010f230 0x7f4b500f90d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.296 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.289+0000 7f4b559186c0 1 -- 10.20.193.11:0/2152226122 >> 10.20.193.11:0/2152226122 conn(0x7f4b500ecb30 msgr2=0x7f4b50113080 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:11.297 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.289+0000 7f4b559186c0 1 -- 10.20.193.11:0/2152226122 shutdown_connections 2026-02-13T02:19:11.297 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.289+0000 7f4b559186c0 1 -- 10.20.193.11:0/2152226122 wait complete. 2026-02-13T02:19:11.297 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.289+0000 7fedec3886c0 1 -- 10.20.193.11:0/2810223595 shutdown_connections 2026-02-13T02:19:11.297 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.289+0000 7fedec3886c0 1 -- 10.20.193.11:0/2810223595 wait complete. 2026-02-13T02:19:11.298 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.291+0000 7f01bdac56c0 1 -- 10.20.193.11:0/2095418547 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f01b80fc980 con 0x7f01b810bb00 2026-02-13T02:19:11.298 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.291+0000 7f01b4ff96c0 1 -- 10.20.193.11:0/2095418547 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f01a80cd840 con 0x7f01b810bb00 2026-02-13T02:19:11.298 INFO:teuthology.orchestra.run.trial011.stdout:60129542165 2026-02-13T02:19:11.299 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.294+0000 7f01bdac56c0 1 -- 10.20.193.11:0/2095418547 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f018c0b5710 msgr2=0x7f018c0d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:11.299 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.294+0000 7f01bdac56c0 1 --2- 10.20.193.11:0/2095418547 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f018c0b5710 0x7f018c0d5bc0 secure :-1 s=READY pgs=204 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f01a4005980 tx=0x7f01a4005910 comp rx=0 tx=0).stop 2026-02-13T02:19:11.299 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.294+0000 7f01bdac56c0 1 -- 10.20.193.11:0/2095418547 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f01b810bb00 msgr2=0x7f01b80fbd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:11.299 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.294+0000 7f01bdac56c0 1 --2- 10.20.193.11:0/2095418547 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f01b810bb00 0x7f01b80fbd40 secure :-1 s=READY pgs=285 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f01a80098c0 tx=0x7f01a80047f0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.300 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.294+0000 7f01bdac56c0 1 -- 10.20.193.11:0/2095418547 shutdown_connections 2026-02-13T02:19:11.300 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.294+0000 7f01bdac56c0 1 --2- 10.20.193.11:0/2095418547 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f018c0b5710 0x7f018c0d5bc0 unknown :-1 s=CLOSED pgs=204 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.300 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.294+0000 7f01bdac56c0 1 --2- 10.20.193.11:0/2095418547 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f01b8153420 0x7f01b81010b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.300 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.294+0000 7f01bdac56c0 1 --2- 10.20.193.11:0/2095418547 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f01b810bb00 0x7f01b80fbd40 unknown :-1 s=CLOSED pgs=285 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.300 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.294+0000 7f01bdac56c0 1 --2- 10.20.193.11:0/2095418547 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f01b810b1f0 0x7f01b80fb800 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.300 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.294+0000 7f01bdac56c0 1 -- 10.20.193.11:0/2095418547 >> 10.20.193.11:0/2095418547 conn(0x7f01b8063af0 msgr2=0x7f01b815a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:11.300 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.294+0000 7f01bdac56c0 1 -- 10.20.193.11:0/2095418547 shutdown_connections 2026-02-13T02:19:11.300 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.294+0000 7f01bdac56c0 1 -- 10.20.193.11:0/2095418547 wait complete. 2026-02-13T02:19:11.301 INFO:tasks.cephadm.ceph_manager.ceph:need seq 210453397516 got 210453397516 for osd.8 2026-02-13T02:19:11.302 DEBUG:teuthology.parallel:result is None 2026-02-13T02:19:11.303 INFO:tasks.cephadm.ceph_manager.ceph:need seq 253403070472 got 253403070472 for osd.10 2026-02-13T02:19:11.304 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.298+0000 7f99d13066c0 1 -- 10.20.193.11:0/1589920223 --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f99cc10d920 con 0x7f99cc113020 2026-02-13T02:19:11.304 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.299+0000 7f99c97fa6c0 1 -- 10.20.193.11:0/1589920223 <== mon.1 v2:10.20.193.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f99bc0a9680 con 0x7f99cc113020 2026-02-13T02:19:11.304 DEBUG:teuthology.parallel:result is None 2026-02-13T02:19:11.304 INFO:teuthology.orchestra.run.trial011.stdout:90194313236 2026-02-13T02:19:11.305 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.302+0000 7f99d13066c0 1 -- 10.20.193.11:0/1589920223 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f99a00b5710 msgr2=0x7f99a00d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:11.305 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.302+0000 7f99d13066c0 1 --2- 10.20.193.11:0/1589920223 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f99a00b5710 0x7f99a00d5bc0 secure :-1 s=READY pgs=205 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f99b802f960 tx=0x7f99b8005ae0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.305 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.302+0000 7f99d13066c0 1 -- 10.20.193.11:0/1589920223 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f99cc113020 msgr2=0x7f99cc10cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:11.305 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.302+0000 7f99d13066c0 1 --2- 10.20.193.11:0/1589920223 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f99cc113020 0x7f99cc10cb60 secure :-1 s=READY pgs=63 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f99bc004750 tx=0x7f99bc00bb80 comp rx=0 tx=0).stop 2026-02-13T02:19:11.305 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.302+0000 7f99d13066c0 1 -- 10.20.193.11:0/1589920223 shutdown_connections 2026-02-13T02:19:11.305 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.302+0000 7f99d13066c0 1 --2- 10.20.193.11:0/1589920223 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f99a00b5710 0x7f99a00d5bc0 unknown :-1 s=CLOSED pgs=205 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.306 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.302+0000 7f99d13066c0 1 --2- 10.20.193.11:0/1589920223 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f99cc10d0a0 0x7f99cc162fe0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.306 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.302+0000 7f99d13066c0 1 --2- 10.20.193.11:0/1589920223 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f99cc113020 0x7f99cc10cb60 unknown :-1 s=CLOSED pgs=63 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.306 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.302+0000 7f99d13066c0 1 --2- 10.20.193.11:0/1589920223 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f99cc10ad40 0x7f99cc10c620 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.306 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.302+0000 7f99d13066c0 1 -- 10.20.193.11:0/1589920223 >> 10.20.193.11:0/1589920223 conn(0x7f99cc0638a0 msgr2=0x7f99cc110a30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:11.306 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.302+0000 7f99d13066c0 1 -- 10.20.193.11:0/1589920223 shutdown_connections 2026-02-13T02:19:11.306 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.302+0000 7f99d13066c0 1 -- 10.20.193.11:0/1589920223 wait complete. 2026-02-13T02:19:11.341 INFO:tasks.cephadm.ceph_manager.ceph:need seq 30064771095 got 30064771095 for osd.0 2026-02-13T02:19:11.342 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.339+0000 7f19922d86c0 1 -- 10.20.193.11:0/4189343092 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f198c1601a0 con 0x7f198c10dd50 2026-02-13T02:19:11.342 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.339+0000 7f19897fa6c0 1 -- 10.20.193.11:0/4189343092 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f19780a98b0 con 0x7f198c10dd50 2026-02-13T02:19:11.342 DEBUG:teuthology.parallel:result is None 2026-02-13T02:19:11.342 INFO:teuthology.orchestra.run.trial011.stdout:120259084306 2026-02-13T02:19:11.345 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.343+0000 7f19922d86c0 1 -- 10.20.193.11:0/4189343092 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f19540b5710 msgr2=0x7f19540d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:11.345 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.343+0000 7f19922d86c0 1 --2- 10.20.193.11:0/4189343092 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f19540b5710 0x7f19540d5bc0 secure :-1 s=READY pgs=206 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f198c1659e0 tx=0x7f197c0023a0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.346 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.343+0000 7f19922d86c0 1 -- 10.20.193.11:0/4189343092 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f198c10dd50 msgr2=0x7f198c15f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:11.346 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.343+0000 7f19922d86c0 1 --2- 10.20.193.11:0/4189343092 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f198c10dd50 0x7f198c15f050 secure :-1 s=READY pgs=288 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1978004750 tx=0x7f197800be00 comp rx=0 tx=0).stop 2026-02-13T02:19:11.346 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.343+0000 7f19922d86c0 1 -- 10.20.193.11:0/4189343092 shutdown_connections 2026-02-13T02:19:11.346 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.343+0000 7f19922d86c0 1 --2- 10.20.193.11:0/4189343092 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f19540b5710 0x7f19540d5bc0 unknown :-1 s=CLOSED pgs=206 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.346 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.343+0000 7f19922d86c0 1 --2- 10.20.193.11:0/4189343092 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f198c10e740 0x7f198c15f590 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.346 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.343+0000 7f19922d86c0 1 --2- 10.20.193.11:0/4189343092 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f198c153300 0x7f198c164950 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.346 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.343+0000 7f19922d86c0 1 --2- 10.20.193.11:0/4189343092 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f198c10dd50 0x7f198c15f050 unknown :-1 s=CLOSED pgs=288 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.346 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.343+0000 7f19922d86c0 1 -- 10.20.193.11:0/4189343092 >> 10.20.193.11:0/4189343092 conn(0x7f198c0e9770 msgr2=0x7f198c109b50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:11.346 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.343+0000 7f19922d86c0 1 -- 10.20.193.11:0/4189343092 shutdown_connections 2026-02-13T02:19:11.346 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.343+0000 7f19922d86c0 1 -- 10.20.193.11:0/4189343092 wait complete. 2026-02-13T02:19:11.347 INFO:tasks.cephadm.ceph_manager.ceph:need seq 42949672981 got 42949672981 for osd.1 2026-02-13T02:19:11.347 DEBUG:teuthology.parallel:result is None 2026-02-13T02:19:11.349 INFO:tasks.cephadm.ceph_manager.ceph:need seq 180388626445 got 180388626445 for osd.7 2026-02-13T02:19:11.350 DEBUG:teuthology.parallel:result is None 2026-02-13T02:19:11.362 INFO:tasks.cephadm.ceph_manager.ceph:need seq 167503724559 got 167503724559 for osd.6 2026-02-13T02:19:11.362 DEBUG:teuthology.parallel:result is None 2026-02-13T02:19:11.363 INFO:tasks.cephadm.ceph_manager.ceph:need seq 90194313236 got 90194313236 for osd.3 2026-02-13T02:19:11.363 DEBUG:teuthology.parallel:result is None 2026-02-13T02:19:11.367 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542165 got 60129542165 for osd.2 2026-02-13T02:19:11.367 DEBUG:teuthology.parallel:result is None 2026-02-13T02:19:11.385 INFO:tasks.cephadm.ceph_manager.ceph:need seq 120259084306 got 120259084306 for osd.4 2026-02-13T02:19:11.386 DEBUG:teuthology.parallel:result is None 2026-02-13T02:19:11.386 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2026-02-13T02:19:11.386 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph pg dump --format=json 2026-02-13T02:19:11.541 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:11 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/2308964302' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T02:19:11.548 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:19:11.658 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.653+0000 7fb7651456c0 1 -- 10.20.193.11:0/923434469 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fb76010fbf0 msgr2=0x7fb760114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:11.658 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.653+0000 7fb7651456c0 1 --2- 10.20.193.11:0/923434469 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fb76010fbf0 0x7fb760114c30 secure :-1 s=READY pgs=289 gs=1 cs=0 l=1 c_cookie=7205400880337089197 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb7480099a0 tx=0x7fb74802ed20 comp rx=0 tx=0).stop 2026-02-13T02:19:11.658 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.654+0000 7fb7651456c0 1 -- 10.20.193.11:0/923434469 shutdown_connections 2026-02-13T02:19:11.658 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.654+0000 7fb7651456c0 1 --2- 10.20.193.11:0/923434469 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb760115410 0x7fb760175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.658 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.654+0000 7fb7651456c0 1 --2- 10.20.193.11:0/923434469 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fb76010fbf0 0x7fb760114c30 unknown :-1 s=CLOSED pgs=289 gs=1 cs=0 l=1 c_cookie=7205400880337089197 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.658 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.654+0000 7fb7651456c0 1 --2- 10.20.193.11:0/923434469 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fb76010f200 0x7fb76010f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.659 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.654+0000 7fb7651456c0 1 -- 10.20.193.11:0/923434469 >> 10.20.193.11:0/923434469 conn(0x7fb7600ecb00 msgr2=0x7fb76010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:11.659 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.654+0000 7fb7651456c0 1 -- 10.20.193.11:0/923434469 shutdown_connections 2026-02-13T02:19:11.659 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.654+0000 7fb7651456c0 1 -- 10.20.193.11:0/923434469 wait complete. 2026-02-13T02:19:11.659 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.654+0000 7fb7651456c0 1 Processor -- start 2026-02-13T02:19:11.659 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.654+0000 7fb7651456c0 1 -- start start 2026-02-13T02:19:11.659 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.654+0000 7fb7651456c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fb76010f200 0x7fb7600f4c50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:11.659 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.654+0000 7fb7651456c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fb760115410 0x7fb760175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:11.659 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.654+0000 7fb7651456c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb7600f5280 0x7fb7600fa550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:11.659 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.654+0000 7fb7651456c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7fb7600f5970 con 0x7fb760115410 2026-02-13T02:19:11.659 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.654+0000 7fb7651456c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb7600faa90 con 0x7fb76010f200 2026-02-13T02:19:11.660 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.654+0000 7fb7651456c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fb7600fac50 con 0x7fb7600f5280 2026-02-13T02:19:11.660 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.654+0000 7fb75e5756c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fb760115410 0x7fb760175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:11.660 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.654+0000 7fb75e5756c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fb760115410 0x7fb760175cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:38238/0 (socket says 10.20.193.11:38238) 2026-02-13T02:19:11.660 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.654+0000 7fb75e5756c0 1 -- 10.20.193.11:0/4120357980 learned_addr learned my addr 10.20.193.11:0/4120357980 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:19:11.660 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.654+0000 7fb75e5756c0 1 -- 10.20.193.11:0/4120357980 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb7600f5280 msgr2=0x7fb7600fa550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:11.660 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.654+0000 7fb75e5756c0 1 --2- 10.20.193.11:0/4120357980 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb7600f5280 0x7fb7600fa550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.660 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.654+0000 7fb75e5756c0 1 -- 10.20.193.11:0/4120357980 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fb76010f200 msgr2=0x7fb7600f4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:11.660 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.654+0000 7fb75ed766c0 1 --2- 10.20.193.11:0/4120357980 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fb76010f200 0x7fb7600f4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:11.660 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.654+0000 7fb75e5756c0 1 --2- 10.20.193.11:0/4120357980 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fb76010f200 0x7fb7600f4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.660 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.654+0000 7fb75e5756c0 1 -- 10.20.193.11:0/4120357980 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb748009590 con 0x7fb760115410 2026-02-13T02:19:11.661 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.654+0000 7fb75ed766c0 1 --2- 10.20.193.11:0/4120357980 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fb76010f200 0x7fb7600f4c50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:19:11.661 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.654+0000 7fb75e5756c0 1 --2- 10.20.193.11:0/4120357980 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fb760115410 0x7fb760175cb0 secure :-1 s=READY pgs=290 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb748031f90 tx=0x7fb7480047f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:11.661 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.654+0000 7fb737fff6c0 1 -- 10.20.193.11:0/4120357980 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb748002ae0 con 0x7fb760115410 2026-02-13T02:19:11.661 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.654+0000 7fb737fff6c0 1 -- 10.20.193.11:0/4120357980 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb748002c40 con 0x7fb760115410 2026-02-13T02:19:11.661 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.654+0000 7fb7651456c0 1 -- 10.20.193.11:0/4120357980 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7600faed0 con 0x7fb760115410 2026-02-13T02:19:11.661 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.654+0000 7fb737fff6c0 1 -- 10.20.193.11:0/4120357980 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb7480312b0 con 0x7fb760115410 2026-02-13T02:19:11.661 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.655+0000 7fb7651456c0 1 -- 10.20.193.11:0/4120357980 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7600fb3a0 con 0x7fb760115410 2026-02-13T02:19:11.661 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.655+0000 7fb7651456c0 1 -- 10.20.193.11:0/4120357980 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7601104d0 con 0x7fb760115410 2026-02-13T02:19:11.662 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.656+0000 7fb737fff6c0 1 -- 10.20.193.11:0/4120357980 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7fb748007260 con 0x7fb760115410 2026-02-13T02:19:11.662 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.657+0000 7fb737fff6c0 1 --2- 10.20.193.11:0/4120357980 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fb7300b5710 0x7fb7300d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:11.663 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.657+0000 7fb737fff6c0 1 -- 10.20.193.11:0/4120357980 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7762+0+0 (secure 0 0 0) 0x7fb748107c90 con 0x7fb760115410 2026-02-13T02:19:11.663 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.657+0000 7fb75ed766c0 1 --2- 10.20.193.11:0/4120357980 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fb7300b5710 0x7fb7300d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:11.663 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.657+0000 7fb75ed766c0 1 --2- 10.20.193.11:0/4120357980 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fb7300b5710 0x7fb7300d5bc0 secure :-1 s=READY pgs=207 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb754004750 tx=0x7fb754005f10 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:11.663 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.658+0000 7fb737fff6c0 1 -- 10.20.193.11:0/4120357980 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fb7480ca6b0 con 0x7fb760115410 2026-02-13T02:19:11.750 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.748+0000 7fb7651456c0 1 -- 10.20.193.11:0/4120357980 --> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb7600f5e30 con 0x7fb7300b5710 2026-02-13T02:19:11.752 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.751+0000 7fb737fff6c0 1 -- 10.20.193.11:0/4120357980 <== mgr.14116 v2:10.20.193.11:6800/861334768 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258862 (secure 0 0 0) 0x7fb75400b780 con 0x7fb7300b5710 2026-02-13T02:19:11.757 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:19:11.759 INFO:teuthology.orchestra.run.trial011.stderr:dumped all 2026-02-13T02:19:11.761 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.752+0000 7fb7651456c0 1 -- 10.20.193.11:0/4120357980 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fb7300b5710 msgr2=0x7fb7300d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:11.761 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.752+0000 7fb7651456c0 1 --2- 10.20.193.11:0/4120357980 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fb7300b5710 0x7fb7300d5bc0 secure :-1 s=READY pgs=207 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb754004750 tx=0x7fb754005f10 comp rx=0 tx=0).stop 2026-02-13T02:19:11.761 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.752+0000 7fb7651456c0 1 -- 10.20.193.11:0/4120357980 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fb760115410 msgr2=0x7fb760175cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:11.761 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.752+0000 7fb7651456c0 1 --2- 10.20.193.11:0/4120357980 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fb760115410 0x7fb760175cb0 secure :-1 s=READY pgs=290 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb748031f90 tx=0x7fb7480047f0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.761 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.752+0000 7fb7651456c0 1 -- 10.20.193.11:0/4120357980 shutdown_connections 2026-02-13T02:19:11.762 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.752+0000 7fb7651456c0 1 --2- 10.20.193.11:0/4120357980 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fb7300b5710 0x7fb7300d5bc0 unknown :-1 s=CLOSED pgs=207 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.762 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.753+0000 7fb7651456c0 1 --2- 10.20.193.11:0/4120357980 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb7600f5280 0x7fb7600fa550 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.762 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.753+0000 7fb7651456c0 1 --2- 10.20.193.11:0/4120357980 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fb760115410 0x7fb760175cb0 unknown :-1 s=CLOSED pgs=290 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.762 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.753+0000 7fb7651456c0 1 --2- 10.20.193.11:0/4120357980 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fb76010f200 0x7fb7600f4c50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:11.762 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.753+0000 7fb7651456c0 1 -- 10.20.193.11:0/4120357980 >> 10.20.193.11:0/4120357980 conn(0x7fb7600ecb00 msgr2=0x7fb76010d900 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:11.762 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.753+0000 7fb7651456c0 1 -- 10.20.193.11:0/4120357980 shutdown_connections 2026-02-13T02:19:11.762 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:11.753+0000 7fb7651456c0 1 -- 10.20.193.11:0/4120357980 wait complete. 2026-02-13T02:19:11.793 INFO:teuthology.orchestra.run.trial011.stdout:{"pg_ready":true,"pg_map":{"version":190,"stamp":"2026-02-13T02:19:10.947128+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":650388,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":190,"num_read_kb":200,"num_write":417,"num_write_kb":3846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":351,"ondisk_log_size":351,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":8808038400,"kb_used":334740,"kb_used_data":11172,"kb_used_omap":440,"kb_used_meta":322887,"kb_avail":8807703660,"statfs":{"total":9019431321600,"available":9019088547840,"internally_reserved":0,"allocated":11440128,"data_stored":6320400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":451176,"internal_metadata":330636696},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":59860,"num_objects":97,"num_object_clones":0,"num_object_copies":291,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":97,"num_whiteouts":0,"num_read":84,"num_read_kb":109,"num_write":223,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":65,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.922822"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.023100+0000","last_change":"2026-02-13T02:18:59.021168+0000","last_active":"2026-02-13T02:19:00.023100+0000","last_peered":"2026-02-13T02:19:00.023100+0000","last_clean":"2026-02-13T02:19:00.023100+0000","last_became_active":"2026-02-13T02:18:59.020969+0000","last_became_peered":"2026-02-13T02:18:59.020969+0000","last_unstale":"2026-02-13T02:19:00.023100+0000","last_undegraded":"2026-02-13T02:19:00.023100+0000","last_fullsized":"2026-02-13T02:19:00.023100+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:15:33.793511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:01.085894+0000","last_change":"2026-02-13T02:18:59.021361+0000","last_active":"2026-02-13T02:19:01.085894+0000","last_peered":"2026-02-13T02:19:01.085894+0000","last_clean":"2026-02-13T02:19:01.085894+0000","last_became_active":"2026-02-13T02:18:59.021114+0000","last_became_peered":"2026-02-13T02:18:59.021114+0000","last_unstale":"2026-02-13T02:19:01.085894+0000","last_undegraded":"2026-02-13T02:19:01.085894+0000","last_fullsized":"2026-02-13T02:19:01.085894+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:17:48.819148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:01.085816+0000","last_change":"2026-02-13T02:18:59.022954+0000","last_active":"2026-02-13T02:19:01.085816+0000","last_peered":"2026-02-13T02:19:01.085816+0000","last_clean":"2026-02-13T02:19:01.085816+0000","last_became_active":"2026-02-13T02:18:59.022582+0000","last_became_peered":"2026-02-13T02:18:59.022582+0000","last_unstale":"2026-02-13T02:19:01.085816+0000","last_undegraded":"2026-02-13T02:19:01.085816+0000","last_fullsized":"2026-02-13T02:19:01.085816+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:34:51.801255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.398301+0000","last_change":"2026-02-13T02:18:59.022389+0000","last_active":"2026-02-13T02:19:00.398301+0000","last_peered":"2026-02-13T02:19:00.398301+0000","last_clean":"2026-02-13T02:19:00.398301+0000","last_became_active":"2026-02-13T02:18:59.022176+0000","last_became_peered":"2026-02-13T02:18:59.022176+0000","last_unstale":"2026-02-13T02:19:00.398301+0000","last_undegraded":"2026-02-13T02:19:00.398301+0000","last_fullsized":"2026-02-13T02:19:00.398301+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:46:51.207583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.269641+0000","last_change":"2026-02-13T02:18:59.021747+0000","last_active":"2026-02-13T02:19:00.269641+0000","last_peered":"2026-02-13T02:19:00.269641+0000","last_clean":"2026-02-13T02:19:00.269641+0000","last_became_active":"2026-02-13T02:18:59.021407+0000","last_became_peered":"2026-02-13T02:18:59.021407+0000","last_unstale":"2026-02-13T02:19:00.269641+0000","last_undegraded":"2026-02-13T02:19:00.269641+0000","last_fullsized":"2026-02-13T02:19:00.269641+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:39:47.768337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026389+0000","last_change":"2026-02-13T02:18:59.022054+0000","last_active":"2026-02-13T02:19:00.026389+0000","last_peered":"2026-02-13T02:19:00.026389+0000","last_clean":"2026-02-13T02:19:00.026389+0000","last_became_active":"2026-02-13T02:18:59.021802+0000","last_became_peered":"2026-02-13T02:18:59.021802+0000","last_unstale":"2026-02-13T02:19:00.026389+0000","last_undegraded":"2026-02-13T02:19:00.026389+0000","last_fullsized":"2026-02-13T02:19:00.026389+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:49:10.152281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026097+0000","last_change":"2026-02-13T02:18:59.023580+0000","last_active":"2026-02-13T02:19:00.026097+0000","last_peered":"2026-02-13T02:19:00.026097+0000","last_clean":"2026-02-13T02:19:00.026097+0000","last_became_active":"2026-02-13T02:18:59.023348+0000","last_became_peered":"2026-02-13T02:18:59.023348+0000","last_unstale":"2026-02-13T02:19:00.026097+0000","last_undegraded":"2026-02-13T02:19:00.026097+0000","last_fullsized":"2026-02-13T02:19:00.026097+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:21:20.473098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.025858+0000","last_change":"2026-02-13T02:18:59.023105+0000","last_active":"2026-02-13T02:19:00.025858+0000","last_peered":"2026-02-13T02:19:00.025858+0000","last_clean":"2026-02-13T02:19:00.025858+0000","last_became_active":"2026-02-13T02:18:59.022960+0000","last_became_peered":"2026-02-13T02:18:59.022960+0000","last_unstale":"2026-02-13T02:19:00.025858+0000","last_undegraded":"2026-02-13T02:19:00.025858+0000","last_fullsized":"2026-02-13T02:19:00.025858+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:04:13.537414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026452+0000","last_change":"2026-02-13T02:18:59.025487+0000","last_active":"2026-02-13T02:19:00.026452+0000","last_peered":"2026-02-13T02:19:00.026452+0000","last_clean":"2026-02-13T02:19:00.026452+0000","last_became_active":"2026-02-13T02:18:59.025162+0000","last_became_peered":"2026-02-13T02:18:59.025162+0000","last_unstale":"2026-02-13T02:19:00.026452+0000","last_undegraded":"2026-02-13T02:19:00.026452+0000","last_fullsized":"2026-02-13T02:19:00.026452+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:02:12.030985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026633+0000","last_change":"2026-02-13T02:18:59.024537+0000","last_active":"2026-02-13T02:19:00.026633+0000","last_peered":"2026-02-13T02:19:00.026633+0000","last_clean":"2026-02-13T02:19:00.026633+0000","last_became_active":"2026-02-13T02:18:59.024265+0000","last_became_peered":"2026-02-13T02:18:59.024265+0000","last_unstale":"2026-02-13T02:19:00.026633+0000","last_undegraded":"2026-02-13T02:19:00.026633+0000","last_fullsized":"2026-02-13T02:19:00.026633+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:34:28.463458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026396+0000","last_change":"2026-02-13T02:18:59.024867+0000","last_active":"2026-02-13T02:19:00.026396+0000","last_peered":"2026-02-13T02:19:00.026396+0000","last_clean":"2026-02-13T02:19:00.026396+0000","last_became_active":"2026-02-13T02:18:59.024696+0000","last_became_peered":"2026-02-13T02:18:59.024696+0000","last_unstale":"2026-02-13T02:19:00.026396+0000","last_undegraded":"2026-02-13T02:19:00.026396+0000","last_fullsized":"2026-02-13T02:19:00.026396+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:09:44.461888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.398342+0000","last_change":"2026-02-13T02:18:59.022594+0000","last_active":"2026-02-13T02:19:00.398342+0000","last_peered":"2026-02-13T02:19:00.398342+0000","last_clean":"2026-02-13T02:19:00.398342+0000","last_became_active":"2026-02-13T02:18:59.022375+0000","last_became_peered":"2026-02-13T02:18:59.022375+0000","last_unstale":"2026-02-13T02:19:00.398342+0000","last_undegraded":"2026-02-13T02:19:00.398342+0000","last_fullsized":"2026-02-13T02:19:00.398342+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:55:59.143677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.025380+0000","last_change":"2026-02-13T02:18:59.023047+0000","last_active":"2026-02-13T02:19:00.025380+0000","last_peered":"2026-02-13T02:19:00.025380+0000","last_clean":"2026-02-13T02:19:00.025380+0000","last_became_active":"2026-02-13T02:18:59.022786+0000","last_became_peered":"2026-02-13T02:18:59.022786+0000","last_unstale":"2026-02-13T02:19:00.025380+0000","last_undegraded":"2026-02-13T02:19:00.025380+0000","last_fullsized":"2026-02-13T02:19:00.025380+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:28:02.421314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:01.085745+0000","last_change":"2026-02-13T02:18:59.022223+0000","last_active":"2026-02-13T02:19:01.085745+0000","last_peered":"2026-02-13T02:19:01.085745+0000","last_clean":"2026-02-13T02:19:01.085745+0000","last_became_active":"2026-02-13T02:18:59.021655+0000","last_became_peered":"2026-02-13T02:18:59.021655+0000","last_unstale":"2026-02-13T02:19:01.085745+0000","last_undegraded":"2026-02-13T02:19:01.085745+0000","last_fullsized":"2026-02-13T02:19:01.085745+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:14:17.871724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:01.085745+0000","last_change":"2026-02-13T02:18:59.022539+0000","last_active":"2026-02-13T02:19:01.085745+0000","last_peered":"2026-02-13T02:19:01.085745+0000","last_clean":"2026-02-13T02:19:01.085745+0000","last_became_active":"2026-02-13T02:18:59.022262+0000","last_became_peered":"2026-02-13T02:18:59.022262+0000","last_unstale":"2026-02-13T02:19:01.085745+0000","last_undegraded":"2026-02-13T02:19:01.085745+0000","last_fullsized":"2026-02-13T02:19:01.085745+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:55:02.955479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026233+0000","last_change":"2026-02-13T02:18:59.024960+0000","last_active":"2026-02-13T02:19:00.026233+0000","last_peered":"2026-02-13T02:19:00.026233+0000","last_clean":"2026-02-13T02:19:00.026233+0000","last_became_active":"2026-02-13T02:18:59.023945+0000","last_became_peered":"2026-02-13T02:18:59.023945+0000","last_unstale":"2026-02-13T02:19:00.026233+0000","last_undegraded":"2026-02-13T02:19:00.026233+0000","last_fullsized":"2026-02-13T02:19:00.026233+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:13:11.195636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.023170+0000","last_change":"2026-02-13T02:18:59.021383+0000","last_active":"2026-02-13T02:19:00.023170+0000","last_peered":"2026-02-13T02:19:00.023170+0000","last_clean":"2026-02-13T02:19:00.023170+0000","last_became_active":"2026-02-13T02:18:59.021225+0000","last_became_peered":"2026-02-13T02:18:59.021225+0000","last_unstale":"2026-02-13T02:19:00.023170+0000","last_undegraded":"2026-02-13T02:19:00.023170+0000","last_fullsized":"2026-02-13T02:19:00.023170+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:26:53.426955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:01.022801+0000","last_change":"2026-02-13T02:18:59.020231+0000","last_active":"2026-02-13T02:19:01.022801+0000","last_peered":"2026-02-13T02:19:01.022801+0000","last_clean":"2026-02-13T02:19:01.022801+0000","last_became_active":"2026-02-13T02:18:59.020054+0000","last_became_peered":"2026-02-13T02:18:59.020054+0000","last_unstale":"2026-02-13T02:19:01.022801+0000","last_undegraded":"2026-02-13T02:19:01.022801+0000","last_fullsized":"2026-02-13T02:19:01.022801+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:32:25.993500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:01.058735+0000","last_change":"2026-02-13T02:18:59.020750+0000","last_active":"2026-02-13T02:19:01.058735+0000","last_peered":"2026-02-13T02:19:01.058735+0000","last_clean":"2026-02-13T02:19:01.058735+0000","last_became_active":"2026-02-13T02:18:59.020321+0000","last_became_peered":"2026-02-13T02:18:59.020321+0000","last_unstale":"2026-02-13T02:19:01.058735+0000","last_undegraded":"2026-02-13T02:19:01.058735+0000","last_fullsized":"2026-02-13T02:19:01.058735+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:58:49.111664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.023065+0000","last_change":"2026-02-13T02:18:59.019826+0000","last_active":"2026-02-13T02:19:00.023065+0000","last_peered":"2026-02-13T02:19:00.023065+0000","last_clean":"2026-02-13T02:19:00.023065+0000","last_became_active":"2026-02-13T02:18:59.019638+0000","last_became_peered":"2026-02-13T02:18:59.019638+0000","last_unstale":"2026-02-13T02:19:00.023065+0000","last_undegraded":"2026-02-13T02:19:00.023065+0000","last_fullsized":"2026-02-13T02:19:00.023065+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:34:29.076454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.025414+0000","last_change":"2026-02-13T02:18:59.021568+0000","last_active":"2026-02-13T02:19:00.025414+0000","last_peered":"2026-02-13T02:19:00.025414+0000","last_clean":"2026-02-13T02:19:00.025414+0000","last_became_active":"2026-02-13T02:18:59.021304+0000","last_became_peered":"2026-02-13T02:18:59.021304+0000","last_unstale":"2026-02-13T02:19:00.025414+0000","last_undegraded":"2026-02-13T02:19:00.025414+0000","last_fullsized":"2026-02-13T02:19:00.025414+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:38:59.142564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026218+0000","last_change":"2026-02-13T02:18:59.024188+0000","last_active":"2026-02-13T02:19:00.026218+0000","last_peered":"2026-02-13T02:19:00.026218+0000","last_clean":"2026-02-13T02:19:00.026218+0000","last_became_active":"2026-02-13T02:18:59.023908+0000","last_became_peered":"2026-02-13T02:18:59.023908+0000","last_unstale":"2026-02-13T02:19:00.026218+0000","last_undegraded":"2026-02-13T02:19:00.026218+0000","last_fullsized":"2026-02-13T02:19:00.026218+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:10:18.045079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.025946+0000","last_change":"2026-02-13T02:18:59.023175+0000","last_active":"2026-02-13T02:19:00.025946+0000","last_peered":"2026-02-13T02:19:00.025946+0000","last_clean":"2026-02-13T02:19:00.025946+0000","last_became_active":"2026-02-13T02:18:59.022967+0000","last_became_peered":"2026-02-13T02:18:59.022967+0000","last_unstale":"2026-02-13T02:19:00.025946+0000","last_undegraded":"2026-02-13T02:19:00.025946+0000","last_fullsized":"2026-02-13T02:19:00.025946+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:52:00.572082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:01.059499+0000","last_change":"2026-02-13T02:18:59.021552+0000","last_active":"2026-02-13T02:19:01.059499+0000","last_peered":"2026-02-13T02:19:01.059499+0000","last_clean":"2026-02-13T02:19:01.059499+0000","last_became_active":"2026-02-13T02:18:59.021213+0000","last_became_peered":"2026-02-13T02:18:59.021213+0000","last_unstale":"2026-02-13T02:19:01.059499+0000","last_undegraded":"2026-02-13T02:19:01.059499+0000","last_fullsized":"2026-02-13T02:19:01.059499+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:10:29.362585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026274+0000","last_change":"2026-02-13T02:18:59.022674+0000","last_active":"2026-02-13T02:19:00.026274+0000","last_peered":"2026-02-13T02:19:00.026274+0000","last_clean":"2026-02-13T02:19:00.026274+0000","last_became_active":"2026-02-13T02:18:59.022325+0000","last_became_peered":"2026-02-13T02:18:59.022325+0000","last_unstale":"2026-02-13T02:19:00.026274+0000","last_undegraded":"2026-02-13T02:19:00.026274+0000","last_fullsized":"2026-02-13T02:19:00.026274+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:31:28.596666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:01.058743+0000","last_change":"2026-02-13T02:18:59.020392+0000","last_active":"2026-02-13T02:19:01.058743+0000","last_peered":"2026-02-13T02:19:01.058743+0000","last_clean":"2026-02-13T02:19:01.058743+0000","last_became_active":"2026-02-13T02:18:59.019982+0000","last_became_peered":"2026-02-13T02:18:59.019982+0000","last_unstale":"2026-02-13T02:19:01.058743+0000","last_undegraded":"2026-02-13T02:19:01.058743+0000","last_fullsized":"2026-02-13T02:19:01.058743+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:05:17.845797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.023147+0000","last_change":"2026-02-13T02:18:59.020196+0000","last_active":"2026-02-13T02:19:00.023147+0000","last_peered":"2026-02-13T02:19:00.023147+0000","last_clean":"2026-02-13T02:19:00.023147+0000","last_became_active":"2026-02-13T02:18:59.019918+0000","last_became_peered":"2026-02-13T02:18:59.019918+0000","last_unstale":"2026-02-13T02:19:00.023147+0000","last_undegraded":"2026-02-13T02:19:00.023147+0000","last_fullsized":"2026-02-13T02:19:00.023147+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:12:07.357874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.025392+0000","last_change":"2026-02-13T02:18:59.021792+0000","last_active":"2026-02-13T02:19:00.025392+0000","last_peered":"2026-02-13T02:19:00.025392+0000","last_clean":"2026-02-13T02:19:00.025392+0000","last_became_active":"2026-02-13T02:18:59.021490+0000","last_became_peered":"2026-02-13T02:18:59.021490+0000","last_unstale":"2026-02-13T02:19:00.025392+0000","last_undegraded":"2026-02-13T02:19:00.025392+0000","last_fullsized":"2026-02-13T02:19:00.025392+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:25:48.353959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:01.085846+0000","last_change":"2026-02-13T02:18:59.022139+0000","last_active":"2026-02-13T02:19:01.085846+0000","last_peered":"2026-02-13T02:19:01.085846+0000","last_clean":"2026-02-13T02:19:01.085846+0000","last_became_active":"2026-02-13T02:18:59.021874+0000","last_became_peered":"2026-02-13T02:18:59.021874+0000","last_unstale":"2026-02-13T02:19:01.085846+0000","last_undegraded":"2026-02-13T02:19:01.085846+0000","last_fullsized":"2026-02-13T02:19:01.085846+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:57:27.700971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:01.058631+0000","last_change":"2026-02-13T02:18:59.019769+0000","last_active":"2026-02-13T02:19:01.058631+0000","last_peered":"2026-02-13T02:19:01.058631+0000","last_clean":"2026-02-13T02:19:01.058631+0000","last_became_active":"2026-02-13T02:18:59.019582+0000","last_became_peered":"2026-02-13T02:18:59.019582+0000","last_unstale":"2026-02-13T02:19:01.058631+0000","last_undegraded":"2026-02-13T02:19:01.058631+0000","last_fullsized":"2026-02-13T02:19:01.058631+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:53:56.089564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:01.058600+0000","last_change":"2026-02-13T02:18:59.020880+0000","last_active":"2026-02-13T02:19:01.058600+0000","last_peered":"2026-02-13T02:19:01.058600+0000","last_clean":"2026-02-13T02:19:01.058600+0000","last_became_active":"2026-02-13T02:18:59.020558+0000","last_became_peered":"2026-02-13T02:18:59.020558+0000","last_unstale":"2026-02-13T02:19:01.058600+0000","last_undegraded":"2026-02-13T02:19:01.058600+0000","last_fullsized":"2026-02-13T02:19:01.058600+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:02:40.364817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.023030+0000","last_change":"2026-02-13T02:18:59.022093+0000","last_active":"2026-02-13T02:19:00.023030+0000","last_peered":"2026-02-13T02:19:00.023030+0000","last_clean":"2026-02-13T02:19:00.023030+0000","last_became_active":"2026-02-13T02:18:59.021669+0000","last_became_peered":"2026-02-13T02:18:59.021669+0000","last_unstale":"2026-02-13T02:19:00.023030+0000","last_undegraded":"2026-02-13T02:19:00.023030+0000","last_fullsized":"2026-02-13T02:19:00.023030+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:30:30.662498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.269509+0000","last_change":"2026-02-13T02:18:59.021435+0000","last_active":"2026-02-13T02:19:00.269509+0000","last_peered":"2026-02-13T02:19:00.269509+0000","last_clean":"2026-02-13T02:19:00.269509+0000","last_became_active":"2026-02-13T02:18:59.020960+0000","last_became_peered":"2026-02-13T02:18:59.020960+0000","last_unstale":"2026-02-13T02:19:00.269509+0000","last_undegraded":"2026-02-13T02:19:00.269509+0000","last_fullsized":"2026-02-13T02:19:00.269509+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:38:16.139971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"71'5","reported_seq":28,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:09.067800+0000","last_change":"2026-02-13T02:18:58.015175+0000","last_active":"2026-02-13T02:19:09.067800+0000","last_peered":"2026-02-13T02:19:09.067800+0000","last_clean":"2026-02-13T02:19:09.067800+0000","last_became_active":"2026-02-13T02:18:58.014835+0000","last_became_peered":"2026-02-13T02:18:58.014835+0000","last_unstale":"2026-02-13T02:19:09.067800+0000","last_undegraded":"2026-02-13T02:19:09.067800+0000","last_fullsized":"2026-02-13T02:19:09.067800+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:27:53.220446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:01.059509+0000","last_change":"2026-02-13T02:18:59.021246+0000","last_active":"2026-02-13T02:19:01.059509+0000","last_peered":"2026-02-13T02:19:01.059509+0000","last_clean":"2026-02-13T02:19:01.059509+0000","last_became_active":"2026-02-13T02:18:59.020902+0000","last_became_peered":"2026-02-13T02:18:59.020902+0000","last_unstale":"2026-02-13T02:19:01.059509+0000","last_undegraded":"2026-02-13T02:19:01.059509+0000","last_fullsized":"2026-02-13T02:19:01.059509+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:22:04.706073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"71'7","reported_seq":23,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:04.053335+0000","last_change":"2026-02-13T02:18:58.019626+0000","last_active":"2026-02-13T02:19:04.053335+0000","last_peered":"2026-02-13T02:19:04.053335+0000","last_clean":"2026-02-13T02:19:04.053335+0000","last_became_active":"2026-02-13T02:18:58.019415+0000","last_became_peered":"2026-02-13T02:18:58.019415+0000","last_unstale":"2026-02-13T02:19:04.053335+0000","last_undegraded":"2026-02-13T02:19:04.053335+0000","last_fullsized":"2026-02-13T02:19:04.053335+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:33:18.766107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"71'3","reported_seq":19,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:03.045478+0000","last_change":"2026-02-13T02:18:58.017302+0000","last_active":"2026-02-13T02:19:03.045478+0000","last_peered":"2026-02-13T02:19:03.045478+0000","last_clean":"2026-02-13T02:19:03.045478+0000","last_became_active":"2026-02-13T02:18:58.016498+0000","last_became_peered":"2026-02-13T02:18:58.016498+0000","last_unstale":"2026-02-13T02:19:03.045478+0000","last_undegraded":"2026-02-13T02:19:03.045478+0000","last_fullsized":"2026-02-13T02:19:03.045478+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:51:46.201734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026051+0000","last_change":"2026-02-13T02:18:59.021203+0000","last_active":"2026-02-13T02:19:00.026051+0000","last_peered":"2026-02-13T02:19:00.026051+0000","last_clean":"2026-02-13T02:19:00.026051+0000","last_became_active":"2026-02-13T02:18:59.020781+0000","last_became_peered":"2026-02-13T02:18:59.020781+0000","last_unstale":"2026-02-13T02:19:00.026051+0000","last_undegraded":"2026-02-13T02:19:00.026051+0000","last_fullsized":"2026-02-13T02:19:00.026051+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:22:58.765719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"71'3","reported_seq":20,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:05.055986+0000","last_change":"2026-02-13T02:18:58.016151+0000","last_active":"2026-02-13T02:19:05.055986+0000","last_peered":"2026-02-13T02:19:05.055986+0000","last_clean":"2026-02-13T02:19:05.055986+0000","last_became_active":"2026-02-13T02:18:58.015775+0000","last_became_peered":"2026-02-13T02:18:58.015775+0000","last_unstale":"2026-02-13T02:19:05.055986+0000","last_undegraded":"2026-02-13T02:19:05.055986+0000","last_fullsized":"2026-02-13T02:19:05.055986+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:59:25.743829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:01.022817+0000","last_change":"2026-02-13T02:18:59.020334+0000","last_active":"2026-02-13T02:19:01.022817+0000","last_peered":"2026-02-13T02:19:01.022817+0000","last_clean":"2026-02-13T02:19:01.022817+0000","last_became_active":"2026-02-13T02:18:59.020137+0000","last_became_peered":"2026-02-13T02:18:59.020137+0000","last_unstale":"2026-02-13T02:19:01.022817+0000","last_undegraded":"2026-02-13T02:19:01.022817+0000","last_fullsized":"2026-02-13T02:19:01.022817+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:31:43.321951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"71'4","reported_seq":30,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:10.070955+0000","last_change":"2026-02-13T02:18:58.020328+0000","last_active":"2026-02-13T02:19:10.070955+0000","last_peered":"2026-02-13T02:19:10.070955+0000","last_clean":"2026-02-13T02:19:10.070955+0000","last_became_active":"2026-02-13T02:18:58.020172+0000","last_became_peered":"2026-02-13T02:18:58.020172+0000","last_unstale":"2026-02-13T02:19:10.070955+0000","last_undegraded":"2026-02-13T02:19:10.070955+0000","last_fullsized":"2026-02-13T02:19:10.070955+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:38:31.643491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026409+0000","last_change":"2026-02-13T02:18:59.022851+0000","last_active":"2026-02-13T02:19:00.026409+0000","last_peered":"2026-02-13T02:19:00.026409+0000","last_clean":"2026-02-13T02:19:00.026409+0000","last_became_active":"2026-02-13T02:18:59.022669+0000","last_became_peered":"2026-02-13T02:18:59.022669+0000","last_unstale":"2026-02-13T02:19:00.026409+0000","last_undegraded":"2026-02-13T02:19:00.026409+0000","last_fullsized":"2026-02-13T02:19:00.026409+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:51:54.769188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"71'4","reported_seq":20,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:05.059230+0000","last_change":"2026-02-13T02:18:58.018467+0000","last_active":"2026-02-13T02:19:05.059230+0000","last_peered":"2026-02-13T02:19:05.059230+0000","last_clean":"2026-02-13T02:19:05.059230+0000","last_became_active":"2026-02-13T02:18:58.018121+0000","last_became_peered":"2026-02-13T02:18:58.018121+0000","last_unstale":"2026-02-13T02:19:05.059230+0000","last_undegraded":"2026-02-13T02:19:05.059230+0000","last_fullsized":"2026-02-13T02:19:05.059230+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:26:43.250379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:01.086021+0000","last_change":"2026-02-13T02:18:59.022489+0000","last_active":"2026-02-13T02:19:01.086021+0000","last_peered":"2026-02-13T02:19:01.086021+0000","last_clean":"2026-02-13T02:19:01.086021+0000","last_became_active":"2026-02-13T02:18:59.022123+0000","last_became_peered":"2026-02-13T02:18:59.022123+0000","last_unstale":"2026-02-13T02:19:01.086021+0000","last_undegraded":"2026-02-13T02:19:01.086021+0000","last_fullsized":"2026-02-13T02:19:01.086021+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:44:21.124098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"71'5","reported_seq":22,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:04.049593+0000","last_change":"2026-02-13T02:18:58.015339+0000","last_active":"2026-02-13T02:19:04.049593+0000","last_peered":"2026-02-13T02:19:04.049593+0000","last_clean":"2026-02-13T02:19:04.049593+0000","last_became_active":"2026-02-13T02:18:58.015045+0000","last_became_peered":"2026-02-13T02:18:58.015045+0000","last_unstale":"2026-02-13T02:19:04.049593+0000","last_undegraded":"2026-02-13T02:19:04.049593+0000","last_fullsized":"2026-02-13T02:19:04.049593+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:41:53.333544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":694,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026351+0000","last_change":"2026-02-13T02:18:59.024095+0000","last_active":"2026-02-13T02:19:00.026351+0000","last_peered":"2026-02-13T02:19:00.026351+0000","last_clean":"2026-02-13T02:19:00.026351+0000","last_became_active":"2026-02-13T02:18:59.023757+0000","last_became_peered":"2026-02-13T02:18:59.023757+0000","last_unstale":"2026-02-13T02:19:00.026351+0000","last_undegraded":"2026-02-13T02:19:00.026351+0000","last_fullsized":"2026-02-13T02:19:00.026351+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:37:25.170781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"71'24","reported_seq":54,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:10.071930+0000","last_change":"2026-02-13T02:18:58.019442+0000","last_active":"2026-02-13T02:19:10.071930+0000","last_peered":"2026-02-13T02:19:10.071930+0000","last_clean":"2026-02-13T02:19:10.071930+0000","last_became_active":"2026-02-13T02:18:58.019224+0000","last_became_peered":"2026-02-13T02:18:58.019224+0000","last_unstale":"2026-02-13T02:19:10.071930+0000","last_undegraded":"2026-02-13T02:19:10.071930+0000","last_fullsized":"2026-02-13T02:19:10.071930+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:18:16.234056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52844,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":14,"num_read_kb":59,"num_write":26,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.269821+0000","last_change":"2026-02-13T02:18:59.020682+0000","last_active":"2026-02-13T02:19:00.269821+0000","last_peered":"2026-02-13T02:19:00.269821+0000","last_clean":"2026-02-13T02:19:00.269821+0000","last_became_active":"2026-02-13T02:18:59.019992+0000","last_became_peered":"2026-02-13T02:18:59.019992+0000","last_unstale":"2026-02-13T02:19:00.269821+0000","last_undegraded":"2026-02-13T02:19:00.269821+0000","last_fullsized":"2026-02-13T02:19:00.269821+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:26:25.490570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"71'9","reported_seq":27,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:06.064344+0000","last_change":"2026-02-13T02:18:58.017003+0000","last_active":"2026-02-13T02:19:06.064344+0000","last_peered":"2026-02-13T02:19:06.064344+0000","last_clean":"2026-02-13T02:19:06.064344+0000","last_became_active":"2026-02-13T02:18:58.016821+0000","last_became_peered":"2026-02-13T02:18:58.016821+0000","last_unstale":"2026-02-13T02:19:06.064344+0000","last_undegraded":"2026-02-13T02:19:06.064344+0000","last_fullsized":"2026-02-13T02:19:06.064344+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:52:59.197342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.025359+0000","last_change":"2026-02-13T02:18:59.022587+0000","last_active":"2026-02-13T02:19:00.025359+0000","last_peered":"2026-02-13T02:19:00.025359+0000","last_clean":"2026-02-13T02:19:00.025359+0000","last_became_active":"2026-02-13T02:18:59.021700+0000","last_became_peered":"2026-02-13T02:18:59.021700+0000","last_unstale":"2026-02-13T02:19:00.025359+0000","last_undegraded":"2026-02-13T02:19:00.025359+0000","last_fullsized":"2026-02-13T02:19:00.025359+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:25:36.714629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"71'5","reported_seq":22,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:05.056706+0000","last_change":"2026-02-13T02:18:58.016995+0000","last_active":"2026-02-13T02:19:05.056706+0000","last_peered":"2026-02-13T02:19:05.056706+0000","last_clean":"2026-02-13T02:19:05.056706+0000","last_became_active":"2026-02-13T02:18:58.016790+0000","last_became_peered":"2026-02-13T02:18:58.016790+0000","last_unstale":"2026-02-13T02:19:05.056706+0000","last_undegraded":"2026-02-13T02:19:05.056706+0000","last_fullsized":"2026-02-13T02:19:05.056706+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:16:22.317768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026344+0000","last_change":"2026-02-13T02:18:59.023842+0000","last_active":"2026-02-13T02:19:00.026344+0000","last_peered":"2026-02-13T02:19:00.026344+0000","last_clean":"2026-02-13T02:19:00.026344+0000","last_became_active":"2026-02-13T02:18:59.023100+0000","last_became_peered":"2026-02-13T02:18:59.023100+0000","last_unstale":"2026-02-13T02:19:00.026344+0000","last_undegraded":"2026-02-13T02:19:00.026344+0000","last_fullsized":"2026-02-13T02:19:00.026344+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:49:06.786362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"71'6","reported_seq":29,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:09.071334+0000","last_change":"2026-02-13T02:18:58.016750+0000","last_active":"2026-02-13T02:19:09.071334+0000","last_peered":"2026-02-13T02:19:09.071334+0000","last_clean":"2026-02-13T02:19:09.071334+0000","last_became_active":"2026-02-13T02:18:58.016568+0000","last_became_peered":"2026-02-13T02:18:58.016568+0000","last_unstale":"2026-02-13T02:19:09.071334+0000","last_undegraded":"2026-02-13T02:19:09.071334+0000","last_fullsized":"2026-02-13T02:19:09.071334+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:30:56.973436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":998,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":8,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026083+0000","last_change":"2026-02-13T02:18:59.023967+0000","last_active":"2026-02-13T02:19:00.026083+0000","last_peered":"2026-02-13T02:19:00.026083+0000","last_clean":"2026-02-13T02:19:00.026083+0000","last_became_active":"2026-02-13T02:18:59.023488+0000","last_became_peered":"2026-02-13T02:18:59.023488+0000","last_unstale":"2026-02-13T02:19:00.026083+0000","last_undegraded":"2026-02-13T02:19:00.026083+0000","last_fullsized":"2026-02-13T02:19:00.026083+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:22:22.901773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"71'17","reported_seq":34,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:05.056052+0000","last_change":"2026-02-13T02:18:58.017311+0000","last_active":"2026-02-13T02:19:05.056052+0000","last_peered":"2026-02-13T02:19:05.056052+0000","last_clean":"2026-02-13T02:19:05.056052+0000","last_became_active":"2026-02-13T02:18:58.016759+0000","last_became_peered":"2026-02-13T02:18:58.016759+0000","last_unstale":"2026-02-13T02:19:05.056052+0000","last_undegraded":"2026-02-13T02:19:05.056052+0000","last_fullsized":"2026-02-13T02:19:05.056052+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:56:39.432654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:01.059526+0000","last_change":"2026-02-13T02:18:59.021764+0000","last_active":"2026-02-13T02:19:01.059526+0000","last_peered":"2026-02-13T02:19:01.059526+0000","last_clean":"2026-02-13T02:19:01.059526+0000","last_became_active":"2026-02-13T02:18:59.021364+0000","last_became_peered":"2026-02-13T02:18:59.021364+0000","last_unstale":"2026-02-13T02:19:01.059526+0000","last_undegraded":"2026-02-13T02:19:01.059526+0000","last_fullsized":"2026-02-13T02:19:01.059526+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:13:00.776080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"71'2","reported_seq":19,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:05.042750+0000","last_change":"2026-02-13T02:18:58.017465+0000","last_active":"2026-02-13T02:19:05.042750+0000","last_peered":"2026-02-13T02:19:05.042750+0000","last_clean":"2026-02-13T02:19:05.042750+0000","last_became_active":"2026-02-13T02:18:58.016957+0000","last_became_peered":"2026-02-13T02:18:58.016957+0000","last_unstale":"2026-02-13T02:19:05.042750+0000","last_undegraded":"2026-02-13T02:19:05.042750+0000","last_fullsized":"2026-02-13T02:19:05.042750+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:17:33.831136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.022946+0000","last_change":"2026-02-13T02:18:59.020929+0000","last_active":"2026-02-13T02:19:00.022946+0000","last_peered":"2026-02-13T02:19:00.022946+0000","last_clean":"2026-02-13T02:19:00.022946+0000","last_became_active":"2026-02-13T02:18:59.020519+0000","last_became_peered":"2026-02-13T02:18:59.020519+0000","last_unstale":"2026-02-13T02:19:00.022946+0000","last_undegraded":"2026-02-13T02:19:00.022946+0000","last_fullsized":"2026-02-13T02:19:00.022946+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:46:07.242524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"71'5","reported_seq":21,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:05.057217+0000","last_change":"2026-02-13T02:18:58.017516+0000","last_active":"2026-02-13T02:19:05.057217+0000","last_peered":"2026-02-13T02:19:05.057217+0000","last_clean":"2026-02-13T02:19:05.057217+0000","last_became_active":"2026-02-13T02:18:58.017217+0000","last_became_peered":"2026-02-13T02:18:58.017217+0000","last_unstale":"2026-02-13T02:19:05.057217+0000","last_undegraded":"2026-02-13T02:19:05.057217+0000","last_fullsized":"2026-02-13T02:19:05.057217+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:02:32.458073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026497+0000","last_change":"2026-02-13T02:18:59.022648+0000","last_active":"2026-02-13T02:19:00.026497+0000","last_peered":"2026-02-13T02:19:00.026497+0000","last_clean":"2026-02-13T02:19:00.026497+0000","last_became_active":"2026-02-13T02:18:59.022416+0000","last_became_peered":"2026-02-13T02:18:59.022416+0000","last_unstale":"2026-02-13T02:19:00.026497+0000","last_undegraded":"2026-02-13T02:19:00.026497+0000","last_fullsized":"2026-02-13T02:19:00.026497+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:27:43.916972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"71'3","reported_seq":20,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:05.056078+0000","last_change":"2026-02-13T02:18:58.016793+0000","last_active":"2026-02-13T02:19:05.056078+0000","last_peered":"2026-02-13T02:19:05.056078+0000","last_clean":"2026-02-13T02:19:05.056078+0000","last_became_active":"2026-02-13T02:18:58.016440+0000","last_became_peered":"2026-02-13T02:18:58.016440+0000","last_unstale":"2026-02-13T02:19:05.056078+0000","last_undegraded":"2026-02-13T02:19:05.056078+0000","last_fullsized":"2026-02-13T02:19:05.056078+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:50:19.963252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"71'1","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026378+0000","last_change":"2026-02-13T02:18:59.024040+0000","last_active":"2026-02-13T02:19:00.026378+0000","last_peered":"2026-02-13T02:19:00.026378+0000","last_clean":"2026-02-13T02:19:00.026378+0000","last_became_active":"2026-02-13T02:18:59.023539+0000","last_became_peered":"2026-02-13T02:18:59.023539+0000","last_unstale":"2026-02-13T02:19:00.026378+0000","last_undegraded":"2026-02-13T02:19:00.026378+0000","last_fullsized":"2026-02-13T02:19:00.026378+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:04:33.603294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"71'5","reported_seq":28,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:09.070788+0000","last_change":"2026-02-13T02:18:58.015927+0000","last_active":"2026-02-13T02:19:09.070788+0000","last_peered":"2026-02-13T02:19:09.070788+0000","last_clean":"2026-02-13T02:19:09.070788+0000","last_became_active":"2026-02-13T02:18:58.015746+0000","last_became_peered":"2026-02-13T02:18:58.015746+0000","last_unstale":"2026-02-13T02:19:09.070788+0000","last_undegraded":"2026-02-13T02:19:09.070788+0000","last_fullsized":"2026-02-13T02:19:09.070788+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:25:54.397951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1192,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026442+0000","last_change":"2026-02-13T02:18:59.025074+0000","last_active":"2026-02-13T02:19:00.026442+0000","last_peered":"2026-02-13T02:19:00.026442+0000","last_clean":"2026-02-13T02:19:00.026442+0000","last_became_active":"2026-02-13T02:18:59.024633+0000","last_became_peered":"2026-02-13T02:18:59.024633+0000","last_unstale":"2026-02-13T02:19:00.026442+0000","last_undegraded":"2026-02-13T02:19:00.026442+0000","last_fullsized":"2026-02-13T02:19:00.026442+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:39:45.349715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'152","reported_seq":337,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026105+0000","last_change":"2026-02-13T02:18:39.248696+0000","last_active":"2026-02-13T02:19:00.026105+0000","last_peered":"2026-02-13T02:19:00.026105+0000","last_clean":"2026-02-13T02:19:00.026105+0000","last_became_active":"2026-02-13T02:18:39.248579+0000","last_became_peered":"2026-02-13T02:18:39.248579+0000","last_unstale":"2026-02-13T02:19:00.026105+0000","last_undegraded":"2026-02-13T02:19:00.026105+0000","last_fullsized":"2026-02-13T02:19:00.026105+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:17:40.238745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:17:40.238745+0000","last_clean_scrub_stamp":"2026-02-13T02:17:40.238745+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:50:58.102014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"71'6","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:06.067281+0000","last_change":"2026-02-13T02:18:58.017400+0000","last_active":"2026-02-13T02:19:06.067281+0000","last_peered":"2026-02-13T02:19:06.067281+0000","last_clean":"2026-02-13T02:19:06.067281+0000","last_became_active":"2026-02-13T02:18:58.017073+0000","last_became_peered":"2026-02-13T02:18:58.017073+0000","last_unstale":"2026-02-13T02:19:06.067281+0000","last_undegraded":"2026-02-13T02:19:06.067281+0000","last_fullsized":"2026-02-13T02:19:06.067281+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:07:32.354072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026155+0000","last_change":"2026-02-13T02:18:59.022794+0000","last_active":"2026-02-13T02:19:00.026155+0000","last_peered":"2026-02-13T02:19:00.026155+0000","last_clean":"2026-02-13T02:19:00.026155+0000","last_became_active":"2026-02-13T02:18:59.022108+0000","last_became_peered":"2026-02-13T02:18:59.022108+0000","last_unstale":"2026-02-13T02:19:00.026155+0000","last_undegraded":"2026-02-13T02:19:00.026155+0000","last_fullsized":"2026-02-13T02:19:00.026155+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:22:15.433204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"71'4","reported_seq":20,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:03.046718+0000","last_change":"2026-02-13T02:18:58.018751+0000","last_active":"2026-02-13T02:19:03.046718+0000","last_peered":"2026-02-13T02:19:03.046718+0000","last_clean":"2026-02-13T02:19:03.046718+0000","last_became_active":"2026-02-13T02:18:58.018516+0000","last_became_peered":"2026-02-13T02:18:58.018516+0000","last_unstale":"2026-02-13T02:19:03.046718+0000","last_undegraded":"2026-02-13T02:19:03.046718+0000","last_fullsized":"2026-02-13T02:19:03.046718+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:20:45.263014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.025233+0000","last_change":"2026-02-13T02:18:59.023047+0000","last_active":"2026-02-13T02:19:00.025233+0000","last_peered":"2026-02-13T02:19:00.025233+0000","last_clean":"2026-02-13T02:19:00.025233+0000","last_became_active":"2026-02-13T02:18:59.022759+0000","last_became_peered":"2026-02-13T02:18:59.022759+0000","last_unstale":"2026-02-13T02:19:00.025233+0000","last_undegraded":"2026-02-13T02:19:00.025233+0000","last_fullsized":"2026-02-13T02:19:00.025233+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:41:05.253744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"71'5","reported_seq":27,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:09.069170+0000","last_change":"2026-02-13T02:18:58.017745+0000","last_active":"2026-02-13T02:19:09.069170+0000","last_peered":"2026-02-13T02:19:09.069170+0000","last_clean":"2026-02-13T02:19:09.069170+0000","last_became_active":"2026-02-13T02:18:58.017075+0000","last_became_peered":"2026-02-13T02:18:58.017075+0000","last_unstale":"2026-02-13T02:19:09.069170+0000","last_undegraded":"2026-02-13T02:19:09.069170+0000","last_fullsized":"2026-02-13T02:19:09.069170+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:30:40.480682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:01.059608+0000","last_change":"2026-02-13T02:18:59.020766+0000","last_active":"2026-02-13T02:19:01.059608+0000","last_peered":"2026-02-13T02:19:01.059608+0000","last_clean":"2026-02-13T02:19:01.059608+0000","last_became_active":"2026-02-13T02:18:59.020423+0000","last_became_peered":"2026-02-13T02:18:59.020423+0000","last_unstale":"2026-02-13T02:19:01.059608+0000","last_undegraded":"2026-02-13T02:19:01.059608+0000","last_fullsized":"2026-02-13T02:19:01.059608+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:28:14.129049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"71'5","reported_seq":27,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:09.073783+0000","last_change":"2026-02-13T02:18:58.018774+0000","last_active":"2026-02-13T02:19:09.073783+0000","last_peered":"2026-02-13T02:19:09.073783+0000","last_clean":"2026-02-13T02:19:09.073783+0000","last_became_active":"2026-02-13T02:18:58.018494+0000","last_became_peered":"2026-02-13T02:18:58.018494+0000","last_unstale":"2026-02-13T02:19:09.073783+0000","last_undegraded":"2026-02-13T02:19:09.073783+0000","last_fullsized":"2026-02-13T02:19:09.073783+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:54:08.283495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026508+0000","last_change":"2026-02-13T02:18:59.024900+0000","last_active":"2026-02-13T02:19:00.026508+0000","last_peered":"2026-02-13T02:19:00.026508+0000","last_clean":"2026-02-13T02:19:00.026508+0000","last_became_active":"2026-02-13T02:18:59.024012+0000","last_became_peered":"2026-02-13T02:18:59.024012+0000","last_unstale":"2026-02-13T02:19:00.026508+0000","last_undegraded":"2026-02-13T02:19:00.026508+0000","last_fullsized":"2026-02-13T02:19:00.026508+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:30:24.252966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"71'1","reported_seq":17,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:01.022784+0000","last_change":"2026-02-13T02:18:58.018004+0000","last_active":"2026-02-13T02:19:01.022784+0000","last_peered":"2026-02-13T02:19:01.022784+0000","last_clean":"2026-02-13T02:19:01.022784+0000","last_became_active":"2026-02-13T02:18:58.017319+0000","last_became_peered":"2026-02-13T02:18:58.017319+0000","last_unstale":"2026-02-13T02:19:01.022784+0000","last_undegraded":"2026-02-13T02:19:01.022784+0000","last_fullsized":"2026-02-13T02:19:01.022784+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:26:29.965359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"71'1","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:01.037590+0000","last_change":"2026-02-13T02:18:59.025358+0000","last_active":"2026-02-13T02:19:01.037590+0000","last_peered":"2026-02-13T02:19:01.037590+0000","last_clean":"2026-02-13T02:19:01.037590+0000","last_became_active":"2026-02-13T02:18:59.024743+0000","last_became_peered":"2026-02-13T02:18:59.024743+0000","last_unstale":"2026-02-13T02:19:01.037590+0000","last_undegraded":"2026-02-13T02:19:01.037590+0000","last_fullsized":"2026-02-13T02:19:01.037590+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:05:43.480846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"71'4","reported_seq":21,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:05.056604+0000","last_change":"2026-02-13T02:18:58.017585+0000","last_active":"2026-02-13T02:19:05.056604+0000","last_peered":"2026-02-13T02:19:05.056604+0000","last_clean":"2026-02-13T02:19:05.056604+0000","last_became_active":"2026-02-13T02:18:58.017323+0000","last_became_peered":"2026-02-13T02:18:58.017323+0000","last_unstale":"2026-02-13T02:19:05.056604+0000","last_undegraded":"2026-02-13T02:19:05.056604+0000","last_fullsized":"2026-02-13T02:19:05.056604+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:25:25.624809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.025394+0000","last_change":"2026-02-13T02:18:59.020945+0000","last_active":"2026-02-13T02:19:00.025394+0000","last_peered":"2026-02-13T02:19:00.025394+0000","last_clean":"2026-02-13T02:19:00.025394+0000","last_became_active":"2026-02-13T02:18:59.020719+0000","last_became_peered":"2026-02-13T02:18:59.020719+0000","last_unstale":"2026-02-13T02:19:00.025394+0000","last_undegraded":"2026-02-13T02:19:00.025394+0000","last_fullsized":"2026-02-13T02:19:00.025394+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:13:20.283266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"71'10","reported_seq":26,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:07.022623+0000","last_change":"2026-02-13T02:18:58.018055+0000","last_active":"2026-02-13T02:19:07.022623+0000","last_peered":"2026-02-13T02:19:07.022623+0000","last_clean":"2026-02-13T02:19:07.022623+0000","last_became_active":"2026-02-13T02:18:58.017824+0000","last_became_peered":"2026-02-13T02:18:58.017824+0000","last_unstale":"2026-02-13T02:19:07.022623+0000","last_undegraded":"2026-02-13T02:19:07.022623+0000","last_fullsized":"2026-02-13T02:19:07.022623+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:00:19.476969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026322+0000","last_change":"2026-02-13T02:18:59.021532+0000","last_active":"2026-02-13T02:19:00.026322+0000","last_peered":"2026-02-13T02:19:00.026322+0000","last_clean":"2026-02-13T02:19:00.026322+0000","last_became_active":"2026-02-13T02:18:59.020792+0000","last_became_peered":"2026-02-13T02:18:59.020792+0000","last_unstale":"2026-02-13T02:19:00.026322+0000","last_undegraded":"2026-02-13T02:19:00.026322+0000","last_fullsized":"2026-02-13T02:19:00.026322+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:55:45.772056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"71'7","reported_seq":24,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:05.059314+0000","last_change":"2026-02-13T02:18:58.017322+0000","last_active":"2026-02-13T02:19:05.059314+0000","last_peered":"2026-02-13T02:19:05.059314+0000","last_clean":"2026-02-13T02:19:05.059314+0000","last_became_active":"2026-02-13T02:18:58.017078+0000","last_became_peered":"2026-02-13T02:18:58.017078+0000","last_unstale":"2026-02-13T02:19:05.059314+0000","last_undegraded":"2026-02-13T02:19:05.059314+0000","last_fullsized":"2026-02-13T02:19:05.059314+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:38:36.066817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:01.085941+0000","last_change":"2026-02-13T02:18:59.023478+0000","last_active":"2026-02-13T02:19:01.085941+0000","last_peered":"2026-02-13T02:19:01.085941+0000","last_clean":"2026-02-13T02:19:01.085941+0000","last_became_active":"2026-02-13T02:18:59.023251+0000","last_became_peered":"2026-02-13T02:18:59.023251+0000","last_unstale":"2026-02-13T02:19:01.085941+0000","last_undegraded":"2026-02-13T02:19:01.085941+0000","last_fullsized":"2026-02-13T02:19:01.085941+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:46:43.414532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"71'2","reported_seq":18,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:02.042384+0000","last_change":"2026-02-13T02:18:58.018029+0000","last_active":"2026-02-13T02:19:02.042384+0000","last_peered":"2026-02-13T02:19:02.042384+0000","last_clean":"2026-02-13T02:19:02.042384+0000","last_became_active":"2026-02-13T02:18:58.017853+0000","last_became_peered":"2026-02-13T02:18:58.017853+0000","last_unstale":"2026-02-13T02:19:02.042384+0000","last_undegraded":"2026-02-13T02:19:02.042384+0000","last_fullsized":"2026-02-13T02:19:02.042384+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:42:13.248907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.269489+0000","last_change":"2026-02-13T02:18:59.021333+0000","last_active":"2026-02-13T02:19:00.269489+0000","last_peered":"2026-02-13T02:19:00.269489+0000","last_clean":"2026-02-13T02:19:00.269489+0000","last_became_active":"2026-02-13T02:18:59.020957+0000","last_became_peered":"2026-02-13T02:18:59.020957+0000","last_unstale":"2026-02-13T02:19:00.269489+0000","last_undegraded":"2026-02-13T02:19:00.269489+0000","last_fullsized":"2026-02-13T02:19:00.269489+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:03:43.534623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"71'7","reported_seq":23,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:05.057144+0000","last_change":"2026-02-13T02:18:58.018621+0000","last_active":"2026-02-13T02:19:05.057144+0000","last_peered":"2026-02-13T02:19:05.057144+0000","last_clean":"2026-02-13T02:19:05.057144+0000","last_became_active":"2026-02-13T02:18:58.018470+0000","last_became_peered":"2026-02-13T02:18:58.018470+0000","last_unstale":"2026-02-13T02:19:05.057144+0000","last_undegraded":"2026-02-13T02:19:05.057144+0000","last_fullsized":"2026-02-13T02:19:05.057144+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:23:51.053480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.023004+0000","last_change":"2026-02-13T02:18:59.020330+0000","last_active":"2026-02-13T02:19:00.023004+0000","last_peered":"2026-02-13T02:19:00.023004+0000","last_clean":"2026-02-13T02:19:00.023004+0000","last_became_active":"2026-02-13T02:18:59.020032+0000","last_became_peered":"2026-02-13T02:18:59.020032+0000","last_unstale":"2026-02-13T02:19:00.023004+0000","last_undegraded":"2026-02-13T02:19:00.023004+0000","last_fullsized":"2026-02-13T02:19:00.023004+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:53:04.758527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"71'3","reported_seq":19,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:04.049544+0000","last_change":"2026-02-13T02:18:58.017473+0000","last_active":"2026-02-13T02:19:04.049544+0000","last_peered":"2026-02-13T02:19:04.049544+0000","last_clean":"2026-02-13T02:19:04.049544+0000","last_became_active":"2026-02-13T02:18:58.017315+0000","last_became_peered":"2026-02-13T02:18:58.017315+0000","last_unstale":"2026-02-13T02:19:04.049544+0000","last_undegraded":"2026-02-13T02:19:04.049544+0000","last_fullsized":"2026-02-13T02:19:04.049544+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:25:15.481559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026238+0000","last_change":"2026-02-13T02:18:59.023576+0000","last_active":"2026-02-13T02:19:00.026238+0000","last_peered":"2026-02-13T02:19:00.026238+0000","last_clean":"2026-02-13T02:19:00.026238+0000","last_became_active":"2026-02-13T02:18:59.022528+0000","last_became_peered":"2026-02-13T02:18:59.022528+0000","last_unstale":"2026-02-13T02:19:00.026238+0000","last_undegraded":"2026-02-13T02:19:00.026238+0000","last_fullsized":"2026-02-13T02:19:00.026238+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:14:20.280447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"71'4","reported_seq":21,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:02.040196+0000","last_change":"2026-02-13T02:18:58.017265+0000","last_active":"2026-02-13T02:19:02.040196+0000","last_peered":"2026-02-13T02:19:02.040196+0000","last_clean":"2026-02-13T02:19:02.040196+0000","last_became_active":"2026-02-13T02:18:58.016951+0000","last_became_peered":"2026-02-13T02:18:58.016951+0000","last_unstale":"2026-02-13T02:19:02.040196+0000","last_undegraded":"2026-02-13T02:19:02.040196+0000","last_fullsized":"2026-02-13T02:19:02.040196+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:50:01.682853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026205+0000","last_change":"2026-02-13T02:18:59.022425+0000","last_active":"2026-02-13T02:19:00.026205+0000","last_peered":"2026-02-13T02:19:00.026205+0000","last_clean":"2026-02-13T02:19:00.026205+0000","last_became_active":"2026-02-13T02:18:59.022229+0000","last_became_peered":"2026-02-13T02:18:59.022229+0000","last_unstale":"2026-02-13T02:19:00.026205+0000","last_undegraded":"2026-02-13T02:19:00.026205+0000","last_fullsized":"2026-02-13T02:19:00.026205+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:46:02.938928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:01.059766+0000","last_change":"2026-02-13T02:18:59.022165+0000","last_active":"2026-02-13T02:19:01.059766+0000","last_peered":"2026-02-13T02:19:01.059766+0000","last_clean":"2026-02-13T02:19:01.059766+0000","last_became_active":"2026-02-13T02:18:59.021833+0000","last_became_peered":"2026-02-13T02:18:59.021833+0000","last_unstale":"2026-02-13T02:19:01.059766+0000","last_undegraded":"2026-02-13T02:19:01.059766+0000","last_fullsized":"2026-02-13T02:19:01.059766+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:37:51.478861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"71'5","reported_seq":22,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:05.056744+0000","last_change":"2026-02-13T02:18:58.016572+0000","last_active":"2026-02-13T02:19:05.056744+0000","last_peered":"2026-02-13T02:19:05.056744+0000","last_clean":"2026-02-13T02:19:05.056744+0000","last_became_active":"2026-02-13T02:18:58.016013+0000","last_became_peered":"2026-02-13T02:18:58.016013+0000","last_unstale":"2026-02-13T02:19:05.056744+0000","last_undegraded":"2026-02-13T02:19:05.056744+0000","last_fullsized":"2026-02-13T02:19:05.056744+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:07:58.232144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026287+0000","last_change":"2026-02-13T02:18:59.022737+0000","last_active":"2026-02-13T02:19:00.026287+0000","last_peered":"2026-02-13T02:19:00.026287+0000","last_clean":"2026-02-13T02:19:00.026287+0000","last_became_active":"2026-02-13T02:18:59.022601+0000","last_became_peered":"2026-02-13T02:18:59.022601+0000","last_unstale":"2026-02-13T02:19:00.026287+0000","last_undegraded":"2026-02-13T02:19:00.026287+0000","last_fullsized":"2026-02-13T02:19:00.026287+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:08:39.591613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"71'12","reported_seq":29,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:06.066169+0000","last_change":"2026-02-13T02:18:58.016288+0000","last_active":"2026-02-13T02:19:06.066169+0000","last_peered":"2026-02-13T02:19:06.066169+0000","last_clean":"2026-02-13T02:19:06.066169+0000","last_became_active":"2026-02-13T02:18:58.015859+0000","last_became_peered":"2026-02-13T02:18:58.015859+0000","last_unstale":"2026-02-13T02:19:06.066169+0000","last_undegraded":"2026-02-13T02:19:06.066169+0000","last_fullsized":"2026-02-13T02:19:06.066169+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:23:12.911321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:01.085995+0000","last_change":"2026-02-13T02:18:59.022151+0000","last_active":"2026-02-13T02:19:01.085995+0000","last_peered":"2026-02-13T02:19:01.085995+0000","last_clean":"2026-02-13T02:19:01.085995+0000","last_became_active":"2026-02-13T02:18:59.021969+0000","last_became_peered":"2026-02-13T02:18:59.021969+0000","last_unstale":"2026-02-13T02:19:01.085995+0000","last_undegraded":"2026-02-13T02:19:01.085995+0000","last_fullsized":"2026-02-13T02:19:01.085995+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:58:12.160164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"71'2","reported_seq":18,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.545301+0000","last_change":"2026-02-13T02:18:58.018388+0000","last_active":"2026-02-13T02:19:00.545301+0000","last_peered":"2026-02-13T02:19:00.545301+0000","last_clean":"2026-02-13T02:19:00.545301+0000","last_became_active":"2026-02-13T02:18:58.018186+0000","last_became_peered":"2026-02-13T02:18:58.018186+0000","last_unstale":"2026-02-13T02:19:00.545301+0000","last_undegraded":"2026-02-13T02:19:00.545301+0000","last_fullsized":"2026-02-13T02:19:00.545301+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:26:19.032391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026257+0000","last_change":"2026-02-13T02:18:59.021699+0000","last_active":"2026-02-13T02:19:00.026257+0000","last_peered":"2026-02-13T02:19:00.026257+0000","last_clean":"2026-02-13T02:19:00.026257+0000","last_became_active":"2026-02-13T02:18:59.021479+0000","last_became_peered":"2026-02-13T02:18:59.021479+0000","last_unstale":"2026-02-13T02:19:00.026257+0000","last_undegraded":"2026-02-13T02:19:00.026257+0000","last_fullsized":"2026-02-13T02:19:00.026257+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:26:34.039117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"71'13","reported_seq":35,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:09.071624+0000","last_change":"2026-02-13T02:18:58.017925+0000","last_active":"2026-02-13T02:19:09.071624+0000","last_peered":"2026-02-13T02:19:09.071624+0000","last_clean":"2026-02-13T02:19:09.071624+0000","last_became_active":"2026-02-13T02:18:58.017527+0000","last_became_peered":"2026-02-13T02:18:58.017527+0000","last_unstale":"2026-02-13T02:19:09.071624+0000","last_undegraded":"2026-02-13T02:19:09.071624+0000","last_fullsized":"2026-02-13T02:19:09.071624+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:30:09.132332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":694,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":59786,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":84,"num_read_kb":109,"num_write":226,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":540672,"data_stored":179358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":179894,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":66,"seq":283467841544,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27716,"kb_used_data":752,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":733975484,"statfs":{"total":751619276800,"available":751590895616,"internally_reserved":0,"allocated":770048,"data_stored":365317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9465,"internal_metadata":27581191},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":59,"seq":253403070472,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28392,"kb_used_data":1428,"kb_used_omap":34,"kb_used_meta":26909,"kb_avail":733974808,"statfs":{"total":751619276800,"available":751590203392,"internally_reserved":0,"allocated":1462272,"data_stored":1009600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":35780,"internal_metadata":27554876},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":56,"seq":240518168587,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27740,"kb_used_data":776,"kb_used_omap":30,"kb_used_meta":26913,"kb_avail":733975460,"statfs":{"total":751619276800,"available":751590871040,"internally_reserved":0,"allocated":794624,"data_stored":365247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31730,"internal_metadata":27558926},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":49,"seq":210453397516,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27736,"kb_used_data":772,"kb_used_omap":34,"kb_used_meta":26909,"kb_avail":733975464,"statfs":{"total":751619276800,"available":751590875136,"internally_reserved":0,"allocated":790528,"data_stored":365647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":34997,"internal_metadata":27555659},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":42,"seq":180388626445,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28320,"kb_used_data":1356,"kb_used_omap":34,"kb_used_meta":26909,"kb_avail":733974880,"statfs":{"total":751619276800,"available":751590277120,"internally_reserved":0,"allocated":1388544,"data_stored":958184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":35183,"internal_metadata":27555473},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":39,"seq":167503724559,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27724,"kb_used_data":760,"kb_used_omap":22,"kb_used_meta":26921,"kb_avail":733975476,"statfs":{"total":751619276800,"available":751590887424,"internally_reserved":0,"allocated":778240,"data_stored":364942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22674,"internal_metadata":27567982},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":32,"seq":137438953489,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28332,"kb_used_data":1368,"kb_used_omap":28,"kb_used_meta":26915,"kb_avail":733974868,"statfs":{"total":751619276800,"available":751590264832,"internally_reserved":0,"allocated":1400832,"data_stored":957474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28878,"internal_metadata":27561778},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":28,"seq":120259084306,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27724,"kb_used_data":760,"kb_used_omap":44,"kb_used_meta":26899,"kb_avail":733975476,"statfs":{"total":751619276800,"available":751590887424,"internally_reserved":0,"allocated":778240,"data_stored":365213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":45156,"internal_metadata":27545500},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":21,"seq":90194313236,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27740,"kb_used_data":776,"kb_used_omap":46,"kb_used_meta":26897,"kb_avail":733975460,"statfs":{"total":751619276800,"available":751590871040,"internally_reserved":0,"allocated":794624,"data_stored":364767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47114,"internal_metadata":27543542},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542165,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27796,"kb_used_data":832,"kb_used_omap":59,"kb_used_meta":26884,"kb_avail":733975404,"statfs":{"total":751619276800,"available":751590813696,"internally_reserved":0,"allocated":851968,"data_stored":418941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":60875,"internal_metadata":27529781},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672981,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27776,"kb_used_data":812,"kb_used_omap":43,"kb_used_meta":26900,"kb_avail":733975424,"statfs":{"total":751619276800,"available":751590834176,"internally_reserved":0,"allocated":831488,"data_stored":418743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":45022,"internal_metadata":27545634},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":7,"seq":30064771095,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27744,"kb_used_data":780,"kb_used_omap":53,"kb_used_meta":26890,"kb_avail":733975456,"statfs":{"total":751619276800,"available":751590866944,"internally_reserved":0,"allocated":798720,"data_stored":366325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":54302,"internal_metadata":27536354},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10960,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":54640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3996,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":54838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10596,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":26521,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12438,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7102,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10745,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17629,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":33293,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22947,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":55012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20517,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3150,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-13T02:19:11.800 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph pg dump --format=json 2026-02-13T02:19:11.956 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:19:12.068 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.064+0000 7fc8db97b6c0 1 -- 10.20.193.11:0/2147566197 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fc8d4115410 msgr2=0x7fc8d4175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:12.068 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.064+0000 7fc8db97b6c0 1 --2- 10.20.193.11:0/2147566197 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fc8d4115410 0x7fc8d4175db0 secure :-1 s=READY pgs=291 gs=1 cs=0 l=1 c_cookie=13957491314608805966 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc8d000aa70 tx=0x7fc8d002fde0 comp rx=0 tx=0).stop 2026-02-13T02:19:12.069 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.064+0000 7fc8db97b6c0 1 -- 10.20.193.11:0/2147566197 shutdown_connections 2026-02-13T02:19:12.069 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.064+0000 7fc8db97b6c0 1 --2- 10.20.193.11:0/2147566197 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fc8d410fbf0 0x7fc8d4114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:12.069 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.064+0000 7fc8db97b6c0 1 --2- 10.20.193.11:0/2147566197 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fc8d4115410 0x7fc8d4175db0 unknown :-1 s=CLOSED pgs=291 gs=1 cs=0 l=1 c_cookie=13957491314608805966 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:12.069 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.064+0000 7fc8db97b6c0 1 --2- 10.20.193.11:0/2147566197 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fc8d410f200 0x7fc8d410f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:12.069 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.064+0000 7fc8db97b6c0 1 -- 10.20.193.11:0/2147566197 >> 10.20.193.11:0/2147566197 conn(0x7fc8d40ecb00 msgr2=0x7fc8d410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:12.069 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.064+0000 7fc8db97b6c0 1 -- 10.20.193.11:0/2147566197 shutdown_connections 2026-02-13T02:19:12.069 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.064+0000 7fc8db97b6c0 1 -- 10.20.193.11:0/2147566197 wait complete. 2026-02-13T02:19:12.069 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.065+0000 7fc8db97b6c0 1 Processor -- start 2026-02-13T02:19:12.069 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.065+0000 7fc8db97b6c0 1 -- start start 2026-02-13T02:19:12.070 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.065+0000 7fc8db97b6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fc8d410f200 0x7fc8d411d1f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:12.070 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.065+0000 7fc8db97b6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fc8d4115410 0x7fc8d411d730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:12.070 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.065+0000 7fc8db97b6c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fc8d4122af0 0x7fc8d4122f90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:12.070 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.065+0000 7fc8db97b6c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7fc8d4123500 con 0x7fc8d410f200 2026-02-13T02:19:12.070 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.065+0000 7fc8db97b6c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc8d4123670 con 0x7fc8d4122af0 2026-02-13T02:19:12.070 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.065+0000 7fc8db97b6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc8d4123830 con 0x7fc8d4115410 2026-02-13T02:19:12.070 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.065+0000 7fc8d96ec6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fc8d410f200 0x7fc8d411d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:12.070 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.065+0000 7fc8d96ec6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fc8d410f200 0x7fc8d411d1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:38264/0 (socket says 10.20.193.11:38264) 2026-02-13T02:19:12.070 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.065+0000 7fc8d96ec6c0 1 -- 10.20.193.11:0/1472562332 learned_addr learned my addr 10.20.193.11:0/1472562332 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:19:12.070 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.065+0000 7fc8d8eeb6c0 1 --2- 10.20.193.11:0/1472562332 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fc8d4115410 0x7fc8d411d730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:12.070 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.065+0000 7fc8d96ec6c0 1 -- 10.20.193.11:0/1472562332 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fc8d4115410 msgr2=0x7fc8d411d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:12.071 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.065+0000 7fc8d96ec6c0 1 --2- 10.20.193.11:0/1472562332 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fc8d4115410 0x7fc8d411d730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:12.071 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.065+0000 7fc8d9eed6c0 1 --2- 10.20.193.11:0/1472562332 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fc8d4122af0 0x7fc8d4122f90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:12.071 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.065+0000 7fc8d96ec6c0 1 -- 10.20.193.11:0/1472562332 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fc8d4122af0 msgr2=0x7fc8d4122f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:12.071 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.065+0000 7fc8d96ec6c0 1 --2- 10.20.193.11:0/1472562332 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fc8d4122af0 0x7fc8d4122f90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:12.071 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.065+0000 7fc8d96ec6c0 1 -- 10.20.193.11:0/1472562332 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8d000a660 con 0x7fc8d410f200 2026-02-13T02:19:12.071 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.065+0000 7fc8d8eeb6c0 1 --2- 10.20.193.11:0/1472562332 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fc8d4115410 0x7fc8d411d730 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:19:12.071 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.065+0000 7fc8d9eed6c0 1 --2- 10.20.193.11:0/1472562332 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fc8d4122af0 0x7fc8d4122f90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:19:12.071 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.065+0000 7fc8d96ec6c0 1 --2- 10.20.193.11:0/1472562332 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fc8d410f200 0x7fc8d411d1f0 secure :-1 s=READY pgs=292 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc8c4005dc0 tx=0x7fc8c400bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:12.071 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.065+0000 7fc8c27fc6c0 1 -- 10.20.193.11:0/1472562332 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc8c4004250 con 0x7fc8d410f200 2026-02-13T02:19:12.071 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.065+0000 7fc8db97b6c0 1 -- 10.20.193.11:0/1472562332 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8d4163ce0 con 0x7fc8d410f200 2026-02-13T02:19:12.071 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.065+0000 7fc8c27fc6c0 1 -- 10.20.193.11:0/1472562332 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fc8c4009070 con 0x7fc8d410f200 2026-02-13T02:19:12.072 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.065+0000 7fc8c27fc6c0 1 -- 10.20.193.11:0/1472562332 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc8c400cde0 con 0x7fc8d410f200 2026-02-13T02:19:12.072 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.065+0000 7fc8db97b6c0 1 -- 10.20.193.11:0/1472562332 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8d4164170 con 0x7fc8d410f200 2026-02-13T02:19:12.072 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.066+0000 7fc8db97b6c0 1 -- 10.20.193.11:0/1472562332 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8d41104d0 con 0x7fc8d410f200 2026-02-13T02:19:12.073 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.067+0000 7fc8c27fc6c0 1 -- 10.20.193.11:0/1472562332 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7fc8c40028c0 con 0x7fc8d410f200 2026-02-13T02:19:12.073 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.067+0000 7fc8c27fc6c0 1 --2- 10.20.193.11:0/1472562332 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fc8b00b5690 0x7fc8b00d5b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:12.073 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.067+0000 7fc8c27fc6c0 1 -- 10.20.193.11:0/1472562332 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7762+0+0 (secure 0 0 0) 0x7fc8c40e3ba0 con 0x7fc8d410f200 2026-02-13T02:19:12.073 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.067+0000 7fc8d8eeb6c0 1 --2- 10.20.193.11:0/1472562332 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fc8b00b5690 0x7fc8b00d5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:12.073 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.068+0000 7fc8c27fc6c0 1 -- 10.20.193.11:0/1472562332 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fc8c40a65c0 con 0x7fc8d410f200 2026-02-13T02:19:12.073 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.068+0000 7fc8d8eeb6c0 1 --2- 10.20.193.11:0/1472562332 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fc8b00b5690 0x7fc8b00d5b40 secure :-1 s=READY pgs=208 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc8c8005fd0 tx=0x7fc8c8005d50 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:12.158 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.156+0000 7fc8db97b6c0 1 -- 10.20.193.11:0/1472562332 --> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc8d411e340 con 0x7fc8b00b5690 2026-02-13T02:19:12.159 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:12 trial011 ceph-mon[11956]: pgmap v190: 97 pgs: 97 active+clean; 635 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 10 KiB/s rd, 12 KiB/s wr, 28 op/s 2026-02-13T02:19:12.159 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:12 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/703108575' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2026-02-13T02:19:12.159 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:12 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/4161908006' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2026-02-13T02:19:12.159 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:12 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/176805436' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2026-02-13T02:19:12.159 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:12 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/2247458172' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2026-02-13T02:19:12.159 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:12 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/3323114477' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2026-02-13T02:19:12.159 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:12 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/2252238137' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2026-02-13T02:19:12.159 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:12 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/530309646' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2026-02-13T02:19:12.160 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:12 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/2810223595' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2026-02-13T02:19:12.160 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:12 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/2152226122' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-13T02:19:12.160 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:12 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/2095418547' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2026-02-13T02:19:12.160 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:12 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/1589920223' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2026-02-13T02:19:12.160 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:12 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/4189343092' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2026-02-13T02:19:12.161 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.158+0000 7fc8c27fc6c0 1 -- 10.20.193.11:0/1472562332 <== mgr.14116 v2:10.20.193.11:6800/861334768 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258862 (secure 0 0 0) 0x7fc8d411e340 con 0x7fc8b00b5690 2026-02-13T02:19:12.163 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:19:12.165 INFO:teuthology.orchestra.run.trial011.stderr:dumped all 2026-02-13T02:19:12.166 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.160+0000 7fc8db97b6c0 1 -- 10.20.193.11:0/1472562332 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fc8b00b5690 msgr2=0x7fc8b00d5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:12.167 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.160+0000 7fc8db97b6c0 1 --2- 10.20.193.11:0/1472562332 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fc8b00b5690 0x7fc8b00d5b40 secure :-1 s=READY pgs=208 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc8c8005fd0 tx=0x7fc8c8005d50 comp rx=0 tx=0).stop 2026-02-13T02:19:12.167 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.160+0000 7fc8db97b6c0 1 -- 10.20.193.11:0/1472562332 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fc8d410f200 msgr2=0x7fc8d411d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:12.167 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.160+0000 7fc8db97b6c0 1 --2- 10.20.193.11:0/1472562332 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fc8d410f200 0x7fc8d411d1f0 secure :-1 s=READY pgs=292 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc8c4005dc0 tx=0x7fc8c400bbb0 comp rx=0 tx=0).stop 2026-02-13T02:19:12.167 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.160+0000 7fc8db97b6c0 1 -- 10.20.193.11:0/1472562332 shutdown_connections 2026-02-13T02:19:12.167 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.160+0000 7fc8db97b6c0 1 --2- 10.20.193.11:0/1472562332 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fc8b00b5690 0x7fc8b00d5b40 unknown :-1 s=CLOSED pgs=208 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:12.167 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.160+0000 7fc8db97b6c0 1 --2- 10.20.193.11:0/1472562332 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fc8d4122af0 0x7fc8d4122f90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:12.167 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.160+0000 7fc8db97b6c0 1 --2- 10.20.193.11:0/1472562332 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fc8d4115410 0x7fc8d411d730 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:12.167 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.160+0000 7fc8db97b6c0 1 --2- 10.20.193.11:0/1472562332 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fc8d410f200 0x7fc8d411d1f0 unknown :-1 s=CLOSED pgs=292 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:12.167 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.160+0000 7fc8db97b6c0 1 -- 10.20.193.11:0/1472562332 >> 10.20.193.11:0/1472562332 conn(0x7fc8d40ecb00 msgr2=0x7fc8d410cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:12.167 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.160+0000 7fc8db97b6c0 1 -- 10.20.193.11:0/1472562332 shutdown_connections 2026-02-13T02:19:12.168 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.160+0000 7fc8db97b6c0 1 -- 10.20.193.11:0/1472562332 wait complete. 2026-02-13T02:19:12.201 INFO:teuthology.orchestra.run.trial011.stdout:{"pg_ready":true,"pg_map":{"version":190,"stamp":"2026-02-13T02:19:10.947128+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":650388,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":190,"num_read_kb":200,"num_write":417,"num_write_kb":3846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":351,"ondisk_log_size":351,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":8808038400,"kb_used":334740,"kb_used_data":11172,"kb_used_omap":440,"kb_used_meta":322887,"kb_avail":8807703660,"statfs":{"total":9019431321600,"available":9019088547840,"internally_reserved":0,"allocated":11440128,"data_stored":6320400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":451176,"internal_metadata":330636696},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":59860,"num_objects":97,"num_object_clones":0,"num_object_copies":291,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":97,"num_whiteouts":0,"num_read":84,"num_read_kb":109,"num_write":223,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":65,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.922822"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.023100+0000","last_change":"2026-02-13T02:18:59.021168+0000","last_active":"2026-02-13T02:19:00.023100+0000","last_peered":"2026-02-13T02:19:00.023100+0000","last_clean":"2026-02-13T02:19:00.023100+0000","last_became_active":"2026-02-13T02:18:59.020969+0000","last_became_peered":"2026-02-13T02:18:59.020969+0000","last_unstale":"2026-02-13T02:19:00.023100+0000","last_undegraded":"2026-02-13T02:19:00.023100+0000","last_fullsized":"2026-02-13T02:19:00.023100+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:15:33.793511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:01.085894+0000","last_change":"2026-02-13T02:18:59.021361+0000","last_active":"2026-02-13T02:19:01.085894+0000","last_peered":"2026-02-13T02:19:01.085894+0000","last_clean":"2026-02-13T02:19:01.085894+0000","last_became_active":"2026-02-13T02:18:59.021114+0000","last_became_peered":"2026-02-13T02:18:59.021114+0000","last_unstale":"2026-02-13T02:19:01.085894+0000","last_undegraded":"2026-02-13T02:19:01.085894+0000","last_fullsized":"2026-02-13T02:19:01.085894+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:17:48.819148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:01.085816+0000","last_change":"2026-02-13T02:18:59.022954+0000","last_active":"2026-02-13T02:19:01.085816+0000","last_peered":"2026-02-13T02:19:01.085816+0000","last_clean":"2026-02-13T02:19:01.085816+0000","last_became_active":"2026-02-13T02:18:59.022582+0000","last_became_peered":"2026-02-13T02:18:59.022582+0000","last_unstale":"2026-02-13T02:19:01.085816+0000","last_undegraded":"2026-02-13T02:19:01.085816+0000","last_fullsized":"2026-02-13T02:19:01.085816+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:34:51.801255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.398301+0000","last_change":"2026-02-13T02:18:59.022389+0000","last_active":"2026-02-13T02:19:00.398301+0000","last_peered":"2026-02-13T02:19:00.398301+0000","last_clean":"2026-02-13T02:19:00.398301+0000","last_became_active":"2026-02-13T02:18:59.022176+0000","last_became_peered":"2026-02-13T02:18:59.022176+0000","last_unstale":"2026-02-13T02:19:00.398301+0000","last_undegraded":"2026-02-13T02:19:00.398301+0000","last_fullsized":"2026-02-13T02:19:00.398301+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:46:51.207583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.269641+0000","last_change":"2026-02-13T02:18:59.021747+0000","last_active":"2026-02-13T02:19:00.269641+0000","last_peered":"2026-02-13T02:19:00.269641+0000","last_clean":"2026-02-13T02:19:00.269641+0000","last_became_active":"2026-02-13T02:18:59.021407+0000","last_became_peered":"2026-02-13T02:18:59.021407+0000","last_unstale":"2026-02-13T02:19:00.269641+0000","last_undegraded":"2026-02-13T02:19:00.269641+0000","last_fullsized":"2026-02-13T02:19:00.269641+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:39:47.768337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026389+0000","last_change":"2026-02-13T02:18:59.022054+0000","last_active":"2026-02-13T02:19:00.026389+0000","last_peered":"2026-02-13T02:19:00.026389+0000","last_clean":"2026-02-13T02:19:00.026389+0000","last_became_active":"2026-02-13T02:18:59.021802+0000","last_became_peered":"2026-02-13T02:18:59.021802+0000","last_unstale":"2026-02-13T02:19:00.026389+0000","last_undegraded":"2026-02-13T02:19:00.026389+0000","last_fullsized":"2026-02-13T02:19:00.026389+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:49:10.152281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026097+0000","last_change":"2026-02-13T02:18:59.023580+0000","last_active":"2026-02-13T02:19:00.026097+0000","last_peered":"2026-02-13T02:19:00.026097+0000","last_clean":"2026-02-13T02:19:00.026097+0000","last_became_active":"2026-02-13T02:18:59.023348+0000","last_became_peered":"2026-02-13T02:18:59.023348+0000","last_unstale":"2026-02-13T02:19:00.026097+0000","last_undegraded":"2026-02-13T02:19:00.026097+0000","last_fullsized":"2026-02-13T02:19:00.026097+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:21:20.473098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.025858+0000","last_change":"2026-02-13T02:18:59.023105+0000","last_active":"2026-02-13T02:19:00.025858+0000","last_peered":"2026-02-13T02:19:00.025858+0000","last_clean":"2026-02-13T02:19:00.025858+0000","last_became_active":"2026-02-13T02:18:59.022960+0000","last_became_peered":"2026-02-13T02:18:59.022960+0000","last_unstale":"2026-02-13T02:19:00.025858+0000","last_undegraded":"2026-02-13T02:19:00.025858+0000","last_fullsized":"2026-02-13T02:19:00.025858+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:04:13.537414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026452+0000","last_change":"2026-02-13T02:18:59.025487+0000","last_active":"2026-02-13T02:19:00.026452+0000","last_peered":"2026-02-13T02:19:00.026452+0000","last_clean":"2026-02-13T02:19:00.026452+0000","last_became_active":"2026-02-13T02:18:59.025162+0000","last_became_peered":"2026-02-13T02:18:59.025162+0000","last_unstale":"2026-02-13T02:19:00.026452+0000","last_undegraded":"2026-02-13T02:19:00.026452+0000","last_fullsized":"2026-02-13T02:19:00.026452+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:02:12.030985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026633+0000","last_change":"2026-02-13T02:18:59.024537+0000","last_active":"2026-02-13T02:19:00.026633+0000","last_peered":"2026-02-13T02:19:00.026633+0000","last_clean":"2026-02-13T02:19:00.026633+0000","last_became_active":"2026-02-13T02:18:59.024265+0000","last_became_peered":"2026-02-13T02:18:59.024265+0000","last_unstale":"2026-02-13T02:19:00.026633+0000","last_undegraded":"2026-02-13T02:19:00.026633+0000","last_fullsized":"2026-02-13T02:19:00.026633+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:34:28.463458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026396+0000","last_change":"2026-02-13T02:18:59.024867+0000","last_active":"2026-02-13T02:19:00.026396+0000","last_peered":"2026-02-13T02:19:00.026396+0000","last_clean":"2026-02-13T02:19:00.026396+0000","last_became_active":"2026-02-13T02:18:59.024696+0000","last_became_peered":"2026-02-13T02:18:59.024696+0000","last_unstale":"2026-02-13T02:19:00.026396+0000","last_undegraded":"2026-02-13T02:19:00.026396+0000","last_fullsized":"2026-02-13T02:19:00.026396+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:09:44.461888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.398342+0000","last_change":"2026-02-13T02:18:59.022594+0000","last_active":"2026-02-13T02:19:00.398342+0000","last_peered":"2026-02-13T02:19:00.398342+0000","last_clean":"2026-02-13T02:19:00.398342+0000","last_became_active":"2026-02-13T02:18:59.022375+0000","last_became_peered":"2026-02-13T02:18:59.022375+0000","last_unstale":"2026-02-13T02:19:00.398342+0000","last_undegraded":"2026-02-13T02:19:00.398342+0000","last_fullsized":"2026-02-13T02:19:00.398342+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:55:59.143677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.025380+0000","last_change":"2026-02-13T02:18:59.023047+0000","last_active":"2026-02-13T02:19:00.025380+0000","last_peered":"2026-02-13T02:19:00.025380+0000","last_clean":"2026-02-13T02:19:00.025380+0000","last_became_active":"2026-02-13T02:18:59.022786+0000","last_became_peered":"2026-02-13T02:18:59.022786+0000","last_unstale":"2026-02-13T02:19:00.025380+0000","last_undegraded":"2026-02-13T02:19:00.025380+0000","last_fullsized":"2026-02-13T02:19:00.025380+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:28:02.421314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:01.085745+0000","last_change":"2026-02-13T02:18:59.022223+0000","last_active":"2026-02-13T02:19:01.085745+0000","last_peered":"2026-02-13T02:19:01.085745+0000","last_clean":"2026-02-13T02:19:01.085745+0000","last_became_active":"2026-02-13T02:18:59.021655+0000","last_became_peered":"2026-02-13T02:18:59.021655+0000","last_unstale":"2026-02-13T02:19:01.085745+0000","last_undegraded":"2026-02-13T02:19:01.085745+0000","last_fullsized":"2026-02-13T02:19:01.085745+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:14:17.871724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:01.085745+0000","last_change":"2026-02-13T02:18:59.022539+0000","last_active":"2026-02-13T02:19:01.085745+0000","last_peered":"2026-02-13T02:19:01.085745+0000","last_clean":"2026-02-13T02:19:01.085745+0000","last_became_active":"2026-02-13T02:18:59.022262+0000","last_became_peered":"2026-02-13T02:18:59.022262+0000","last_unstale":"2026-02-13T02:19:01.085745+0000","last_undegraded":"2026-02-13T02:19:01.085745+0000","last_fullsized":"2026-02-13T02:19:01.085745+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:55:02.955479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026233+0000","last_change":"2026-02-13T02:18:59.024960+0000","last_active":"2026-02-13T02:19:00.026233+0000","last_peered":"2026-02-13T02:19:00.026233+0000","last_clean":"2026-02-13T02:19:00.026233+0000","last_became_active":"2026-02-13T02:18:59.023945+0000","last_became_peered":"2026-02-13T02:18:59.023945+0000","last_unstale":"2026-02-13T02:19:00.026233+0000","last_undegraded":"2026-02-13T02:19:00.026233+0000","last_fullsized":"2026-02-13T02:19:00.026233+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:13:11.195636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.023170+0000","last_change":"2026-02-13T02:18:59.021383+0000","last_active":"2026-02-13T02:19:00.023170+0000","last_peered":"2026-02-13T02:19:00.023170+0000","last_clean":"2026-02-13T02:19:00.023170+0000","last_became_active":"2026-02-13T02:18:59.021225+0000","last_became_peered":"2026-02-13T02:18:59.021225+0000","last_unstale":"2026-02-13T02:19:00.023170+0000","last_undegraded":"2026-02-13T02:19:00.023170+0000","last_fullsized":"2026-02-13T02:19:00.023170+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:26:53.426955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:01.022801+0000","last_change":"2026-02-13T02:18:59.020231+0000","last_active":"2026-02-13T02:19:01.022801+0000","last_peered":"2026-02-13T02:19:01.022801+0000","last_clean":"2026-02-13T02:19:01.022801+0000","last_became_active":"2026-02-13T02:18:59.020054+0000","last_became_peered":"2026-02-13T02:18:59.020054+0000","last_unstale":"2026-02-13T02:19:01.022801+0000","last_undegraded":"2026-02-13T02:19:01.022801+0000","last_fullsized":"2026-02-13T02:19:01.022801+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:32:25.993500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:01.058735+0000","last_change":"2026-02-13T02:18:59.020750+0000","last_active":"2026-02-13T02:19:01.058735+0000","last_peered":"2026-02-13T02:19:01.058735+0000","last_clean":"2026-02-13T02:19:01.058735+0000","last_became_active":"2026-02-13T02:18:59.020321+0000","last_became_peered":"2026-02-13T02:18:59.020321+0000","last_unstale":"2026-02-13T02:19:01.058735+0000","last_undegraded":"2026-02-13T02:19:01.058735+0000","last_fullsized":"2026-02-13T02:19:01.058735+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:58:49.111664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.023065+0000","last_change":"2026-02-13T02:18:59.019826+0000","last_active":"2026-02-13T02:19:00.023065+0000","last_peered":"2026-02-13T02:19:00.023065+0000","last_clean":"2026-02-13T02:19:00.023065+0000","last_became_active":"2026-02-13T02:18:59.019638+0000","last_became_peered":"2026-02-13T02:18:59.019638+0000","last_unstale":"2026-02-13T02:19:00.023065+0000","last_undegraded":"2026-02-13T02:19:00.023065+0000","last_fullsized":"2026-02-13T02:19:00.023065+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:34:29.076454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.025414+0000","last_change":"2026-02-13T02:18:59.021568+0000","last_active":"2026-02-13T02:19:00.025414+0000","last_peered":"2026-02-13T02:19:00.025414+0000","last_clean":"2026-02-13T02:19:00.025414+0000","last_became_active":"2026-02-13T02:18:59.021304+0000","last_became_peered":"2026-02-13T02:18:59.021304+0000","last_unstale":"2026-02-13T02:19:00.025414+0000","last_undegraded":"2026-02-13T02:19:00.025414+0000","last_fullsized":"2026-02-13T02:19:00.025414+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:38:59.142564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026218+0000","last_change":"2026-02-13T02:18:59.024188+0000","last_active":"2026-02-13T02:19:00.026218+0000","last_peered":"2026-02-13T02:19:00.026218+0000","last_clean":"2026-02-13T02:19:00.026218+0000","last_became_active":"2026-02-13T02:18:59.023908+0000","last_became_peered":"2026-02-13T02:18:59.023908+0000","last_unstale":"2026-02-13T02:19:00.026218+0000","last_undegraded":"2026-02-13T02:19:00.026218+0000","last_fullsized":"2026-02-13T02:19:00.026218+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:10:18.045079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.025946+0000","last_change":"2026-02-13T02:18:59.023175+0000","last_active":"2026-02-13T02:19:00.025946+0000","last_peered":"2026-02-13T02:19:00.025946+0000","last_clean":"2026-02-13T02:19:00.025946+0000","last_became_active":"2026-02-13T02:18:59.022967+0000","last_became_peered":"2026-02-13T02:18:59.022967+0000","last_unstale":"2026-02-13T02:19:00.025946+0000","last_undegraded":"2026-02-13T02:19:00.025946+0000","last_fullsized":"2026-02-13T02:19:00.025946+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:52:00.572082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:01.059499+0000","last_change":"2026-02-13T02:18:59.021552+0000","last_active":"2026-02-13T02:19:01.059499+0000","last_peered":"2026-02-13T02:19:01.059499+0000","last_clean":"2026-02-13T02:19:01.059499+0000","last_became_active":"2026-02-13T02:18:59.021213+0000","last_became_peered":"2026-02-13T02:18:59.021213+0000","last_unstale":"2026-02-13T02:19:01.059499+0000","last_undegraded":"2026-02-13T02:19:01.059499+0000","last_fullsized":"2026-02-13T02:19:01.059499+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:10:29.362585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026274+0000","last_change":"2026-02-13T02:18:59.022674+0000","last_active":"2026-02-13T02:19:00.026274+0000","last_peered":"2026-02-13T02:19:00.026274+0000","last_clean":"2026-02-13T02:19:00.026274+0000","last_became_active":"2026-02-13T02:18:59.022325+0000","last_became_peered":"2026-02-13T02:18:59.022325+0000","last_unstale":"2026-02-13T02:19:00.026274+0000","last_undegraded":"2026-02-13T02:19:00.026274+0000","last_fullsized":"2026-02-13T02:19:00.026274+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:31:28.596666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:01.058743+0000","last_change":"2026-02-13T02:18:59.020392+0000","last_active":"2026-02-13T02:19:01.058743+0000","last_peered":"2026-02-13T02:19:01.058743+0000","last_clean":"2026-02-13T02:19:01.058743+0000","last_became_active":"2026-02-13T02:18:59.019982+0000","last_became_peered":"2026-02-13T02:18:59.019982+0000","last_unstale":"2026-02-13T02:19:01.058743+0000","last_undegraded":"2026-02-13T02:19:01.058743+0000","last_fullsized":"2026-02-13T02:19:01.058743+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:05:17.845797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.023147+0000","last_change":"2026-02-13T02:18:59.020196+0000","last_active":"2026-02-13T02:19:00.023147+0000","last_peered":"2026-02-13T02:19:00.023147+0000","last_clean":"2026-02-13T02:19:00.023147+0000","last_became_active":"2026-02-13T02:18:59.019918+0000","last_became_peered":"2026-02-13T02:18:59.019918+0000","last_unstale":"2026-02-13T02:19:00.023147+0000","last_undegraded":"2026-02-13T02:19:00.023147+0000","last_fullsized":"2026-02-13T02:19:00.023147+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:12:07.357874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.025392+0000","last_change":"2026-02-13T02:18:59.021792+0000","last_active":"2026-02-13T02:19:00.025392+0000","last_peered":"2026-02-13T02:19:00.025392+0000","last_clean":"2026-02-13T02:19:00.025392+0000","last_became_active":"2026-02-13T02:18:59.021490+0000","last_became_peered":"2026-02-13T02:18:59.021490+0000","last_unstale":"2026-02-13T02:19:00.025392+0000","last_undegraded":"2026-02-13T02:19:00.025392+0000","last_fullsized":"2026-02-13T02:19:00.025392+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:25:48.353959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:01.085846+0000","last_change":"2026-02-13T02:18:59.022139+0000","last_active":"2026-02-13T02:19:01.085846+0000","last_peered":"2026-02-13T02:19:01.085846+0000","last_clean":"2026-02-13T02:19:01.085846+0000","last_became_active":"2026-02-13T02:18:59.021874+0000","last_became_peered":"2026-02-13T02:18:59.021874+0000","last_unstale":"2026-02-13T02:19:01.085846+0000","last_undegraded":"2026-02-13T02:19:01.085846+0000","last_fullsized":"2026-02-13T02:19:01.085846+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:57:27.700971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:01.058631+0000","last_change":"2026-02-13T02:18:59.019769+0000","last_active":"2026-02-13T02:19:01.058631+0000","last_peered":"2026-02-13T02:19:01.058631+0000","last_clean":"2026-02-13T02:19:01.058631+0000","last_became_active":"2026-02-13T02:18:59.019582+0000","last_became_peered":"2026-02-13T02:18:59.019582+0000","last_unstale":"2026-02-13T02:19:01.058631+0000","last_undegraded":"2026-02-13T02:19:01.058631+0000","last_fullsized":"2026-02-13T02:19:01.058631+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:53:56.089564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:01.058600+0000","last_change":"2026-02-13T02:18:59.020880+0000","last_active":"2026-02-13T02:19:01.058600+0000","last_peered":"2026-02-13T02:19:01.058600+0000","last_clean":"2026-02-13T02:19:01.058600+0000","last_became_active":"2026-02-13T02:18:59.020558+0000","last_became_peered":"2026-02-13T02:18:59.020558+0000","last_unstale":"2026-02-13T02:19:01.058600+0000","last_undegraded":"2026-02-13T02:19:01.058600+0000","last_fullsized":"2026-02-13T02:19:01.058600+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:02:40.364817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.023030+0000","last_change":"2026-02-13T02:18:59.022093+0000","last_active":"2026-02-13T02:19:00.023030+0000","last_peered":"2026-02-13T02:19:00.023030+0000","last_clean":"2026-02-13T02:19:00.023030+0000","last_became_active":"2026-02-13T02:18:59.021669+0000","last_became_peered":"2026-02-13T02:18:59.021669+0000","last_unstale":"2026-02-13T02:19:00.023030+0000","last_undegraded":"2026-02-13T02:19:00.023030+0000","last_fullsized":"2026-02-13T02:19:00.023030+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:30:30.662498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.269509+0000","last_change":"2026-02-13T02:18:59.021435+0000","last_active":"2026-02-13T02:19:00.269509+0000","last_peered":"2026-02-13T02:19:00.269509+0000","last_clean":"2026-02-13T02:19:00.269509+0000","last_became_active":"2026-02-13T02:18:59.020960+0000","last_became_peered":"2026-02-13T02:18:59.020960+0000","last_unstale":"2026-02-13T02:19:00.269509+0000","last_undegraded":"2026-02-13T02:19:00.269509+0000","last_fullsized":"2026-02-13T02:19:00.269509+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:38:16.139971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"71'5","reported_seq":28,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:09.067800+0000","last_change":"2026-02-13T02:18:58.015175+0000","last_active":"2026-02-13T02:19:09.067800+0000","last_peered":"2026-02-13T02:19:09.067800+0000","last_clean":"2026-02-13T02:19:09.067800+0000","last_became_active":"2026-02-13T02:18:58.014835+0000","last_became_peered":"2026-02-13T02:18:58.014835+0000","last_unstale":"2026-02-13T02:19:09.067800+0000","last_undegraded":"2026-02-13T02:19:09.067800+0000","last_fullsized":"2026-02-13T02:19:09.067800+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:27:53.220446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:01.059509+0000","last_change":"2026-02-13T02:18:59.021246+0000","last_active":"2026-02-13T02:19:01.059509+0000","last_peered":"2026-02-13T02:19:01.059509+0000","last_clean":"2026-02-13T02:19:01.059509+0000","last_became_active":"2026-02-13T02:18:59.020902+0000","last_became_peered":"2026-02-13T02:18:59.020902+0000","last_unstale":"2026-02-13T02:19:01.059509+0000","last_undegraded":"2026-02-13T02:19:01.059509+0000","last_fullsized":"2026-02-13T02:19:01.059509+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:22:04.706073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"71'7","reported_seq":23,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:04.053335+0000","last_change":"2026-02-13T02:18:58.019626+0000","last_active":"2026-02-13T02:19:04.053335+0000","last_peered":"2026-02-13T02:19:04.053335+0000","last_clean":"2026-02-13T02:19:04.053335+0000","last_became_active":"2026-02-13T02:18:58.019415+0000","last_became_peered":"2026-02-13T02:18:58.019415+0000","last_unstale":"2026-02-13T02:19:04.053335+0000","last_undegraded":"2026-02-13T02:19:04.053335+0000","last_fullsized":"2026-02-13T02:19:04.053335+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:33:18.766107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"71'3","reported_seq":19,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:03.045478+0000","last_change":"2026-02-13T02:18:58.017302+0000","last_active":"2026-02-13T02:19:03.045478+0000","last_peered":"2026-02-13T02:19:03.045478+0000","last_clean":"2026-02-13T02:19:03.045478+0000","last_became_active":"2026-02-13T02:18:58.016498+0000","last_became_peered":"2026-02-13T02:18:58.016498+0000","last_unstale":"2026-02-13T02:19:03.045478+0000","last_undegraded":"2026-02-13T02:19:03.045478+0000","last_fullsized":"2026-02-13T02:19:03.045478+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:51:46.201734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026051+0000","last_change":"2026-02-13T02:18:59.021203+0000","last_active":"2026-02-13T02:19:00.026051+0000","last_peered":"2026-02-13T02:19:00.026051+0000","last_clean":"2026-02-13T02:19:00.026051+0000","last_became_active":"2026-02-13T02:18:59.020781+0000","last_became_peered":"2026-02-13T02:18:59.020781+0000","last_unstale":"2026-02-13T02:19:00.026051+0000","last_undegraded":"2026-02-13T02:19:00.026051+0000","last_fullsized":"2026-02-13T02:19:00.026051+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:22:58.765719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"71'3","reported_seq":20,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:05.055986+0000","last_change":"2026-02-13T02:18:58.016151+0000","last_active":"2026-02-13T02:19:05.055986+0000","last_peered":"2026-02-13T02:19:05.055986+0000","last_clean":"2026-02-13T02:19:05.055986+0000","last_became_active":"2026-02-13T02:18:58.015775+0000","last_became_peered":"2026-02-13T02:18:58.015775+0000","last_unstale":"2026-02-13T02:19:05.055986+0000","last_undegraded":"2026-02-13T02:19:05.055986+0000","last_fullsized":"2026-02-13T02:19:05.055986+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:59:25.743829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:01.022817+0000","last_change":"2026-02-13T02:18:59.020334+0000","last_active":"2026-02-13T02:19:01.022817+0000","last_peered":"2026-02-13T02:19:01.022817+0000","last_clean":"2026-02-13T02:19:01.022817+0000","last_became_active":"2026-02-13T02:18:59.020137+0000","last_became_peered":"2026-02-13T02:18:59.020137+0000","last_unstale":"2026-02-13T02:19:01.022817+0000","last_undegraded":"2026-02-13T02:19:01.022817+0000","last_fullsized":"2026-02-13T02:19:01.022817+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:31:43.321951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"71'4","reported_seq":30,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:10.070955+0000","last_change":"2026-02-13T02:18:58.020328+0000","last_active":"2026-02-13T02:19:10.070955+0000","last_peered":"2026-02-13T02:19:10.070955+0000","last_clean":"2026-02-13T02:19:10.070955+0000","last_became_active":"2026-02-13T02:18:58.020172+0000","last_became_peered":"2026-02-13T02:18:58.020172+0000","last_unstale":"2026-02-13T02:19:10.070955+0000","last_undegraded":"2026-02-13T02:19:10.070955+0000","last_fullsized":"2026-02-13T02:19:10.070955+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:38:31.643491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026409+0000","last_change":"2026-02-13T02:18:59.022851+0000","last_active":"2026-02-13T02:19:00.026409+0000","last_peered":"2026-02-13T02:19:00.026409+0000","last_clean":"2026-02-13T02:19:00.026409+0000","last_became_active":"2026-02-13T02:18:59.022669+0000","last_became_peered":"2026-02-13T02:18:59.022669+0000","last_unstale":"2026-02-13T02:19:00.026409+0000","last_undegraded":"2026-02-13T02:19:00.026409+0000","last_fullsized":"2026-02-13T02:19:00.026409+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:51:54.769188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"71'4","reported_seq":20,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:05.059230+0000","last_change":"2026-02-13T02:18:58.018467+0000","last_active":"2026-02-13T02:19:05.059230+0000","last_peered":"2026-02-13T02:19:05.059230+0000","last_clean":"2026-02-13T02:19:05.059230+0000","last_became_active":"2026-02-13T02:18:58.018121+0000","last_became_peered":"2026-02-13T02:18:58.018121+0000","last_unstale":"2026-02-13T02:19:05.059230+0000","last_undegraded":"2026-02-13T02:19:05.059230+0000","last_fullsized":"2026-02-13T02:19:05.059230+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:26:43.250379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:01.086021+0000","last_change":"2026-02-13T02:18:59.022489+0000","last_active":"2026-02-13T02:19:01.086021+0000","last_peered":"2026-02-13T02:19:01.086021+0000","last_clean":"2026-02-13T02:19:01.086021+0000","last_became_active":"2026-02-13T02:18:59.022123+0000","last_became_peered":"2026-02-13T02:18:59.022123+0000","last_unstale":"2026-02-13T02:19:01.086021+0000","last_undegraded":"2026-02-13T02:19:01.086021+0000","last_fullsized":"2026-02-13T02:19:01.086021+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:44:21.124098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"71'5","reported_seq":22,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:04.049593+0000","last_change":"2026-02-13T02:18:58.015339+0000","last_active":"2026-02-13T02:19:04.049593+0000","last_peered":"2026-02-13T02:19:04.049593+0000","last_clean":"2026-02-13T02:19:04.049593+0000","last_became_active":"2026-02-13T02:18:58.015045+0000","last_became_peered":"2026-02-13T02:18:58.015045+0000","last_unstale":"2026-02-13T02:19:04.049593+0000","last_undegraded":"2026-02-13T02:19:04.049593+0000","last_fullsized":"2026-02-13T02:19:04.049593+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:41:53.333544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":694,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026351+0000","last_change":"2026-02-13T02:18:59.024095+0000","last_active":"2026-02-13T02:19:00.026351+0000","last_peered":"2026-02-13T02:19:00.026351+0000","last_clean":"2026-02-13T02:19:00.026351+0000","last_became_active":"2026-02-13T02:18:59.023757+0000","last_became_peered":"2026-02-13T02:18:59.023757+0000","last_unstale":"2026-02-13T02:19:00.026351+0000","last_undegraded":"2026-02-13T02:19:00.026351+0000","last_fullsized":"2026-02-13T02:19:00.026351+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:37:25.170781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"71'24","reported_seq":54,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:10.071930+0000","last_change":"2026-02-13T02:18:58.019442+0000","last_active":"2026-02-13T02:19:10.071930+0000","last_peered":"2026-02-13T02:19:10.071930+0000","last_clean":"2026-02-13T02:19:10.071930+0000","last_became_active":"2026-02-13T02:18:58.019224+0000","last_became_peered":"2026-02-13T02:18:58.019224+0000","last_unstale":"2026-02-13T02:19:10.071930+0000","last_undegraded":"2026-02-13T02:19:10.071930+0000","last_fullsized":"2026-02-13T02:19:10.071930+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:18:16.234056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52844,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":14,"num_read_kb":59,"num_write":26,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.269821+0000","last_change":"2026-02-13T02:18:59.020682+0000","last_active":"2026-02-13T02:19:00.269821+0000","last_peered":"2026-02-13T02:19:00.269821+0000","last_clean":"2026-02-13T02:19:00.269821+0000","last_became_active":"2026-02-13T02:18:59.019992+0000","last_became_peered":"2026-02-13T02:18:59.019992+0000","last_unstale":"2026-02-13T02:19:00.269821+0000","last_undegraded":"2026-02-13T02:19:00.269821+0000","last_fullsized":"2026-02-13T02:19:00.269821+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:26:25.490570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"71'9","reported_seq":27,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:06.064344+0000","last_change":"2026-02-13T02:18:58.017003+0000","last_active":"2026-02-13T02:19:06.064344+0000","last_peered":"2026-02-13T02:19:06.064344+0000","last_clean":"2026-02-13T02:19:06.064344+0000","last_became_active":"2026-02-13T02:18:58.016821+0000","last_became_peered":"2026-02-13T02:18:58.016821+0000","last_unstale":"2026-02-13T02:19:06.064344+0000","last_undegraded":"2026-02-13T02:19:06.064344+0000","last_fullsized":"2026-02-13T02:19:06.064344+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:52:59.197342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.025359+0000","last_change":"2026-02-13T02:18:59.022587+0000","last_active":"2026-02-13T02:19:00.025359+0000","last_peered":"2026-02-13T02:19:00.025359+0000","last_clean":"2026-02-13T02:19:00.025359+0000","last_became_active":"2026-02-13T02:18:59.021700+0000","last_became_peered":"2026-02-13T02:18:59.021700+0000","last_unstale":"2026-02-13T02:19:00.025359+0000","last_undegraded":"2026-02-13T02:19:00.025359+0000","last_fullsized":"2026-02-13T02:19:00.025359+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:25:36.714629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"71'5","reported_seq":22,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:05.056706+0000","last_change":"2026-02-13T02:18:58.016995+0000","last_active":"2026-02-13T02:19:05.056706+0000","last_peered":"2026-02-13T02:19:05.056706+0000","last_clean":"2026-02-13T02:19:05.056706+0000","last_became_active":"2026-02-13T02:18:58.016790+0000","last_became_peered":"2026-02-13T02:18:58.016790+0000","last_unstale":"2026-02-13T02:19:05.056706+0000","last_undegraded":"2026-02-13T02:19:05.056706+0000","last_fullsized":"2026-02-13T02:19:05.056706+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:16:22.317768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026344+0000","last_change":"2026-02-13T02:18:59.023842+0000","last_active":"2026-02-13T02:19:00.026344+0000","last_peered":"2026-02-13T02:19:00.026344+0000","last_clean":"2026-02-13T02:19:00.026344+0000","last_became_active":"2026-02-13T02:18:59.023100+0000","last_became_peered":"2026-02-13T02:18:59.023100+0000","last_unstale":"2026-02-13T02:19:00.026344+0000","last_undegraded":"2026-02-13T02:19:00.026344+0000","last_fullsized":"2026-02-13T02:19:00.026344+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:49:06.786362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"71'6","reported_seq":29,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:09.071334+0000","last_change":"2026-02-13T02:18:58.016750+0000","last_active":"2026-02-13T02:19:09.071334+0000","last_peered":"2026-02-13T02:19:09.071334+0000","last_clean":"2026-02-13T02:19:09.071334+0000","last_became_active":"2026-02-13T02:18:58.016568+0000","last_became_peered":"2026-02-13T02:18:58.016568+0000","last_unstale":"2026-02-13T02:19:09.071334+0000","last_undegraded":"2026-02-13T02:19:09.071334+0000","last_fullsized":"2026-02-13T02:19:09.071334+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:30:56.973436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":998,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":8,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026083+0000","last_change":"2026-02-13T02:18:59.023967+0000","last_active":"2026-02-13T02:19:00.026083+0000","last_peered":"2026-02-13T02:19:00.026083+0000","last_clean":"2026-02-13T02:19:00.026083+0000","last_became_active":"2026-02-13T02:18:59.023488+0000","last_became_peered":"2026-02-13T02:18:59.023488+0000","last_unstale":"2026-02-13T02:19:00.026083+0000","last_undegraded":"2026-02-13T02:19:00.026083+0000","last_fullsized":"2026-02-13T02:19:00.026083+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:22:22.901773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"71'17","reported_seq":34,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:05.056052+0000","last_change":"2026-02-13T02:18:58.017311+0000","last_active":"2026-02-13T02:19:05.056052+0000","last_peered":"2026-02-13T02:19:05.056052+0000","last_clean":"2026-02-13T02:19:05.056052+0000","last_became_active":"2026-02-13T02:18:58.016759+0000","last_became_peered":"2026-02-13T02:18:58.016759+0000","last_unstale":"2026-02-13T02:19:05.056052+0000","last_undegraded":"2026-02-13T02:19:05.056052+0000","last_fullsized":"2026-02-13T02:19:05.056052+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:56:39.432654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:01.059526+0000","last_change":"2026-02-13T02:18:59.021764+0000","last_active":"2026-02-13T02:19:01.059526+0000","last_peered":"2026-02-13T02:19:01.059526+0000","last_clean":"2026-02-13T02:19:01.059526+0000","last_became_active":"2026-02-13T02:18:59.021364+0000","last_became_peered":"2026-02-13T02:18:59.021364+0000","last_unstale":"2026-02-13T02:19:01.059526+0000","last_undegraded":"2026-02-13T02:19:01.059526+0000","last_fullsized":"2026-02-13T02:19:01.059526+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:13:00.776080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"71'2","reported_seq":19,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:05.042750+0000","last_change":"2026-02-13T02:18:58.017465+0000","last_active":"2026-02-13T02:19:05.042750+0000","last_peered":"2026-02-13T02:19:05.042750+0000","last_clean":"2026-02-13T02:19:05.042750+0000","last_became_active":"2026-02-13T02:18:58.016957+0000","last_became_peered":"2026-02-13T02:18:58.016957+0000","last_unstale":"2026-02-13T02:19:05.042750+0000","last_undegraded":"2026-02-13T02:19:05.042750+0000","last_fullsized":"2026-02-13T02:19:05.042750+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:17:33.831136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.022946+0000","last_change":"2026-02-13T02:18:59.020929+0000","last_active":"2026-02-13T02:19:00.022946+0000","last_peered":"2026-02-13T02:19:00.022946+0000","last_clean":"2026-02-13T02:19:00.022946+0000","last_became_active":"2026-02-13T02:18:59.020519+0000","last_became_peered":"2026-02-13T02:18:59.020519+0000","last_unstale":"2026-02-13T02:19:00.022946+0000","last_undegraded":"2026-02-13T02:19:00.022946+0000","last_fullsized":"2026-02-13T02:19:00.022946+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:46:07.242524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"71'5","reported_seq":21,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:05.057217+0000","last_change":"2026-02-13T02:18:58.017516+0000","last_active":"2026-02-13T02:19:05.057217+0000","last_peered":"2026-02-13T02:19:05.057217+0000","last_clean":"2026-02-13T02:19:05.057217+0000","last_became_active":"2026-02-13T02:18:58.017217+0000","last_became_peered":"2026-02-13T02:18:58.017217+0000","last_unstale":"2026-02-13T02:19:05.057217+0000","last_undegraded":"2026-02-13T02:19:05.057217+0000","last_fullsized":"2026-02-13T02:19:05.057217+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:02:32.458073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026497+0000","last_change":"2026-02-13T02:18:59.022648+0000","last_active":"2026-02-13T02:19:00.026497+0000","last_peered":"2026-02-13T02:19:00.026497+0000","last_clean":"2026-02-13T02:19:00.026497+0000","last_became_active":"2026-02-13T02:18:59.022416+0000","last_became_peered":"2026-02-13T02:18:59.022416+0000","last_unstale":"2026-02-13T02:19:00.026497+0000","last_undegraded":"2026-02-13T02:19:00.026497+0000","last_fullsized":"2026-02-13T02:19:00.026497+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:27:43.916972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"71'3","reported_seq":20,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:05.056078+0000","last_change":"2026-02-13T02:18:58.016793+0000","last_active":"2026-02-13T02:19:05.056078+0000","last_peered":"2026-02-13T02:19:05.056078+0000","last_clean":"2026-02-13T02:19:05.056078+0000","last_became_active":"2026-02-13T02:18:58.016440+0000","last_became_peered":"2026-02-13T02:18:58.016440+0000","last_unstale":"2026-02-13T02:19:05.056078+0000","last_undegraded":"2026-02-13T02:19:05.056078+0000","last_fullsized":"2026-02-13T02:19:05.056078+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:50:19.963252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"71'1","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026378+0000","last_change":"2026-02-13T02:18:59.024040+0000","last_active":"2026-02-13T02:19:00.026378+0000","last_peered":"2026-02-13T02:19:00.026378+0000","last_clean":"2026-02-13T02:19:00.026378+0000","last_became_active":"2026-02-13T02:18:59.023539+0000","last_became_peered":"2026-02-13T02:18:59.023539+0000","last_unstale":"2026-02-13T02:19:00.026378+0000","last_undegraded":"2026-02-13T02:19:00.026378+0000","last_fullsized":"2026-02-13T02:19:00.026378+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:04:33.603294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"71'5","reported_seq":28,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:09.070788+0000","last_change":"2026-02-13T02:18:58.015927+0000","last_active":"2026-02-13T02:19:09.070788+0000","last_peered":"2026-02-13T02:19:09.070788+0000","last_clean":"2026-02-13T02:19:09.070788+0000","last_became_active":"2026-02-13T02:18:58.015746+0000","last_became_peered":"2026-02-13T02:18:58.015746+0000","last_unstale":"2026-02-13T02:19:09.070788+0000","last_undegraded":"2026-02-13T02:19:09.070788+0000","last_fullsized":"2026-02-13T02:19:09.070788+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:25:54.397951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1192,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026442+0000","last_change":"2026-02-13T02:18:59.025074+0000","last_active":"2026-02-13T02:19:00.026442+0000","last_peered":"2026-02-13T02:19:00.026442+0000","last_clean":"2026-02-13T02:19:00.026442+0000","last_became_active":"2026-02-13T02:18:59.024633+0000","last_became_peered":"2026-02-13T02:18:59.024633+0000","last_unstale":"2026-02-13T02:19:00.026442+0000","last_undegraded":"2026-02-13T02:19:00.026442+0000","last_fullsized":"2026-02-13T02:19:00.026442+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:39:45.349715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'152","reported_seq":337,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026105+0000","last_change":"2026-02-13T02:18:39.248696+0000","last_active":"2026-02-13T02:19:00.026105+0000","last_peered":"2026-02-13T02:19:00.026105+0000","last_clean":"2026-02-13T02:19:00.026105+0000","last_became_active":"2026-02-13T02:18:39.248579+0000","last_became_peered":"2026-02-13T02:18:39.248579+0000","last_unstale":"2026-02-13T02:19:00.026105+0000","last_undegraded":"2026-02-13T02:19:00.026105+0000","last_fullsized":"2026-02-13T02:19:00.026105+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:17:40.238745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:17:40.238745+0000","last_clean_scrub_stamp":"2026-02-13T02:17:40.238745+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:50:58.102014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"71'6","reported_seq":25,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:06.067281+0000","last_change":"2026-02-13T02:18:58.017400+0000","last_active":"2026-02-13T02:19:06.067281+0000","last_peered":"2026-02-13T02:19:06.067281+0000","last_clean":"2026-02-13T02:19:06.067281+0000","last_became_active":"2026-02-13T02:18:58.017073+0000","last_became_peered":"2026-02-13T02:18:58.017073+0000","last_unstale":"2026-02-13T02:19:06.067281+0000","last_undegraded":"2026-02-13T02:19:06.067281+0000","last_fullsized":"2026-02-13T02:19:06.067281+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:07:32.354072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026155+0000","last_change":"2026-02-13T02:18:59.022794+0000","last_active":"2026-02-13T02:19:00.026155+0000","last_peered":"2026-02-13T02:19:00.026155+0000","last_clean":"2026-02-13T02:19:00.026155+0000","last_became_active":"2026-02-13T02:18:59.022108+0000","last_became_peered":"2026-02-13T02:18:59.022108+0000","last_unstale":"2026-02-13T02:19:00.026155+0000","last_undegraded":"2026-02-13T02:19:00.026155+0000","last_fullsized":"2026-02-13T02:19:00.026155+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:22:15.433204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"71'4","reported_seq":20,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:03.046718+0000","last_change":"2026-02-13T02:18:58.018751+0000","last_active":"2026-02-13T02:19:03.046718+0000","last_peered":"2026-02-13T02:19:03.046718+0000","last_clean":"2026-02-13T02:19:03.046718+0000","last_became_active":"2026-02-13T02:18:58.018516+0000","last_became_peered":"2026-02-13T02:18:58.018516+0000","last_unstale":"2026-02-13T02:19:03.046718+0000","last_undegraded":"2026-02-13T02:19:03.046718+0000","last_fullsized":"2026-02-13T02:19:03.046718+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:20:45.263014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.025233+0000","last_change":"2026-02-13T02:18:59.023047+0000","last_active":"2026-02-13T02:19:00.025233+0000","last_peered":"2026-02-13T02:19:00.025233+0000","last_clean":"2026-02-13T02:19:00.025233+0000","last_became_active":"2026-02-13T02:18:59.022759+0000","last_became_peered":"2026-02-13T02:18:59.022759+0000","last_unstale":"2026-02-13T02:19:00.025233+0000","last_undegraded":"2026-02-13T02:19:00.025233+0000","last_fullsized":"2026-02-13T02:19:00.025233+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:41:05.253744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"71'5","reported_seq":27,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:09.069170+0000","last_change":"2026-02-13T02:18:58.017745+0000","last_active":"2026-02-13T02:19:09.069170+0000","last_peered":"2026-02-13T02:19:09.069170+0000","last_clean":"2026-02-13T02:19:09.069170+0000","last_became_active":"2026-02-13T02:18:58.017075+0000","last_became_peered":"2026-02-13T02:18:58.017075+0000","last_unstale":"2026-02-13T02:19:09.069170+0000","last_undegraded":"2026-02-13T02:19:09.069170+0000","last_fullsized":"2026-02-13T02:19:09.069170+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:30:40.480682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:01.059608+0000","last_change":"2026-02-13T02:18:59.020766+0000","last_active":"2026-02-13T02:19:01.059608+0000","last_peered":"2026-02-13T02:19:01.059608+0000","last_clean":"2026-02-13T02:19:01.059608+0000","last_became_active":"2026-02-13T02:18:59.020423+0000","last_became_peered":"2026-02-13T02:18:59.020423+0000","last_unstale":"2026-02-13T02:19:01.059608+0000","last_undegraded":"2026-02-13T02:19:01.059608+0000","last_fullsized":"2026-02-13T02:19:01.059608+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:28:14.129049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"71'5","reported_seq":27,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:09.073783+0000","last_change":"2026-02-13T02:18:58.018774+0000","last_active":"2026-02-13T02:19:09.073783+0000","last_peered":"2026-02-13T02:19:09.073783+0000","last_clean":"2026-02-13T02:19:09.073783+0000","last_became_active":"2026-02-13T02:18:58.018494+0000","last_became_peered":"2026-02-13T02:18:58.018494+0000","last_unstale":"2026-02-13T02:19:09.073783+0000","last_undegraded":"2026-02-13T02:19:09.073783+0000","last_fullsized":"2026-02-13T02:19:09.073783+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:54:08.283495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026508+0000","last_change":"2026-02-13T02:18:59.024900+0000","last_active":"2026-02-13T02:19:00.026508+0000","last_peered":"2026-02-13T02:19:00.026508+0000","last_clean":"2026-02-13T02:19:00.026508+0000","last_became_active":"2026-02-13T02:18:59.024012+0000","last_became_peered":"2026-02-13T02:18:59.024012+0000","last_unstale":"2026-02-13T02:19:00.026508+0000","last_undegraded":"2026-02-13T02:19:00.026508+0000","last_fullsized":"2026-02-13T02:19:00.026508+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:30:24.252966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"71'1","reported_seq":17,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:01.022784+0000","last_change":"2026-02-13T02:18:58.018004+0000","last_active":"2026-02-13T02:19:01.022784+0000","last_peered":"2026-02-13T02:19:01.022784+0000","last_clean":"2026-02-13T02:19:01.022784+0000","last_became_active":"2026-02-13T02:18:58.017319+0000","last_became_peered":"2026-02-13T02:18:58.017319+0000","last_unstale":"2026-02-13T02:19:01.022784+0000","last_undegraded":"2026-02-13T02:19:01.022784+0000","last_fullsized":"2026-02-13T02:19:01.022784+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:26:29.965359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"71'1","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:01.037590+0000","last_change":"2026-02-13T02:18:59.025358+0000","last_active":"2026-02-13T02:19:01.037590+0000","last_peered":"2026-02-13T02:19:01.037590+0000","last_clean":"2026-02-13T02:19:01.037590+0000","last_became_active":"2026-02-13T02:18:59.024743+0000","last_became_peered":"2026-02-13T02:18:59.024743+0000","last_unstale":"2026-02-13T02:19:01.037590+0000","last_undegraded":"2026-02-13T02:19:01.037590+0000","last_fullsized":"2026-02-13T02:19:01.037590+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:05:43.480846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"71'4","reported_seq":21,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:05.056604+0000","last_change":"2026-02-13T02:18:58.017585+0000","last_active":"2026-02-13T02:19:05.056604+0000","last_peered":"2026-02-13T02:19:05.056604+0000","last_clean":"2026-02-13T02:19:05.056604+0000","last_became_active":"2026-02-13T02:18:58.017323+0000","last_became_peered":"2026-02-13T02:18:58.017323+0000","last_unstale":"2026-02-13T02:19:05.056604+0000","last_undegraded":"2026-02-13T02:19:05.056604+0000","last_fullsized":"2026-02-13T02:19:05.056604+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:25:25.624809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.025394+0000","last_change":"2026-02-13T02:18:59.020945+0000","last_active":"2026-02-13T02:19:00.025394+0000","last_peered":"2026-02-13T02:19:00.025394+0000","last_clean":"2026-02-13T02:19:00.025394+0000","last_became_active":"2026-02-13T02:18:59.020719+0000","last_became_peered":"2026-02-13T02:18:59.020719+0000","last_unstale":"2026-02-13T02:19:00.025394+0000","last_undegraded":"2026-02-13T02:19:00.025394+0000","last_fullsized":"2026-02-13T02:19:00.025394+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:13:20.283266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"71'10","reported_seq":26,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:07.022623+0000","last_change":"2026-02-13T02:18:58.018055+0000","last_active":"2026-02-13T02:19:07.022623+0000","last_peered":"2026-02-13T02:19:07.022623+0000","last_clean":"2026-02-13T02:19:07.022623+0000","last_became_active":"2026-02-13T02:18:58.017824+0000","last_became_peered":"2026-02-13T02:18:58.017824+0000","last_unstale":"2026-02-13T02:19:07.022623+0000","last_undegraded":"2026-02-13T02:19:07.022623+0000","last_fullsized":"2026-02-13T02:19:07.022623+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:00:19.476969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026322+0000","last_change":"2026-02-13T02:18:59.021532+0000","last_active":"2026-02-13T02:19:00.026322+0000","last_peered":"2026-02-13T02:19:00.026322+0000","last_clean":"2026-02-13T02:19:00.026322+0000","last_became_active":"2026-02-13T02:18:59.020792+0000","last_became_peered":"2026-02-13T02:18:59.020792+0000","last_unstale":"2026-02-13T02:19:00.026322+0000","last_undegraded":"2026-02-13T02:19:00.026322+0000","last_fullsized":"2026-02-13T02:19:00.026322+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:55:45.772056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"71'7","reported_seq":24,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:05.059314+0000","last_change":"2026-02-13T02:18:58.017322+0000","last_active":"2026-02-13T02:19:05.059314+0000","last_peered":"2026-02-13T02:19:05.059314+0000","last_clean":"2026-02-13T02:19:05.059314+0000","last_became_active":"2026-02-13T02:18:58.017078+0000","last_became_peered":"2026-02-13T02:18:58.017078+0000","last_unstale":"2026-02-13T02:19:05.059314+0000","last_undegraded":"2026-02-13T02:19:05.059314+0000","last_fullsized":"2026-02-13T02:19:05.059314+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:38:36.066817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:01.085941+0000","last_change":"2026-02-13T02:18:59.023478+0000","last_active":"2026-02-13T02:19:01.085941+0000","last_peered":"2026-02-13T02:19:01.085941+0000","last_clean":"2026-02-13T02:19:01.085941+0000","last_became_active":"2026-02-13T02:18:59.023251+0000","last_became_peered":"2026-02-13T02:18:59.023251+0000","last_unstale":"2026-02-13T02:19:01.085941+0000","last_undegraded":"2026-02-13T02:19:01.085941+0000","last_fullsized":"2026-02-13T02:19:01.085941+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:46:43.414532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"71'2","reported_seq":18,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:02.042384+0000","last_change":"2026-02-13T02:18:58.018029+0000","last_active":"2026-02-13T02:19:02.042384+0000","last_peered":"2026-02-13T02:19:02.042384+0000","last_clean":"2026-02-13T02:19:02.042384+0000","last_became_active":"2026-02-13T02:18:58.017853+0000","last_became_peered":"2026-02-13T02:18:58.017853+0000","last_unstale":"2026-02-13T02:19:02.042384+0000","last_undegraded":"2026-02-13T02:19:02.042384+0000","last_fullsized":"2026-02-13T02:19:02.042384+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:42:13.248907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.269489+0000","last_change":"2026-02-13T02:18:59.021333+0000","last_active":"2026-02-13T02:19:00.269489+0000","last_peered":"2026-02-13T02:19:00.269489+0000","last_clean":"2026-02-13T02:19:00.269489+0000","last_became_active":"2026-02-13T02:18:59.020957+0000","last_became_peered":"2026-02-13T02:18:59.020957+0000","last_unstale":"2026-02-13T02:19:00.269489+0000","last_undegraded":"2026-02-13T02:19:00.269489+0000","last_fullsized":"2026-02-13T02:19:00.269489+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:03:43.534623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"71'7","reported_seq":23,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:05.057144+0000","last_change":"2026-02-13T02:18:58.018621+0000","last_active":"2026-02-13T02:19:05.057144+0000","last_peered":"2026-02-13T02:19:05.057144+0000","last_clean":"2026-02-13T02:19:05.057144+0000","last_became_active":"2026-02-13T02:18:58.018470+0000","last_became_peered":"2026-02-13T02:18:58.018470+0000","last_unstale":"2026-02-13T02:19:05.057144+0000","last_undegraded":"2026-02-13T02:19:05.057144+0000","last_fullsized":"2026-02-13T02:19:05.057144+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:23:51.053480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.023004+0000","last_change":"2026-02-13T02:18:59.020330+0000","last_active":"2026-02-13T02:19:00.023004+0000","last_peered":"2026-02-13T02:19:00.023004+0000","last_clean":"2026-02-13T02:19:00.023004+0000","last_became_active":"2026-02-13T02:18:59.020032+0000","last_became_peered":"2026-02-13T02:18:59.020032+0000","last_unstale":"2026-02-13T02:19:00.023004+0000","last_undegraded":"2026-02-13T02:19:00.023004+0000","last_fullsized":"2026-02-13T02:19:00.023004+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:53:04.758527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"71'3","reported_seq":19,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:04.049544+0000","last_change":"2026-02-13T02:18:58.017473+0000","last_active":"2026-02-13T02:19:04.049544+0000","last_peered":"2026-02-13T02:19:04.049544+0000","last_clean":"2026-02-13T02:19:04.049544+0000","last_became_active":"2026-02-13T02:18:58.017315+0000","last_became_peered":"2026-02-13T02:18:58.017315+0000","last_unstale":"2026-02-13T02:19:04.049544+0000","last_undegraded":"2026-02-13T02:19:04.049544+0000","last_fullsized":"2026-02-13T02:19:04.049544+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:25:15.481559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026238+0000","last_change":"2026-02-13T02:18:59.023576+0000","last_active":"2026-02-13T02:19:00.026238+0000","last_peered":"2026-02-13T02:19:00.026238+0000","last_clean":"2026-02-13T02:19:00.026238+0000","last_became_active":"2026-02-13T02:18:59.022528+0000","last_became_peered":"2026-02-13T02:18:59.022528+0000","last_unstale":"2026-02-13T02:19:00.026238+0000","last_undegraded":"2026-02-13T02:19:00.026238+0000","last_fullsized":"2026-02-13T02:19:00.026238+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:14:20.280447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"71'4","reported_seq":21,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:02.040196+0000","last_change":"2026-02-13T02:18:58.017265+0000","last_active":"2026-02-13T02:19:02.040196+0000","last_peered":"2026-02-13T02:19:02.040196+0000","last_clean":"2026-02-13T02:19:02.040196+0000","last_became_active":"2026-02-13T02:18:58.016951+0000","last_became_peered":"2026-02-13T02:18:58.016951+0000","last_unstale":"2026-02-13T02:19:02.040196+0000","last_undegraded":"2026-02-13T02:19:02.040196+0000","last_fullsized":"2026-02-13T02:19:02.040196+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:50:01.682853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026205+0000","last_change":"2026-02-13T02:18:59.022425+0000","last_active":"2026-02-13T02:19:00.026205+0000","last_peered":"2026-02-13T02:19:00.026205+0000","last_clean":"2026-02-13T02:19:00.026205+0000","last_became_active":"2026-02-13T02:18:59.022229+0000","last_became_peered":"2026-02-13T02:18:59.022229+0000","last_unstale":"2026-02-13T02:19:00.026205+0000","last_undegraded":"2026-02-13T02:19:00.026205+0000","last_fullsized":"2026-02-13T02:19:00.026205+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:46:02.938928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:01.059766+0000","last_change":"2026-02-13T02:18:59.022165+0000","last_active":"2026-02-13T02:19:01.059766+0000","last_peered":"2026-02-13T02:19:01.059766+0000","last_clean":"2026-02-13T02:19:01.059766+0000","last_became_active":"2026-02-13T02:18:59.021833+0000","last_became_peered":"2026-02-13T02:18:59.021833+0000","last_unstale":"2026-02-13T02:19:01.059766+0000","last_undegraded":"2026-02-13T02:19:01.059766+0000","last_fullsized":"2026-02-13T02:19:01.059766+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:37:51.478861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"71'5","reported_seq":22,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:05.056744+0000","last_change":"2026-02-13T02:18:58.016572+0000","last_active":"2026-02-13T02:19:05.056744+0000","last_peered":"2026-02-13T02:19:05.056744+0000","last_clean":"2026-02-13T02:19:05.056744+0000","last_became_active":"2026-02-13T02:18:58.016013+0000","last_became_peered":"2026-02-13T02:18:58.016013+0000","last_unstale":"2026-02-13T02:19:05.056744+0000","last_undegraded":"2026-02-13T02:19:05.056744+0000","last_fullsized":"2026-02-13T02:19:05.056744+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:07:58.232144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026287+0000","last_change":"2026-02-13T02:18:59.022737+0000","last_active":"2026-02-13T02:19:00.026287+0000","last_peered":"2026-02-13T02:19:00.026287+0000","last_clean":"2026-02-13T02:19:00.026287+0000","last_became_active":"2026-02-13T02:18:59.022601+0000","last_became_peered":"2026-02-13T02:18:59.022601+0000","last_unstale":"2026-02-13T02:19:00.026287+0000","last_undegraded":"2026-02-13T02:19:00.026287+0000","last_fullsized":"2026-02-13T02:19:00.026287+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:08:39.591613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"71'12","reported_seq":29,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:06.066169+0000","last_change":"2026-02-13T02:18:58.016288+0000","last_active":"2026-02-13T02:19:06.066169+0000","last_peered":"2026-02-13T02:19:06.066169+0000","last_clean":"2026-02-13T02:19:06.066169+0000","last_became_active":"2026-02-13T02:18:58.015859+0000","last_became_peered":"2026-02-13T02:18:58.015859+0000","last_unstale":"2026-02-13T02:19:06.066169+0000","last_undegraded":"2026-02-13T02:19:06.066169+0000","last_fullsized":"2026-02-13T02:19:06.066169+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:23:12.911321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:01.085995+0000","last_change":"2026-02-13T02:18:59.022151+0000","last_active":"2026-02-13T02:19:01.085995+0000","last_peered":"2026-02-13T02:19:01.085995+0000","last_clean":"2026-02-13T02:19:01.085995+0000","last_became_active":"2026-02-13T02:18:59.021969+0000","last_became_peered":"2026-02-13T02:18:59.021969+0000","last_unstale":"2026-02-13T02:19:01.085995+0000","last_undegraded":"2026-02-13T02:19:01.085995+0000","last_fullsized":"2026-02-13T02:19:01.085995+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:58:12.160164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"71'2","reported_seq":18,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.545301+0000","last_change":"2026-02-13T02:18:58.018388+0000","last_active":"2026-02-13T02:19:00.545301+0000","last_peered":"2026-02-13T02:19:00.545301+0000","last_clean":"2026-02-13T02:19:00.545301+0000","last_became_active":"2026-02-13T02:18:58.018186+0000","last_became_peered":"2026-02-13T02:18:58.018186+0000","last_unstale":"2026-02-13T02:19:00.545301+0000","last_undegraded":"2026-02-13T02:19:00.545301+0000","last_fullsized":"2026-02-13T02:19:00.545301+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:26:19.032391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:00.026257+0000","last_change":"2026-02-13T02:18:59.021699+0000","last_active":"2026-02-13T02:19:00.026257+0000","last_peered":"2026-02-13T02:19:00.026257+0000","last_clean":"2026-02-13T02:19:00.026257+0000","last_became_active":"2026-02-13T02:18:59.021479+0000","last_became_peered":"2026-02-13T02:18:59.021479+0000","last_unstale":"2026-02-13T02:19:00.026257+0000","last_undegraded":"2026-02-13T02:19:00.026257+0000","last_fullsized":"2026-02-13T02:19:00.026257+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:58.007447+0000","last_clean_scrub_stamp":"2026-02-13T02:18:58.007447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:26:34.039117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"71'13","reported_seq":35,"reported_epoch":71,"state":"active+clean","last_fresh":"2026-02-13T02:19:09.071624+0000","last_change":"2026-02-13T02:18:58.017925+0000","last_active":"2026-02-13T02:19:09.071624+0000","last_peered":"2026-02-13T02:19:09.071624+0000","last_clean":"2026-02-13T02:19:09.071624+0000","last_became_active":"2026-02-13T02:18:58.017527+0000","last_became_peered":"2026-02-13T02:18:58.017527+0000","last_unstale":"2026-02-13T02:19:09.071624+0000","last_undegraded":"2026-02-13T02:19:09.071624+0000","last_fullsized":"2026-02-13T02:19:09.071624+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T02:18:57.003323+0000","last_clean_scrub_stamp":"2026-02-13T02:18:57.003323+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:30:09.132332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":694,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":59786,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":84,"num_read_kb":109,"num_write":226,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":540672,"data_stored":179358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":179894,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":66,"seq":283467841544,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27716,"kb_used_data":752,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":733975484,"statfs":{"total":751619276800,"available":751590895616,"internally_reserved":0,"allocated":770048,"data_stored":365317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9465,"internal_metadata":27581191},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":59,"seq":253403070472,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28392,"kb_used_data":1428,"kb_used_omap":34,"kb_used_meta":26909,"kb_avail":733974808,"statfs":{"total":751619276800,"available":751590203392,"internally_reserved":0,"allocated":1462272,"data_stored":1009600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":35780,"internal_metadata":27554876},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":56,"seq":240518168587,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27740,"kb_used_data":776,"kb_used_omap":30,"kb_used_meta":26913,"kb_avail":733975460,"statfs":{"total":751619276800,"available":751590871040,"internally_reserved":0,"allocated":794624,"data_stored":365247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31730,"internal_metadata":27558926},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":49,"seq":210453397516,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27736,"kb_used_data":772,"kb_used_omap":34,"kb_used_meta":26909,"kb_avail":733975464,"statfs":{"total":751619276800,"available":751590875136,"internally_reserved":0,"allocated":790528,"data_stored":365647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":34997,"internal_metadata":27555659},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":42,"seq":180388626445,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28320,"kb_used_data":1356,"kb_used_omap":34,"kb_used_meta":26909,"kb_avail":733974880,"statfs":{"total":751619276800,"available":751590277120,"internally_reserved":0,"allocated":1388544,"data_stored":958184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":35183,"internal_metadata":27555473},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":39,"seq":167503724559,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27724,"kb_used_data":760,"kb_used_omap":22,"kb_used_meta":26921,"kb_avail":733975476,"statfs":{"total":751619276800,"available":751590887424,"internally_reserved":0,"allocated":778240,"data_stored":364942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22674,"internal_metadata":27567982},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":32,"seq":137438953489,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28332,"kb_used_data":1368,"kb_used_omap":28,"kb_used_meta":26915,"kb_avail":733974868,"statfs":{"total":751619276800,"available":751590264832,"internally_reserved":0,"allocated":1400832,"data_stored":957474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28878,"internal_metadata":27561778},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":28,"seq":120259084306,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27724,"kb_used_data":760,"kb_used_omap":44,"kb_used_meta":26899,"kb_avail":733975476,"statfs":{"total":751619276800,"available":751590887424,"internally_reserved":0,"allocated":778240,"data_stored":365213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":45156,"internal_metadata":27545500},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":21,"seq":90194313236,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27740,"kb_used_data":776,"kb_used_omap":46,"kb_used_meta":26897,"kb_avail":733975460,"statfs":{"total":751619276800,"available":751590871040,"internally_reserved":0,"allocated":794624,"data_stored":364767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47114,"internal_metadata":27543542},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542165,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27796,"kb_used_data":832,"kb_used_omap":59,"kb_used_meta":26884,"kb_avail":733975404,"statfs":{"total":751619276800,"available":751590813696,"internally_reserved":0,"allocated":851968,"data_stored":418941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":60875,"internal_metadata":27529781},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672981,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27776,"kb_used_data":812,"kb_used_omap":43,"kb_used_meta":26900,"kb_avail":733975424,"statfs":{"total":751619276800,"available":751590834176,"internally_reserved":0,"allocated":831488,"data_stored":418743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":45022,"internal_metadata":27545634},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":7,"seq":30064771095,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27744,"kb_used_data":780,"kb_used_omap":53,"kb_used_meta":26890,"kb_avail":733975456,"statfs":{"total":751619276800,"available":751590866944,"internally_reserved":0,"allocated":798720,"data_stored":366325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":54302,"internal_metadata":27536354},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10960,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":54640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3996,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":54838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10596,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":26521,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12438,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7102,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10745,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17629,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":33293,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":22947,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":55012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20517,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3150,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-13T02:19:12.208 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2026-02-13T02:19:12.209 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-13T02:19:12.209 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2026-02-13T02:19:12.209 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:19:12.362 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:19:12.470 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.466+0000 7f9788db86c0 1 -- 10.20.193.11:0/2480339595 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f9784115410 msgr2=0x7f9784175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:12.470 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.466+0000 7f9788db86c0 1 --2- 10.20.193.11:0/2480339595 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f9784115410 0x7f9784175db0 secure :-1 s=READY pgs=293 gs=1 cs=0 l=1 c_cookie=13015017795037951455 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f977400aa70 tx=0x7f977402fde0 comp rx=0 tx=0).stop 2026-02-13T02:19:12.470 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.466+0000 7f9788db86c0 1 -- 10.20.193.11:0/2480339595 shutdown_connections 2026-02-13T02:19:12.471 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.466+0000 7f9788db86c0 1 --2- 10.20.193.11:0/2480339595 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f978410fbf0 0x7f9784114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:12.471 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.466+0000 7f9788db86c0 1 --2- 10.20.193.11:0/2480339595 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f9784115410 0x7f9784175db0 unknown :-1 s=CLOSED pgs=293 gs=1 cs=0 l=1 c_cookie=13015017795037951455 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:12.471 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.466+0000 7f9788db86c0 1 --2- 10.20.193.11:0/2480339595 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f978410f200 0x7f978410f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:12.471 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.466+0000 7f9788db86c0 1 -- 10.20.193.11:0/2480339595 >> 10.20.193.11:0/2480339595 conn(0x7f97840ecb00 msgr2=0x7f978410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:12.471 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.466+0000 7f9788db86c0 1 -- 10.20.193.11:0/2480339595 shutdown_connections 2026-02-13T02:19:12.471 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.466+0000 7f9788db86c0 1 -- 10.20.193.11:0/2480339595 wait complete. 2026-02-13T02:19:12.471 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.467+0000 7f9788db86c0 1 Processor -- start 2026-02-13T02:19:12.471 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.467+0000 7f9788db86c0 1 -- start start 2026-02-13T02:19:12.471 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.467+0000 7f9788db86c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f978410f200 0x7f978411d1f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:12.471 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.467+0000 7f9788db86c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f9784115410 0x7f978411d730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:12.472 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.467+0000 7f9788db86c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f9784122af0 0x7f9784122f90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:12.472 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.467+0000 7f9788db86c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f9784123500 con 0x7f9784122af0 2026-02-13T02:19:12.472 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.467+0000 7f9788db86c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9784123670 con 0x7f978410f200 2026-02-13T02:19:12.472 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.467+0000 7f9788db86c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f9784123830 con 0x7f9784115410 2026-02-13T02:19:12.472 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.467+0000 7f9782d766c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f9784122af0 0x7f9784122f90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:12.472 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.467+0000 7f9782d766c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f9784122af0 0x7f9784122f90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:38288/0 (socket says 10.20.193.11:38288) 2026-02-13T02:19:12.472 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.467+0000 7f9782d766c0 1 -- 10.20.193.11:0/3315362503 learned_addr learned my addr 10.20.193.11:0/3315362503 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:19:12.472 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.467+0000 7f97825756c0 1 --2- 10.20.193.11:0/3315362503 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f978410f200 0x7f978411d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:12.472 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.467+0000 7f9781d746c0 1 --2- 10.20.193.11:0/3315362503 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f9784115410 0x7f978411d730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:12.472 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.467+0000 7f9782d766c0 1 -- 10.20.193.11:0/3315362503 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f9784115410 msgr2=0x7f978411d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:12.472 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.467+0000 7f9782d766c0 1 --2- 10.20.193.11:0/3315362503 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f9784115410 0x7f978411d730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:12.473 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.467+0000 7f9782d766c0 1 -- 10.20.193.11:0/3315362503 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f978410f200 msgr2=0x7f978411d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:12.473 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.467+0000 7f9782d766c0 1 --2- 10.20.193.11:0/3315362503 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f978410f200 0x7f978411d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:12.473 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.467+0000 7f9782d766c0 1 -- 10.20.193.11:0/3315362503 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f977400a660 con 0x7f9784122af0 2026-02-13T02:19:12.473 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.467+0000 7f9782d766c0 1 --2- 10.20.193.11:0/3315362503 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f9784122af0 0x7f9784122f90 secure :-1 s=READY pgs=294 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f97740054b0 tx=0x7f97740054e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:12.473 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.467+0000 7f976b7fe6c0 1 -- 10.20.193.11:0/3315362503 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9774003a30 con 0x7f9784122af0 2026-02-13T02:19:12.473 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.467+0000 7f9788db86c0 1 -- 10.20.193.11:0/3315362503 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9784163c80 con 0x7f9784122af0 2026-02-13T02:19:12.473 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.467+0000 7f976b7fe6c0 1 -- 10.20.193.11:0/3315362503 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9774030990 con 0x7f9784122af0 2026-02-13T02:19:12.473 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.467+0000 7f976b7fe6c0 1 -- 10.20.193.11:0/3315362503 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f97740382f0 con 0x7f9784122af0 2026-02-13T02:19:12.473 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.467+0000 7f9788db86c0 1 -- 10.20.193.11:0/3315362503 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97841640b0 con 0x7f9784122af0 2026-02-13T02:19:12.473 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.468+0000 7f9788db86c0 1 -- 10.20.193.11:0/3315362503 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97841104d0 con 0x7f9784122af0 2026-02-13T02:19:12.475 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.469+0000 7f976b7fe6c0 1 -- 10.20.193.11:0/3315362503 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7f9774003b90 con 0x7f9784122af0 2026-02-13T02:19:12.475 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.470+0000 7f976b7fe6c0 1 --2- 10.20.193.11:0/3315362503 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f975c0b5710 0x7f975c0d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:12.475 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.470+0000 7f97825756c0 1 --2- 10.20.193.11:0/3315362503 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f975c0b5710 0x7f975c0d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:12.475 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.470+0000 7f976b7fe6c0 1 -- 10.20.193.11:0/3315362503 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7762+0+0 (secure 0 0 0) 0x7f9774108e40 con 0x7f9784122af0 2026-02-13T02:19:12.475 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.470+0000 7f976b7fe6c0 1 -- 10.20.193.11:0/3315362503 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f9774109330 con 0x7f9784122af0 2026-02-13T02:19:12.475 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.470+0000 7f97825756c0 1 --2- 10.20.193.11:0/3315362503 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f975c0b5710 0x7f975c0d5bc0 secure :-1 s=READY pgs=209 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9778004750 tx=0x7f9778009390 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:12.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:12 trial060 ceph-mon[14797]: pgmap v190: 97 pgs: 97 active+clean; 635 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 10 KiB/s rd, 12 KiB/s wr, 28 op/s 2026-02-13T02:19:12.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:12 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/703108575' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2026-02-13T02:19:12.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:12 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/4161908006' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2026-02-13T02:19:12.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:12 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/176805436' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2026-02-13T02:19:12.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:12 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/2247458172' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2026-02-13T02:19:12.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:12 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/3323114477' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2026-02-13T02:19:12.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:12 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/2252238137' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2026-02-13T02:19:12.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:12 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/530309646' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2026-02-13T02:19:12.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:12 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/2810223595' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2026-02-13T02:19:12.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:12 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/2152226122' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-13T02:19:12.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:12 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/2095418547' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2026-02-13T02:19:12.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:12 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/1589920223' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2026-02-13T02:19:12.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:12 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/4189343092' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2026-02-13T02:19:12.541 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:12 trial078 ceph-mon[14969]: pgmap v190: 97 pgs: 97 active+clean; 635 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 10 KiB/s rd, 12 KiB/s wr, 28 op/s 2026-02-13T02:19:12.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:12 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/703108575' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2026-02-13T02:19:12.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:12 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/4161908006' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2026-02-13T02:19:12.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:12 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/176805436' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2026-02-13T02:19:12.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:12 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/2247458172' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2026-02-13T02:19:12.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:12 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/3323114477' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2026-02-13T02:19:12.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:12 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/2252238137' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2026-02-13T02:19:12.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:12 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/530309646' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2026-02-13T02:19:12.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:12 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/2810223595' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2026-02-13T02:19:12.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:12 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/2152226122' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-13T02:19:12.543 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:12 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/2095418547' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2026-02-13T02:19:12.543 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:12 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/1589920223' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2026-02-13T02:19:12.543 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:12 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/4189343092' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2026-02-13T02:19:12.590 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.588+0000 7f9788db86c0 1 -- 10.20.193.11:0/3315362503 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f978410f5d0 con 0x7f9784122af0 2026-02-13T02:19:12.590 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.588+0000 7f976b7fe6c0 1 -- 10.20.193.11:0/3315362503 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f97740cb8a0 con 0x7f9784122af0 2026-02-13T02:19:12.590 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:19:12.590 INFO:teuthology.orchestra.run.trial011.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:19:12.591 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.589+0000 7f9788db86c0 1 -- 10.20.193.11:0/3315362503 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f975c0b5710 msgr2=0x7f975c0d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:12.591 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.589+0000 7f9788db86c0 1 --2- 10.20.193.11:0/3315362503 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f975c0b5710 0x7f975c0d5bc0 secure :-1 s=READY pgs=209 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9778004750 tx=0x7f9778009390 comp rx=0 tx=0).stop 2026-02-13T02:19:12.591 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.589+0000 7f9788db86c0 1 -- 10.20.193.11:0/3315362503 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f9784122af0 msgr2=0x7f9784122f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:12.592 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.589+0000 7f9788db86c0 1 --2- 10.20.193.11:0/3315362503 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f9784122af0 0x7f9784122f90 secure :-1 s=READY pgs=294 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f97740054b0 tx=0x7f97740054e0 comp rx=0 tx=0).stop 2026-02-13T02:19:12.592 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.589+0000 7f9788db86c0 1 -- 10.20.193.11:0/3315362503 shutdown_connections 2026-02-13T02:19:12.592 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.589+0000 7f9788db86c0 1 --2- 10.20.193.11:0/3315362503 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f975c0b5710 0x7f975c0d5bc0 unknown :-1 s=CLOSED pgs=209 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:12.592 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.589+0000 7f9788db86c0 1 --2- 10.20.193.11:0/3315362503 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f9784122af0 0x7f9784122f90 unknown :-1 s=CLOSED pgs=294 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:12.592 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.589+0000 7f9788db86c0 1 --2- 10.20.193.11:0/3315362503 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f9784115410 0x7f978411d730 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:12.592 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.589+0000 7f9788db86c0 1 --2- 10.20.193.11:0/3315362503 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f978410f200 0x7f978411d1f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:12.592 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.589+0000 7f9788db86c0 1 -- 10.20.193.11:0/3315362503 >> 10.20.193.11:0/3315362503 conn(0x7f97840ecb00 msgr2=0x7f978410cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:12.592 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.589+0000 7f9788db86c0 1 -- 10.20.193.11:0/3315362503 shutdown_connections 2026-02-13T02:19:12.592 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:12.589+0000 7f9788db86c0 1 -- 10.20.193.11:0/3315362503 wait complete. 2026-02-13T02:19:13.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:13 trial011 ceph-mon[11956]: from='client.15084 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T02:19:13.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:13 trial011 ceph-mon[11956]: from='client.15090 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T02:19:13.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:13 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/3315362503' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:19:13.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:13 trial060 ceph-mon[14797]: from='client.15084 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T02:19:13.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:13 trial060 ceph-mon[14797]: from='client.15090 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T02:19:13.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:13 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/3315362503' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:19:13.541 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:13 trial078 ceph-mon[14969]: from='client.15084 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T02:19:13.541 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:13 trial078 ceph-mon[14969]: from='client.15090 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T02:19:13.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:13 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/3315362503' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:19:14.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:14 trial011 ceph-mon[11956]: pgmap v191: 97 pgs: 97 active+clean; 635 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 9.2 KiB/s rd, 11 KiB/s wr, 25 op/s 2026-02-13T02:19:14.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:14 trial060 ceph-mon[14797]: pgmap v191: 97 pgs: 97 active+clean; 635 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 9.2 KiB/s rd, 11 KiB/s wr, 25 op/s 2026-02-13T02:19:14.541 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:14 trial078 ceph-mon[14969]: pgmap v191: 97 pgs: 97 active+clean; 635 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 9.2 KiB/s rd, 11 KiB/s wr, 25 op/s 2026-02-13T02:19:15.629 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:19:15.753 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:19:15.880 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:15.876+0000 7f10b91cd6c0 1 -- 10.20.193.11:0/3848489553 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f10b4113190 msgr2=0x7f10b4173b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:15.881 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:15.876+0000 7f10b91cd6c0 1 --2- 10.20.193.11:0/3848489553 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f10b4113190 0x7f10b4173b30 secure :-1 s=READY pgs=295 gs=1 cs=0 l=1 c_cookie=13488217866310126189 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f10a400aa70 tx=0x7f10a402fde0 comp rx=0 tx=0).stop 2026-02-13T02:19:15.881 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:15.876+0000 7f10b91cd6c0 1 -- 10.20.193.11:0/3848489553 shutdown_connections 2026-02-13T02:19:15.881 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:15.876+0000 7f10b91cd6c0 1 --2- 10.20.193.11:0/3848489553 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f10b4113190 0x7f10b4173b30 unknown :-1 s=CLOSED pgs=295 gs=1 cs=0 l=1 c_cookie=13488217866310126189 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:15.881 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:15.876+0000 7f10b91cd6c0 1 --2- 10.20.193.11:0/3848489553 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f10b4060200 0x7f10b41129b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:15.881 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:15.876+0000 7f10b91cd6c0 1 --2- 10.20.193.11:0/3848489553 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f10b405f810 0x7f10b405fbe0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:15.881 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:15.877+0000 7f10b91cd6c0 1 -- 10.20.193.11:0/3848489553 >> 10.20.193.11:0/3848489553 conn(0x7f10b40e9700 msgr2=0x7f10b4109b10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:15.881 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:15.877+0000 7f10b91cd6c0 1 -- 10.20.193.11:0/3848489553 shutdown_connections 2026-02-13T02:19:15.881 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:15.877+0000 7f10b91cd6c0 1 -- 10.20.193.11:0/3848489553 wait complete. 2026-02-13T02:19:15.882 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:15.877+0000 7f10b91cd6c0 1 Processor -- start 2026-02-13T02:19:15.882 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:15.877+0000 7f10b91cd6c0 1 -- start start 2026-02-13T02:19:15.882 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:15.877+0000 7f10b91cd6c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f10b405f810 0x7f10b40f3900 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:15.882 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:15.877+0000 7f10b91cd6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f10b4113190 0x7f10b4173a30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:15.882 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:15.877+0000 7f10b91cd6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f10b40f3f30 0x7f10b40f9200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:15.882 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:15.877+0000 7f10b91cd6c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f10b40f4620 con 0x7f10b40f3f30 2026-02-13T02:19:15.882 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:15.877+0000 7f10b91cd6c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f10b40f9740 con 0x7f10b405f810 2026-02-13T02:19:15.882 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:15.877+0000 7f10b91cd6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f10b40f9900 con 0x7f10b4113190 2026-02-13T02:19:15.882 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:15.877+0000 7f10b35776c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f10b40f3f30 0x7f10b40f9200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:15.882 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:15.877+0000 7f10b35776c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f10b40f3f30 0x7f10b40f9200 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:38302/0 (socket says 10.20.193.11:38302) 2026-02-13T02:19:15.882 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:15.877+0000 7f10b35776c0 1 -- 10.20.193.11:0/841745822 learned_addr learned my addr 10.20.193.11:0/841745822 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:19:15.883 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:15.877+0000 7f10b2d766c0 1 --2- 10.20.193.11:0/841745822 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f10b405f810 0x7f10b40f3900 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:15.883 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:15.877+0000 7f10b35776c0 1 -- 10.20.193.11:0/841745822 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f10b4113190 msgr2=0x7f10b4173a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:15.883 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:15.877+0000 7f10b35776c0 1 --2- 10.20.193.11:0/841745822 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f10b4113190 0x7f10b4173a30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:15.883 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:15.877+0000 7f10b35776c0 1 -- 10.20.193.11:0/841745822 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f10b405f810 msgr2=0x7f10b40f3900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:15.883 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:15.877+0000 7f10b35776c0 1 --2- 10.20.193.11:0/841745822 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f10b405f810 0x7f10b40f3900 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:15.883 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:15.877+0000 7f10b35776c0 1 -- 10.20.193.11:0/841745822 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10a400a660 con 0x7f10b40f3f30 2026-02-13T02:19:15.883 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:15.877+0000 7f10b35776c0 1 --2- 10.20.193.11:0/841745822 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f10b40f3f30 0x7f10b40f9200 secure :-1 s=READY pgs=296 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f10a40054b0 tx=0x7f10a40054e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:15.883 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:15.877+0000 7f1093fff6c0 1 -- 10.20.193.11:0/841745822 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f10a4003a30 con 0x7f10b40f3f30 2026-02-13T02:19:15.883 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:15.877+0000 7f1093fff6c0 1 -- 10.20.193.11:0/841745822 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f10a4030990 con 0x7f10b40f3f30 2026-02-13T02:19:15.883 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:15.877+0000 7f10b91cd6c0 1 -- 10.20.193.11:0/841745822 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10b40f9b80 con 0x7f10b40f3f30 2026-02-13T02:19:15.883 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:15.877+0000 7f1093fff6c0 1 -- 10.20.193.11:0/841745822 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f10a40382f0 con 0x7f10b40f3f30 2026-02-13T02:19:15.884 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:15.877+0000 7f10b91cd6c0 1 -- 10.20.193.11:0/841745822 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10b40f9fb0 con 0x7f10b40f3f30 2026-02-13T02:19:15.884 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:15.878+0000 7f10b91cd6c0 1 -- 10.20.193.11:0/841745822 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10b410e250 con 0x7f10b40f3f30 2026-02-13T02:19:15.885 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:15.879+0000 7f1093fff6c0 1 -- 10.20.193.11:0/841745822 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7f10a4003b90 con 0x7f10b40f3f30 2026-02-13T02:19:15.885 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:15.880+0000 7f1093fff6c0 1 --2- 10.20.193.11:0/841745822 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f10880b5690 0x7f10880d5b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:15.885 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:15.880+0000 7f1093fff6c0 1 -- 10.20.193.11:0/841745822 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7762+0+0 (secure 0 0 0) 0x7f10a4108d40 con 0x7f10b40f3f30 2026-02-13T02:19:15.885 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:15.880+0000 7f10b2d766c0 1 --2- 10.20.193.11:0/841745822 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f10880b5690 0x7f10880d5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:15.885 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:15.880+0000 7f1093fff6c0 1 -- 10.20.193.11:0/841745822 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f10a4109230 con 0x7f10b40f3f30 2026-02-13T02:19:15.885 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:15.880+0000 7f10b2d766c0 1 --2- 10.20.193.11:0/841745822 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f10880b5690 0x7f10880d5b40 secure :-1 s=READY pgs=210 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f10a8004750 tx=0x7f10a8009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:16.004 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:16.002+0000 7f10b91cd6c0 1 -- 10.20.193.11:0/841745822 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f10b405fbe0 con 0x7f10b40f3f30 2026-02-13T02:19:16.004 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:16.002+0000 7f1093fff6c0 1 -- 10.20.193.11:0/841745822 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f10a40cb7a0 con 0x7f10b40f3f30 2026-02-13T02:19:16.005 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:19:16.005 INFO:teuthology.orchestra.run.trial011.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:19:16.006 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:16.003+0000 7f10b91cd6c0 1 -- 10.20.193.11:0/841745822 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f10880b5690 msgr2=0x7f10880d5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:16.006 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:16.003+0000 7f10b91cd6c0 1 --2- 10.20.193.11:0/841745822 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f10880b5690 0x7f10880d5b40 secure :-1 s=READY pgs=210 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f10a8004750 tx=0x7f10a8009260 comp rx=0 tx=0).stop 2026-02-13T02:19:16.006 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:16.003+0000 7f10b91cd6c0 1 -- 10.20.193.11:0/841745822 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f10b40f3f30 msgr2=0x7f10b40f9200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:16.006 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:16.003+0000 7f10b91cd6c0 1 --2- 10.20.193.11:0/841745822 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f10b40f3f30 0x7f10b40f9200 secure :-1 s=READY pgs=296 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f10a40054b0 tx=0x7f10a40054e0 comp rx=0 tx=0).stop 2026-02-13T02:19:16.006 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:16.003+0000 7f10b91cd6c0 1 -- 10.20.193.11:0/841745822 shutdown_connections 2026-02-13T02:19:16.006 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:16.003+0000 7f10b91cd6c0 1 --2- 10.20.193.11:0/841745822 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f10880b5690 0x7f10880d5b40 unknown :-1 s=CLOSED pgs=210 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:16.006 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:16.003+0000 7f10b91cd6c0 1 --2- 10.20.193.11:0/841745822 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f10b40f3f30 0x7f10b40f9200 unknown :-1 s=CLOSED pgs=296 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:16.006 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:16.003+0000 7f10b91cd6c0 1 --2- 10.20.193.11:0/841745822 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f10b4113190 0x7f10b4173a30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:16.007 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:16.003+0000 7f10b91cd6c0 1 --2- 10.20.193.11:0/841745822 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f10b405f810 0x7f10b40f3900 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:16.007 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:16.003+0000 7f10b91cd6c0 1 -- 10.20.193.11:0/841745822 >> 10.20.193.11:0/841745822 conn(0x7f10b40e9700 msgr2=0x7f10b410e740 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:16.007 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:16.003+0000 7f10b91cd6c0 1 -- 10.20.193.11:0/841745822 shutdown_connections 2026-02-13T02:19:16.007 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:16.003+0000 7f10b91cd6c0 1 -- 10.20.193.11:0/841745822 wait complete. 2026-02-13T02:19:16.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:16 trial011 ceph-mon[11956]: pgmap v192: 97 pgs: 97 active+clean; 635 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 9.4 KiB/s rd, 9.8 KiB/s wr, 24 op/s 2026-02-13T02:19:16.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:16 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/841745822' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:19:16.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:16 trial060 ceph-mon[14797]: pgmap v192: 97 pgs: 97 active+clean; 635 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 9.4 KiB/s rd, 9.8 KiB/s wr, 24 op/s 2026-02-13T02:19:16.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:16 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/841745822' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:19:16.541 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:16 trial078 ceph-mon[14969]: pgmap v192: 97 pgs: 97 active+clean; 635 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 9.4 KiB/s rd, 9.8 KiB/s wr, 24 op/s 2026-02-13T02:19:16.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:16 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/841745822' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:19:18.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:18 trial011 ceph-mon[11956]: pgmap v193: 97 pgs: 97 active+clean; 648 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 9.5 KiB/s wr, 23 op/s 2026-02-13T02:19:18.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:18 trial060 ceph-mon[14797]: pgmap v193: 97 pgs: 97 active+clean; 648 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 9.5 KiB/s wr, 23 op/s 2026-02-13T02:19:18.541 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:18 trial078 ceph-mon[14969]: pgmap v193: 97 pgs: 97 active+clean; 648 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 9.5 KiB/s wr, 23 op/s 2026-02-13T02:19:19.044 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:19:19.170 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:19:19.282 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:19.278+0000 7ff0e8af86c0 1 -- 10.20.193.11:0/196455966 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7ff0e410fbf0 msgr2=0x7ff0e4114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:19.282 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:19.278+0000 7ff0e8af86c0 1 --2- 10.20.193.11:0/196455966 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7ff0e410fbf0 0x7ff0e4114c30 secure :-1 s=READY pgs=297 gs=1 cs=0 l=1 c_cookie=14405966650518960474 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff0cc0099a0 tx=0x7ff0cc02ed20 comp rx=0 tx=0).stop 2026-02-13T02:19:19.282 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:19.278+0000 7ff0e8af86c0 1 -- 10.20.193.11:0/196455966 shutdown_connections 2026-02-13T02:19:19.283 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:19.278+0000 7ff0e8af86c0 1 --2- 10.20.193.11:0/196455966 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff0e4115410 0x7ff0e4175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:19.283 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:19.278+0000 7ff0e8af86c0 1 --2- 10.20.193.11:0/196455966 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7ff0e410fbf0 0x7ff0e4114c30 unknown :-1 s=CLOSED pgs=297 gs=1 cs=0 l=1 c_cookie=14405966650518960474 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:19.283 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:19.278+0000 7ff0e8af86c0 1 --2- 10.20.193.11:0/196455966 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7ff0e410f200 0x7ff0e410f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:19.283 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:19.278+0000 7ff0e8af86c0 1 -- 10.20.193.11:0/196455966 >> 10.20.193.11:0/196455966 conn(0x7ff0e40ecb00 msgr2=0x7ff0e410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:19.283 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:19.278+0000 7ff0e8af86c0 1 -- 10.20.193.11:0/196455966 shutdown_connections 2026-02-13T02:19:19.283 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:19.278+0000 7ff0e8af86c0 1 -- 10.20.193.11:0/196455966 wait complete. 2026-02-13T02:19:19.283 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:19.278+0000 7ff0e8af86c0 1 Processor -- start 2026-02-13T02:19:19.283 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:19.278+0000 7ff0e8af86c0 1 -- start start 2026-02-13T02:19:19.283 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:19.278+0000 7ff0e8af86c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7ff0e410f200 0x7ff0e40f4c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:19.283 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:19.278+0000 7ff0e8af86c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7ff0e4115410 0x7ff0e4175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:19.283 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:19.278+0000 7ff0e8af86c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff0e40f5270 0x7ff0e40fa540 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:19.284 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:19.278+0000 7ff0e8af86c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7ff0e40f5960 con 0x7ff0e4115410 2026-02-13T02:19:19.284 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:19.278+0000 7ff0e8af86c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff0e40faa80 con 0x7ff0e410f200 2026-02-13T02:19:19.284 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:19.278+0000 7ff0e8af86c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7ff0e40fac40 con 0x7ff0e40f5270 2026-02-13T02:19:19.284 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:19.278+0000 7ff0e1d746c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7ff0e4115410 0x7ff0e4175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:19.284 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:19.279+0000 7ff0e1d746c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7ff0e4115410 0x7ff0e4175cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:38314/0 (socket says 10.20.193.11:38314) 2026-02-13T02:19:19.284 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:19.279+0000 7ff0e1d746c0 1 -- 10.20.193.11:0/4145745688 learned_addr learned my addr 10.20.193.11:0/4145745688 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:19:19.284 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:19.279+0000 7ff0e25756c0 1 --2- 10.20.193.11:0/4145745688 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7ff0e410f200 0x7ff0e40f4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:19.284 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:19.279+0000 7ff0e1d746c0 1 -- 10.20.193.11:0/4145745688 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff0e40f5270 msgr2=0x7ff0e40fa540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:19.284 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:19.279+0000 7ff0e1d746c0 1 --2- 10.20.193.11:0/4145745688 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff0e40f5270 0x7ff0e40fa540 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:19.284 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:19.279+0000 7ff0e1d746c0 1 -- 10.20.193.11:0/4145745688 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7ff0e410f200 msgr2=0x7ff0e40f4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:19.284 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:19.279+0000 7ff0e1d746c0 1 --2- 10.20.193.11:0/4145745688 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7ff0e410f200 0x7ff0e40f4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:19.284 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:19.279+0000 7ff0e1d746c0 1 -- 10.20.193.11:0/4145745688 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0cc009590 con 0x7ff0e4115410 2026-02-13T02:19:19.285 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:19.279+0000 7ff0e1d746c0 1 --2- 10.20.193.11:0/4145745688 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7ff0e4115410 0x7ff0e4175cb0 secure :-1 s=READY pgs=298 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff0cc031f90 tx=0x7ff0cc0047f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:19.285 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:19.279+0000 7ff0cb7fe6c0 1 -- 10.20.193.11:0/4145745688 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff0cc002ae0 con 0x7ff0e4115410 2026-02-13T02:19:19.285 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:19.279+0000 7ff0e8af86c0 1 -- 10.20.193.11:0/4145745688 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0e40faec0 con 0x7ff0e4115410 2026-02-13T02:19:19.285 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:19.279+0000 7ff0cb7fe6c0 1 -- 10.20.193.11:0/4145745688 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff0cc007740 con 0x7ff0e4115410 2026-02-13T02:19:19.285 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:19.279+0000 7ff0cb7fe6c0 1 -- 10.20.193.11:0/4145745688 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff0cc031560 con 0x7ff0e4115410 2026-02-13T02:19:19.285 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:19.279+0000 7ff0e8af86c0 1 -- 10.20.193.11:0/4145745688 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0e40fb340 con 0x7ff0e4115410 2026-02-13T02:19:19.285 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:19.279+0000 7ff0e8af86c0 1 -- 10.20.193.11:0/4145745688 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0e41104d0 con 0x7ff0e4115410 2026-02-13T02:19:19.286 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:19.281+0000 7ff0cb7fe6c0 1 -- 10.20.193.11:0/4145745688 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7ff0cc002c40 con 0x7ff0e4115410 2026-02-13T02:19:19.286 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:19.281+0000 7ff0cb7fe6c0 1 --2- 10.20.193.11:0/4145745688 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7ff0bc0b5690 0x7ff0bc0d5b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:19.286 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:19.281+0000 7ff0e25756c0 1 --2- 10.20.193.11:0/4145745688 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7ff0bc0b5690 0x7ff0bc0d5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:19.286 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:19.281+0000 7ff0cb7fe6c0 1 -- 10.20.193.11:0/4145745688 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7762+0+0 (secure 0 0 0) 0x7ff0cc107d70 con 0x7ff0e4115410 2026-02-13T02:19:19.287 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:19.281+0000 7ff0cb7fe6c0 1 -- 10.20.193.11:0/4145745688 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7ff0cc0ce230 con 0x7ff0e4115410 2026-02-13T02:19:19.287 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:19.281+0000 7ff0e25756c0 1 --2- 10.20.193.11:0/4145745688 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7ff0bc0b5690 0x7ff0bc0d5b40 secure :-1 s=READY pgs=211 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff0d8005980 tx=0x7ff0d8005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:19.396 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:19.395+0000 7ff0e8af86c0 1 -- 10.20.193.11:0/4145745688 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ff0e410f5d0 con 0x7ff0e4115410 2026-02-13T02:19:19.397 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:19.395+0000 7ff0cb7fe6c0 1 -- 10.20.193.11:0/4145745688 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7ff0cc0cd980 con 0x7ff0e4115410 2026-02-13T02:19:19.397 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:19:19.397 INFO:teuthology.orchestra.run.trial011.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:19:19.398 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:19.396+0000 7ff0e8af86c0 1 -- 10.20.193.11:0/4145745688 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7ff0bc0b5690 msgr2=0x7ff0bc0d5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:19.398 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:19.396+0000 7ff0e8af86c0 1 --2- 10.20.193.11:0/4145745688 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7ff0bc0b5690 0x7ff0bc0d5b40 secure :-1 s=READY pgs=211 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff0d8005980 tx=0x7ff0d8005910 comp rx=0 tx=0).stop 2026-02-13T02:19:19.398 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:19.396+0000 7ff0e8af86c0 1 -- 10.20.193.11:0/4145745688 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7ff0e4115410 msgr2=0x7ff0e4175cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:19.398 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:19.396+0000 7ff0e8af86c0 1 --2- 10.20.193.11:0/4145745688 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7ff0e4115410 0x7ff0e4175cb0 secure :-1 s=READY pgs=298 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff0cc031f90 tx=0x7ff0cc0047f0 comp rx=0 tx=0).stop 2026-02-13T02:19:19.398 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:19.396+0000 7ff0e8af86c0 1 -- 10.20.193.11:0/4145745688 shutdown_connections 2026-02-13T02:19:19.398 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:19.396+0000 7ff0e8af86c0 1 --2- 10.20.193.11:0/4145745688 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7ff0bc0b5690 0x7ff0bc0d5b40 unknown :-1 s=CLOSED pgs=211 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:19.398 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:19.396+0000 7ff0e8af86c0 1 --2- 10.20.193.11:0/4145745688 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff0e40f5270 0x7ff0e40fa540 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:19.398 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:19.396+0000 7ff0e8af86c0 1 --2- 10.20.193.11:0/4145745688 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7ff0e4115410 0x7ff0e4175cb0 unknown :-1 s=CLOSED pgs=298 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:19.398 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:19.396+0000 7ff0e8af86c0 1 --2- 10.20.193.11:0/4145745688 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7ff0e410f200 0x7ff0e40f4c40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:19.398 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:19.396+0000 7ff0e8af86c0 1 -- 10.20.193.11:0/4145745688 >> 10.20.193.11:0/4145745688 conn(0x7ff0e40ecb00 msgr2=0x7ff0e410d860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:19.398 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:19.396+0000 7ff0e8af86c0 1 -- 10.20.193.11:0/4145745688 shutdown_connections 2026-02-13T02:19:19.398 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:19.396+0000 7ff0e8af86c0 1 -- 10.20.193.11:0/4145745688 wait complete. 2026-02-13T02:19:20.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:20 trial011 ceph-mon[11956]: pgmap v194: 97 pgs: 97 active+clean; 648 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 5.1 KiB/s wr, 16 op/s 2026-02-13T02:19:20.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:20 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/4145745688' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:19:20.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:20 trial060 ceph-mon[14797]: pgmap v194: 97 pgs: 97 active+clean; 648 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 5.1 KiB/s wr, 16 op/s 2026-02-13T02:19:20.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:20 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/4145745688' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:19:20.541 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:20 trial078 ceph-mon[14969]: pgmap v194: 97 pgs: 97 active+clean; 648 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 5.1 KiB/s wr, 16 op/s 2026-02-13T02:19:20.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:20 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/4145745688' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:19:22.436 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:19:22.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:22 trial011 ceph-mon[11956]: pgmap v195: 97 pgs: 97 active+clean; 648 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 10 KiB/s rd, 4.1 KiB/s wr, 11 op/s 2026-02-13T02:19:22.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:22 trial060 ceph-mon[14797]: pgmap v195: 97 pgs: 97 active+clean; 648 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 10 KiB/s rd, 4.1 KiB/s wr, 11 op/s 2026-02-13T02:19:22.541 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:22 trial078 ceph-mon[14969]: pgmap v195: 97 pgs: 97 active+clean; 648 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 10 KiB/s rd, 4.1 KiB/s wr, 11 op/s 2026-02-13T02:19:22.561 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:19:22.682 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:22.678+0000 7fc49160b6c0 1 -- 10.20.193.11:0/3358541763 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fc48c10fbf0 msgr2=0x7fc48c114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:22.682 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:22.678+0000 7fc49160b6c0 1 --2- 10.20.193.11:0/3358541763 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fc48c10fbf0 0x7fc48c114c30 secure :-1 s=READY pgs=299 gs=1 cs=0 l=1 c_cookie=8359105228853513771 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc4740099a0 tx=0x7fc47402ed20 comp rx=0 tx=0).stop 2026-02-13T02:19:22.683 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:22.678+0000 7fc49160b6c0 1 -- 10.20.193.11:0/3358541763 shutdown_connections 2026-02-13T02:19:22.683 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:22.678+0000 7fc49160b6c0 1 --2- 10.20.193.11:0/3358541763 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fc48c115410 0x7fc48c175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:22.683 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:22.678+0000 7fc49160b6c0 1 --2- 10.20.193.11:0/3358541763 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fc48c10fbf0 0x7fc48c114c30 unknown :-1 s=CLOSED pgs=299 gs=1 cs=0 l=1 c_cookie=8359105228853513771 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:22.683 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:22.678+0000 7fc49160b6c0 1 --2- 10.20.193.11:0/3358541763 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fc48c10f200 0x7fc48c10f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:22.683 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:22.678+0000 7fc49160b6c0 1 -- 10.20.193.11:0/3358541763 >> 10.20.193.11:0/3358541763 conn(0x7fc48c0ecb00 msgr2=0x7fc48c10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:22.683 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:22.678+0000 7fc49160b6c0 1 -- 10.20.193.11:0/3358541763 shutdown_connections 2026-02-13T02:19:22.683 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:22.678+0000 7fc49160b6c0 1 -- 10.20.193.11:0/3358541763 wait complete. 2026-02-13T02:19:22.683 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:22.679+0000 7fc49160b6c0 1 Processor -- start 2026-02-13T02:19:22.683 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:22.679+0000 7fc49160b6c0 1 -- start start 2026-02-13T02:19:22.683 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:22.679+0000 7fc49160b6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fc48c10f200 0x7fc48c0f4b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:22.684 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:22.679+0000 7fc49160b6c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fc48c115410 0x7fc48c175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:22.684 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:22.679+0000 7fc49160b6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fc48c0f5170 0x7fc48c0fa3f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:22.684 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:22.679+0000 7fc49160b6c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7fc48c0f5860 con 0x7fc48c10f200 2026-02-13T02:19:22.684 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:22.679+0000 7fc49160b6c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc48c0fa930 con 0x7fc48c115410 2026-02-13T02:19:22.684 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:22.679+0000 7fc49160b6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc48c0faaf0 con 0x7fc48c0f5170 2026-02-13T02:19:22.684 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:22.679+0000 7fc48affd6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fc48c10f200 0x7fc48c0f4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:22.684 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:22.679+0000 7fc48affd6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fc48c10f200 0x7fc48c0f4b40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:33960/0 (socket says 10.20.193.11:33960) 2026-02-13T02:19:22.684 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:22.679+0000 7fc48affd6c0 1 -- 10.20.193.11:0/866419440 learned_addr learned my addr 10.20.193.11:0/866419440 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:19:22.684 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:22.679+0000 7fc48b7fe6c0 1 --2- 10.20.193.11:0/866419440 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fc48c0f5170 0x7fc48c0fa3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:22.684 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:22.679+0000 7fc48affd6c0 1 -- 10.20.193.11:0/866419440 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fc48c0f5170 msgr2=0x7fc48c0fa3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:22.684 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:22.679+0000 7fc48affd6c0 1 --2- 10.20.193.11:0/866419440 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fc48c0f5170 0x7fc48c0fa3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:22.684 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:22.679+0000 7fc48affd6c0 1 -- 10.20.193.11:0/866419440 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fc48c115410 msgr2=0x7fc48c175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:22.685 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:22.679+0000 7fc48affd6c0 1 --2- 10.20.193.11:0/866419440 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fc48c115410 0x7fc48c175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:22.685 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:22.679+0000 7fc48affd6c0 1 -- 10.20.193.11:0/866419440 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc474009590 con 0x7fc48c10f200 2026-02-13T02:19:22.685 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:22.679+0000 7fc48b7fe6c0 1 --2- 10.20.193.11:0/866419440 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fc48c0f5170 0x7fc48c0fa3f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:19:22.685 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:22.679+0000 7fc48affd6c0 1 --2- 10.20.193.11:0/866419440 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fc48c10f200 0x7fc48c0f4b40 secure :-1 s=READY pgs=300 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc480009490 tx=0x7fc48000bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:22.685 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:22.679+0000 7fc46bfff6c0 1 -- 10.20.193.11:0/866419440 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc480004a80 con 0x7fc48c10f200 2026-02-13T02:19:22.685 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:22.679+0000 7fc46bfff6c0 1 -- 10.20.193.11:0/866419440 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fc480009030 con 0x7fc48c10f200 2026-02-13T02:19:22.685 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:22.679+0000 7fc49160b6c0 1 -- 10.20.193.11:0/866419440 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc48c0fadd0 con 0x7fc48c10f200 2026-02-13T02:19:22.685 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:22.679+0000 7fc46bfff6c0 1 -- 10.20.193.11:0/866419440 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc4800071c0 con 0x7fc48c10f200 2026-02-13T02:19:22.685 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:22.679+0000 7fc49160b6c0 1 -- 10.20.193.11:0/866419440 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc48c0fb560 con 0x7fc48c10f200 2026-02-13T02:19:22.685 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:22.680+0000 7fc49160b6c0 1 -- 10.20.193.11:0/866419440 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc48c1104d0 con 0x7fc48c10f200 2026-02-13T02:19:22.686 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:22.681+0000 7fc46bfff6c0 1 -- 10.20.193.11:0/866419440 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7fc480005000 con 0x7fc48c10f200 2026-02-13T02:19:22.686 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:22.681+0000 7fc46bfff6c0 1 --2- 10.20.193.11:0/866419440 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fc4600b5710 0x7fc4600d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:22.686 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:22.682+0000 7fc48a7fc6c0 1 --2- 10.20.193.11:0/866419440 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fc4600b5710 0x7fc4600d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:22.687 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:22.682+0000 7fc46bfff6c0 1 -- 10.20.193.11:0/866419440 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7762+0+0 (secure 0 0 0) 0x7fc4800e3ba0 con 0x7fc48c10f200 2026-02-13T02:19:22.687 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:22.682+0000 7fc48a7fc6c0 1 --2- 10.20.193.11:0/866419440 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fc4600b5710 0x7fc4600d5bc0 secure :-1 s=READY pgs=212 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc4740098c0 tx=0x7fc474005bc0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:22.687 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:22.682+0000 7fc46bfff6c0 1 -- 10.20.193.11:0/866419440 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fc4800a65c0 con 0x7fc48c10f200 2026-02-13T02:19:22.802 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:22.800+0000 7fc49160b6c0 1 -- 10.20.193.11:0/866419440 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fc48c0f5ca0 con 0x7fc48c10f200 2026-02-13T02:19:22.803 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:22.800+0000 7fc46bfff6c0 1 -- 10.20.193.11:0/866419440 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fc480004d90 con 0x7fc48c10f200 2026-02-13T02:19:22.803 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:19:22.803 INFO:teuthology.orchestra.run.trial011.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:19:22.804 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:22.802+0000 7fc49160b6c0 1 -- 10.20.193.11:0/866419440 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fc4600b5710 msgr2=0x7fc4600d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:22.804 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:22.802+0000 7fc49160b6c0 1 --2- 10.20.193.11:0/866419440 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fc4600b5710 0x7fc4600d5bc0 secure :-1 s=READY pgs=212 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc4740098c0 tx=0x7fc474005bc0 comp rx=0 tx=0).stop 2026-02-13T02:19:22.804 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:22.802+0000 7fc49160b6c0 1 -- 10.20.193.11:0/866419440 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fc48c10f200 msgr2=0x7fc48c0f4b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:22.804 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:22.802+0000 7fc49160b6c0 1 --2- 10.20.193.11:0/866419440 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fc48c10f200 0x7fc48c0f4b40 secure :-1 s=READY pgs=300 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc480009490 tx=0x7fc48000bca0 comp rx=0 tx=0).stop 2026-02-13T02:19:22.804 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:22.802+0000 7fc49160b6c0 1 -- 10.20.193.11:0/866419440 shutdown_connections 2026-02-13T02:19:22.805 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:22.802+0000 7fc49160b6c0 1 --2- 10.20.193.11:0/866419440 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fc4600b5710 0x7fc4600d5bc0 unknown :-1 s=CLOSED pgs=212 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:22.805 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:22.802+0000 7fc49160b6c0 1 --2- 10.20.193.11:0/866419440 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fc48c115410 0x7fc48c175cb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:22.805 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:22.802+0000 7fc49160b6c0 1 --2- 10.20.193.11:0/866419440 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fc48c0f5170 0x7fc48c0fa3f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:22.805 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:22.802+0000 7fc49160b6c0 1 --2- 10.20.193.11:0/866419440 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fc48c10f200 0x7fc48c0f4b40 unknown :-1 s=CLOSED pgs=300 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:22.805 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:22.802+0000 7fc49160b6c0 1 -- 10.20.193.11:0/866419440 >> 10.20.193.11:0/866419440 conn(0x7fc48c0ecb00 msgr2=0x7fc48c10d760 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:22.805 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:22.802+0000 7fc49160b6c0 1 -- 10.20.193.11:0/866419440 shutdown_connections 2026-02-13T02:19:22.805 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:22.802+0000 7fc49160b6c0 1 -- 10.20.193.11:0/866419440 wait complete. 2026-02-13T02:19:23.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:23 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/866419440' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:19:23.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:23 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/866419440' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:19:23.541 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:23 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/866419440' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:19:24.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:24 trial011 ceph-mon[11956]: pgmap v196: 97 pgs: 97 active+clean; 648 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 1.3 KiB/s wr, 8 op/s 2026-02-13T02:19:24.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:24 trial060 ceph-mon[14797]: pgmap v196: 97 pgs: 97 active+clean; 648 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 1.3 KiB/s wr, 8 op/s 2026-02-13T02:19:24.541 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:24 trial078 ceph-mon[14969]: pgmap v196: 97 pgs: 97 active+clean; 648 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 1.3 KiB/s wr, 8 op/s 2026-02-13T02:19:25.844 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:19:25.970 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:19:26.080 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:26.076+0000 7fdc52f846c0 1 -- 10.20.193.11:0/2205932279 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fdc4c10fbf0 msgr2=0x7fdc4c114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:26.080 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:26.076+0000 7fdc52f846c0 1 --2- 10.20.193.11:0/2205932279 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fdc4c10fbf0 0x7fdc4c114c30 secure :-1 s=READY pgs=301 gs=1 cs=0 l=1 c_cookie=11158904772030372017 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdc340099a0 tx=0x7fdc3402ed20 comp rx=0 tx=0).stop 2026-02-13T02:19:26.080 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:26.076+0000 7fdc52f846c0 1 -- 10.20.193.11:0/2205932279 shutdown_connections 2026-02-13T02:19:26.080 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:26.076+0000 7fdc52f846c0 1 --2- 10.20.193.11:0/2205932279 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fdc4c115410 0x7fdc4c175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:26.080 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:26.076+0000 7fdc52f846c0 1 --2- 10.20.193.11:0/2205932279 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fdc4c10fbf0 0x7fdc4c114c30 unknown :-1 s=CLOSED pgs=301 gs=1 cs=0 l=1 c_cookie=11158904772030372017 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:26.080 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:26.076+0000 7fdc52f846c0 1 --2- 10.20.193.11:0/2205932279 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fdc4c10f200 0x7fdc4c10f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:26.080 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:26.076+0000 7fdc52f846c0 1 -- 10.20.193.11:0/2205932279 >> 10.20.193.11:0/2205932279 conn(0x7fdc4c0ecb00 msgr2=0x7fdc4c10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:26.080 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:26.076+0000 7fdc52f846c0 1 -- 10.20.193.11:0/2205932279 shutdown_connections 2026-02-13T02:19:26.081 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:26.076+0000 7fdc52f846c0 1 -- 10.20.193.11:0/2205932279 wait complete. 2026-02-13T02:19:26.081 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:26.076+0000 7fdc52f846c0 1 Processor -- start 2026-02-13T02:19:26.081 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:26.076+0000 7fdc52f846c0 1 -- start start 2026-02-13T02:19:26.081 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:26.076+0000 7fdc52f846c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fdc4c10f200 0x7fdc4c0f4b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:26.081 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:26.076+0000 7fdc52f846c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fdc4c115410 0x7fdc4c175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:26.081 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:26.076+0000 7fdc52f846c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fdc4c0f51c0 0x7fdc4c0fa440 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:26.081 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:26.076+0000 7fdc52f846c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7fdc4c0f58b0 con 0x7fdc4c10f200 2026-02-13T02:19:26.081 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:26.076+0000 7fdc52f846c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7fdc4c0fa980 con 0x7fdc4c115410 2026-02-13T02:19:26.081 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:26.076+0000 7fdc52f846c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fdc4c0fab40 con 0x7fdc4c0f51c0 2026-02-13T02:19:26.081 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:26.076+0000 7fdc50cf96c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fdc4c10f200 0x7fdc4c0f4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:26.081 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:26.076+0000 7fdc50cf96c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fdc4c10f200 0x7fdc4c0f4b90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:33976/0 (socket says 10.20.193.11:33976) 2026-02-13T02:19:26.081 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:26.076+0000 7fdc50cf96c0 1 -- 10.20.193.11:0/3942231131 learned_addr learned my addr 10.20.193.11:0/3942231131 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:19:26.082 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:26.076+0000 7fdc43fff6c0 1 --2- 10.20.193.11:0/3942231131 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fdc4c115410 0x7fdc4c175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:26.082 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:26.077+0000 7fdc514fa6c0 1 --2- 10.20.193.11:0/3942231131 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fdc4c0f51c0 0x7fdc4c0fa440 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:26.082 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:26.077+0000 7fdc50cf96c0 1 -- 10.20.193.11:0/3942231131 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fdc4c0f51c0 msgr2=0x7fdc4c0fa440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:26.082 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:26.077+0000 7fdc50cf96c0 1 --2- 10.20.193.11:0/3942231131 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fdc4c0f51c0 0x7fdc4c0fa440 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:26.082 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:26.077+0000 7fdc50cf96c0 1 -- 10.20.193.11:0/3942231131 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fdc4c115410 msgr2=0x7fdc4c175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:26.082 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:26.077+0000 7fdc50cf96c0 1 --2- 10.20.193.11:0/3942231131 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fdc4c115410 0x7fdc4c175cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:26.082 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:26.077+0000 7fdc50cf96c0 1 -- 10.20.193.11:0/3942231131 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc34009590 con 0x7fdc4c10f200 2026-02-13T02:19:26.082 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:26.077+0000 7fdc43fff6c0 1 --2- 10.20.193.11:0/3942231131 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fdc4c115410 0x7fdc4c175cb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T02:19:26.082 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:26.077+0000 7fdc50cf96c0 1 --2- 10.20.193.11:0/3942231131 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fdc4c10f200 0x7fdc4c0f4b90 secure :-1 s=READY pgs=302 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdc3c00b710 tx=0x7fdc3c00bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:26.082 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:26.077+0000 7fdc41ffb6c0 1 -- 10.20.193.11:0/3942231131 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdc3c004250 con 0x7fdc4c10f200 2026-02-13T02:19:26.082 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:26.077+0000 7fdc41ffb6c0 1 -- 10.20.193.11:0/3942231131 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fdc3c009070 con 0x7fdc4c10f200 2026-02-13T02:19:26.082 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:26.077+0000 7fdc52f846c0 1 -- 10.20.193.11:0/3942231131 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc4c0fae20 con 0x7fdc4c10f200 2026-02-13T02:19:26.082 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:26.077+0000 7fdc41ffb6c0 1 -- 10.20.193.11:0/3942231131 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdc3c00cd70 con 0x7fdc4c10f200 2026-02-13T02:19:26.083 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:26.077+0000 7fdc52f846c0 1 -- 10.20.193.11:0/3942231131 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc4c0fb5b0 con 0x7fdc4c10f200 2026-02-13T02:19:26.083 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:26.077+0000 7fdc52f846c0 1 -- 10.20.193.11:0/3942231131 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc4c1104d0 con 0x7fdc4c10f200 2026-02-13T02:19:26.084 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:26.079+0000 7fdc41ffb6c0 1 -- 10.20.193.11:0/3942231131 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7fdc3c0028c0 con 0x7fdc4c10f200 2026-02-13T02:19:26.084 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:26.080+0000 7fdc41ffb6c0 1 --2- 10.20.193.11:0/3942231131 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fdc280b5710 0x7fdc280d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:26.084 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:26.080+0000 7fdc43fff6c0 1 --2- 10.20.193.11:0/3942231131 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fdc280b5710 0x7fdc280d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:26.084 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:26.080+0000 7fdc41ffb6c0 1 -- 10.20.193.11:0/3942231131 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7762+0+0 (secure 0 0 0) 0x7fdc3c0e3b20 con 0x7fdc4c10f200 2026-02-13T02:19:26.084 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:26.080+0000 7fdc41ffb6c0 1 -- 10.20.193.11:0/3942231131 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fdc3c0a9fa0 con 0x7fdc4c10f200 2026-02-13T02:19:26.084 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:26.080+0000 7fdc43fff6c0 1 --2- 10.20.193.11:0/3942231131 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fdc280b5710 0x7fdc280d5bc0 secure :-1 s=READY pgs=213 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdc340023e0 tx=0x7fdc34031f90 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:26.197 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:26.196+0000 7fdc52f846c0 1 -- 10.20.193.11:0/3942231131 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fdc4c0f5c90 con 0x7fdc4c10f200 2026-02-13T02:19:26.197 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:26 trial011 ceph-mon[11956]: pgmap v197: 97 pgs: 97 active+clean; 648 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.5 KiB/s rd, 1.3 KiB/s wr, 10 op/s 2026-02-13T02:19:26.198 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:26.196+0000 7fdc41ffb6c0 1 -- 10.20.193.11:0/3942231131 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fdc3c0a96f0 con 0x7fdc4c10f200 2026-02-13T02:19:26.198 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:19:26.198 INFO:teuthology.orchestra.run.trial011.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:19:26.199 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:26.197+0000 7fdc52f846c0 1 -- 10.20.193.11:0/3942231131 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fdc280b5710 msgr2=0x7fdc280d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:26.199 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:26.197+0000 7fdc52f846c0 1 --2- 10.20.193.11:0/3942231131 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fdc280b5710 0x7fdc280d5bc0 secure :-1 s=READY pgs=213 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdc340023e0 tx=0x7fdc34031f90 comp rx=0 tx=0).stop 2026-02-13T02:19:26.199 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:26.197+0000 7fdc52f846c0 1 -- 10.20.193.11:0/3942231131 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fdc4c10f200 msgr2=0x7fdc4c0f4b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:26.199 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:26.197+0000 7fdc52f846c0 1 --2- 10.20.193.11:0/3942231131 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fdc4c10f200 0x7fdc4c0f4b90 secure :-1 s=READY pgs=302 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdc3c00b710 tx=0x7fdc3c00bbe0 comp rx=0 tx=0).stop 2026-02-13T02:19:26.199 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:26.197+0000 7fdc52f846c0 1 -- 10.20.193.11:0/3942231131 shutdown_connections 2026-02-13T02:19:26.199 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:26.197+0000 7fdc52f846c0 1 --2- 10.20.193.11:0/3942231131 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fdc280b5710 0x7fdc280d5bc0 unknown :-1 s=CLOSED pgs=213 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:26.199 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:26.197+0000 7fdc52f846c0 1 --2- 10.20.193.11:0/3942231131 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fdc4c115410 0x7fdc4c175cb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:26.199 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:26.197+0000 7fdc52f846c0 1 --2- 10.20.193.11:0/3942231131 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fdc4c0f51c0 0x7fdc4c0fa440 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:26.199 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:26.197+0000 7fdc52f846c0 1 --2- 10.20.193.11:0/3942231131 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fdc4c10f200 0x7fdc4c0f4b90 unknown :-1 s=CLOSED pgs=302 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:26.199 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:26.197+0000 7fdc52f846c0 1 -- 10.20.193.11:0/3942231131 >> 10.20.193.11:0/3942231131 conn(0x7fdc4c0ecb00 msgr2=0x7fdc4c10d760 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:26.199 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:26.197+0000 7fdc52f846c0 1 -- 10.20.193.11:0/3942231131 shutdown_connections 2026-02-13T02:19:26.199 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:26.197+0000 7fdc52f846c0 1 -- 10.20.193.11:0/3942231131 wait complete. 2026-02-13T02:19:26.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:26 trial060 ceph-mon[14797]: pgmap v197: 97 pgs: 97 active+clean; 648 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.5 KiB/s rd, 1.3 KiB/s wr, 10 op/s 2026-02-13T02:19:26.541 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:26 trial078 ceph-mon[14969]: pgmap v197: 97 pgs: 97 active+clean; 648 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.5 KiB/s rd, 1.3 KiB/s wr, 10 op/s 2026-02-13T02:19:27.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:27 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/3942231131' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:19:27.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:27 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/3942231131' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:19:27.541 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:27 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/3942231131' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:19:28.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:28 trial011 ceph-mon[11956]: pgmap v198: 97 pgs: 97 active+clean; 651 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 7.2 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2026-02-13T02:19:28.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:28 trial060 ceph-mon[14797]: pgmap v198: 97 pgs: 97 active+clean; 651 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 7.2 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2026-02-13T02:19:28.541 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:28 trial078 ceph-mon[14969]: pgmap v198: 97 pgs: 97 active+clean; 651 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 7.2 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2026-02-13T02:19:29.239 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:19:29.362 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:19:29.480 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:29.475+0000 7f113bf416c0 1 -- 10.20.193.11:0/2578329067 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f1134115410 msgr2=0x7f1134175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:29.481 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:29.475+0000 7f113bf416c0 1 --2- 10.20.193.11:0/2578329067 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f1134115410 0x7f1134175db0 secure :-1 s=READY pgs=303 gs=1 cs=0 l=1 c_cookie=2483688494391112456 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f113000aa70 tx=0x7f113002fde0 comp rx=0 tx=0).stop 2026-02-13T02:19:29.481 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:29.475+0000 7f113bf416c0 1 -- 10.20.193.11:0/2578329067 shutdown_connections 2026-02-13T02:19:29.481 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:29.475+0000 7f113bf416c0 1 --2- 10.20.193.11:0/2578329067 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f113410fbf0 0x7f1134114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:29.481 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:29.475+0000 7f113bf416c0 1 --2- 10.20.193.11:0/2578329067 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f1134115410 0x7f1134175db0 unknown :-1 s=CLOSED pgs=303 gs=1 cs=0 l=1 c_cookie=2483688494391112456 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:29.481 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:29.475+0000 7f113bf416c0 1 --2- 10.20.193.11:0/2578329067 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f113410f200 0x7f113410f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:29.481 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:29.475+0000 7f113bf416c0 1 -- 10.20.193.11:0/2578329067 >> 10.20.193.11:0/2578329067 conn(0x7f11340ecb00 msgr2=0x7f113410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:29.481 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:29.475+0000 7f113bf416c0 1 -- 10.20.193.11:0/2578329067 shutdown_connections 2026-02-13T02:19:29.481 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:29.475+0000 7f113bf416c0 1 -- 10.20.193.11:0/2578329067 wait complete. 2026-02-13T02:19:29.481 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:29.475+0000 7f113bf416c0 1 Processor -- start 2026-02-13T02:19:29.481 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:29.476+0000 7f113bf416c0 1 -- start start 2026-02-13T02:19:29.482 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:29.476+0000 7f113bf416c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f113410f200 0x7f113411d0b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:29.482 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:29.476+0000 7f113bf416c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f1134115410 0x7f113411d5f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:29.482 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:29.476+0000 7f113bf416c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f11341229b0 0x7f1134122e50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:29.482 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:29.476+0000 7f113bf416c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f11341233c0 con 0x7f1134115410 2026-02-13T02:19:29.482 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:29.476+0000 7f113bf416c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f1134123530 con 0x7f113410f200 2026-02-13T02:19:29.482 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:29.476+0000 7f113bf416c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f11341236f0 con 0x7f11341229b0 2026-02-13T02:19:29.482 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:29.476+0000 7f11394b16c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f1134115410 0x7f113411d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:29.482 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:29.476+0000 7f11394b16c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f1134115410 0x7f113411d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:33988/0 (socket says 10.20.193.11:33988) 2026-02-13T02:19:29.482 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:29.476+0000 7f11394b16c0 1 -- 10.20.193.11:0/1850534944 learned_addr learned my addr 10.20.193.11:0/1850534944 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:19:29.482 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:29.476+0000 7f1139cb26c0 1 --2- 10.20.193.11:0/1850534944 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f113410f200 0x7f113411d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:29.482 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:29.476+0000 7f113a4b36c0 1 --2- 10.20.193.11:0/1850534944 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f11341229b0 0x7f1134122e50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:29.482 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:29.476+0000 7f11394b16c0 1 -- 10.20.193.11:0/1850534944 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f11341229b0 msgr2=0x7f1134122e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:29.483 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:29.476+0000 7f11394b16c0 1 --2- 10.20.193.11:0/1850534944 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f11341229b0 0x7f1134122e50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:29.483 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:29.476+0000 7f11394b16c0 1 -- 10.20.193.11:0/1850534944 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f113410f200 msgr2=0x7f113411d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:29.483 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:29.476+0000 7f11394b16c0 1 --2- 10.20.193.11:0/1850534944 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f113410f200 0x7f113411d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:29.483 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:29.476+0000 7f11394b16c0 1 -- 10.20.193.11:0/1850534944 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f113000a660 con 0x7f1134115410 2026-02-13T02:19:29.483 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:29.476+0000 7f1139cb26c0 1 --2- 10.20.193.11:0/1850534944 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f113410f200 0x7f113411d0b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T02:19:29.483 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:29.476+0000 7f11394b16c0 1 --2- 10.20.193.11:0/1850534944 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f1134115410 0x7f113411d5f0 secure :-1 s=READY pgs=304 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1128005dc0 tx=0x7f112800bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:29.483 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:29.476+0000 7f1122ffd6c0 1 -- 10.20.193.11:0/1850534944 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1128004250 con 0x7f1134115410 2026-02-13T02:19:29.483 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:29.476+0000 7f1122ffd6c0 1 -- 10.20.193.11:0/1850534944 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1128009070 con 0x7f1134115410 2026-02-13T02:19:29.483 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:29.476+0000 7f113bf416c0 1 -- 10.20.193.11:0/1850534944 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1134163ba0 con 0x7f1134115410 2026-02-13T02:19:29.483 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:29.476+0000 7f1122ffd6c0 1 -- 10.20.193.11:0/1850534944 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f112800cdc0 con 0x7f1134115410 2026-02-13T02:19:29.483 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:29.476+0000 7f113bf416c0 1 -- 10.20.193.11:0/1850534944 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1134164080 con 0x7f1134115410 2026-02-13T02:19:29.483 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:29.477+0000 7f113bf416c0 1 -- 10.20.193.11:0/1850534944 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11341104d0 con 0x7f1134115410 2026-02-13T02:19:29.484 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:29.478+0000 7f1122ffd6c0 1 -- 10.20.193.11:0/1850534944 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7f11280028c0 con 0x7f1134115410 2026-02-13T02:19:29.485 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:29.479+0000 7f1122ffd6c0 1 --2- 10.20.193.11:0/1850534944 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f11100b5710 0x7f11100d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:29.485 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:29.479+0000 7f1139cb26c0 1 --2- 10.20.193.11:0/1850534944 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f11100b5710 0x7f11100d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:29.485 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:29.479+0000 7f1122ffd6c0 1 -- 10.20.193.11:0/1850534944 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7762+0+0 (secure 0 0 0) 0x7f11280e3b20 con 0x7f1134115410 2026-02-13T02:19:29.485 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:29.479+0000 7f1139cb26c0 1 --2- 10.20.193.11:0/1850534944 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f11100b5710 0x7f11100d5bc0 secure :-1 s=READY pgs=214 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1124004750 tx=0x7f1124009630 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:29.485 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:29.479+0000 7f1122ffd6c0 1 -- 10.20.193.11:0/1850534944 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f11280a6540 con 0x7f1134115410 2026-02-13T02:19:29.597 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:29.594+0000 7f113bf416c0 1 -- 10.20.193.11:0/1850534944 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f113410f5d0 con 0x7f1134115410 2026-02-13T02:19:29.597 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:29.594+0000 7f1122ffd6c0 1 -- 10.20.193.11:0/1850534944 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f11280a96f0 con 0x7f1134115410 2026-02-13T02:19:29.597 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:19:29.597 INFO:teuthology.orchestra.run.trial011.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:19:29.598 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:29.595+0000 7f113bf416c0 1 -- 10.20.193.11:0/1850534944 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f11100b5710 msgr2=0x7f11100d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:29.599 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:29.595+0000 7f113bf416c0 1 --2- 10.20.193.11:0/1850534944 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f11100b5710 0x7f11100d5bc0 secure :-1 s=READY pgs=214 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1124004750 tx=0x7f1124009630 comp rx=0 tx=0).stop 2026-02-13T02:19:29.599 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:29.595+0000 7f113bf416c0 1 -- 10.20.193.11:0/1850534944 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f1134115410 msgr2=0x7f113411d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:29.599 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:29.595+0000 7f113bf416c0 1 --2- 10.20.193.11:0/1850534944 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f1134115410 0x7f113411d5f0 secure :-1 s=READY pgs=304 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1128005dc0 tx=0x7f112800bbb0 comp rx=0 tx=0).stop 2026-02-13T02:19:29.599 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:29.595+0000 7f113bf416c0 1 -- 10.20.193.11:0/1850534944 shutdown_connections 2026-02-13T02:19:29.599 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:29.595+0000 7f113bf416c0 1 --2- 10.20.193.11:0/1850534944 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f11100b5710 0x7f11100d5bc0 unknown :-1 s=CLOSED pgs=214 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:29.599 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:29.595+0000 7f113bf416c0 1 --2- 10.20.193.11:0/1850534944 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f11341229b0 0x7f1134122e50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:29.599 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:29.595+0000 7f113bf416c0 1 --2- 10.20.193.11:0/1850534944 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f1134115410 0x7f113411d5f0 unknown :-1 s=CLOSED pgs=304 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:29.599 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:29.595+0000 7f113bf416c0 1 --2- 10.20.193.11:0/1850534944 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f113410f200 0x7f113411d0b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:29.599 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:29.595+0000 7f113bf416c0 1 -- 10.20.193.11:0/1850534944 >> 10.20.193.11:0/1850534944 conn(0x7f11340ecb00 msgr2=0x7f113410cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:29.599 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:29.595+0000 7f113bf416c0 1 -- 10.20.193.11:0/1850534944 shutdown_connections 2026-02-13T02:19:29.599 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:29.595+0000 7f113bf416c0 1 -- 10.20.193.11:0/1850534944 wait complete. 2026-02-13T02:19:30.451 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:30 trial011 ceph-mon[11956]: pgmap v199: 97 pgs: 97 active+clean; 651 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.9 KiB/s rd, 341 B/s wr, 10 op/s 2026-02-13T02:19:30.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:30 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/1850534944' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:19:30.499 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:30 trial060 ceph-mon[14797]: pgmap v199: 97 pgs: 97 active+clean; 651 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.9 KiB/s rd, 341 B/s wr, 10 op/s 2026-02-13T02:19:30.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:30 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/1850534944' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:19:30.541 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:30 trial078 ceph-mon[14969]: pgmap v199: 97 pgs: 97 active+clean; 651 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.9 KiB/s rd, 341 B/s wr, 10 op/s 2026-02-13T02:19:30.541 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:30 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/1850534944' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:19:32.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:32 trial011 ceph-mon[11956]: pgmap v200: 97 pgs: 97 active+clean; 651 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.5 KiB/s rd, 341 B/s wr, 8 op/s 2026-02-13T02:19:32.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:32 trial060 ceph-mon[14797]: pgmap v200: 97 pgs: 97 active+clean; 651 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.5 KiB/s rd, 341 B/s wr, 8 op/s 2026-02-13T02:19:32.541 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:32 trial078 ceph-mon[14969]: pgmap v200: 97 pgs: 97 active+clean; 651 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.5 KiB/s rd, 341 B/s wr, 8 op/s 2026-02-13T02:19:32.637 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:19:32.763 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:19:32.880 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:32.876+0000 7f5022ef56c0 1 -- 10.20.193.11:0/2700507353 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f501c115410 msgr2=0x7f501c175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:32.880 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:32.876+0000 7f5022ef56c0 1 --2- 10.20.193.11:0/2700507353 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f501c115410 0x7f501c175db0 secure :-1 s=READY pgs=305 gs=1 cs=0 l=1 c_cookie=16341817621639068657 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f501800aa70 tx=0x7f501802fde0 comp rx=0 tx=0).stop 2026-02-13T02:19:32.881 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:32.876+0000 7f5022ef56c0 1 -- 10.20.193.11:0/2700507353 shutdown_connections 2026-02-13T02:19:32.881 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:32.876+0000 7f5022ef56c0 1 --2- 10.20.193.11:0/2700507353 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f501c10fbf0 0x7f501c114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:32.881 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:32.876+0000 7f5022ef56c0 1 --2- 10.20.193.11:0/2700507353 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f501c115410 0x7f501c175db0 unknown :-1 s=CLOSED pgs=305 gs=1 cs=0 l=1 c_cookie=16341817621639068657 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:32.881 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:32.876+0000 7f5022ef56c0 1 --2- 10.20.193.11:0/2700507353 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f501c10f200 0x7f501c10f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:32.881 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:32.876+0000 7f5022ef56c0 1 -- 10.20.193.11:0/2700507353 >> 10.20.193.11:0/2700507353 conn(0x7f501c0ecb00 msgr2=0x7f501c10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:32.881 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:32.876+0000 7f5022ef56c0 1 -- 10.20.193.11:0/2700507353 shutdown_connections 2026-02-13T02:19:32.881 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:32.876+0000 7f5022ef56c0 1 -- 10.20.193.11:0/2700507353 wait complete. 2026-02-13T02:19:32.882 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:32.877+0000 7f5022ef56c0 1 Processor -- start 2026-02-13T02:19:32.882 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:32.877+0000 7f5022ef56c0 1 -- start start 2026-02-13T02:19:32.882 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:32.877+0000 7f5022ef56c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f501c10f200 0x7f501c11d0b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:32.882 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:32.877+0000 7f5022ef56c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f501c115410 0x7f501c11d5f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:32.882 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:32.877+0000 7f5022ef56c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f501c1229b0 0x7f501c122e50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:32.882 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:32.877+0000 7f5022ef56c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f501c1233c0 con 0x7f501c115410 2026-02-13T02:19:32.882 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:32.877+0000 7f5022ef56c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f501c123530 con 0x7f501c10f200 2026-02-13T02:19:32.883 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:32.877+0000 7f5022ef56c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f501c1236f0 con 0x7f501c1229b0 2026-02-13T02:19:32.883 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:32.877+0000 7f5013fff6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f501c115410 0x7f501c11d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:32.883 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:32.877+0000 7f5013fff6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f501c115410 0x7f501c11d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:45638/0 (socket says 10.20.193.11:45638) 2026-02-13T02:19:32.883 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:32.877+0000 7f5013fff6c0 1 -- 10.20.193.11:0/42926912 learned_addr learned my addr 10.20.193.11:0/42926912 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:19:32.883 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:32.877+0000 7f50214676c0 1 --2- 10.20.193.11:0/42926912 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f501c1229b0 0x7f501c122e50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:32.883 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:32.877+0000 7f5013fff6c0 1 -- 10.20.193.11:0/42926912 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f501c1229b0 msgr2=0x7f501c122e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:32.883 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:32.877+0000 7f5013fff6c0 1 --2- 10.20.193.11:0/42926912 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f501c1229b0 0x7f501c122e50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:32.884 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:32.877+0000 7f5013fff6c0 1 -- 10.20.193.11:0/42926912 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f501c10f200 msgr2=0x7f501c11d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:32.884 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:32.877+0000 7f5013fff6c0 1 --2- 10.20.193.11:0/42926912 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f501c10f200 0x7f501c11d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:32.884 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:32.877+0000 7f5013fff6c0 1 -- 10.20.193.11:0/42926912 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f501800a660 con 0x7f501c115410 2026-02-13T02:19:32.884 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:32.877+0000 7f50214676c0 1 --2- 10.20.193.11:0/42926912 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f501c1229b0 0x7f501c122e50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:19:32.884 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:32.877+0000 7f5013fff6c0 1 --2- 10.20.193.11:0/42926912 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f501c115410 0x7f501c11d5f0 secure :-1 s=READY pgs=306 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5004005dc0 tx=0x7f500400bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:32.884 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:32.877+0000 7f5011ffb6c0 1 -- 10.20.193.11:0/42926912 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5004004250 con 0x7f501c115410 2026-02-13T02:19:32.885 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:32.877+0000 7f5011ffb6c0 1 -- 10.20.193.11:0/42926912 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f5004009070 con 0x7f501c115410 2026-02-13T02:19:32.885 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:32.877+0000 7f5022ef56c0 1 -- 10.20.193.11:0/42926912 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f501c163ba0 con 0x7f501c115410 2026-02-13T02:19:32.885 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:32.877+0000 7f5011ffb6c0 1 -- 10.20.193.11:0/42926912 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f500400cdc0 con 0x7f501c115410 2026-02-13T02:19:32.885 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:32.877+0000 7f5022ef56c0 1 -- 10.20.193.11:0/42926912 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f501c164080 con 0x7f501c115410 2026-02-13T02:19:32.885 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:32.878+0000 7f5022ef56c0 1 -- 10.20.193.11:0/42926912 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f501c1104d0 con 0x7f501c115410 2026-02-13T02:19:32.887 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:32.879+0000 7f5011ffb6c0 1 -- 10.20.193.11:0/42926912 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7f50040028c0 con 0x7f501c115410 2026-02-13T02:19:32.887 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:32.880+0000 7f5011ffb6c0 1 --2- 10.20.193.11:0/42926912 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f4ff80b5710 0x7f4ff80d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:32.887 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:32.880+0000 7f5020c666c0 1 --2- 10.20.193.11:0/42926912 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f4ff80b5710 0x7f4ff80d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:32.887 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:32.880+0000 7f5011ffb6c0 1 -- 10.20.193.11:0/42926912 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7762+0+0 (secure 0 0 0) 0x7f50040e3ae0 con 0x7f501c115410 2026-02-13T02:19:32.888 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:32.880+0000 7f5020c666c0 1 --2- 10.20.193.11:0/42926912 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f4ff80b5710 0x7f4ff80d5bc0 secure :-1 s=READY pgs=215 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f500c004750 tx=0x7f500c0096a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:32.888 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:32.880+0000 7f5011ffb6c0 1 -- 10.20.193.11:0/42926912 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f50040a6540 con 0x7f501c115410 2026-02-13T02:19:32.998 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:32.995+0000 7f5022ef56c0 1 -- 10.20.193.11:0/42926912 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f501c10fbf0 con 0x7f501c115410 2026-02-13T02:19:32.998 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:32.996+0000 7f5011ffb6c0 1 -- 10.20.193.11:0/42926912 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f50040a96f0 con 0x7f501c115410 2026-02-13T02:19:32.998 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:19:32.999 INFO:teuthology.orchestra.run.trial011.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:19:33.000 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:32.997+0000 7f5022ef56c0 1 -- 10.20.193.11:0/42926912 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f4ff80b5710 msgr2=0x7f4ff80d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:33.000 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:32.997+0000 7f5022ef56c0 1 --2- 10.20.193.11:0/42926912 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f4ff80b5710 0x7f4ff80d5bc0 secure :-1 s=READY pgs=215 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f500c004750 tx=0x7f500c0096a0 comp rx=0 tx=0).stop 2026-02-13T02:19:33.000 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:32.997+0000 7f5022ef56c0 1 -- 10.20.193.11:0/42926912 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f501c115410 msgr2=0x7f501c11d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:33.000 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:32.997+0000 7f5022ef56c0 1 --2- 10.20.193.11:0/42926912 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f501c115410 0x7f501c11d5f0 secure :-1 s=READY pgs=306 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5004005dc0 tx=0x7f500400bbb0 comp rx=0 tx=0).stop 2026-02-13T02:19:33.000 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:32.997+0000 7f5022ef56c0 1 -- 10.20.193.11:0/42926912 shutdown_connections 2026-02-13T02:19:33.000 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:32.997+0000 7f5022ef56c0 1 --2- 10.20.193.11:0/42926912 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f4ff80b5710 0x7f4ff80d5bc0 unknown :-1 s=CLOSED pgs=215 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:33.000 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:32.997+0000 7f5022ef56c0 1 --2- 10.20.193.11:0/42926912 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f501c1229b0 0x7f501c122e50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:33.000 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:32.997+0000 7f5022ef56c0 1 --2- 10.20.193.11:0/42926912 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f501c115410 0x7f501c11d5f0 unknown :-1 s=CLOSED pgs=306 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:33.001 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:32.997+0000 7f5022ef56c0 1 --2- 10.20.193.11:0/42926912 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f501c10f200 0x7f501c11d0b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:33.001 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:32.997+0000 7f5022ef56c0 1 -- 10.20.193.11:0/42926912 >> 10.20.193.11:0/42926912 conn(0x7f501c0ecb00 msgr2=0x7f501c10cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:33.001 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:32.997+0000 7f5022ef56c0 1 -- 10.20.193.11:0/42926912 shutdown_connections 2026-02-13T02:19:33.001 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:32.997+0000 7f5022ef56c0 1 -- 10.20.193.11:0/42926912 wait complete. 2026-02-13T02:19:33.442 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:33 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/42926912' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:19:33.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:33 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/42926912' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:19:33.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:33 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/42926912' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:19:34.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:34 trial011 ceph-mon[11956]: pgmap v201: 97 pgs: 97 active+clean; 651 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 6.2 KiB/s rd, 341 B/s wr, 11 op/s 2026-02-13T02:19:34.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:34 trial060 ceph-mon[14797]: pgmap v201: 97 pgs: 97 active+clean; 651 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 6.2 KiB/s rd, 341 B/s wr, 11 op/s 2026-02-13T02:19:34.541 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:34 trial078 ceph-mon[14969]: pgmap v201: 97 pgs: 97 active+clean; 651 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 6.2 KiB/s rd, 341 B/s wr, 11 op/s 2026-02-13T02:19:36.038 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:19:36.163 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:19:36.279 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:36.275+0000 7f262a0bc6c0 1 -- 10.20.193.11:0/34557908 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f262410fbf0 msgr2=0x7f2624114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:36.279 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:36.275+0000 7f262a0bc6c0 1 --2- 10.20.193.11:0/34557908 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f262410fbf0 0x7f2624114c30 secure :-1 s=READY pgs=307 gs=1 cs=0 l=1 c_cookie=6868002632377165554 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f26140099a0 tx=0x7f261402ed20 comp rx=0 tx=0).stop 2026-02-13T02:19:36.279 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:36.275+0000 7f262a0bc6c0 1 -- 10.20.193.11:0/34557908 shutdown_connections 2026-02-13T02:19:36.279 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:36.275+0000 7f262a0bc6c0 1 --2- 10.20.193.11:0/34557908 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f2624115410 0x7f2624175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:36.279 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:36.275+0000 7f262a0bc6c0 1 --2- 10.20.193.11:0/34557908 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f262410fbf0 0x7f2624114c30 unknown :-1 s=CLOSED pgs=307 gs=1 cs=0 l=1 c_cookie=6868002632377165554 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:36.279 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:36.275+0000 7f262a0bc6c0 1 --2- 10.20.193.11:0/34557908 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f262410f200 0x7f262410f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:36.279 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:36.275+0000 7f262a0bc6c0 1 -- 10.20.193.11:0/34557908 >> 10.20.193.11:0/34557908 conn(0x7f26240ecb00 msgr2=0x7f262410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:36.279 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:36.275+0000 7f262a0bc6c0 1 -- 10.20.193.11:0/34557908 shutdown_connections 2026-02-13T02:19:36.280 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:36.275+0000 7f262a0bc6c0 1 -- 10.20.193.11:0/34557908 wait complete. 2026-02-13T02:19:36.280 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:36.275+0000 7f262a0bc6c0 1 Processor -- start 2026-02-13T02:19:36.280 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:36.275+0000 7f262a0bc6c0 1 -- start start 2026-02-13T02:19:36.280 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:36.275+0000 7f262a0bc6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f262410f200 0x7f26240f4c60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:36.280 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:36.275+0000 7f262a0bc6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f2624115410 0x7f2624175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:36.280 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:36.275+0000 7f262a0bc6c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f26240f5290 0x7f26240fa510 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:36.280 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:36.275+0000 7f262a0bc6c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f26240f5980 con 0x7f2624115410 2026-02-13T02:19:36.280 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:36.275+0000 7f262a0bc6c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f26240faa50 con 0x7f26240f5290 2026-02-13T02:19:36.280 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:36.275+0000 7f262a0bc6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f26240fac10 con 0x7f262410f200 2026-02-13T02:19:36.280 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:36.275+0000 7f2622ffd6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f2624115410 0x7f2624175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:36.280 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:36.275+0000 7f2622ffd6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f2624115410 0x7f2624175cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:45660/0 (socket says 10.20.193.11:45660) 2026-02-13T02:19:36.281 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:36.275+0000 7f2622ffd6c0 1 -- 10.20.193.11:0/1401604800 learned_addr learned my addr 10.20.193.11:0/1401604800 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:19:36.281 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:36.275+0000 7f26237fe6c0 1 --2- 10.20.193.11:0/1401604800 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f262410f200 0x7f26240f4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:36.281 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:36.275+0000 7f2623fff6c0 1 --2- 10.20.193.11:0/1401604800 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f26240f5290 0x7f26240fa510 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:36.281 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:36.275+0000 7f2622ffd6c0 1 -- 10.20.193.11:0/1401604800 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f262410f200 msgr2=0x7f26240f4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:36.281 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:36.275+0000 7f2622ffd6c0 1 --2- 10.20.193.11:0/1401604800 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f262410f200 0x7f26240f4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:36.281 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:36.275+0000 7f2622ffd6c0 1 -- 10.20.193.11:0/1401604800 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f26240f5290 msgr2=0x7f26240fa510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:36.281 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:36.275+0000 7f2622ffd6c0 1 --2- 10.20.193.11:0/1401604800 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f26240f5290 0x7f26240fa510 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:36.281 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:36.275+0000 7f2622ffd6c0 1 -- 10.20.193.11:0/1401604800 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2614009590 con 0x7f2624115410 2026-02-13T02:19:36.281 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:36.275+0000 7f26237fe6c0 1 --2- 10.20.193.11:0/1401604800 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f262410f200 0x7f26240f4c60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:19:36.281 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:36.275+0000 7f2623fff6c0 1 --2- 10.20.193.11:0/1401604800 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f26240f5290 0x7f26240fa510 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:19:36.281 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:36.275+0000 7f2622ffd6c0 1 --2- 10.20.193.11:0/1401604800 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f2624115410 0x7f2624175cb0 secure :-1 s=READY pgs=308 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2614031f90 tx=0x7f26140047f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:36.281 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:36.275+0000 7f2620ff96c0 1 -- 10.20.193.11:0/1401604800 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2614002ae0 con 0x7f2624115410 2026-02-13T02:19:36.282 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:36.276+0000 7f2620ff96c0 1 -- 10.20.193.11:0/1401604800 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2614002c40 con 0x7f2624115410 2026-02-13T02:19:36.282 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:36.276+0000 7f262a0bc6c0 1 -- 10.20.193.11:0/1401604800 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26240fae90 con 0x7f2624115410 2026-02-13T02:19:36.282 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:36.276+0000 7f2620ff96c0 1 -- 10.20.193.11:0/1401604800 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f26140312b0 con 0x7f2624115410 2026-02-13T02:19:36.282 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:36.276+0000 7f262a0bc6c0 1 -- 10.20.193.11:0/1401604800 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26240fb360 con 0x7f2624115410 2026-02-13T02:19:36.282 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:36.276+0000 7f262a0bc6c0 1 -- 10.20.193.11:0/1401604800 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26241104d0 con 0x7f2624115410 2026-02-13T02:19:36.282 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:36.277+0000 7f2620ff96c0 1 -- 10.20.193.11:0/1401604800 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7f2614007260 con 0x7f2624115410 2026-02-13T02:19:36.283 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:36.278+0000 7f2620ff96c0 1 --2- 10.20.193.11:0/1401604800 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f25f80b5710 0x7f25f80d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:36.283 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:36.278+0000 7f2620ff96c0 1 -- 10.20.193.11:0/1401604800 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7762+0+0 (secure 0 0 0) 0x7f2614107c80 con 0x7f2624115410 2026-02-13T02:19:36.283 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:36.278+0000 7f26237fe6c0 1 --2- 10.20.193.11:0/1401604800 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f25f80b5710 0x7f25f80d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:36.283 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:36.278+0000 7f26237fe6c0 1 --2- 10.20.193.11:0/1401604800 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f25f80b5710 0x7f25f80d5bc0 secure :-1 s=READY pgs=216 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2610004750 tx=0x7f2610005f10 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:36.283 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:36.278+0000 7f2620ff96c0 1 -- 10.20.193.11:0/1401604800 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f26140ca6a0 con 0x7f2624115410 2026-02-13T02:19:36.394 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:36.392+0000 7f262a0bc6c0 1 -- 10.20.193.11:0/1401604800 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f262410f5d0 con 0x7f2624115410 2026-02-13T02:19:36.395 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:36 trial011 ceph-mon[11956]: pgmap v202: 97 pgs: 97 active+clean; 651 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.9 KiB/s rd, 341 B/s wr, 10 op/s 2026-02-13T02:19:36.395 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:36.392+0000 7f2620ff96c0 1 -- 10.20.193.11:0/1401604800 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f26140077d0 con 0x7f2624115410 2026-02-13T02:19:36.395 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:19:36.396 INFO:teuthology.orchestra.run.trial011.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:19:36.396 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:36.393+0000 7f262a0bc6c0 1 -- 10.20.193.11:0/1401604800 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f25f80b5710 msgr2=0x7f25f80d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:36.397 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:36.393+0000 7f262a0bc6c0 1 --2- 10.20.193.11:0/1401604800 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f25f80b5710 0x7f25f80d5bc0 secure :-1 s=READY pgs=216 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2610004750 tx=0x7f2610005f10 comp rx=0 tx=0).stop 2026-02-13T02:19:36.397 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:36.393+0000 7f262a0bc6c0 1 -- 10.20.193.11:0/1401604800 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f2624115410 msgr2=0x7f2624175cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:36.397 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:36.393+0000 7f262a0bc6c0 1 --2- 10.20.193.11:0/1401604800 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f2624115410 0x7f2624175cb0 secure :-1 s=READY pgs=308 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2614031f90 tx=0x7f26140047f0 comp rx=0 tx=0).stop 2026-02-13T02:19:36.397 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:36.393+0000 7f262a0bc6c0 1 -- 10.20.193.11:0/1401604800 shutdown_connections 2026-02-13T02:19:36.397 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:36.393+0000 7f262a0bc6c0 1 --2- 10.20.193.11:0/1401604800 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f25f80b5710 0x7f25f80d5bc0 unknown :-1 s=CLOSED pgs=216 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:36.397 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:36.393+0000 7f262a0bc6c0 1 --2- 10.20.193.11:0/1401604800 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f26240f5290 0x7f26240fa510 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:36.397 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:36.393+0000 7f262a0bc6c0 1 --2- 10.20.193.11:0/1401604800 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f2624115410 0x7f2624175cb0 unknown :-1 s=CLOSED pgs=308 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:36.397 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:36.393+0000 7f262a0bc6c0 1 --2- 10.20.193.11:0/1401604800 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f262410f200 0x7f26240f4c60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:36.397 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:36.393+0000 7f262a0bc6c0 1 -- 10.20.193.11:0/1401604800 >> 10.20.193.11:0/1401604800 conn(0x7f26240ecb00 msgr2=0x7f262410d860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:36.397 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:36.394+0000 7f262a0bc6c0 1 -- 10.20.193.11:0/1401604800 shutdown_connections 2026-02-13T02:19:36.398 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:36.394+0000 7f262a0bc6c0 1 -- 10.20.193.11:0/1401604800 wait complete. 2026-02-13T02:19:36.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:36 trial060 ceph-mon[14797]: pgmap v202: 97 pgs: 97 active+clean; 651 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.9 KiB/s rd, 341 B/s wr, 10 op/s 2026-02-13T02:19:36.541 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:36 trial078 ceph-mon[14969]: pgmap v202: 97 pgs: 97 active+clean; 651 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.9 KiB/s rd, 341 B/s wr, 10 op/s 2026-02-13T02:19:37.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:37 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/1401604800' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:19:37.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:37 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/1401604800' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:19:37.541 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:37 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/1401604800' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:19:38.451 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:38 trial011 ceph-mon[11956]: pgmap v203: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 6.3 KiB/s rd, 597 B/s wr, 10 op/s 2026-02-13T02:19:38.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:38 trial060 ceph-mon[14797]: pgmap v203: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 6.3 KiB/s rd, 597 B/s wr, 10 op/s 2026-02-13T02:19:38.541 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:38 trial078 ceph-mon[14969]: pgmap v203: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 6.3 KiB/s rd, 597 B/s wr, 10 op/s 2026-02-13T02:19:39.434 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:19:39.560 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:19:39.680 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:39.676+0000 7f6dd68456c0 1 -- 10.20.193.11:0/3350962777 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f6dd0113190 msgr2=0x7f6dd0173b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:39.680 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:39.676+0000 7f6dd68456c0 1 --2- 10.20.193.11:0/3350962777 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f6dd0113190 0x7f6dd0173b30 secure :-1 s=READY pgs=309 gs=1 cs=0 l=1 c_cookie=13507208614399766320 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6dc400aa70 tx=0x7f6dc402fde0 comp rx=0 tx=0).stop 2026-02-13T02:19:39.680 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:39.676+0000 7f6dd68456c0 1 -- 10.20.193.11:0/3350962777 shutdown_connections 2026-02-13T02:19:39.680 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:39.676+0000 7f6dd68456c0 1 --2- 10.20.193.11:0/3350962777 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f6dd010d970 0x7f6dd01129b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:39.680 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:39.676+0000 7f6dd68456c0 1 --2- 10.20.193.11:0/3350962777 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f6dd0113190 0x7f6dd0173b30 unknown :-1 s=CLOSED pgs=309 gs=1 cs=0 l=1 c_cookie=13507208614399766320 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:39.681 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:39.676+0000 7f6dd68456c0 1 --2- 10.20.193.11:0/3350962777 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6dd010cf80 0x7f6dd010d350 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:39.681 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:39.676+0000 7f6dd68456c0 1 -- 10.20.193.11:0/3350962777 >> 10.20.193.11:0/3350962777 conn(0x7f6dd00ea880 msgr2=0x7f6dd010ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:39.681 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:39.676+0000 7f6dd68456c0 1 -- 10.20.193.11:0/3350962777 shutdown_connections 2026-02-13T02:19:39.681 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:39.676+0000 7f6dd68456c0 1 -- 10.20.193.11:0/3350962777 wait complete. 2026-02-13T02:19:39.681 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:39.676+0000 7f6dd68456c0 1 Processor -- start 2026-02-13T02:19:39.681 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:39.676+0000 7f6dd68456c0 1 -- start start 2026-02-13T02:19:39.681 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:39.677+0000 7f6dd68456c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6dd010cf80 0x7f6dd0060700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:39.681 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:39.677+0000 7f6dd68456c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f6dd0113190 0x7f6dd0060c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:39.681 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:39.677+0000 7f6dd68456c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f6dd0061180 0x7f6dd0163110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:39.681 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:39.677+0000 7f6dd68456c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f6dd0163650 con 0x7f6dd0061180 2026-02-13T02:19:39.681 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:39.677+0000 7f6dd68456c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6dd01637c0 con 0x7f6dd0113190 2026-02-13T02:19:39.682 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:39.677+0000 7f6dd68456c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f6dd0163980 con 0x7f6dd010cf80 2026-02-13T02:19:39.682 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:39.677+0000 7f6dd4db76c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f6dd0061180 0x7f6dd0163110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:39.682 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:39.677+0000 7f6dd4db76c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f6dd0061180 0x7f6dd0163110 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:45680/0 (socket says 10.20.193.11:45680) 2026-02-13T02:19:39.682 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:39.677+0000 7f6dd4db76c0 1 -- 10.20.193.11:0/2721801604 learned_addr learned my addr 10.20.193.11:0/2721801604 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:19:39.682 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:39.677+0000 7f6dcffff6c0 1 --2- 10.20.193.11:0/2721801604 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6dd010cf80 0x7f6dd0060700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:39.682 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:39.677+0000 7f6dcf7fe6c0 1 --2- 10.20.193.11:0/2721801604 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f6dd0113190 0x7f6dd0060c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:39.682 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:39.677+0000 7f6dd4db76c0 1 -- 10.20.193.11:0/2721801604 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6dd010cf80 msgr2=0x7f6dd0060700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:39.682 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:39.677+0000 7f6dd4db76c0 1 --2- 10.20.193.11:0/2721801604 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6dd010cf80 0x7f6dd0060700 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:39.682 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:39.677+0000 7f6dd4db76c0 1 -- 10.20.193.11:0/2721801604 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f6dd0113190 msgr2=0x7f6dd0060c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:39.682 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:39.677+0000 7f6dd4db76c0 1 --2- 10.20.193.11:0/2721801604 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f6dd0113190 0x7f6dd0060c40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:39.682 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:39.677+0000 7f6dd4db76c0 1 -- 10.20.193.11:0/2721801604 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dc400a660 con 0x7f6dd0061180 2026-02-13T02:19:39.682 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:39.677+0000 7f6dd4db76c0 1 --2- 10.20.193.11:0/2721801604 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f6dd0061180 0x7f6dd0163110 secure :-1 s=READY pgs=310 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6dc40054b0 tx=0x7f6dc40054e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:39.682 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:39.677+0000 7f6dcd7fa6c0 1 -- 10.20.193.11:0/2721801604 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6dc4003a30 con 0x7f6dd0061180 2026-02-13T02:19:39.683 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:39.677+0000 7f6dcd7fa6c0 1 -- 10.20.193.11:0/2721801604 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6dc4003b90 con 0x7f6dd0061180 2026-02-13T02:19:39.683 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:39.677+0000 7f6dd68456c0 1 -- 10.20.193.11:0/2721801604 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dd0163c00 con 0x7f6dd0061180 2026-02-13T02:19:39.683 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:39.677+0000 7f6dcd7fa6c0 1 -- 10.20.193.11:0/2721801604 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6dc40382d0 con 0x7f6dd0061180 2026-02-13T02:19:39.683 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:39.677+0000 7f6dd68456c0 1 -- 10.20.193.11:0/2721801604 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dd0164080 con 0x7f6dd0061180 2026-02-13T02:19:39.683 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:39.678+0000 7f6dd68456c0 1 -- 10.20.193.11:0/2721801604 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6dd010e250 con 0x7f6dd0061180 2026-02-13T02:19:39.684 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:39.679+0000 7f6dcd7fa6c0 1 -- 10.20.193.11:0/2721801604 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7f6dc4003d00 con 0x7f6dd0061180 2026-02-13T02:19:39.684 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:39.680+0000 7f6dcd7fa6c0 1 --2- 10.20.193.11:0/2721801604 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f6da40b5710 0x7f6da40d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:39.684 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:39.680+0000 7f6dcffff6c0 1 --2- 10.20.193.11:0/2721801604 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f6da40b5710 0x7f6da40d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:39.684 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:39.680+0000 7f6dcd7fa6c0 1 -- 10.20.193.11:0/2721801604 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7762+0+0 (secure 0 0 0) 0x7f6dc4108d50 con 0x7f6dd0061180 2026-02-13T02:19:39.684 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:39.680+0000 7f6dcd7fa6c0 1 -- 10.20.193.11:0/2721801604 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f6dc4109240 con 0x7f6dd0061180 2026-02-13T02:19:39.684 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:39.680+0000 7f6dcffff6c0 1 --2- 10.20.193.11:0/2721801604 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f6da40b5710 0x7f6da40d5bc0 secure :-1 s=READY pgs=217 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6dbc004750 tx=0x7f6dbc009390 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:39.797 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:39.795+0000 7f6dd68456c0 1 -- 10.20.193.11:0/2721801604 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f6dd010d350 con 0x7f6dd0061180 2026-02-13T02:19:39.797 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:39.795+0000 7f6dcd7fa6c0 1 -- 10.20.193.11:0/2721801604 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f6dc40cb7b0 con 0x7f6dd0061180 2026-02-13T02:19:39.797 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:19:39.797 INFO:teuthology.orchestra.run.trial011.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:19:39.799 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:39.796+0000 7f6dd68456c0 1 -- 10.20.193.11:0/2721801604 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f6da40b5710 msgr2=0x7f6da40d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:39.799 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:39.796+0000 7f6dd68456c0 1 --2- 10.20.193.11:0/2721801604 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f6da40b5710 0x7f6da40d5bc0 secure :-1 s=READY pgs=217 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6dbc004750 tx=0x7f6dbc009390 comp rx=0 tx=0).stop 2026-02-13T02:19:39.799 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:39.796+0000 7f6dd68456c0 1 -- 10.20.193.11:0/2721801604 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f6dd0061180 msgr2=0x7f6dd0163110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:39.799 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:39.796+0000 7f6dd68456c0 1 --2- 10.20.193.11:0/2721801604 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f6dd0061180 0x7f6dd0163110 secure :-1 s=READY pgs=310 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6dc40054b0 tx=0x7f6dc40054e0 comp rx=0 tx=0).stop 2026-02-13T02:19:39.799 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:39.796+0000 7f6dd68456c0 1 -- 10.20.193.11:0/2721801604 shutdown_connections 2026-02-13T02:19:39.799 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:39.796+0000 7f6dd68456c0 1 --2- 10.20.193.11:0/2721801604 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f6da40b5710 0x7f6da40d5bc0 unknown :-1 s=CLOSED pgs=217 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:39.799 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:39.796+0000 7f6dd68456c0 1 --2- 10.20.193.11:0/2721801604 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f6dd0113190 0x7f6dd0060c40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:39.799 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:39.796+0000 7f6dd68456c0 1 --2- 10.20.193.11:0/2721801604 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f6dd0061180 0x7f6dd0163110 unknown :-1 s=CLOSED pgs=310 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:39.799 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:39.796+0000 7f6dd68456c0 1 --2- 10.20.193.11:0/2721801604 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6dd010cf80 0x7f6dd0060700 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:39.800 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:39.796+0000 7f6dd68456c0 1 -- 10.20.193.11:0/2721801604 >> 10.20.193.11:0/2721801604 conn(0x7f6dd00ea880 msgr2=0x7f6dd010ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:39.800 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:39.796+0000 7f6dd68456c0 1 -- 10.20.193.11:0/2721801604 shutdown_connections 2026-02-13T02:19:39.800 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:39.796+0000 7f6dd68456c0 1 -- 10.20.193.11:0/2721801604 wait complete. 2026-02-13T02:19:40.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:40 trial011 ceph-mon[11956]: pgmap v204: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 10 op/s 2026-02-13T02:19:40.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:40 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/2721801604' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:19:40.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:40 trial060 ceph-mon[14797]: pgmap v204: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 10 op/s 2026-02-13T02:19:40.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:40 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/2721801604' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:19:40.541 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:40 trial078 ceph-mon[14969]: pgmap v204: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 10 op/s 2026-02-13T02:19:40.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:40 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/2721801604' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:19:42.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:42 trial011 ceph-mon[11956]: pgmap v205: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 8 op/s 2026-02-13T02:19:42.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:42 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]} : dispatch 2026-02-13T02:19:42.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:42 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]} : dispatch 2026-02-13T02:19:42.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:42 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 1]} : dispatch 2026-02-13T02:19:42.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:42 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]} : dispatch 2026-02-13T02:19:42.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:42 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]} : dispatch 2026-02-13T02:19:42.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:42 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]} : dispatch 2026-02-13T02:19:42.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:42 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]} : dispatch 2026-02-13T02:19:42.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:42 trial060 ceph-mon[14797]: pgmap v205: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 8 op/s 2026-02-13T02:19:42.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:42 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]} : dispatch 2026-02-13T02:19:42.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:42 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]} : dispatch 2026-02-13T02:19:42.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:42 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 1]} : dispatch 2026-02-13T02:19:42.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:42 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]} : dispatch 2026-02-13T02:19:42.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:42 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]} : dispatch 2026-02-13T02:19:42.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:42 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]} : dispatch 2026-02-13T02:19:42.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:42 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]} : dispatch 2026-02-13T02:19:42.541 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:42 trial078 ceph-mon[14969]: pgmap v205: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 8 op/s 2026-02-13T02:19:42.541 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:42 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]} : dispatch 2026-02-13T02:19:42.541 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:42 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]} : dispatch 2026-02-13T02:19:42.541 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:42 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 1]} : dispatch 2026-02-13T02:19:42.541 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:42 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]} : dispatch 2026-02-13T02:19:42.541 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:42 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]} : dispatch 2026-02-13T02:19:42.541 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:42 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]} : dispatch 2026-02-13T02:19:42.541 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:42 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]} : dispatch 2026-02-13T02:19:42.837 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:19:42.961 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:19:43.087 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:43.084+0000 7f28a535c6c0 1 -- 10.20.193.11:0/2301802342 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f28a0115410 msgr2=0x7f28a0175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:43.087 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:43.084+0000 7f28a535c6c0 1 --2- 10.20.193.11:0/2301802342 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f28a0115410 0x7f28a0175db0 secure :-1 s=READY pgs=311 gs=1 cs=0 l=1 c_cookie=13846615211225988177 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f289000aa70 tx=0x7f289002fde0 comp rx=0 tx=0).stop 2026-02-13T02:19:43.087 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:43.084+0000 7f28a535c6c0 1 -- 10.20.193.11:0/2301802342 shutdown_connections 2026-02-13T02:19:43.087 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:43.084+0000 7f28a535c6c0 1 --2- 10.20.193.11:0/2301802342 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f28a010fbf0 0x7f28a0114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:43.087 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:43.084+0000 7f28a535c6c0 1 --2- 10.20.193.11:0/2301802342 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f28a0115410 0x7f28a0175db0 unknown :-1 s=CLOSED pgs=311 gs=1 cs=0 l=1 c_cookie=13846615211225988177 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:43.087 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:43.084+0000 7f28a535c6c0 1 --2- 10.20.193.11:0/2301802342 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f28a010f200 0x7f28a010f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:43.087 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:43.084+0000 7f28a535c6c0 1 -- 10.20.193.11:0/2301802342 >> 10.20.193.11:0/2301802342 conn(0x7f28a00ecb00 msgr2=0x7f28a010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:43.087 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:43.084+0000 7f28a535c6c0 1 -- 10.20.193.11:0/2301802342 shutdown_connections 2026-02-13T02:19:43.087 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:43.084+0000 7f28a535c6c0 1 -- 10.20.193.11:0/2301802342 wait complete. 2026-02-13T02:19:43.087 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:43.085+0000 7f28a535c6c0 1 Processor -- start 2026-02-13T02:19:43.087 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:43.085+0000 7f28a535c6c0 1 -- start start 2026-02-13T02:19:43.087 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:43.085+0000 7f28a535c6c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f28a010f200 0x7f28a011d0b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:43.087 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:43.085+0000 7f28a535c6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f28a0115410 0x7f28a011d5f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:43.088 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:43.085+0000 7f28a535c6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f28a01229b0 0x7f28a0122e50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:43.088 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:43.085+0000 7f28a535c6c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f28a01233c0 con 0x7f28a0115410 2026-02-13T02:19:43.088 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:43.085+0000 7f28a535c6c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f28a0123530 con 0x7f28a010f200 2026-02-13T02:19:43.088 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:43.085+0000 7f28a535c6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f28a01236f0 con 0x7f28a01229b0 2026-02-13T02:19:43.088 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:43.085+0000 7f289e7fc6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f28a0115410 0x7f28a011d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:43.088 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:43.085+0000 7f289e7fc6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f28a0115410 0x7f28a011d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:32828/0 (socket says 10.20.193.11:32828) 2026-02-13T02:19:43.088 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:43.085+0000 7f289e7fc6c0 1 -- 10.20.193.11:0/1455387372 learned_addr learned my addr 10.20.193.11:0/1455387372 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:19:43.088 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:43.085+0000 7f289f7fe6c0 1 --2- 10.20.193.11:0/1455387372 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f28a01229b0 0x7f28a0122e50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:43.088 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:43.085+0000 7f289e7fc6c0 1 -- 10.20.193.11:0/1455387372 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f28a01229b0 msgr2=0x7f28a0122e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:43.088 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:43.085+0000 7f289e7fc6c0 1 --2- 10.20.193.11:0/1455387372 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f28a01229b0 0x7f28a0122e50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:43.088 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:43.085+0000 7f289e7fc6c0 1 -- 10.20.193.11:0/1455387372 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f28a010f200 msgr2=0x7f28a011d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:43.088 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:43.085+0000 7f289effd6c0 1 --2- 10.20.193.11:0/1455387372 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f28a010f200 0x7f28a011d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:43.088 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:43.085+0000 7f289e7fc6c0 1 --2- 10.20.193.11:0/1455387372 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f28a010f200 0x7f28a011d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:43.088 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:43.085+0000 7f289e7fc6c0 1 -- 10.20.193.11:0/1455387372 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f289000a660 con 0x7f28a0115410 2026-02-13T02:19:43.088 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:43.085+0000 7f289f7fe6c0 1 --2- 10.20.193.11:0/1455387372 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f28a01229b0 0x7f28a0122e50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:19:43.088 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:43.085+0000 7f289effd6c0 1 --2- 10.20.193.11:0/1455387372 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f28a010f200 0x7f28a011d0b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:19:43.088 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:43.085+0000 7f289e7fc6c0 1 --2- 10.20.193.11:0/1455387372 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f28a0115410 0x7f28a011d5f0 secure :-1 s=READY pgs=312 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2888005dc0 tx=0x7f288800bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:43.088 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:43.085+0000 7f287ffff6c0 1 -- 10.20.193.11:0/1455387372 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2888004250 con 0x7f28a0115410 2026-02-13T02:19:43.088 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:43.085+0000 7f28a535c6c0 1 -- 10.20.193.11:0/1455387372 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28a0163ba0 con 0x7f28a0115410 2026-02-13T02:19:43.088 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:43.085+0000 7f287ffff6c0 1 -- 10.20.193.11:0/1455387372 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2888009070 con 0x7f28a0115410 2026-02-13T02:19:43.088 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:43.085+0000 7f287ffff6c0 1 -- 10.20.193.11:0/1455387372 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f288800cdc0 con 0x7f28a0115410 2026-02-13T02:19:43.088 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:43.085+0000 7f28a535c6c0 1 -- 10.20.193.11:0/1455387372 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28a0164030 con 0x7f28a0115410 2026-02-13T02:19:43.088 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:43.086+0000 7f28a535c6c0 1 -- 10.20.193.11:0/1455387372 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28a01104d0 con 0x7f28a0115410 2026-02-13T02:19:43.089 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:43.087+0000 7f287ffff6c0 1 -- 10.20.193.11:0/1455387372 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7f28880028c0 con 0x7f28a0115410 2026-02-13T02:19:43.089 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:43.088+0000 7f287ffff6c0 1 --2- 10.20.193.11:0/1455387372 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f28740b5690 0x7f28740d5b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:43.089 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:43.088+0000 7f287ffff6c0 1 -- 10.20.193.11:0/1455387372 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7965+0+0 (secure 0 0 0) 0x7f28880e3c00 con 0x7f28a0115410 2026-02-13T02:19:43.089 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:43.088+0000 7f289effd6c0 1 --2- 10.20.193.11:0/1455387372 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f28740b5690 0x7f28740d5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:43.090 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:43.088+0000 7f289effd6c0 1 --2- 10.20.193.11:0/1455387372 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f28740b5690 0x7f28740d5b40 secure :-1 s=READY pgs=218 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2894004750 tx=0x7f2894005f10 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:43.090 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:43.088+0000 7f287ffff6c0 1 -- 10.20.193.11:0/1455387372 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f28880a65a0 con 0x7f28a0115410 2026-02-13T02:19:43.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:43 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2026-02-13T02:19:43.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:43 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]': finished 2026-02-13T02:19:43.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:43 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 1]}]': finished 2026-02-13T02:19:43.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:43 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]': finished 2026-02-13T02:19:43.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:43 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2026-02-13T02:19:43.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:43 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]': finished 2026-02-13T02:19:43.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:43 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2026-02-13T02:19:43.203 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:43 trial011 ceph-mon[11956]: osdmap e72: 12 total, 12 up, 12 in 2026-02-13T02:19:43.208 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:43.207+0000 7f28a535c6c0 1 -- 10.20.193.11:0/1455387372 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f28a010f5d0 con 0x7f28a0115410 2026-02-13T02:19:43.209 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:43.207+0000 7f287ffff6c0 1 -- 10.20.193.11:0/1455387372 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f28880a9750 con 0x7f28a0115410 2026-02-13T02:19:43.209 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:19:43.209 INFO:teuthology.orchestra.run.trial011.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:19:43.210 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:43.208+0000 7f28a535c6c0 1 -- 10.20.193.11:0/1455387372 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f28740b5690 msgr2=0x7f28740d5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:43.211 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:43.208+0000 7f28a535c6c0 1 --2- 10.20.193.11:0/1455387372 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f28740b5690 0x7f28740d5b40 secure :-1 s=READY pgs=218 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2894004750 tx=0x7f2894005f10 comp rx=0 tx=0).stop 2026-02-13T02:19:43.211 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:43.208+0000 7f28a535c6c0 1 -- 10.20.193.11:0/1455387372 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f28a0115410 msgr2=0x7f28a011d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:43.211 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:43.208+0000 7f28a535c6c0 1 --2- 10.20.193.11:0/1455387372 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f28a0115410 0x7f28a011d5f0 secure :-1 s=READY pgs=312 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2888005dc0 tx=0x7f288800bbb0 comp rx=0 tx=0).stop 2026-02-13T02:19:43.211 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:43.208+0000 7f28a535c6c0 1 -- 10.20.193.11:0/1455387372 shutdown_connections 2026-02-13T02:19:43.211 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:43.208+0000 7f28a535c6c0 1 --2- 10.20.193.11:0/1455387372 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f28740b5690 0x7f28740d5b40 unknown :-1 s=CLOSED pgs=218 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:43.211 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:43.208+0000 7f28a535c6c0 1 --2- 10.20.193.11:0/1455387372 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f28a01229b0 0x7f28a0122e50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:43.211 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:43.208+0000 7f28a535c6c0 1 --2- 10.20.193.11:0/1455387372 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f28a0115410 0x7f28a011d5f0 unknown :-1 s=CLOSED pgs=312 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:43.211 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:43.208+0000 7f28a535c6c0 1 --2- 10.20.193.11:0/1455387372 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f28a010f200 0x7f28a011d0b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:43.211 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:43.208+0000 7f28a535c6c0 1 -- 10.20.193.11:0/1455387372 >> 10.20.193.11:0/1455387372 conn(0x7f28a00ecb00 msgr2=0x7f28a010cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:43.211 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:43.208+0000 7f28a535c6c0 1 -- 10.20.193.11:0/1455387372 shutdown_connections 2026-02-13T02:19:43.212 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:43.208+0000 7f28a535c6c0 1 -- 10.20.193.11:0/1455387372 wait complete. 2026-02-13T02:19:43.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:43 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2026-02-13T02:19:43.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:43 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]': finished 2026-02-13T02:19:43.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:43 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 1]}]': finished 2026-02-13T02:19:43.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:43 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]': finished 2026-02-13T02:19:43.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:43 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2026-02-13T02:19:43.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:43 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]': finished 2026-02-13T02:19:43.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:43 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2026-02-13T02:19:43.501 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:43 trial060 ceph-mon[14797]: osdmap e72: 12 total, 12 up, 12 in 2026-02-13T02:19:43.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:43 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2026-02-13T02:19:43.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:43 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]': finished 2026-02-13T02:19:43.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:43 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 1]}]': finished 2026-02-13T02:19:43.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:43 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [2, 4]}]': finished 2026-02-13T02:19:43.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:43 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2026-02-13T02:19:43.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:43 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]': finished 2026-02-13T02:19:43.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:43 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2026-02-13T02:19:43.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:43 trial078 ceph-mon[14969]: osdmap e72: 12 total, 12 up, 12 in 2026-02-13T02:19:44.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:44 trial011 ceph-mon[11956]: pgmap v207: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2026-02-13T02:19:44.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:44 trial011 ceph-mon[11956]: osdmap e73: 12 total, 12 up, 12 in 2026-02-13T02:19:44.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:44 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/1455387372' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:19:44.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:44 trial060 ceph-mon[14797]: pgmap v207: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2026-02-13T02:19:44.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:44 trial060 ceph-mon[14797]: osdmap e73: 12 total, 12 up, 12 in 2026-02-13T02:19:44.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:44 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/1455387372' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:19:44.541 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:44 trial078 ceph-mon[14969]: pgmap v207: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 307 B/s wr, 10 op/s 2026-02-13T02:19:44.541 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:44 trial078 ceph-mon[14969]: osdmap e73: 12 total, 12 up, 12 in 2026-02-13T02:19:44.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:44 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/1455387372' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:19:46.250 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:19:46.376 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:19:46.397 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:46 trial011 ceph-mon[11956]: pgmap v209: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 3.6 KiB/s rd, 9 op/s; 13 B/s, 0 keys/s, 0 objects/s recovering 2026-02-13T02:19:46.491 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:46.487+0000 7ff59be386c0 1 -- 10.20.193.11:0/2001792607 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7ff59410b5e0 msgr2=0x7ff59410b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:46.491 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:46.487+0000 7ff59be386c0 1 --2- 10.20.193.11:0/2001792607 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7ff59410b5e0 0x7ff59410b9b0 secure :-1 s=READY pgs=313 gs=1 cs=0 l=1 c_cookie=15988653359514941321 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff58400aaf0 tx=0x7ff58402fe50 comp rx=0 tx=0).stop 2026-02-13T02:19:46.491 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:46.487+0000 7ff59be386c0 1 -- 10.20.193.11:0/2001792607 shutdown_connections 2026-02-13T02:19:46.491 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:46.487+0000 7ff59be386c0 1 --2- 10.20.193.11:0/2001792607 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7ff5941117f0 0x7ff594172190 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:46.491 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:46.487+0000 7ff59be386c0 1 --2- 10.20.193.11:0/2001792607 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff59410bfd0 0x7ff594111010 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:46.491 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:46.487+0000 7ff59be386c0 1 --2- 10.20.193.11:0/2001792607 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7ff59410b5e0 0x7ff59410b9b0 unknown :-1 s=CLOSED pgs=313 gs=1 cs=0 l=1 c_cookie=15988653359514941321 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:46.492 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:46.487+0000 7ff59be386c0 1 -- 10.20.193.11:0/2001792607 >> 10.20.193.11:0/2001792607 conn(0x7ff594062e00 msgr2=0x7ff594109660 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:46.492 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:46.487+0000 7ff59be386c0 1 -- 10.20.193.11:0/2001792607 shutdown_connections 2026-02-13T02:19:46.492 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:46.487+0000 7ff59be386c0 1 -- 10.20.193.11:0/2001792607 wait complete. 2026-02-13T02:19:46.492 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:46.487+0000 7ff59be386c0 1 Processor -- start 2026-02-13T02:19:46.492 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:46.488+0000 7ff59be386c0 1 -- start start 2026-02-13T02:19:46.492 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:46.488+0000 7ff59be386c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7ff59410b5e0 0x7ff5940f4490 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:46.492 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:46.488+0000 7ff59be386c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7ff5941117f0 0x7ff594172090 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:46.492 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:46.488+0000 7ff59be386c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff5940f4ac0 0x7ff5940f9d90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:46.492 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:46.488+0000 7ff59be386c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7ff5940f51b0 con 0x7ff5941117f0 2026-02-13T02:19:46.492 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:46.488+0000 7ff59be386c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff5940fa2d0 con 0x7ff59410b5e0 2026-02-13T02:19:46.492 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:46.488+0000 7ff59be386c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7ff5940fa490 con 0x7ff5940f4ac0 2026-02-13T02:19:46.492 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:46.488+0000 7ff5993a86c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7ff5941117f0 0x7ff594172090 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:46.493 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:46.488+0000 7ff5993a86c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7ff5941117f0 0x7ff594172090 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:32852/0 (socket says 10.20.193.11:32852) 2026-02-13T02:19:46.493 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:46.488+0000 7ff5993a86c0 1 -- 10.20.193.11:0/3249259930 learned_addr learned my addr 10.20.193.11:0/3249259930 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:19:46.493 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:46.488+0000 7ff599ba96c0 1 --2- 10.20.193.11:0/3249259930 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7ff59410b5e0 0x7ff5940f4490 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:46.493 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:46.488+0000 7ff5993a86c0 1 -- 10.20.193.11:0/3249259930 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff5940f4ac0 msgr2=0x7ff5940f9d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:46.493 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:46.488+0000 7ff5993a86c0 1 --2- 10.20.193.11:0/3249259930 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff5940f4ac0 0x7ff5940f9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:46.493 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:46.488+0000 7ff5993a86c0 1 -- 10.20.193.11:0/3249259930 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7ff59410b5e0 msgr2=0x7ff5940f4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:46.493 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:46.488+0000 7ff5993a86c0 1 --2- 10.20.193.11:0/3249259930 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7ff59410b5e0 0x7ff5940f4490 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:46.493 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:46.488+0000 7ff5993a86c0 1 -- 10.20.193.11:0/3249259930 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff58400a6e0 con 0x7ff5941117f0 2026-02-13T02:19:46.493 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:46.488+0000 7ff5993a86c0 1 --2- 10.20.193.11:0/3249259930 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7ff5941117f0 0x7ff594172090 secure :-1 s=READY pgs=314 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff588005fd0 tx=0x7ff58800bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:46.493 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:46.488+0000 7ff582ffd6c0 1 -- 10.20.193.11:0/3249259930 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff588004280 con 0x7ff5941117f0 2026-02-13T02:19:46.493 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:46.488+0000 7ff582ffd6c0 1 -- 10.20.193.11:0/3249259930 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff5880043e0 con 0x7ff5941117f0 2026-02-13T02:19:46.494 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:46.488+0000 7ff582ffd6c0 1 -- 10.20.193.11:0/3249259930 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff58800ce10 con 0x7ff5941117f0 2026-02-13T02:19:46.494 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:46.488+0000 7ff59be386c0 1 -- 10.20.193.11:0/3249259930 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5940fa770 con 0x7ff5941117f0 2026-02-13T02:19:46.494 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:46.488+0000 7ff59be386c0 1 -- 10.20.193.11:0/3249259930 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5940fac00 con 0x7ff5941117f0 2026-02-13T02:19:46.494 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:46.489+0000 7ff59be386c0 1 -- 10.20.193.11:0/3249259930 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff59410c8b0 con 0x7ff5941117f0 2026-02-13T02:19:46.495 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:46.490+0000 7ff582ffd6c0 1 -- 10.20.193.11:0/3249259930 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7ff5880026b0 con 0x7ff5941117f0 2026-02-13T02:19:46.495 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:46.491+0000 7ff582ffd6c0 1 --2- 10.20.193.11:0/3249259930 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7ff5700b5710 0x7ff5700d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:46.495 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:46.491+0000 7ff599ba96c0 1 --2- 10.20.193.11:0/3249259930 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7ff5700b5710 0x7ff5700d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:46.495 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:46.491+0000 7ff582ffd6c0 1 -- 10.20.193.11:0/3249259930 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7965+0+0 (secure 0 0 0) 0x7ff5880e3990 con 0x7ff5941117f0 2026-02-13T02:19:46.495 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:46.491+0000 7ff599ba96c0 1 --2- 10.20.193.11:0/3249259930 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7ff5700b5710 0x7ff5700d5bc0 secure :-1 s=READY pgs=219 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff58400aa10 tx=0x7ff584005c00 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:46.495 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:46.491+0000 7ff582ffd6c0 1 -- 10.20.193.11:0/3249259930 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7ff5880a94a0 con 0x7ff5941117f0 2026-02-13T02:19:46.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:46 trial060 ceph-mon[14797]: pgmap v209: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 3.6 KiB/s rd, 9 op/s; 13 B/s, 0 keys/s, 0 objects/s recovering 2026-02-13T02:19:46.541 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:46 trial078 ceph-mon[14969]: pgmap v209: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 3.6 KiB/s rd, 9 op/s; 13 B/s, 0 keys/s, 0 objects/s recovering 2026-02-13T02:19:46.607 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:46.605+0000 7ff59be386c0 1 -- 10.20.193.11:0/3249259930 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ff59410b9b0 con 0x7ff5941117f0 2026-02-13T02:19:46.607 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:46.605+0000 7ff582ffd6c0 1 -- 10.20.193.11:0/3249259930 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7ff5880a9680 con 0x7ff5941117f0 2026-02-13T02:19:46.607 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:19:46.607 INFO:teuthology.orchestra.run.trial011.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:19:46.608 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:46.606+0000 7ff59be386c0 1 -- 10.20.193.11:0/3249259930 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7ff5700b5710 msgr2=0x7ff5700d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:46.608 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:46.606+0000 7ff59be386c0 1 --2- 10.20.193.11:0/3249259930 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7ff5700b5710 0x7ff5700d5bc0 secure :-1 s=READY pgs=219 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff58400aa10 tx=0x7ff584005c00 comp rx=0 tx=0).stop 2026-02-13T02:19:46.609 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:46.606+0000 7ff59be386c0 1 -- 10.20.193.11:0/3249259930 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7ff5941117f0 msgr2=0x7ff594172090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:46.609 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:46.606+0000 7ff59be386c0 1 --2- 10.20.193.11:0/3249259930 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7ff5941117f0 0x7ff594172090 secure :-1 s=READY pgs=314 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff588005fd0 tx=0x7ff58800bca0 comp rx=0 tx=0).stop 2026-02-13T02:19:46.609 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:46.606+0000 7ff59be386c0 1 -- 10.20.193.11:0/3249259930 shutdown_connections 2026-02-13T02:19:46.609 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:46.606+0000 7ff59be386c0 1 --2- 10.20.193.11:0/3249259930 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7ff5700b5710 0x7ff5700d5bc0 unknown :-1 s=CLOSED pgs=219 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:46.609 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:46.606+0000 7ff59be386c0 1 --2- 10.20.193.11:0/3249259930 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff5940f4ac0 0x7ff5940f9d90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:46.609 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:46.606+0000 7ff59be386c0 1 --2- 10.20.193.11:0/3249259930 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7ff5941117f0 0x7ff594172090 unknown :-1 s=CLOSED pgs=314 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:46.609 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:46.606+0000 7ff59be386c0 1 --2- 10.20.193.11:0/3249259930 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7ff59410b5e0 0x7ff5940f4490 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:46.609 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:46.606+0000 7ff59be386c0 1 -- 10.20.193.11:0/3249259930 >> 10.20.193.11:0/3249259930 conn(0x7ff594062e00 msgr2=0x7ff59410de90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:46.609 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:46.606+0000 7ff59be386c0 1 -- 10.20.193.11:0/3249259930 shutdown_connections 2026-02-13T02:19:46.609 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:46.606+0000 7ff59be386c0 1 -- 10.20.193.11:0/3249259930 wait complete. 2026-02-13T02:19:47.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:47 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/3249259930' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:19:47.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:47 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/3249259930' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:19:47.541 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:47 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/3249259930' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:19:48.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:48 trial011 ceph-mon[11956]: pgmap v210: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.5 KiB/s rd, 9 op/s; 13 B/s, 0 keys/s, 1 objects/s recovering 2026-02-13T02:19:48.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:48 trial060 ceph-mon[14797]: pgmap v210: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.5 KiB/s rd, 9 op/s; 13 B/s, 0 keys/s, 1 objects/s recovering 2026-02-13T02:19:48.541 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:48 trial078 ceph-mon[14969]: pgmap v210: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.5 KiB/s rd, 9 op/s; 13 B/s, 0 keys/s, 1 objects/s recovering 2026-02-13T02:19:49.646 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:19:49.773 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:19:49.894 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:49.890+0000 7fe47d2246c0 1 -- 10.20.193.11:0/639169563 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fe47810d970 msgr2=0x7fe4781129b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:49.894 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:49.890+0000 7fe47d2246c0 1 --2- 10.20.193.11:0/639169563 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fe47810d970 0x7fe4781129b0 secure :-1 s=READY pgs=315 gs=1 cs=0 l=1 c_cookie=6651937983924116211 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe4600098d0 tx=0x7fe46002ec40 comp rx=0 tx=0).stop 2026-02-13T02:19:49.894 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:49.890+0000 7fe47d2246c0 1 -- 10.20.193.11:0/639169563 shutdown_connections 2026-02-13T02:19:49.894 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:49.890+0000 7fe47d2246c0 1 --2- 10.20.193.11:0/639169563 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fe478113190 0x7fe478173b30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:49.894 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:49.890+0000 7fe47d2246c0 1 --2- 10.20.193.11:0/639169563 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fe47810d970 0x7fe4781129b0 unknown :-1 s=CLOSED pgs=315 gs=1 cs=0 l=1 c_cookie=6651937983924116211 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:49.894 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:49.890+0000 7fe47d2246c0 1 --2- 10.20.193.11:0/639169563 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fe47810cf80 0x7fe47810d350 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:49.894 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:49.890+0000 7fe47d2246c0 1 -- 10.20.193.11:0/639169563 >> 10.20.193.11:0/639169563 conn(0x7fe4780ea880 msgr2=0x7fe47810ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:49.895 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:49.890+0000 7fe47d2246c0 1 -- 10.20.193.11:0/639169563 shutdown_connections 2026-02-13T02:19:49.895 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:49.890+0000 7fe47d2246c0 1 -- 10.20.193.11:0/639169563 wait complete. 2026-02-13T02:19:49.895 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:49.890+0000 7fe47d2246c0 1 Processor -- start 2026-02-13T02:19:49.895 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:49.890+0000 7fe47d2246c0 1 -- start start 2026-02-13T02:19:49.895 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:49.890+0000 7fe47d2246c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fe47810cf80 0x7fe4780f2870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:49.895 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:49.890+0000 7fe47d2246c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fe478113190 0x7fe478173a30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:49.895 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:49.890+0000 7fe47d2246c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fe4780f2ea0 0x7fe4780f8170 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:49.895 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:49.890+0000 7fe47d2246c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7fe4780f3590 con 0x7fe478113190 2026-02-13T02:19:49.895 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:49.890+0000 7fe47d2246c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe4780f86b0 con 0x7fe4780f2ea0 2026-02-13T02:19:49.895 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:49.890+0000 7fe47d2246c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fe4780f8870 con 0x7fe47810cf80 2026-02-13T02:19:49.895 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:49.891+0000 7fe4765756c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fe478113190 0x7fe478173a30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:49.895 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:49.891+0000 7fe4765756c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fe478113190 0x7fe478173a30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:32874/0 (socket says 10.20.193.11:32874) 2026-02-13T02:19:49.896 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:49.891+0000 7fe4765756c0 1 -- 10.20.193.11:0/68333726 learned_addr learned my addr 10.20.193.11:0/68333726 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:19:49.896 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:49.891+0000 7fe476d766c0 1 --2- 10.20.193.11:0/68333726 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fe47810cf80 0x7fe4780f2870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:49.896 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:49.891+0000 7fe4775776c0 1 --2- 10.20.193.11:0/68333726 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fe4780f2ea0 0x7fe4780f8170 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:49.896 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:49.891+0000 7fe4765756c0 1 -- 10.20.193.11:0/68333726 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fe47810cf80 msgr2=0x7fe4780f2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:49.896 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:49.891+0000 7fe4765756c0 1 --2- 10.20.193.11:0/68333726 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fe47810cf80 0x7fe4780f2870 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:49.896 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:49.891+0000 7fe4765756c0 1 -- 10.20.193.11:0/68333726 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fe4780f2ea0 msgr2=0x7fe4780f8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:49.896 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:49.891+0000 7fe4765756c0 1 --2- 10.20.193.11:0/68333726 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fe4780f2ea0 0x7fe4780f8170 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:49.896 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:49.891+0000 7fe4765756c0 1 -- 10.20.193.11:0/68333726 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4600094c0 con 0x7fe478113190 2026-02-13T02:19:49.896 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:49.891+0000 7fe4765756c0 1 --2- 10.20.193.11:0/68333726 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fe478113190 0x7fe478173a30 secure :-1 s=READY pgs=316 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe4600099d0 tx=0x7fe46002fba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:49.896 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:49.891+0000 7fe457fff6c0 1 -- 10.20.193.11:0/68333726 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe460002ae0 con 0x7fe478113190 2026-02-13T02:19:49.896 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:49.891+0000 7fe457fff6c0 1 -- 10.20.193.11:0/68333726 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe460005d50 con 0x7fe478113190 2026-02-13T02:19:49.896 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:49.891+0000 7fe47d2246c0 1 -- 10.20.193.11:0/68333726 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4780f8af0 con 0x7fe478113190 2026-02-13T02:19:49.896 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:49.891+0000 7fe457fff6c0 1 -- 10.20.193.11:0/68333726 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe460031030 con 0x7fe478113190 2026-02-13T02:19:49.897 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:49.891+0000 7fe47d2246c0 1 -- 10.20.193.11:0/68333726 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4780f8fc0 con 0x7fe478113190 2026-02-13T02:19:49.897 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:49.891+0000 7fe47d2246c0 1 -- 10.20.193.11:0/68333726 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe47810e250 con 0x7fe478113190 2026-02-13T02:19:49.898 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:49.893+0000 7fe457fff6c0 1 -- 10.20.193.11:0/68333726 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7fe460002c40 con 0x7fe478113190 2026-02-13T02:19:49.898 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:49.894+0000 7fe457fff6c0 1 --2- 10.20.193.11:0/68333726 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fe44c0b5710 0x7fe44c0d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:49.898 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:49.894+0000 7fe476d766c0 1 --2- 10.20.193.11:0/68333726 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fe44c0b5710 0x7fe44c0d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:49.898 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:49.894+0000 7fe457fff6c0 1 -- 10.20.193.11:0/68333726 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7965+0+0 (secure 0 0 0) 0x7fe460107af0 con 0x7fe478113190 2026-02-13T02:19:49.898 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:49.894+0000 7fe476d766c0 1 --2- 10.20.193.11:0/68333726 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fe44c0b5710 0x7fe44c0d5bc0 secure :-1 s=READY pgs=220 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe46c005b40 tx=0x7fe46c009310 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:49.898 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:49.894+0000 7fe457fff6c0 1 -- 10.20.193.11:0/68333726 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fe4601405e0 con 0x7fe478113190 2026-02-13T02:19:50.012 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:50.010+0000 7fe47d2246c0 1 -- 10.20.193.11:0/68333726 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fe4780f39c0 con 0x7fe478113190 2026-02-13T02:19:50.012 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:50.010+0000 7fe457fff6c0 1 -- 10.20.193.11:0/68333726 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fe4600ca450 con 0x7fe478113190 2026-02-13T02:19:50.012 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:19:50.012 INFO:teuthology.orchestra.run.trial011.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:19:50.013 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:50.011+0000 7fe47d2246c0 1 -- 10.20.193.11:0/68333726 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fe44c0b5710 msgr2=0x7fe44c0d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:50.013 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:50.011+0000 7fe47d2246c0 1 --2- 10.20.193.11:0/68333726 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fe44c0b5710 0x7fe44c0d5bc0 secure :-1 s=READY pgs=220 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe46c005b40 tx=0x7fe46c009310 comp rx=0 tx=0).stop 2026-02-13T02:19:50.013 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:50.011+0000 7fe47d2246c0 1 -- 10.20.193.11:0/68333726 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fe478113190 msgr2=0x7fe478173a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:50.014 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:50.011+0000 7fe47d2246c0 1 --2- 10.20.193.11:0/68333726 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fe478113190 0x7fe478173a30 secure :-1 s=READY pgs=316 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe4600099d0 tx=0x7fe46002fba0 comp rx=0 tx=0).stop 2026-02-13T02:19:50.014 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:50.011+0000 7fe47d2246c0 1 -- 10.20.193.11:0/68333726 shutdown_connections 2026-02-13T02:19:50.014 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:50.011+0000 7fe47d2246c0 1 --2- 10.20.193.11:0/68333726 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fe44c0b5710 0x7fe44c0d5bc0 unknown :-1 s=CLOSED pgs=220 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:50.014 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:50.011+0000 7fe47d2246c0 1 --2- 10.20.193.11:0/68333726 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fe4780f2ea0 0x7fe4780f8170 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:50.014 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:50.011+0000 7fe47d2246c0 1 --2- 10.20.193.11:0/68333726 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fe478113190 0x7fe478173a30 unknown :-1 s=CLOSED pgs=316 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:50.014 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:50.011+0000 7fe47d2246c0 1 --2- 10.20.193.11:0/68333726 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fe47810cf80 0x7fe4780f2870 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:50.014 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:50.011+0000 7fe47d2246c0 1 -- 10.20.193.11:0/68333726 >> 10.20.193.11:0/68333726 conn(0x7fe4780ea880 msgr2=0x7fe47810b580 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:50.014 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:50.011+0000 7fe47d2246c0 1 -- 10.20.193.11:0/68333726 shutdown_connections 2026-02-13T02:19:50.014 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:50.011+0000 7fe47d2246c0 1 -- 10.20.193.11:0/68333726 wait complete. 2026-02-13T02:19:50.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:50 trial011 ceph-mon[11956]: pgmap v211: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 6.1 KiB/s rd, 11 op/s; 13 B/s, 0 keys/s, 1 objects/s recovering 2026-02-13T02:19:50.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:50 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/68333726' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:19:50.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:50 trial060 ceph-mon[14797]: pgmap v211: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 6.1 KiB/s rd, 11 op/s; 13 B/s, 0 keys/s, 1 objects/s recovering 2026-02-13T02:19:50.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:50 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/68333726' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:19:50.541 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:50 trial078 ceph-mon[14969]: pgmap v211: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 6.1 KiB/s rd, 11 op/s; 13 B/s, 0 keys/s, 1 objects/s recovering 2026-02-13T02:19:50.541 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:50 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/68333726' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:19:52.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:52 trial011 ceph-mon[11956]: pgmap v212: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 8 op/s; 12 B/s, 0 keys/s, 1 objects/s recovering 2026-02-13T02:19:52.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:52 trial060 ceph-mon[14797]: pgmap v212: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 8 op/s; 12 B/s, 0 keys/s, 1 objects/s recovering 2026-02-13T02:19:52.541 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:52 trial078 ceph-mon[14969]: pgmap v212: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 3.3 KiB/s rd, 8 op/s; 12 B/s, 0 keys/s, 1 objects/s recovering 2026-02-13T02:19:53.053 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:19:53.181 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:19:53.295 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:53.291+0000 7f08864f06c0 1 -- 10.20.193.11:0/3965505669 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f088010fbf0 msgr2=0x7f0880114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:53.295 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:53.291+0000 7f08864f06c0 1 --2- 10.20.193.11:0/3965505669 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f088010fbf0 0x7f0880114c30 secure :-1 s=READY pgs=317 gs=1 cs=0 l=1 c_cookie=3861650605024353005 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f08700099a0 tx=0x7f087002ed20 comp rx=0 tx=0).stop 2026-02-13T02:19:53.295 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:53.291+0000 7f08864f06c0 1 -- 10.20.193.11:0/3965505669 shutdown_connections 2026-02-13T02:19:53.295 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:53.291+0000 7f08864f06c0 1 --2- 10.20.193.11:0/3965505669 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f0880115410 0x7f0880175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:53.295 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:53.291+0000 7f08864f06c0 1 --2- 10.20.193.11:0/3965505669 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f088010fbf0 0x7f0880114c30 unknown :-1 s=CLOSED pgs=317 gs=1 cs=0 l=1 c_cookie=3861650605024353005 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:53.295 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:53.291+0000 7f08864f06c0 1 --2- 10.20.193.11:0/3965505669 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f088010f200 0x7f088010f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:53.295 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:53.291+0000 7f08864f06c0 1 -- 10.20.193.11:0/3965505669 >> 10.20.193.11:0/3965505669 conn(0x7f08800ecb00 msgr2=0x7f088010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:53.295 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:53.291+0000 7f08864f06c0 1 -- 10.20.193.11:0/3965505669 shutdown_connections 2026-02-13T02:19:53.296 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:53.291+0000 7f08864f06c0 1 -- 10.20.193.11:0/3965505669 wait complete. 2026-02-13T02:19:53.296 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:53.292+0000 7f08864f06c0 1 Processor -- start 2026-02-13T02:19:53.296 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:53.292+0000 7f08864f06c0 1 -- start start 2026-02-13T02:19:53.296 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:53.292+0000 7f08864f06c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f088010f200 0x7f08800f4c60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:53.296 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:53.292+0000 7f08864f06c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f0880115410 0x7f0880175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:53.296 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:53.292+0000 7f08864f06c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f08800f5290 0x7f08800fa510 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:53.296 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:53.292+0000 7f08864f06c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f08800f5980 con 0x7f08800f5290 2026-02-13T02:19:53.296 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:53.292+0000 7f08864f06c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f08800faa50 con 0x7f0880115410 2026-02-13T02:19:53.296 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:53.292+0000 7f08864f06c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f08800fac10 con 0x7f088010f200 2026-02-13T02:19:53.296 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:53.292+0000 7f0884a666c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f08800f5290 0x7f08800fa510 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:53.296 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:53.292+0000 7f0884a666c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f08800f5290 0x7f08800fa510 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:41490/0 (socket says 10.20.193.11:41490) 2026-02-13T02:19:53.296 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:53.292+0000 7f0884a666c0 1 -- 10.20.193.11:0/337893356 learned_addr learned my addr 10.20.193.11:0/337893356 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:19:53.296 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:53.292+0000 7f087ffff6c0 1 --2- 10.20.193.11:0/337893356 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f088010f200 0x7f08800f4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:53.296 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:53.292+0000 7f087f7fe6c0 1 --2- 10.20.193.11:0/337893356 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f0880115410 0x7f0880175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:53.296 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:53.292+0000 7f0884a666c0 1 -- 10.20.193.11:0/337893356 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f088010f200 msgr2=0x7f08800f4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:53.297 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:53.292+0000 7f0884a666c0 1 --2- 10.20.193.11:0/337893356 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f088010f200 0x7f08800f4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:53.297 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:53.292+0000 7f0884a666c0 1 -- 10.20.193.11:0/337893356 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f0880115410 msgr2=0x7f0880175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:53.297 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:53.292+0000 7f0884a666c0 1 --2- 10.20.193.11:0/337893356 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f0880115410 0x7f0880175cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:53.297 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:53.292+0000 7f0884a666c0 1 -- 10.20.193.11:0/337893356 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0870009590 con 0x7f08800f5290 2026-02-13T02:19:53.297 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:53.292+0000 7f087f7fe6c0 1 --2- 10.20.193.11:0/337893356 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f0880115410 0x7f0880175cb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T02:19:53.297 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:53.292+0000 7f0884a666c0 1 --2- 10.20.193.11:0/337893356 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f08800f5290 0x7f08800fa510 secure :-1 s=READY pgs=318 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0874006ea0 tx=0x7f087400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:53.297 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:53.292+0000 7f087d7fa6c0 1 -- 10.20.193.11:0/337893356 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0874003a30 con 0x7f08800f5290 2026-02-13T02:19:53.297 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:53.292+0000 7f087d7fa6c0 1 -- 10.20.193.11:0/337893356 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0874005510 con 0x7f08800f5290 2026-02-13T02:19:53.297 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:53.292+0000 7f087d7fa6c0 1 -- 10.20.193.11:0/337893356 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f087400dd70 con 0x7f08800f5290 2026-02-13T02:19:53.297 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:53.292+0000 7f08864f06c0 1 -- 10.20.193.11:0/337893356 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08800faef0 con 0x7f08800f5290 2026-02-13T02:19:53.297 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:53.292+0000 7f08864f06c0 1 -- 10.20.193.11:0/337893356 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08800fb680 con 0x7f08800f5290 2026-02-13T02:19:53.297 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:53.293+0000 7f08864f06c0 1 -- 10.20.193.11:0/337893356 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08800fb3d0 con 0x7f08800f5290 2026-02-13T02:19:53.298 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:53.294+0000 7f087d7fa6c0 1 -- 10.20.193.11:0/337893356 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7f0874003b90 con 0x7f08800f5290 2026-02-13T02:19:53.298 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:53.295+0000 7f087d7fa6c0 1 --2- 10.20.193.11:0/337893356 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f08540b5690 0x7f08540d5b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:53.298 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:53.295+0000 7f087ffff6c0 1 --2- 10.20.193.11:0/337893356 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f08540b5690 0x7f08540d5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:53.298 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:53.295+0000 7f087d7fa6c0 1 -- 10.20.193.11:0/337893356 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7965+0+0 (secure 0 0 0) 0x7f08740e4b80 con 0x7f08800f5290 2026-02-13T02:19:53.298 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:53.295+0000 7f087ffff6c0 1 --2- 10.20.193.11:0/337893356 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f08540b5690 0x7f08540d5b40 secure :-1 s=READY pgs=221 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f086c005980 tx=0x7f086c005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:53.298 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:53.295+0000 7f087d7fa6c0 1 -- 10.20.193.11:0/337893356 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f08740a74e0 con 0x7f08800f5290 2026-02-13T02:19:53.411 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:53.409+0000 7f08864f06c0 1 -- 10.20.193.11:0/337893356 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f08801104d0 con 0x7f08800f5290 2026-02-13T02:19:53.411 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:53.409+0000 7f087d7fa6c0 1 -- 10.20.193.11:0/337893356 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f08740aa690 con 0x7f08800f5290 2026-02-13T02:19:53.412 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:19:53.412 INFO:teuthology.orchestra.run.trial011.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:19:53.413 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:53.410+0000 7f08864f06c0 1 -- 10.20.193.11:0/337893356 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f08540b5690 msgr2=0x7f08540d5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:53.413 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:53.410+0000 7f08864f06c0 1 --2- 10.20.193.11:0/337893356 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f08540b5690 0x7f08540d5b40 secure :-1 s=READY pgs=221 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f086c005980 tx=0x7f086c005910 comp rx=0 tx=0).stop 2026-02-13T02:19:53.413 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:53.410+0000 7f08864f06c0 1 -- 10.20.193.11:0/337893356 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f08800f5290 msgr2=0x7f08800fa510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:53.413 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:53.410+0000 7f08864f06c0 1 --2- 10.20.193.11:0/337893356 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f08800f5290 0x7f08800fa510 secure :-1 s=READY pgs=318 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0874006ea0 tx=0x7f087400cca0 comp rx=0 tx=0).stop 2026-02-13T02:19:53.413 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:53.410+0000 7f08864f06c0 1 -- 10.20.193.11:0/337893356 shutdown_connections 2026-02-13T02:19:53.413 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:53.410+0000 7f08864f06c0 1 --2- 10.20.193.11:0/337893356 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f08540b5690 0x7f08540d5b40 unknown :-1 s=CLOSED pgs=221 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:53.413 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:53.410+0000 7f08864f06c0 1 --2- 10.20.193.11:0/337893356 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f0880115410 0x7f0880175cb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:53.413 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:53.410+0000 7f08864f06c0 1 --2- 10.20.193.11:0/337893356 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f08800f5290 0x7f08800fa510 unknown :-1 s=CLOSED pgs=318 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:53.414 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:53.410+0000 7f08864f06c0 1 --2- 10.20.193.11:0/337893356 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f088010f200 0x7f08800f4c60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:53.414 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:53.410+0000 7f08864f06c0 1 -- 10.20.193.11:0/337893356 >> 10.20.193.11:0/337893356 conn(0x7f08800ecb00 msgr2=0x7f088010d860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:53.414 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:53.410+0000 7f08864f06c0 1 -- 10.20.193.11:0/337893356 shutdown_connections 2026-02-13T02:19:53.414 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:53.410+0000 7f08864f06c0 1 -- 10.20.193.11:0/337893356 wait complete. 2026-02-13T02:19:54.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:54 trial011 ceph-mon[11956]: pgmap v213: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.9 KiB/s rd, 9 op/s; 11 B/s, 0 keys/s, 1 objects/s recovering 2026-02-13T02:19:54.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:54 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/337893356' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:19:54.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:54 trial060 ceph-mon[14797]: pgmap v213: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.9 KiB/s rd, 9 op/s; 11 B/s, 0 keys/s, 1 objects/s recovering 2026-02-13T02:19:54.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:54 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/337893356' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:19:54.541 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:54 trial078 ceph-mon[14969]: pgmap v213: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.9 KiB/s rd, 9 op/s; 11 B/s, 0 keys/s, 1 objects/s recovering 2026-02-13T02:19:54.541 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:54 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/337893356' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:19:56.451 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:19:56.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:56 trial011 ceph-mon[11956]: pgmap v214: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 10 op/s; 9 B/s, 0 keys/s, 0 objects/s recovering 2026-02-13T02:19:56.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:56 trial060 ceph-mon[14797]: pgmap v214: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 10 op/s; 9 B/s, 0 keys/s, 0 objects/s recovering 2026-02-13T02:19:56.541 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:56 trial078 ceph-mon[14969]: pgmap v214: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 10 op/s; 9 B/s, 0 keys/s, 0 objects/s recovering 2026-02-13T02:19:56.576 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:19:56.693 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:56.688+0000 7f2cf6be86c0 1 -- 10.20.193.11:0/879435823 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f2cf0113190 msgr2=0x7f2cf0173b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:56.693 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:56.688+0000 7f2cf6be86c0 1 --2- 10.20.193.11:0/879435823 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f2cf0113190 0x7f2cf0173b30 secure :-1 s=READY pgs=319 gs=1 cs=0 l=1 c_cookie=15111079270748161587 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2cec00aa70 tx=0x7f2cec02fde0 comp rx=0 tx=0).stop 2026-02-13T02:19:56.693 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:56.689+0000 7f2cf6be86c0 1 -- 10.20.193.11:0/879435823 shutdown_connections 2026-02-13T02:19:56.693 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:56.689+0000 7f2cf6be86c0 1 --2- 10.20.193.11:0/879435823 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f2cf010d970 0x7f2cf01129b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:56.693 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:56.689+0000 7f2cf6be86c0 1 --2- 10.20.193.11:0/879435823 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f2cf0113190 0x7f2cf0173b30 unknown :-1 s=CLOSED pgs=319 gs=1 cs=0 l=1 c_cookie=15111079270748161587 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:56.693 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:56.689+0000 7f2cf6be86c0 1 --2- 10.20.193.11:0/879435823 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f2cf010cf80 0x7f2cf010d350 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:56.693 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:56.689+0000 7f2cf6be86c0 1 -- 10.20.193.11:0/879435823 >> 10.20.193.11:0/879435823 conn(0x7f2cf00ea880 msgr2=0x7f2cf010ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:56.693 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:56.689+0000 7f2cf6be86c0 1 -- 10.20.193.11:0/879435823 shutdown_connections 2026-02-13T02:19:56.694 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:56.689+0000 7f2cf6be86c0 1 -- 10.20.193.11:0/879435823 wait complete. 2026-02-13T02:19:56.694 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:56.689+0000 7f2cf6be86c0 1 Processor -- start 2026-02-13T02:19:56.694 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:56.689+0000 7f2cf6be86c0 1 -- start start 2026-02-13T02:19:56.694 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:56.689+0000 7f2cf6be86c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f2cf010cf80 0x7f2cf011af50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:56.694 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:56.689+0000 7f2cf6be86c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f2cf0113190 0x7f2cf011b490 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:56.694 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:56.689+0000 7f2cf6be86c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f2cf0120850 0x7f2cf0120cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:56.694 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:56.689+0000 7f2cf6be86c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f2cf0121260 con 0x7f2cf010cf80 2026-02-13T02:19:56.694 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:56.689+0000 7f2cf6be86c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f2cf01213d0 con 0x7f2cf0113190 2026-02-13T02:19:56.694 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:56.689+0000 7f2cf6be86c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f2cf0121590 con 0x7f2cf0120850 2026-02-13T02:19:56.694 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:56.689+0000 7f2cf495d6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f2cf010cf80 0x7f2cf011af50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:56.694 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:56.689+0000 7f2cf495d6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f2cf010cf80 0x7f2cf011af50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:41514/0 (socket says 10.20.193.11:41514) 2026-02-13T02:19:56.694 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:56.689+0000 7f2cf495d6c0 1 -- 10.20.193.11:0/3456895921 learned_addr learned my addr 10.20.193.11:0/3456895921 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:19:56.695 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:56.689+0000 7f2ce7fff6c0 1 --2- 10.20.193.11:0/3456895921 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f2cf0113190 0x7f2cf011b490 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:56.695 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:56.689+0000 7f2cf515e6c0 1 --2- 10.20.193.11:0/3456895921 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f2cf0120850 0x7f2cf0120cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:56.695 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:56.689+0000 7f2cf495d6c0 1 -- 10.20.193.11:0/3456895921 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f2cf0120850 msgr2=0x7f2cf0120cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:56.695 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:56.689+0000 7f2cf495d6c0 1 --2- 10.20.193.11:0/3456895921 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f2cf0120850 0x7f2cf0120cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:56.695 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:56.689+0000 7f2cf495d6c0 1 -- 10.20.193.11:0/3456895921 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f2cf0113190 msgr2=0x7f2cf011b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:56.695 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:56.689+0000 7f2cf495d6c0 1 --2- 10.20.193.11:0/3456895921 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f2cf0113190 0x7f2cf011b490 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:56.695 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:56.689+0000 7f2cf495d6c0 1 -- 10.20.193.11:0/3456895921 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cec00a660 con 0x7f2cf010cf80 2026-02-13T02:19:56.695 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:56.689+0000 7f2cf495d6c0 1 --2- 10.20.193.11:0/3456895921 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f2cf010cf80 0x7f2cf011af50 secure :-1 s=READY pgs=320 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2ce0009490 tx=0x7f2ce000bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:56.695 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:56.690+0000 7f2ce5ffb6c0 1 -- 10.20.193.11:0/3456895921 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2ce0004a80 con 0x7f2cf010cf80 2026-02-13T02:19:56.695 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:56.690+0000 7f2ce5ffb6c0 1 -- 10.20.193.11:0/3456895921 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2ce0009030 con 0x7f2cf010cf80 2026-02-13T02:19:56.695 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:56.690+0000 7f2cf6be86c0 1 -- 10.20.193.11:0/3456895921 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cf0161a40 con 0x7f2cf010cf80 2026-02-13T02:19:56.695 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:56.690+0000 7f2ce5ffb6c0 1 -- 10.20.193.11:0/3456895921 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2ce000ce50 con 0x7f2cf010cf80 2026-02-13T02:19:56.696 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:56.690+0000 7f2cf6be86c0 1 -- 10.20.193.11:0/3456895921 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cf0161ed0 con 0x7f2cf010cf80 2026-02-13T02:19:56.696 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:56.690+0000 7f2cf6be86c0 1 -- 10.20.193.11:0/3456895921 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cf010e250 con 0x7f2cf010cf80 2026-02-13T02:19:56.697 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:56.692+0000 7f2ce5ffb6c0 1 -- 10.20.193.11:0/3456895921 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7f2ce0004ce0 con 0x7f2cf010cf80 2026-02-13T02:19:56.697 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:56.692+0000 7f2ce5ffb6c0 1 --2- 10.20.193.11:0/3456895921 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f2ccc0b5710 0x7f2ccc0d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:19:56.697 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:56.692+0000 7f2ce5ffb6c0 1 -- 10.20.193.11:0/3456895921 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7965+0+0 (secure 0 0 0) 0x7f2ce00e3ca0 con 0x7f2cf010cf80 2026-02-13T02:19:56.697 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:56.693+0000 7f2ce7fff6c0 1 --2- 10.20.193.11:0/3456895921 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f2ccc0b5710 0x7f2ccc0d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:19:56.697 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:56.693+0000 7f2ce5ffb6c0 1 -- 10.20.193.11:0/3456895921 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f2ce00e4120 con 0x7f2cf010cf80 2026-02-13T02:19:56.697 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:56.693+0000 7f2ce7fff6c0 1 --2- 10.20.193.11:0/3456895921 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f2ccc0b5710 0x7f2ccc0d5bc0 secure :-1 s=READY pgs=222 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2cf01218e0 tx=0x7f2cd80093f0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:19:56.810 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:56.808+0000 7f2cf6be86c0 1 -- 10.20.193.11:0/3456895921 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f2cf010d350 con 0x7f2cf010cf80 2026-02-13T02:19:56.810 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:56.808+0000 7f2ce5ffb6c0 1 -- 10.20.193.11:0/3456895921 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f2ce00a6600 con 0x7f2cf010cf80 2026-02-13T02:19:56.810 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:19:56.811 INFO:teuthology.orchestra.run.trial011.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:19:56.812 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:56.809+0000 7f2cf6be86c0 1 -- 10.20.193.11:0/3456895921 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f2ccc0b5710 msgr2=0x7f2ccc0d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:56.812 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:56.809+0000 7f2cf6be86c0 1 --2- 10.20.193.11:0/3456895921 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f2ccc0b5710 0x7f2ccc0d5bc0 secure :-1 s=READY pgs=222 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2cf01218e0 tx=0x7f2cd80093f0 comp rx=0 tx=0).stop 2026-02-13T02:19:56.812 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:56.809+0000 7f2cf6be86c0 1 -- 10.20.193.11:0/3456895921 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f2cf010cf80 msgr2=0x7f2cf011af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:19:56.812 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:56.809+0000 7f2cf6be86c0 1 --2- 10.20.193.11:0/3456895921 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f2cf010cf80 0x7f2cf011af50 secure :-1 s=READY pgs=320 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2ce0009490 tx=0x7f2ce000bc50 comp rx=0 tx=0).stop 2026-02-13T02:19:56.812 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:56.809+0000 7f2cf6be86c0 1 -- 10.20.193.11:0/3456895921 shutdown_connections 2026-02-13T02:19:56.812 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:56.809+0000 7f2cf6be86c0 1 --2- 10.20.193.11:0/3456895921 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f2ccc0b5710 0x7f2ccc0d5bc0 unknown :-1 s=CLOSED pgs=222 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:56.812 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:56.809+0000 7f2cf6be86c0 1 --2- 10.20.193.11:0/3456895921 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f2cf0113190 0x7f2cf011b490 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:56.812 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:56.809+0000 7f2cf6be86c0 1 --2- 10.20.193.11:0/3456895921 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f2cf0120850 0x7f2cf0120cf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:56.812 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:56.809+0000 7f2cf6be86c0 1 --2- 10.20.193.11:0/3456895921 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f2cf010cf80 0x7f2cf011af50 unknown :-1 s=CLOSED pgs=320 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:19:56.812 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:56.809+0000 7f2cf6be86c0 1 -- 10.20.193.11:0/3456895921 >> 10.20.193.11:0/3456895921 conn(0x7f2cf00ea880 msgr2=0x7f2cf010ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:19:56.813 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:56.809+0000 7f2cf6be86c0 1 -- 10.20.193.11:0/3456895921 shutdown_connections 2026-02-13T02:19:56.813 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:19:56.809+0000 7f2cf6be86c0 1 -- 10.20.193.11:0/3456895921 wait complete. 2026-02-13T02:19:57.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:57 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/3456895921' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:19:57.452 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:57 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:19:57.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:57 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/3456895921' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:19:57.500 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:57 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:19:57.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:57 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/3456895921' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:19:57.542 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:57 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:19:58.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:58 trial011 ceph-mon[11956]: pgmap v215: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s; 0 B/s, 0 objects/s recovering 2026-02-13T02:19:58.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:58 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:19:58.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:58 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:19:58.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:58 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:19:58.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:58 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:19:58.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:58 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:19:58.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:58 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:19:58.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:58 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:19:58.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:58 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:19:58.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:58 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:19:58.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:58 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:19:58.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:58 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:19:58.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:58 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:19:59.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:58 trial060 ceph-mon[14797]: pgmap v215: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s; 0 B/s, 0 objects/s recovering 2026-02-13T02:19:59.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:58 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:19:59.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:58 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:19:59.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:58 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:19:59.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:58 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:19:59.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:58 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:19:59.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:58 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:19:59.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:58 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:19:59.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:58 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:19:59.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:58 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:19:59.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:58 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:19:59.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:58 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:19:59.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:58 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:19:59.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:58 trial078 ceph-mon[14969]: pgmap v215: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s; 0 B/s, 0 objects/s recovering 2026-02-13T02:19:59.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:58 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:19:59.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:58 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:19:59.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:58 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:19:59.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:58 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:19:59.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:58 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:19:59.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:58 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:19:59.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:58 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:19:59.043 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:58 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:19:59.043 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:58 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:19:59.043 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:58 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:19:59.043 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:58 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:19:59.043 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:58 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:19:59.851 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:19:59.877 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:59 trial011 ceph-mon[11956]: pgmap v216: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:19:59.877 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:19:59 trial011 ceph-mon[11956]: pgmap v217: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 9 op/s 2026-02-13T02:19:59.976 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:19:59.999 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:59 trial060 ceph-mon[14797]: pgmap v216: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:20:00.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:19:59 trial060 ceph-mon[14797]: pgmap v217: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 9 op/s 2026-02-13T02:20:00.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:59 trial078 ceph-mon[14969]: pgmap v216: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:20:00.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:19:59 trial078 ceph-mon[14969]: pgmap v217: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 9 op/s 2026-02-13T02:20:00.097 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:00.096+0000 7f91ea7f56c0 1 -- 10.20.193.11:0/3963714428 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f91e4115410 msgr2=0x7f91e4175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:20:00.097 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:00.096+0000 7f91ea7f56c0 1 --2- 10.20.193.11:0/3963714428 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f91e4115410 0x7f91e4175db0 secure :-1 s=READY pgs=321 gs=1 cs=0 l=1 c_cookie=15273859721343009878 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f91d800aa70 tx=0x7f91d802fde0 comp rx=0 tx=0).stop 2026-02-13T02:20:00.097 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:00.096+0000 7f91ea7f56c0 1 -- 10.20.193.11:0/3963714428 shutdown_connections 2026-02-13T02:20:00.097 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:00.096+0000 7f91ea7f56c0 1 --2- 10.20.193.11:0/3963714428 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f91e410fbf0 0x7f91e4114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:00.098 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:00.096+0000 7f91ea7f56c0 1 --2- 10.20.193.11:0/3963714428 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f91e4115410 0x7f91e4175db0 unknown :-1 s=CLOSED pgs=321 gs=1 cs=0 l=1 c_cookie=15273859721343009878 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:00.098 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:00.096+0000 7f91ea7f56c0 1 --2- 10.20.193.11:0/3963714428 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f91e410f200 0x7f91e410f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:00.098 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:00.096+0000 7f91ea7f56c0 1 -- 10.20.193.11:0/3963714428 >> 10.20.193.11:0/3963714428 conn(0x7f91e40ecb00 msgr2=0x7f91e410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:20:00.098 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:00.096+0000 7f91ea7f56c0 1 -- 10.20.193.11:0/3963714428 shutdown_connections 2026-02-13T02:20:00.098 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:00.096+0000 7f91ea7f56c0 1 -- 10.20.193.11:0/3963714428 wait complete. 2026-02-13T02:20:00.098 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:00.096+0000 7f91ea7f56c0 1 Processor -- start 2026-02-13T02:20:00.098 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:00.096+0000 7f91ea7f56c0 1 -- start start 2026-02-13T02:20:00.098 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:00.096+0000 7f91ea7f56c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f91e410f200 0x7f91e411d170 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:20:00.098 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:00.096+0000 7f91ea7f56c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f91e4115410 0x7f91e411d6b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:20:00.098 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:00.096+0000 7f91ea7f56c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f91e4122a70 0x7f91e4122f10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:20:00.098 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:00.096+0000 7f91ea7f56c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f91e4123450 con 0x7f91e4115410 2026-02-13T02:20:00.098 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:00.096+0000 7f91ea7f56c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f91e41235c0 con 0x7f91e410f200 2026-02-13T02:20:00.098 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:00.096+0000 7f91ea7f56c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f91e4123780 con 0x7f91e4122a70 2026-02-13T02:20:00.098 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:00.096+0000 7f91e37fe6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f91e4115410 0x7f91e411d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:20:00.099 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:00.096+0000 7f91e37fe6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f91e4115410 0x7f91e411d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:41532/0 (socket says 10.20.193.11:41532) 2026-02-13T02:20:00.099 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:00.096+0000 7f91e37fe6c0 1 -- 10.20.193.11:0/1937005801 learned_addr learned my addr 10.20.193.11:0/1937005801 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:20:00.099 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:00.096+0000 7f91e3fff6c0 1 --2- 10.20.193.11:0/1937005801 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f91e410f200 0x7f91e411d170 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:20:00.099 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:00.096+0000 7f91e8d676c0 1 --2- 10.20.193.11:0/1937005801 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f91e4122a70 0x7f91e4122f10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:20:00.099 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:00.096+0000 7f91e37fe6c0 1 -- 10.20.193.11:0/1937005801 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f91e4122a70 msgr2=0x7f91e4122f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:20:00.099 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:00.096+0000 7f91e37fe6c0 1 --2- 10.20.193.11:0/1937005801 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f91e4122a70 0x7f91e4122f10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:00.099 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:00.096+0000 7f91e37fe6c0 1 -- 10.20.193.11:0/1937005801 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f91e410f200 msgr2=0x7f91e411d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:20:00.099 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:00.096+0000 7f91e37fe6c0 1 --2- 10.20.193.11:0/1937005801 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f91e410f200 0x7f91e411d170 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:00.099 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:00.096+0000 7f91e37fe6c0 1 -- 10.20.193.11:0/1937005801 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91d800a660 con 0x7f91e4115410 2026-02-13T02:20:00.099 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:00.096+0000 7f91e8d676c0 1 --2- 10.20.193.11:0/1937005801 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f91e4122a70 0x7f91e4122f10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:20:00.099 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:00.097+0000 7f91e37fe6c0 1 --2- 10.20.193.11:0/1937005801 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f91e4115410 0x7f91e411d6b0 secure :-1 s=READY pgs=322 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f91d400b650 tx=0x7f91d400bb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:20:00.099 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:00.097+0000 7f91e17fa6c0 1 -- 10.20.193.11:0/1937005801 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f91d40044a0 con 0x7f91e4115410 2026-02-13T02:20:00.099 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:00.097+0000 7f91e17fa6c0 1 -- 10.20.193.11:0/1937005801 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f91d4009030 con 0x7f91e4115410 2026-02-13T02:20:00.099 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:00.097+0000 7f91ea7f56c0 1 -- 10.20.193.11:0/1937005801 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91e4163c00 con 0x7f91e4115410 2026-02-13T02:20:00.099 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:00.097+0000 7f91e17fa6c0 1 -- 10.20.193.11:0/1937005801 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f91d400ccb0 con 0x7f91e4115410 2026-02-13T02:20:00.099 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:00.097+0000 7f91ea7f56c0 1 -- 10.20.193.11:0/1937005801 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91e4164130 con 0x7f91e4115410 2026-02-13T02:20:00.099 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:00.097+0000 7f91ea7f56c0 1 -- 10.20.193.11:0/1937005801 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91e41104d0 con 0x7f91e4115410 2026-02-13T02:20:00.100 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:00.098+0000 7f91e17fa6c0 1 -- 10.20.193.11:0/1937005801 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7f91d40026b0 con 0x7f91e4115410 2026-02-13T02:20:00.101 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:00.099+0000 7f91e17fa6c0 1 --2- 10.20.193.11:0/1937005801 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f91b80b5710 0x7f91b80d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:20:00.101 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:00.099+0000 7f91e3fff6c0 1 --2- 10.20.193.11:0/1937005801 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f91b80b5710 0x7f91b80d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:20:00.101 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:00.099+0000 7f91e17fa6c0 1 -- 10.20.193.11:0/1937005801 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7965+0+0 (secure 0 0 0) 0x7f91d40e3a40 con 0x7f91e4115410 2026-02-13T02:20:00.101 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:00.099+0000 7f91e17fa6c0 1 -- 10.20.193.11:0/1937005801 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f91d411c5e0 con 0x7f91e4115410 2026-02-13T02:20:00.101 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:00.100+0000 7f91e3fff6c0 1 --2- 10.20.193.11:0/1937005801 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f91b80b5710 0x7f91b80d5bc0 secure :-1 s=READY pgs=223 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f91d0005980 tx=0x7f91d00094b0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:20:00.216 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:00.214+0000 7f91ea7f56c0 1 -- 10.20.193.11:0/1937005801 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f91e411e2c0 con 0x7f91e4115410 2026-02-13T02:20:00.216 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:00.214+0000 7f91e17fa6c0 1 -- 10.20.193.11:0/1937005801 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f91d40a63a0 con 0x7f91e4115410 2026-02-13T02:20:00.216 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:20:00.216 INFO:teuthology.orchestra.run.trial011.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:20:00.217 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:00.215+0000 7f91ea7f56c0 1 -- 10.20.193.11:0/1937005801 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f91b80b5710 msgr2=0x7f91b80d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:20:00.217 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:00.215+0000 7f91ea7f56c0 1 --2- 10.20.193.11:0/1937005801 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f91b80b5710 0x7f91b80d5bc0 secure :-1 s=READY pgs=223 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f91d0005980 tx=0x7f91d00094b0 comp rx=0 tx=0).stop 2026-02-13T02:20:00.217 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:00.215+0000 7f91ea7f56c0 1 -- 10.20.193.11:0/1937005801 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f91e4115410 msgr2=0x7f91e411d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:20:00.217 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:00.215+0000 7f91ea7f56c0 1 --2- 10.20.193.11:0/1937005801 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f91e4115410 0x7f91e411d6b0 secure :-1 s=READY pgs=322 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f91d400b650 tx=0x7f91d400bb20 comp rx=0 tx=0).stop 2026-02-13T02:20:00.217 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:00.216+0000 7f91ea7f56c0 1 -- 10.20.193.11:0/1937005801 shutdown_connections 2026-02-13T02:20:00.217 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:00.216+0000 7f91ea7f56c0 1 --2- 10.20.193.11:0/1937005801 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f91b80b5710 0x7f91b80d5bc0 unknown :-1 s=CLOSED pgs=223 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:00.217 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:00.216+0000 7f91ea7f56c0 1 --2- 10.20.193.11:0/1937005801 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f91e4122a70 0x7f91e4122f10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:00.217 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:00.216+0000 7f91ea7f56c0 1 --2- 10.20.193.11:0/1937005801 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f91e4115410 0x7f91e411d6b0 unknown :-1 s=CLOSED pgs=322 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:00.217 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:00.216+0000 7f91ea7f56c0 1 --2- 10.20.193.11:0/1937005801 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f91e410f200 0x7f91e411d170 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:00.217 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:00.216+0000 7f91ea7f56c0 1 -- 10.20.193.11:0/1937005801 >> 10.20.193.11:0/1937005801 conn(0x7f91e40ecb00 msgr2=0x7f91e410cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:20:00.217 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:00.216+0000 7f91ea7f56c0 1 -- 10.20.193.11:0/1937005801 shutdown_connections 2026-02-13T02:20:00.217 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:00.216+0000 7f91ea7f56c0 1 -- 10.20.193.11:0/1937005801 wait complete. 2026-02-13T02:20:00.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:00 trial011 ceph-mon[11956]: Health detail: HEALTH_WARN Failed to apply 1 service(s): osd.default 2026-02-13T02:20:00.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:00 trial011 ceph-mon[11956]: [WRN] CEPHADM_APPLY_SPEC_FAIL: Failed to apply 1 service(s): osd.default 2026-02-13T02:20:00.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:00 trial011 ceph-mon[11956]: osd.default: cephadm exited with an error code: 1, stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.c/config 2026-02-13T02:20:00.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:00 trial011 ceph-mon[11956]: Non-zero exit code 2 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 -e NODE_NAME=trial078 -e CEPH_VOLUME_OSDSPEC_AFFINITY=default -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/fc631695-0881-11f1-899c-d404e6e7d460:/var/run/ceph:z -v /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460:/var/log/ceph:z -v /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmplbjbozbs:/etc/ceph/ceph.conf:z -v /tmp/ceph-tmpgw_69tbr:/var/lib/ceph/bootstrap-osd/ceph.keyring:z quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 lvm batch --no-auto vg_nvme/lv_1 --objectstore bluestore --osd-type OSDType.classic --yes --no-systemd 2026-02-13T02:20:00.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:00 trial011 ceph-mon[11956]: /usr/bin/podman: stderr usage: ceph-volume lvm batch [-h] [--db-devices [DB_DEVICES ...]] 2026-02-13T02:20:00.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:00 trial011 ceph-mon[11956]: /usr/bin/podman: stderr [--wal-devices [WAL_DEVICES ...]] [--auto] 2026-02-13T02:20:00.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:00 trial011 ceph-mon[11956]: /usr/bin/podman: stderr [--no-auto] [--objectstore {bluestore,seastore}] 2026-02-13T02:20:00.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:00 trial011 ceph-mon[11956]: /usr/bin/podman: stderr [--bluestore] [--report] [--yes] 2026-02-13T02:20:00.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:00 trial011 ceph-mon[11956]: /usr/bin/podman: stderr [--format {json,json-pretty,pretty}] [--dmcrypt] 2026-02-13T02:20:00.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:00 trial011 ceph-mon[11956]: /usr/bin/podman: stderr [--with-tpm] 2026-02-13T02:20:00.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:00 trial011 ceph-mon[11956]: /usr/bin/podman: stderr [--crush-device-class CRUSH_DEVICE_CLASS] 2026-02-13T02:20:00.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:00 trial011 ceph-mon[11956]: /usr/bin/podman: stderr [--no-systemd] 2026-02-13T02:20:00.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:00 trial011 ceph-mon[11956]: /usr/bin/podman: stderr [--osds-per-device OSDS_PER_DEVICE] 2026-02-13T02:20:00.954 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:00 trial011 ceph-mon[11956]: /usr/bin/podman: stderr [--data-slots DATA_SLOTS] 2026-02-13T02:20:00.954 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:00 trial011 ceph-mon[11956]: /usr/bin/podman: stderr [--data-allocate-fraction DATA_ALLOCATE_FRACTION] 2026-02-13T02:20:00.954 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:00 trial011 ceph-mon[11956]: /usr/bin/podman: stderr [--block-db-size BLOCK_DB_SIZE] 2026-02-13T02:20:00.954 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:00 trial011 ceph-mon[11956]: /usr/bin/podman: stderr [--block-db-slots BLOCK_DB_SLOTS] 2026-02-13T02:20:00.954 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:00 trial011 ceph-mon[11956]: /usr/bin/podman: stderr [--block-wal-size BLOCK_WAL_SIZE] 2026-02-13T02:20:00.954 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:00 trial011 ceph-mon[11956]: /usr/bin/podman: stderr [--block-wal-slots BLOCK_WAL_SLOTS] [--prepare] 2026-02-13T02:20:00.954 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:00 trial011 ceph-mon[11956]: /usr/bin/podman: stderr [--osd-ids [OSD_IDS ...]] 2026-02-13T02:20:00.954 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:00 trial011 ceph-mon[11956]: /usr/bin/podman: stderr [--dmcrypt-format-opts DMCRYPT_FORMAT_OPTS] 2026-02-13T02:20:00.954 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:00 trial011 ceph-mon[11956]: /usr/bin/podman: stderr [--dmcrypt-open-opts DMCRYPT_OPEN_OPTS] 2026-02-13T02:20:00.954 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:00 trial011 ceph-mon[11956]: /usr/bin/podman: stderr [--osd-type {classic,crimson}] 2026-02-13T02:20:00.954 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:00 trial011 ceph-mon[11956]: /usr/bin/podman: stderr [DEVICES ...] 2026-02-13T02:20:00.954 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:00 trial011 ceph-mon[11956]: /usr/bin/podman: stderr ceph-volume lvm batch: error: argument --osd-type: invalid choice: 'OSDType.classic' (choose from classic, crimson) 2026-02-13T02:20:00.955 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:00 trial011 ceph-mon[11956]: Traceback (most recent call last): 2026-02-13T02:20:00.955 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:00 trial011 ceph-mon[11956]: File "", line 198, in _run_module_as_main 2026-02-13T02:20:00.955 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:00 trial011 ceph-mon[11956]: File "", line 88, in _run_code 2026-02-13T02:20:00.955 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:00 trial011 ceph-mon[11956]: File "/tmp/tmpzmwd66c0.cephadm.build/app/__main__.py", line 5364, in 2026-02-13T02:20:00.955 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:00 trial011 ceph-mon[11956]: File "/tmp/tmpzmwd66c0.cephadm.build/app/__main__.py", line 5352, in main 2026-02-13T02:20:00.955 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:00 trial011 ceph-mon[11956]: File "/tmp/tmpzmwd66c0.cephadm.build/app/__main__.py", line 398, in _infer_config 2026-02-13T02:20:00.955 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:00 trial011 ceph-mon[11956]: File "/tmp/tmpzmwd66c0.cephadm.build/app/__main__.py", line 313, in _infer_fsid 2026-02-13T02:20:00.955 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:00 trial011 ceph-mon[11956]: File "/tmp/tmpzmwd66c0.cephadm.build/app/__main__.py", line 426, in _infer_image 2026-02-13T02:20:00.955 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:00 trial011 ceph-mon[11956]: File "/tmp/tmpzmwd66c0.cephadm.build/app/__main__.py", line 300, in _validate_fsid 2026-02-13T02:20:00.955 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:00 trial011 ceph-mon[11956]: File "/tmp/tmpzmwd66c0.cephadm.build/app/__main__.py", line 3264, in command_ceph_volume 2026-02-13T02:20:00.955 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:00 trial011 ceph-mon[11956]: File "/tmp/tmpzmwd66c0.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2026-02-13T02:20:00.955 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:00 trial011 ceph-mon[11956]: RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 -e NODE_NAME=trial078 -e CEPH_VOLUME_OSDSPEC_AFFINITY=default -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/fc631695-0881-11f1-899c-d404e6e7d460:/var/run/ceph:z -v /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460:/var/log/ceph:z -v /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmplbjbozbs:/etc/ceph/ceph.conf:z -v /tmp/ceph-tmpgw_69tbr:/var/lib/ceph/bootstrap-osd/ceph.keyring:z quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 lvm batch --no-auto vg_nvme/lv_1 --objectstore bluestore --osd-type OSDType.classic --yes --no-systemd 2026-02-13T02:20:00.956 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:00 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/1937005801' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:20:01.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:00 trial060 ceph-mon[14797]: Health detail: HEALTH_WARN Failed to apply 1 service(s): osd.default 2026-02-13T02:20:01.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:00 trial060 ceph-mon[14797]: [WRN] CEPHADM_APPLY_SPEC_FAIL: Failed to apply 1 service(s): osd.default 2026-02-13T02:20:01.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:00 trial060 ceph-mon[14797]: osd.default: cephadm exited with an error code: 1, stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.c/config 2026-02-13T02:20:01.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:00 trial060 ceph-mon[14797]: Non-zero exit code 2 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 -e NODE_NAME=trial078 -e CEPH_VOLUME_OSDSPEC_AFFINITY=default -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/fc631695-0881-11f1-899c-d404e6e7d460:/var/run/ceph:z -v /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460:/var/log/ceph:z -v /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmplbjbozbs:/etc/ceph/ceph.conf:z -v /tmp/ceph-tmpgw_69tbr:/var/lib/ceph/bootstrap-osd/ceph.keyring:z quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 lvm batch --no-auto vg_nvme/lv_1 --objectstore bluestore --osd-type OSDType.classic --yes --no-systemd 2026-02-13T02:20:01.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:00 trial060 ceph-mon[14797]: /usr/bin/podman: stderr usage: ceph-volume lvm batch [-h] [--db-devices [DB_DEVICES ...]] 2026-02-13T02:20:01.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:00 trial060 ceph-mon[14797]: /usr/bin/podman: stderr [--wal-devices [WAL_DEVICES ...]] [--auto] 2026-02-13T02:20:01.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:00 trial060 ceph-mon[14797]: /usr/bin/podman: stderr [--no-auto] [--objectstore {bluestore,seastore}] 2026-02-13T02:20:01.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:00 trial060 ceph-mon[14797]: /usr/bin/podman: stderr [--bluestore] [--report] [--yes] 2026-02-13T02:20:01.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:00 trial060 ceph-mon[14797]: /usr/bin/podman: stderr [--format {json,json-pretty,pretty}] [--dmcrypt] 2026-02-13T02:20:01.002 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:00 trial060 ceph-mon[14797]: /usr/bin/podman: stderr [--with-tpm] 2026-02-13T02:20:01.002 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:00 trial060 ceph-mon[14797]: /usr/bin/podman: stderr [--crush-device-class CRUSH_DEVICE_CLASS] 2026-02-13T02:20:01.002 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:00 trial060 ceph-mon[14797]: /usr/bin/podman: stderr [--no-systemd] 2026-02-13T02:20:01.002 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:00 trial060 ceph-mon[14797]: /usr/bin/podman: stderr [--osds-per-device OSDS_PER_DEVICE] 2026-02-13T02:20:01.002 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:00 trial060 ceph-mon[14797]: /usr/bin/podman: stderr [--data-slots DATA_SLOTS] 2026-02-13T02:20:01.002 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:00 trial060 ceph-mon[14797]: /usr/bin/podman: stderr [--data-allocate-fraction DATA_ALLOCATE_FRACTION] 2026-02-13T02:20:01.002 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:00 trial060 ceph-mon[14797]: /usr/bin/podman: stderr [--block-db-size BLOCK_DB_SIZE] 2026-02-13T02:20:01.002 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:00 trial060 ceph-mon[14797]: /usr/bin/podman: stderr [--block-db-slots BLOCK_DB_SLOTS] 2026-02-13T02:20:01.002 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:00 trial060 ceph-mon[14797]: /usr/bin/podman: stderr [--block-wal-size BLOCK_WAL_SIZE] 2026-02-13T02:20:01.002 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:00 trial060 ceph-mon[14797]: /usr/bin/podman: stderr [--block-wal-slots BLOCK_WAL_SLOTS] [--prepare] 2026-02-13T02:20:01.002 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:00 trial060 ceph-mon[14797]: /usr/bin/podman: stderr [--osd-ids [OSD_IDS ...]] 2026-02-13T02:20:01.002 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:00 trial060 ceph-mon[14797]: /usr/bin/podman: stderr [--dmcrypt-format-opts DMCRYPT_FORMAT_OPTS] 2026-02-13T02:20:01.003 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:00 trial060 ceph-mon[14797]: /usr/bin/podman: stderr [--dmcrypt-open-opts DMCRYPT_OPEN_OPTS] 2026-02-13T02:20:01.003 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:00 trial060 ceph-mon[14797]: /usr/bin/podman: stderr [--osd-type {classic,crimson}] 2026-02-13T02:20:01.003 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:00 trial060 ceph-mon[14797]: /usr/bin/podman: stderr [DEVICES ...] 2026-02-13T02:20:01.003 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:00 trial060 ceph-mon[14797]: /usr/bin/podman: stderr ceph-volume lvm batch: error: argument --osd-type: invalid choice: 'OSDType.classic' (choose from classic, crimson) 2026-02-13T02:20:01.003 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:00 trial060 ceph-mon[14797]: Traceback (most recent call last): 2026-02-13T02:20:01.003 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:00 trial060 ceph-mon[14797]: File "", line 198, in _run_module_as_main 2026-02-13T02:20:01.003 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:00 trial060 ceph-mon[14797]: File "", line 88, in _run_code 2026-02-13T02:20:01.003 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:00 trial060 ceph-mon[14797]: File "/tmp/tmpzmwd66c0.cephadm.build/app/__main__.py", line 5364, in 2026-02-13T02:20:01.003 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:00 trial060 ceph-mon[14797]: File "/tmp/tmpzmwd66c0.cephadm.build/app/__main__.py", line 5352, in main 2026-02-13T02:20:01.003 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:00 trial060 ceph-mon[14797]: File "/tmp/tmpzmwd66c0.cephadm.build/app/__main__.py", line 398, in _infer_config 2026-02-13T02:20:01.003 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:00 trial060 ceph-mon[14797]: File "/tmp/tmpzmwd66c0.cephadm.build/app/__main__.py", line 313, in _infer_fsid 2026-02-13T02:20:01.003 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:00 trial060 ceph-mon[14797]: File "/tmp/tmpzmwd66c0.cephadm.build/app/__main__.py", line 426, in _infer_image 2026-02-13T02:20:01.004 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:00 trial060 ceph-mon[14797]: File "/tmp/tmpzmwd66c0.cephadm.build/app/__main__.py", line 300, in _validate_fsid 2026-02-13T02:20:01.004 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:00 trial060 ceph-mon[14797]: File "/tmp/tmpzmwd66c0.cephadm.build/app/__main__.py", line 3264, in command_ceph_volume 2026-02-13T02:20:01.004 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:00 trial060 ceph-mon[14797]: File "/tmp/tmpzmwd66c0.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2026-02-13T02:20:01.004 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:00 trial060 ceph-mon[14797]: RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 -e NODE_NAME=trial078 -e CEPH_VOLUME_OSDSPEC_AFFINITY=default -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/fc631695-0881-11f1-899c-d404e6e7d460:/var/run/ceph:z -v /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460:/var/log/ceph:z -v /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmplbjbozbs:/etc/ceph/ceph.conf:z -v /tmp/ceph-tmpgw_69tbr:/var/lib/ceph/bootstrap-osd/ceph.keyring:z quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 lvm batch --no-auto vg_nvme/lv_1 --objectstore bluestore --osd-type OSDType.classic --yes --no-systemd 2026-02-13T02:20:01.004 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:00 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/1937005801' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:20:01.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:00 trial078 ceph-mon[14969]: Health detail: HEALTH_WARN Failed to apply 1 service(s): osd.default 2026-02-13T02:20:01.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:00 trial078 ceph-mon[14969]: [WRN] CEPHADM_APPLY_SPEC_FAIL: Failed to apply 1 service(s): osd.default 2026-02-13T02:20:01.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:00 trial078 ceph-mon[14969]: osd.default: cephadm exited with an error code: 1, stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.c/config 2026-02-13T02:20:01.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:00 trial078 ceph-mon[14969]: Non-zero exit code 2 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 -e NODE_NAME=trial078 -e CEPH_VOLUME_OSDSPEC_AFFINITY=default -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/fc631695-0881-11f1-899c-d404e6e7d460:/var/run/ceph:z -v /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460:/var/log/ceph:z -v /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmplbjbozbs:/etc/ceph/ceph.conf:z -v /tmp/ceph-tmpgw_69tbr:/var/lib/ceph/bootstrap-osd/ceph.keyring:z quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 lvm batch --no-auto vg_nvme/lv_1 --objectstore bluestore --osd-type OSDType.classic --yes --no-systemd 2026-02-13T02:20:01.043 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:00 trial078 ceph-mon[14969]: /usr/bin/podman: stderr usage: ceph-volume lvm batch [-h] [--db-devices [DB_DEVICES ...]] 2026-02-13T02:20:01.043 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:00 trial078 ceph-mon[14969]: /usr/bin/podman: stderr [--wal-devices [WAL_DEVICES ...]] [--auto] 2026-02-13T02:20:01.043 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:00 trial078 ceph-mon[14969]: /usr/bin/podman: stderr [--no-auto] [--objectstore {bluestore,seastore}] 2026-02-13T02:20:01.043 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:00 trial078 ceph-mon[14969]: /usr/bin/podman: stderr [--bluestore] [--report] [--yes] 2026-02-13T02:20:01.043 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:00 trial078 ceph-mon[14969]: /usr/bin/podman: stderr [--format {json,json-pretty,pretty}] [--dmcrypt] 2026-02-13T02:20:01.043 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:00 trial078 ceph-mon[14969]: /usr/bin/podman: stderr [--with-tpm] 2026-02-13T02:20:01.043 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:00 trial078 ceph-mon[14969]: /usr/bin/podman: stderr [--crush-device-class CRUSH_DEVICE_CLASS] 2026-02-13T02:20:01.043 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:00 trial078 ceph-mon[14969]: /usr/bin/podman: stderr [--no-systemd] 2026-02-13T02:20:01.043 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:00 trial078 ceph-mon[14969]: /usr/bin/podman: stderr [--osds-per-device OSDS_PER_DEVICE] 2026-02-13T02:20:01.043 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:00 trial078 ceph-mon[14969]: /usr/bin/podman: stderr [--data-slots DATA_SLOTS] 2026-02-13T02:20:01.043 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:00 trial078 ceph-mon[14969]: /usr/bin/podman: stderr [--data-allocate-fraction DATA_ALLOCATE_FRACTION] 2026-02-13T02:20:01.044 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:00 trial078 ceph-mon[14969]: /usr/bin/podman: stderr [--block-db-size BLOCK_DB_SIZE] 2026-02-13T02:20:01.044 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:00 trial078 ceph-mon[14969]: /usr/bin/podman: stderr [--block-db-slots BLOCK_DB_SLOTS] 2026-02-13T02:20:01.044 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:00 trial078 ceph-mon[14969]: /usr/bin/podman: stderr [--block-wal-size BLOCK_WAL_SIZE] 2026-02-13T02:20:01.044 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:00 trial078 ceph-mon[14969]: /usr/bin/podman: stderr [--block-wal-slots BLOCK_WAL_SLOTS] [--prepare] 2026-02-13T02:20:01.044 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:00 trial078 ceph-mon[14969]: /usr/bin/podman: stderr [--osd-ids [OSD_IDS ...]] 2026-02-13T02:20:01.044 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:00 trial078 ceph-mon[14969]: /usr/bin/podman: stderr [--dmcrypt-format-opts DMCRYPT_FORMAT_OPTS] 2026-02-13T02:20:01.044 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:00 trial078 ceph-mon[14969]: /usr/bin/podman: stderr [--dmcrypt-open-opts DMCRYPT_OPEN_OPTS] 2026-02-13T02:20:01.044 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:00 trial078 ceph-mon[14969]: /usr/bin/podman: stderr [--osd-type {classic,crimson}] 2026-02-13T02:20:01.044 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:00 trial078 ceph-mon[14969]: /usr/bin/podman: stderr [DEVICES ...] 2026-02-13T02:20:01.044 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:00 trial078 ceph-mon[14969]: /usr/bin/podman: stderr ceph-volume lvm batch: error: argument --osd-type: invalid choice: 'OSDType.classic' (choose from classic, crimson) 2026-02-13T02:20:01.044 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:00 trial078 ceph-mon[14969]: Traceback (most recent call last): 2026-02-13T02:20:01.044 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:00 trial078 ceph-mon[14969]: File "", line 198, in _run_module_as_main 2026-02-13T02:20:01.044 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:00 trial078 ceph-mon[14969]: File "", line 88, in _run_code 2026-02-13T02:20:01.045 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:00 trial078 ceph-mon[14969]: File "/tmp/tmpzmwd66c0.cephadm.build/app/__main__.py", line 5364, in 2026-02-13T02:20:01.045 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:00 trial078 ceph-mon[14969]: File "/tmp/tmpzmwd66c0.cephadm.build/app/__main__.py", line 5352, in main 2026-02-13T02:20:01.045 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:00 trial078 ceph-mon[14969]: File "/tmp/tmpzmwd66c0.cephadm.build/app/__main__.py", line 398, in _infer_config 2026-02-13T02:20:01.045 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:00 trial078 ceph-mon[14969]: File "/tmp/tmpzmwd66c0.cephadm.build/app/__main__.py", line 313, in _infer_fsid 2026-02-13T02:20:01.045 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:00 trial078 ceph-mon[14969]: File "/tmp/tmpzmwd66c0.cephadm.build/app/__main__.py", line 426, in _infer_image 2026-02-13T02:20:01.045 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:00 trial078 ceph-mon[14969]: File "/tmp/tmpzmwd66c0.cephadm.build/app/__main__.py", line 300, in _validate_fsid 2026-02-13T02:20:01.045 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:00 trial078 ceph-mon[14969]: File "/tmp/tmpzmwd66c0.cephadm.build/app/__main__.py", line 3264, in command_ceph_volume 2026-02-13T02:20:01.045 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:00 trial078 ceph-mon[14969]: File "/tmp/tmpzmwd66c0.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2026-02-13T02:20:01.045 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:00 trial078 ceph-mon[14969]: RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 -e NODE_NAME=trial078 -e CEPH_VOLUME_OSDSPEC_AFFINITY=default -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/fc631695-0881-11f1-899c-d404e6e7d460:/var/run/ceph:z -v /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460:/var/log/ceph:z -v /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmplbjbozbs:/etc/ceph/ceph.conf:z -v /tmp/ceph-tmpgw_69tbr:/var/lib/ceph/bootstrap-osd/ceph.keyring:z quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 lvm batch --no-auto vg_nvme/lv_1 --objectstore bluestore --osd-type OSDType.classic --yes --no-systemd 2026-02-13T02:20:01.045 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:00 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/1937005801' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:20:01.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:01 trial011 ceph-mon[11956]: pgmap v218: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 10 op/s 2026-02-13T02:20:02.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:01 trial060 ceph-mon[14797]: pgmap v218: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 10 op/s 2026-02-13T02:20:02.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:01 trial078 ceph-mon[14969]: pgmap v218: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 10 op/s 2026-02-13T02:20:03.256 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:20:03.382 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:20:03.492 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:03.491+0000 7f950f4a06c0 1 -- 10.20.193.11:0/2016929015 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f950810fbf0 msgr2=0x7f9508114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:20:03.492 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:03.491+0000 7f950f4a06c0 1 --2- 10.20.193.11:0/2016929015 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f950810fbf0 0x7f9508114c30 secure :-1 s=READY pgs=323 gs=1 cs=0 l=1 c_cookie=2520420055111626856 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f94fc0099a0 tx=0x7f94fc02ed50 comp rx=0 tx=0).stop 2026-02-13T02:20:03.493 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:03.491+0000 7f950f4a06c0 1 -- 10.20.193.11:0/2016929015 shutdown_connections 2026-02-13T02:20:03.493 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:03.491+0000 7f950f4a06c0 1 --2- 10.20.193.11:0/2016929015 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f9508115410 0x7f9508175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:03.493 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:03.491+0000 7f950f4a06c0 1 --2- 10.20.193.11:0/2016929015 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f950810fbf0 0x7f9508114c30 unknown :-1 s=CLOSED pgs=323 gs=1 cs=0 l=1 c_cookie=2520420055111626856 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:03.493 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:03.491+0000 7f950f4a06c0 1 --2- 10.20.193.11:0/2016929015 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f950810f200 0x7f950810f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:03.493 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:03.491+0000 7f950f4a06c0 1 -- 10.20.193.11:0/2016929015 >> 10.20.193.11:0/2016929015 conn(0x7f95080ecb00 msgr2=0x7f950810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:20:03.493 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:03.491+0000 7f950f4a06c0 1 -- 10.20.193.11:0/2016929015 shutdown_connections 2026-02-13T02:20:03.493 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:03.491+0000 7f950f4a06c0 1 -- 10.20.193.11:0/2016929015 wait complete. 2026-02-13T02:20:03.493 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:03.491+0000 7f950f4a06c0 1 Processor -- start 2026-02-13T02:20:03.493 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:03.491+0000 7f950f4a06c0 1 -- start start 2026-02-13T02:20:03.493 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:03.491+0000 7f950f4a06c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f950810f200 0x7f95080f4c50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:20:03.493 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:03.491+0000 7f950f4a06c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f9508115410 0x7f9508175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:20:03.493 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:03.491+0000 7f950f4a06c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f95080f5280 0x7f95080fa550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:20:03.493 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:03.491+0000 7f950f4a06c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f95080f58e0 con 0x7f95080f5280 2026-02-13T02:20:03.493 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:03.491+0000 7f950f4a06c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f95080faa90 con 0x7f950810f200 2026-02-13T02:20:03.493 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:03.491+0000 7f950f4a06c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f95080fac50 con 0x7f9508115410 2026-02-13T02:20:03.494 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:03.491+0000 7f950da126c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f95080f5280 0x7f95080fa550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:20:03.494 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:03.491+0000 7f950da126c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f95080f5280 0x7f95080fa550 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:41258/0 (socket says 10.20.193.11:41258) 2026-02-13T02:20:03.494 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:03.491+0000 7f950da126c0 1 -- 10.20.193.11:0/3152464513 learned_addr learned my addr 10.20.193.11:0/3152464513 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:20:03.494 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:03.491+0000 7f950ca106c0 1 --2- 10.20.193.11:0/3152464513 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f9508115410 0x7f9508175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:20:03.494 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:03.492+0000 7f950d2116c0 1 --2- 10.20.193.11:0/3152464513 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f950810f200 0x7f95080f4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:20:03.494 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:03.492+0000 7f950da126c0 1 -- 10.20.193.11:0/3152464513 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f9508115410 msgr2=0x7f9508175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:20:03.494 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:03.492+0000 7f950da126c0 1 --2- 10.20.193.11:0/3152464513 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f9508115410 0x7f9508175cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:03.494 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:03.492+0000 7f950da126c0 1 -- 10.20.193.11:0/3152464513 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f950810f200 msgr2=0x7f95080f4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:20:03.494 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:03.492+0000 7f950da126c0 1 --2- 10.20.193.11:0/3152464513 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f950810f200 0x7f95080f4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:03.494 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:03.492+0000 7f950da126c0 1 -- 10.20.193.11:0/3152464513 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94fc009590 con 0x7f95080f5280 2026-02-13T02:20:03.494 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:03.492+0000 7f950d2116c0 1 --2- 10.20.193.11:0/3152464513 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f950810f200 0x7f95080f4c50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:20:03.494 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:03.492+0000 7f950da126c0 1 --2- 10.20.193.11:0/3152464513 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f95080f5280 0x7f95080fa550 secure :-1 s=READY pgs=324 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9504006ea0 tx=0x7f950400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:20:03.494 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:03.492+0000 7f94f67fc6c0 1 -- 10.20.193.11:0/3152464513 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9504003a30 con 0x7f95080f5280 2026-02-13T02:20:03.494 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:03.492+0000 7f94f67fc6c0 1 -- 10.20.193.11:0/3152464513 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9504005510 con 0x7f95080f5280 2026-02-13T02:20:03.494 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:03.492+0000 7f94f67fc6c0 1 -- 10.20.193.11:0/3152464513 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f950400dd70 con 0x7f95080f5280 2026-02-13T02:20:03.494 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:03.492+0000 7f950f4a06c0 1 -- 10.20.193.11:0/3152464513 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95080faed0 con 0x7f95080f5280 2026-02-13T02:20:03.494 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:03.492+0000 7f950f4a06c0 1 -- 10.20.193.11:0/3152464513 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95080fb6c0 con 0x7f95080f5280 2026-02-13T02:20:03.494 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:03.492+0000 7f950f4a06c0 1 -- 10.20.193.11:0/3152464513 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95080fb400 con 0x7f95080f5280 2026-02-13T02:20:03.495 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:03.494+0000 7f94f67fc6c0 1 -- 10.20.193.11:0/3152464513 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7f9504003b90 con 0x7f95080f5280 2026-02-13T02:20:03.495 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:03.494+0000 7f94f67fc6c0 1 --2- 10.20.193.11:0/3152464513 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f94e40b5710 0x7f94e40d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:20:03.496 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:03.494+0000 7f94f67fc6c0 1 -- 10.20.193.11:0/3152464513 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7965+0+0 (secure 0 0 0) 0x7f95040e49e0 con 0x7f95080f5280 2026-02-13T02:20:03.496 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:03.494+0000 7f950d2116c0 1 --2- 10.20.193.11:0/3152464513 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f94e40b5710 0x7f94e40d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:20:03.496 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:03.494+0000 7f94f67fc6c0 1 -- 10.20.193.11:0/3152464513 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f95040a7340 con 0x7f95080f5280 2026-02-13T02:20:03.496 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:03.494+0000 7f950d2116c0 1 --2- 10.20.193.11:0/3152464513 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f94e40b5710 0x7f94e40d5bc0 secure :-1 s=READY pgs=224 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f94f8004750 tx=0x7f94f8005e50 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:20:03.610 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:03.609+0000 7f950f4a06c0 1 -- 10.20.193.11:0/3152464513 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f95080f5da0 con 0x7f95080f5280 2026-02-13T02:20:03.610 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:03.609+0000 7f94f67fc6c0 1 -- 10.20.193.11:0/3152464513 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f95040aa4f0 con 0x7f95080f5280 2026-02-13T02:20:03.610 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:20:03.610 INFO:teuthology.orchestra.run.trial011.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:20:03.611 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:03.610+0000 7f950f4a06c0 1 -- 10.20.193.11:0/3152464513 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f94e40b5710 msgr2=0x7f94e40d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:20:03.611 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:03.610+0000 7f950f4a06c0 1 --2- 10.20.193.11:0/3152464513 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f94e40b5710 0x7f94e40d5bc0 secure :-1 s=READY pgs=224 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f94f8004750 tx=0x7f94f8005e50 comp rx=0 tx=0).stop 2026-02-13T02:20:03.611 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:03.610+0000 7f950f4a06c0 1 -- 10.20.193.11:0/3152464513 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f95080f5280 msgr2=0x7f95080fa550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:20:03.611 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:03.610+0000 7f950f4a06c0 1 --2- 10.20.193.11:0/3152464513 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f95080f5280 0x7f95080fa550 secure :-1 s=READY pgs=324 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9504006ea0 tx=0x7f950400cca0 comp rx=0 tx=0).stop 2026-02-13T02:20:03.611 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:03.610+0000 7f950f4a06c0 1 -- 10.20.193.11:0/3152464513 shutdown_connections 2026-02-13T02:20:03.612 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:03.610+0000 7f950f4a06c0 1 --2- 10.20.193.11:0/3152464513 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f94e40b5710 0x7f94e40d5bc0 unknown :-1 s=CLOSED pgs=224 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:03.612 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:03.610+0000 7f950f4a06c0 1 --2- 10.20.193.11:0/3152464513 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f95080f5280 0x7f95080fa550 unknown :-1 s=CLOSED pgs=324 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:03.612 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:03.610+0000 7f950f4a06c0 1 --2- 10.20.193.11:0/3152464513 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f9508115410 0x7f9508175cb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:03.612 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:03.610+0000 7f950f4a06c0 1 --2- 10.20.193.11:0/3152464513 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f950810f200 0x7f95080f4c50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:03.612 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:03.610+0000 7f950f4a06c0 1 -- 10.20.193.11:0/3152464513 >> 10.20.193.11:0/3152464513 conn(0x7f95080ecb00 msgr2=0x7f950810d900 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:20:03.612 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:03.610+0000 7f950f4a06c0 1 -- 10.20.193.11:0/3152464513 shutdown_connections 2026-02-13T02:20:03.612 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:03.610+0000 7f950f4a06c0 1 -- 10.20.193.11:0/3152464513 wait complete. 2026-02-13T02:20:03.843 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:03 trial078 ceph-mon[14969]: pgmap v219: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 10 op/s 2026-02-13T02:20:03.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:03 trial011 ceph-mon[11956]: pgmap v219: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 10 op/s 2026-02-13T02:20:04.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:03 trial060 ceph-mon[14797]: pgmap v219: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 10 op/s 2026-02-13T02:20:04.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:04 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/3152464513' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:20:05.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:04 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/3152464513' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:20:05.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:04 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/3152464513' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:20:05.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:05 trial011 ceph-mon[11956]: pgmap v220: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 10 op/s 2026-02-13T02:20:06.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:05 trial060 ceph-mon[14797]: pgmap v220: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 10 op/s 2026-02-13T02:20:06.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:05 trial078 ceph-mon[14969]: pgmap v220: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 10 op/s 2026-02-13T02:20:06.652 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:20:06.779 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:20:06.902 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:06.898+0000 7f45d72786c0 1 -- 10.20.193.11:0/23078298 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f45d010f230 msgr2=0x7f45d010f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:20:06.903 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:06.898+0000 7f45d72786c0 1 --2- 10.20.193.11:0/23078298 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f45d010f230 0x7f45d010f600 secure :-1 s=READY pgs=325 gs=1 cs=0 l=1 c_cookie=3932164613485602458 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f45c00099a0 tx=0x7f45c002ed20 comp rx=0 tx=0).stop 2026-02-13T02:20:06.903 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:06.898+0000 7f45d72786c0 1 -- 10.20.193.11:0/23078298 shutdown_connections 2026-02-13T02:20:06.903 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:06.898+0000 7f45d72786c0 1 --2- 10.20.193.11:0/23078298 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f45d010fc20 0x7f45d0114c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:06.903 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:06.898+0000 7f45d72786c0 1 --2- 10.20.193.11:0/23078298 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f45d0115440 0x7f45d0175de0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:06.903 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:06.898+0000 7f45d72786c0 1 --2- 10.20.193.11:0/23078298 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f45d010f230 0x7f45d010f600 unknown :-1 s=CLOSED pgs=325 gs=1 cs=0 l=1 c_cookie=3932164613485602458 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:06.903 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:06.898+0000 7f45d72786c0 1 -- 10.20.193.11:0/23078298 >> 10.20.193.11:0/23078298 conn(0x7f45d00ecb30 msgr2=0x7f45d010cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:20:06.903 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:06.898+0000 7f45d72786c0 1 -- 10.20.193.11:0/23078298 shutdown_connections 2026-02-13T02:20:06.903 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:06.898+0000 7f45d72786c0 1 -- 10.20.193.11:0/23078298 wait complete. 2026-02-13T02:20:06.903 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:06.899+0000 7f45d72786c0 1 Processor -- start 2026-02-13T02:20:06.904 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:06.899+0000 7f45d72786c0 1 -- start start 2026-02-13T02:20:06.904 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:06.899+0000 7f45d72786c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f45d010f230 0x7f45d011d1c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:20:06.904 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:06.899+0000 7f45d72786c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f45d0115440 0x7f45d011d700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:20:06.904 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:06.899+0000 7f45d72786c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f45d0122ac0 0x7f45d0122f60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:20:06.904 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:06.899+0000 7f45d72786c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f45d01234d0 con 0x7f45d0122ac0 2026-02-13T02:20:06.904 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:06.899+0000 7f45d72786c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f45d0123640 con 0x7f45d010f230 2026-02-13T02:20:06.904 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:06.899+0000 7f45d72786c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f45d0123800 con 0x7f45d0115440 2026-02-13T02:20:06.904 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:06.899+0000 7f45d57ea6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f45d0122ac0 0x7f45d0122f60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:20:06.904 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:06.899+0000 7f45d57ea6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f45d0122ac0 0x7f45d0122f60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:41282/0 (socket says 10.20.193.11:41282) 2026-02-13T02:20:06.904 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:06.899+0000 7f45d57ea6c0 1 -- 10.20.193.11:0/2662771862 learned_addr learned my addr 10.20.193.11:0/2662771862 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:20:06.904 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:06.899+0000 7f45c7fff6c0 1 --2- 10.20.193.11:0/2662771862 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f45d0115440 0x7f45d011d700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:20:06.904 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:06.899+0000 7f45d57ea6c0 1 -- 10.20.193.11:0/2662771862 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f45d0115440 msgr2=0x7f45d011d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:20:06.905 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:06.899+0000 7f45d57ea6c0 1 --2- 10.20.193.11:0/2662771862 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f45d0115440 0x7f45d011d700 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:06.905 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:06.899+0000 7f45d4fe96c0 1 --2- 10.20.193.11:0/2662771862 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f45d010f230 0x7f45d011d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:20:06.905 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:06.899+0000 7f45d57ea6c0 1 -- 10.20.193.11:0/2662771862 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f45d010f230 msgr2=0x7f45d011d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:20:06.905 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:06.899+0000 7f45d57ea6c0 1 --2- 10.20.193.11:0/2662771862 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f45d010f230 0x7f45d011d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:06.905 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:06.899+0000 7f45d57ea6c0 1 -- 10.20.193.11:0/2662771862 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45c0009590 con 0x7f45d0122ac0 2026-02-13T02:20:06.905 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:06.899+0000 7f45d4fe96c0 1 --2- 10.20.193.11:0/2662771862 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f45d010f230 0x7f45d011d1c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:20:06.905 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:06.899+0000 7f45d57ea6c0 1 --2- 10.20.193.11:0/2662771862 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f45d0122ac0 0x7f45d0122f60 secure :-1 s=READY pgs=326 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f45cc006ea0 tx=0x7f45cc00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:20:06.905 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:06.899+0000 7f45c5ffb6c0 1 -- 10.20.193.11:0/2662771862 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f45cc003a30 con 0x7f45d0122ac0 2026-02-13T02:20:06.905 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:06.899+0000 7f45c5ffb6c0 1 -- 10.20.193.11:0/2662771862 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f45cc005510 con 0x7f45d0122ac0 2026-02-13T02:20:06.905 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:06.899+0000 7f45c5ffb6c0 1 -- 10.20.193.11:0/2662771862 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f45cc00dd70 con 0x7f45d0122ac0 2026-02-13T02:20:06.905 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:06.899+0000 7f45d72786c0 1 -- 10.20.193.11:0/2662771862 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45d0163cb0 con 0x7f45d0122ac0 2026-02-13T02:20:06.905 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:06.899+0000 7f45d72786c0 1 -- 10.20.193.11:0/2662771862 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45d0164140 con 0x7f45d0122ac0 2026-02-13T02:20:06.906 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:06.900+0000 7f45d72786c0 1 -- 10.20.193.11:0/2662771862 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45d0110500 con 0x7f45d0122ac0 2026-02-13T02:20:06.907 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:06.901+0000 7f45c5ffb6c0 1 -- 10.20.193.11:0/2662771862 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7f45cc003b90 con 0x7f45d0122ac0 2026-02-13T02:20:06.907 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:06.902+0000 7f45c5ffb6c0 1 --2- 10.20.193.11:0/2662771862 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f45ac0b5710 0x7f45ac0d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:20:06.907 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:06.902+0000 7f45c5ffb6c0 1 -- 10.20.193.11:0/2662771862 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7965+0+0 (secure 0 0 0) 0x7f45cc0e4ca0 con 0x7f45d0122ac0 2026-02-13T02:20:06.907 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:06.902+0000 7f45d4fe96c0 1 --2- 10.20.193.11:0/2662771862 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f45ac0b5710 0x7f45ac0d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:20:06.907 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:06.902+0000 7f45c5ffb6c0 1 -- 10.20.193.11:0/2662771862 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f45cc0a7640 con 0x7f45d0122ac0 2026-02-13T02:20:06.907 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:06.902+0000 7f45d4fe96c0 1 --2- 10.20.193.11:0/2662771862 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f45ac0b5710 0x7f45ac0d5bc0 secure :-1 s=READY pgs=225 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f45c00098c0 tx=0x7f45c0005c80 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:20:07.017 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:07.015+0000 7f45d72786c0 1 -- 10.20.193.11:0/2662771862 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f45d010f600 con 0x7f45d0122ac0 2026-02-13T02:20:07.018 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:07.015+0000 7f45c5ffb6c0 1 -- 10.20.193.11:0/2662771862 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f45cc0aa7f0 con 0x7f45d0122ac0 2026-02-13T02:20:07.018 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:20:07.018 INFO:teuthology.orchestra.run.trial011.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:20:07.019 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:07.016+0000 7f45d72786c0 1 -- 10.20.193.11:0/2662771862 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f45ac0b5710 msgr2=0x7f45ac0d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:20:07.019 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:07.016+0000 7f45d72786c0 1 --2- 10.20.193.11:0/2662771862 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f45ac0b5710 0x7f45ac0d5bc0 secure :-1 s=READY pgs=225 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f45c00098c0 tx=0x7f45c0005c80 comp rx=0 tx=0).stop 2026-02-13T02:20:07.019 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:07.016+0000 7f45d72786c0 1 -- 10.20.193.11:0/2662771862 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f45d0122ac0 msgr2=0x7f45d0122f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:20:07.019 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:07.016+0000 7f45d72786c0 1 --2- 10.20.193.11:0/2662771862 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f45d0122ac0 0x7f45d0122f60 secure :-1 s=READY pgs=326 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f45cc006ea0 tx=0x7f45cc00cca0 comp rx=0 tx=0).stop 2026-02-13T02:20:07.019 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:07.016+0000 7f45d72786c0 1 -- 10.20.193.11:0/2662771862 shutdown_connections 2026-02-13T02:20:07.019 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:07.016+0000 7f45d72786c0 1 --2- 10.20.193.11:0/2662771862 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f45ac0b5710 0x7f45ac0d5bc0 unknown :-1 s=CLOSED pgs=225 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:07.020 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:07.016+0000 7f45d72786c0 1 --2- 10.20.193.11:0/2662771862 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f45d0122ac0 0x7f45d0122f60 unknown :-1 s=CLOSED pgs=326 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:07.020 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:07.016+0000 7f45d72786c0 1 --2- 10.20.193.11:0/2662771862 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f45d0115440 0x7f45d011d700 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:07.020 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:07.016+0000 7f45d72786c0 1 --2- 10.20.193.11:0/2662771862 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f45d010f230 0x7f45d011d1c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:07.020 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:07.016+0000 7f45d72786c0 1 -- 10.20.193.11:0/2662771862 >> 10.20.193.11:0/2662771862 conn(0x7f45d00ecb30 msgr2=0x7f45d010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:20:07.020 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:07.016+0000 7f45d72786c0 1 -- 10.20.193.11:0/2662771862 shutdown_connections 2026-02-13T02:20:07.020 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:07.016+0000 7f45d72786c0 1 -- 10.20.193.11:0/2662771862 wait complete. 2026-02-13T02:20:07.951 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:07 trial011 ceph-mon[11956]: pgmap v221: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 10 op/s 2026-02-13T02:20:07.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:07 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/2662771862' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:20:08.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:07 trial060 ceph-mon[14797]: pgmap v221: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 10 op/s 2026-02-13T02:20:08.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:07 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/2662771862' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:20:08.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:07 trial078 ceph-mon[14969]: pgmap v221: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 10 op/s 2026-02-13T02:20:08.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:07 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/2662771862' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:20:09.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:09 trial011 ceph-mon[11956]: pgmap v222: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 10 op/s 2026-02-13T02:20:10.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:09 trial060 ceph-mon[14797]: pgmap v222: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 10 op/s 2026-02-13T02:20:10.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:09 trial078 ceph-mon[14969]: pgmap v222: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 10 op/s 2026-02-13T02:20:10.058 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:20:10.182 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:20:10.300 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:10.296+0000 7fdcedb446c0 1 -- 10.20.193.11:0/59094221 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fdce8115410 msgr2=0x7fdce8175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:20:10.300 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:10.296+0000 7fdcedb446c0 1 --2- 10.20.193.11:0/59094221 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fdce8115410 0x7fdce8175db0 secure :-1 s=READY pgs=327 gs=1 cs=0 l=1 c_cookie=1966881070610103627 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdcdc00aa70 tx=0x7fdcdc02fde0 comp rx=0 tx=0).stop 2026-02-13T02:20:10.300 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:10.296+0000 7fdcedb446c0 1 -- 10.20.193.11:0/59094221 shutdown_connections 2026-02-13T02:20:10.300 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:10.296+0000 7fdcedb446c0 1 --2- 10.20.193.11:0/59094221 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fdce8115410 0x7fdce8175db0 unknown :-1 s=CLOSED pgs=327 gs=1 cs=0 l=1 c_cookie=1966881070610103627 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:10.300 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:10.296+0000 7fdcedb446c0 1 --2- 10.20.193.11:0/59094221 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fdce810fbf0 0x7fdce8114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:10.300 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:10.296+0000 7fdcedb446c0 1 --2- 10.20.193.11:0/59094221 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fdce810f200 0x7fdce810f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:10.300 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:10.296+0000 7fdcedb446c0 1 -- 10.20.193.11:0/59094221 >> 10.20.193.11:0/59094221 conn(0x7fdce80ecb00 msgr2=0x7fdce810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:20:10.300 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:10.296+0000 7fdcedb446c0 1 -- 10.20.193.11:0/59094221 shutdown_connections 2026-02-13T02:20:10.300 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:10.296+0000 7fdcedb446c0 1 -- 10.20.193.11:0/59094221 wait complete. 2026-02-13T02:20:10.301 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:10.296+0000 7fdcedb446c0 1 Processor -- start 2026-02-13T02:20:10.301 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:10.296+0000 7fdcedb446c0 1 -- start start 2026-02-13T02:20:10.301 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:10.296+0000 7fdcedb446c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fdce810f200 0x7fdce811d170 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:20:10.301 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:10.296+0000 7fdcedb446c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fdce8115410 0x7fdce811d6b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:20:10.301 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:10.296+0000 7fdcedb446c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fdce8122a70 0x7fdce8122f10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:20:10.301 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:10.296+0000 7fdcedb446c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7fdce8123480 con 0x7fdce8122a70 2026-02-13T02:20:10.301 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:10.296+0000 7fdcedb446c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7fdce81235f0 con 0x7fdce810f200 2026-02-13T02:20:10.301 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:10.296+0000 7fdcedb446c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fdce81237b0 con 0x7fdce8115410 2026-02-13T02:20:10.301 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:10.296+0000 7fdce7fff6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fdce8122a70 0x7fdce8122f10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:20:10.301 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:10.296+0000 7fdce7fff6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fdce8122a70 0x7fdce8122f10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:41306/0 (socket says 10.20.193.11:41306) 2026-02-13T02:20:10.301 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:10.296+0000 7fdce7fff6c0 1 -- 10.20.193.11:0/2310048835 learned_addr learned my addr 10.20.193.11:0/2310048835 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:20:10.301 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:10.296+0000 7fdce77fe6c0 1 --2- 10.20.193.11:0/2310048835 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fdce810f200 0x7fdce811d170 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:20:10.301 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:10.296+0000 7fdce6ffd6c0 1 --2- 10.20.193.11:0/2310048835 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fdce8115410 0x7fdce811d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:20:10.302 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:10.297+0000 7fdce7fff6c0 1 -- 10.20.193.11:0/2310048835 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fdce8115410 msgr2=0x7fdce811d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:20:10.302 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:10.297+0000 7fdce7fff6c0 1 --2- 10.20.193.11:0/2310048835 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fdce8115410 0x7fdce811d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:10.302 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:10.297+0000 7fdce7fff6c0 1 -- 10.20.193.11:0/2310048835 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fdce810f200 msgr2=0x7fdce811d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:20:10.302 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:10.297+0000 7fdce7fff6c0 1 --2- 10.20.193.11:0/2310048835 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fdce810f200 0x7fdce811d170 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:10.302 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:10.297+0000 7fdce7fff6c0 1 -- 10.20.193.11:0/2310048835 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcdc00a660 con 0x7fdce8122a70 2026-02-13T02:20:10.302 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:10.297+0000 7fdce7fff6c0 1 --2- 10.20.193.11:0/2310048835 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fdce8122a70 0x7fdce8122f10 secure :-1 s=READY pgs=328 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdcdc030af0 tx=0x7fdcdc0054b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:20:10.302 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:10.297+0000 7fdce4ff96c0 1 -- 10.20.193.11:0/2310048835 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdcdc003a30 con 0x7fdce8122a70 2026-02-13T02:20:10.302 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:10.297+0000 7fdce4ff96c0 1 -- 10.20.193.11:0/2310048835 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fdcdc003b90 con 0x7fdce8122a70 2026-02-13T02:20:10.302 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:10.297+0000 7fdcedb446c0 1 -- 10.20.193.11:0/2310048835 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdce8163c00 con 0x7fdce8122a70 2026-02-13T02:20:10.302 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:10.297+0000 7fdce4ff96c0 1 -- 10.20.193.11:0/2310048835 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdcdc038360 con 0x7fdce8122a70 2026-02-13T02:20:10.302 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:10.297+0000 7fdcedb446c0 1 -- 10.20.193.11:0/2310048835 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdce8164030 con 0x7fdce8122a70 2026-02-13T02:20:10.302 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:10.297+0000 7fdcedb446c0 1 -- 10.20.193.11:0/2310048835 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdce81104d0 con 0x7fdce8122a70 2026-02-13T02:20:10.304 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:10.299+0000 7fdce4ff96c0 1 -- 10.20.193.11:0/2310048835 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 11) ==== 157117+0+0 (secure 0 0 0) 0x7fdcdc008350 con 0x7fdce8122a70 2026-02-13T02:20:10.304 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:10.299+0000 7fdce4ff96c0 1 --2- 10.20.193.11:0/2310048835 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fdcbc0b5710 0x7fdcbc0d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:20:10.304 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:10.299+0000 7fdce77fe6c0 1 --2- 10.20.193.11:0/2310048835 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fdcbc0b5710 0x7fdcbc0d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:20:10.304 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:10.299+0000 7fdce4ff96c0 1 -- 10.20.193.11:0/2310048835 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7965+0+0 (secure 0 0 0) 0x7fdcdc108ee0 con 0x7fdce8122a70 2026-02-13T02:20:10.304 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:10.300+0000 7fdce77fe6c0 1 --2- 10.20.193.11:0/2310048835 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fdcbc0b5710 0x7fdcbc0d5bc0 secure :-1 s=READY pgs=226 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdcd4004750 tx=0x7fdcd4009390 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:20:10.304 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:10.300+0000 7fdce4ff96c0 1 -- 10.20.193.11:0/2310048835 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fdcdc0cb880 con 0x7fdce8122a70 2026-02-13T02:20:10.417 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:10.415+0000 7fdcedb446c0 1 -- 10.20.193.11:0/2310048835 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fdce810f5d0 con 0x7fdce8122a70 2026-02-13T02:20:10.417 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:10.415+0000 7fdce4ff96c0 1 -- 10.20.193.11:0/2310048835 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fdcdc0cea30 con 0x7fdce8122a70 2026-02-13T02:20:10.418 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:20:10.418 INFO:teuthology.orchestra.run.trial011.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:20:10.419 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:10.416+0000 7fdcedb446c0 1 -- 10.20.193.11:0/2310048835 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fdcbc0b5710 msgr2=0x7fdcbc0d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:20:10.419 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:10.416+0000 7fdcedb446c0 1 --2- 10.20.193.11:0/2310048835 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fdcbc0b5710 0x7fdcbc0d5bc0 secure :-1 s=READY pgs=226 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdcd4004750 tx=0x7fdcd4009390 comp rx=0 tx=0).stop 2026-02-13T02:20:10.419 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:10.416+0000 7fdcedb446c0 1 -- 10.20.193.11:0/2310048835 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fdce8122a70 msgr2=0x7fdce8122f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:20:10.419 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:10.416+0000 7fdcedb446c0 1 --2- 10.20.193.11:0/2310048835 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fdce8122a70 0x7fdce8122f10 secure :-1 s=READY pgs=328 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdcdc030af0 tx=0x7fdcdc0054b0 comp rx=0 tx=0).stop 2026-02-13T02:20:10.419 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:10.416+0000 7fdcedb446c0 1 -- 10.20.193.11:0/2310048835 shutdown_connections 2026-02-13T02:20:10.419 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:10.416+0000 7fdcedb446c0 1 --2- 10.20.193.11:0/2310048835 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fdcbc0b5710 0x7fdcbc0d5bc0 unknown :-1 s=CLOSED pgs=226 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:10.419 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:10.416+0000 7fdcedb446c0 1 --2- 10.20.193.11:0/2310048835 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fdce8122a70 0x7fdce8122f10 unknown :-1 s=CLOSED pgs=328 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:10.419 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:10.416+0000 7fdcedb446c0 1 --2- 10.20.193.11:0/2310048835 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fdce8115410 0x7fdce811d6b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:10.419 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:10.416+0000 7fdcedb446c0 1 --2- 10.20.193.11:0/2310048835 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fdce810f200 0x7fdce811d170 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:10.419 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:10.416+0000 7fdcedb446c0 1 -- 10.20.193.11:0/2310048835 >> 10.20.193.11:0/2310048835 conn(0x7fdce80ecb00 msgr2=0x7fdce810cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:20:10.419 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:10.416+0000 7fdcedb446c0 1 -- 10.20.193.11:0/2310048835 shutdown_connections 2026-02-13T02:20:10.420 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:10.416+0000 7fdcedb446c0 1 -- 10.20.193.11:0/2310048835 wait complete. 2026-02-13T02:20:10.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:10 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/2310048835' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:20:10.901 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:10 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/2310048835' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:20:11.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:10 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/2310048835' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:20:11.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:11 trial011 ceph-mon[11956]: pgmap v223: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:20:12.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:11 trial060 ceph-mon[14797]: pgmap v223: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:20:12.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:11 trial078 ceph-mon[14969]: pgmap v223: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:20:13.457 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:20:13.582 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:20:13.701 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:13.698+0000 7f1ab0ae16c0 1 -- 10.20.193.11:0/2630953678 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f1aac115410 msgr2=0x7f1aac175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:20:13.701 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:13.698+0000 7f1ab0ae16c0 1 --2- 10.20.193.11:0/2630953678 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f1aac115410 0x7f1aac175db0 secure :-1 s=READY pgs=329 gs=1 cs=0 l=1 c_cookie=17739582944208366439 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1a9c00aa70 tx=0x7f1a9c02fde0 comp rx=0 tx=0).stop 2026-02-13T02:20:13.701 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:13.698+0000 7f1ab0ae16c0 1 -- 10.20.193.11:0/2630953678 shutdown_connections 2026-02-13T02:20:13.701 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:13.698+0000 7f1ab0ae16c0 1 --2- 10.20.193.11:0/2630953678 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f1aac115410 0x7f1aac175db0 unknown :-1 s=CLOSED pgs=329 gs=1 cs=0 l=1 c_cookie=17739582944208366439 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:13.701 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:13.698+0000 7f1ab0ae16c0 1 --2- 10.20.193.11:0/2630953678 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1aac10fbf0 0x7f1aac114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:13.701 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:13.698+0000 7f1ab0ae16c0 1 --2- 10.20.193.11:0/2630953678 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f1aac10f200 0x7f1aac10f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:13.701 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:13.698+0000 7f1ab0ae16c0 1 -- 10.20.193.11:0/2630953678 >> 10.20.193.11:0/2630953678 conn(0x7f1aac0ecb00 msgr2=0x7f1aac10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:20:13.701 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:13.698+0000 7f1ab0ae16c0 1 -- 10.20.193.11:0/2630953678 shutdown_connections 2026-02-13T02:20:13.701 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:13.698+0000 7f1ab0ae16c0 1 -- 10.20.193.11:0/2630953678 wait complete. 2026-02-13T02:20:13.702 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:13.699+0000 7f1ab0ae16c0 1 Processor -- start 2026-02-13T02:20:13.702 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:13.699+0000 7f1ab0ae16c0 1 -- start start 2026-02-13T02:20:13.702 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:13.699+0000 7f1ab0ae16c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f1aac10f200 0x7f1aac11d180 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:20:13.702 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:13.699+0000 7f1ab0ae16c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1aac115410 0x7f1aac11d6c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:20:13.702 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:13.699+0000 7f1ab0ae16c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f1aac122a80 0x7f1aac122f20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:20:13.702 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:13.699+0000 7f1ab0ae16c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f1aac123490 con 0x7f1aac10f200 2026-02-13T02:20:13.702 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:13.699+0000 7f1ab0ae16c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f1aac123600 con 0x7f1aac122a80 2026-02-13T02:20:13.702 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:13.699+0000 7f1ab0ae16c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f1aac1237c0 con 0x7f1aac115410 2026-02-13T02:20:13.702 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:13.699+0000 7f1aaa5756c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f1aac10f200 0x7f1aac11d180 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:20:13.702 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:13.699+0000 7f1aaa5756c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f1aac10f200 0x7f1aac11d180 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:57778/0 (socket says 10.20.193.11:57778) 2026-02-13T02:20:13.702 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:13.699+0000 7f1aaa5756c0 1 -- 10.20.193.11:0/2649434670 learned_addr learned my addr 10.20.193.11:0/2649434670 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:20:13.702 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:13.699+0000 7f1aa9d746c0 1 --2- 10.20.193.11:0/2649434670 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1aac115410 0x7f1aac11d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:20:13.702 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:13.699+0000 7f1aaa5756c0 1 -- 10.20.193.11:0/2649434670 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1aac115410 msgr2=0x7f1aac11d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:20:13.702 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:13.699+0000 7f1aaa5756c0 1 --2- 10.20.193.11:0/2649434670 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1aac115410 0x7f1aac11d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:13.702 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:13.699+0000 7f1aaa5756c0 1 -- 10.20.193.11:0/2649434670 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f1aac122a80 msgr2=0x7f1aac122f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:20:13.702 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:13.699+0000 7f1aaa5756c0 1 --2- 10.20.193.11:0/2649434670 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f1aac122a80 0x7f1aac122f20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:13.702 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:13.699+0000 7f1aaa5756c0 1 -- 10.20.193.11:0/2649434670 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a9c00a660 con 0x7f1aac10f200 2026-02-13T02:20:13.702 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:13.699+0000 7f1aaa5756c0 1 --2- 10.20.193.11:0/2649434670 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f1aac10f200 0x7f1aac11d180 secure :-1 s=READY pgs=330 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1aa0009490 tx=0x7f1aa000bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:20:13.702 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:13.699+0000 7f1a937fe6c0 1 -- 10.20.193.11:0/2649434670 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1aa0004a80 con 0x7f1aac10f200 2026-02-13T02:20:13.702 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:13.699+0000 7f1a937fe6c0 1 -- 10.20.193.11:0/2649434670 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1aa0009030 con 0x7f1aac10f200 2026-02-13T02:20:13.702 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:13.699+0000 7f1ab0ae16c0 1 -- 10.20.193.11:0/2649434670 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1aac163c70 con 0x7f1aac10f200 2026-02-13T02:20:13.702 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:13.699+0000 7f1a937fe6c0 1 -- 10.20.193.11:0/2649434670 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1aa00071c0 con 0x7f1aac10f200 2026-02-13T02:20:13.702 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:13.699+0000 7f1ab0ae16c0 1 -- 10.20.193.11:0/2649434670 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1aac164150 con 0x7f1aac10f200 2026-02-13T02:20:13.702 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:13.700+0000 7f1ab0ae16c0 1 -- 10.20.193.11:0/2649434670 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1aac1104d0 con 0x7f1aac10f200 2026-02-13T02:20:13.703 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:13.701+0000 7f1a937fe6c0 1 -- 10.20.193.11:0/2649434670 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7f1aa0004060 con 0x7f1aac10f200 2026-02-13T02:20:13.704 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:13.702+0000 7f1a937fe6c0 1 --2- 10.20.193.11:0/2649434670 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f1a840b5680 0x7f1a840d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:20:13.704 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:13.702+0000 7f1aa9d746c0 1 --2- 10.20.193.11:0/2649434670 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f1a840b5680 0x7f1a840d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:20:13.704 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:13.702+0000 7f1a937fe6c0 1 -- 10.20.193.11:0/2649434670 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7965+0+0 (secure 0 0 0) 0x7f1aa00e3b10 con 0x7f1aac10f200 2026-02-13T02:20:13.705 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:13.702+0000 7f1aa9d746c0 1 --2- 10.20.193.11:0/2649434670 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f1a840b5680 0x7f1a840d5b30 secure :-1 s=READY pgs=227 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1aac123b10 tx=0x7f1a940094f0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:20:13.705 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:13.702+0000 7f1a937fe6c0 1 -- 10.20.193.11:0/2649434670 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f1aa011c5e0 con 0x7f1aac10f200 2026-02-13T02:20:13.822 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:13.820+0000 7f1ab0ae16c0 1 -- 10.20.193.11:0/2649434670 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f1aac10fbf0 con 0x7f1aac10f200 2026-02-13T02:20:13.823 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:13 trial011 ceph-mon[11956]: pgmap v224: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T02:20:13.823 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:13.820+0000 7f1a937fe6c0 1 -- 10.20.193.11:0/2649434670 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f1aa00a6610 con 0x7f1aac10f200 2026-02-13T02:20:13.823 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:20:13.823 INFO:teuthology.orchestra.run.trial011.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:20:13.824 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:13.821+0000 7f1ab0ae16c0 1 -- 10.20.193.11:0/2649434670 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f1a840b5680 msgr2=0x7f1a840d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:20:13.824 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:13.821+0000 7f1ab0ae16c0 1 --2- 10.20.193.11:0/2649434670 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f1a840b5680 0x7f1a840d5b30 secure :-1 s=READY pgs=227 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1aac123b10 tx=0x7f1a940094f0 comp rx=0 tx=0).stop 2026-02-13T02:20:13.824 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:13.821+0000 7f1ab0ae16c0 1 -- 10.20.193.11:0/2649434670 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f1aac10f200 msgr2=0x7f1aac11d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:20:13.824 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:13.821+0000 7f1ab0ae16c0 1 --2- 10.20.193.11:0/2649434670 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f1aac10f200 0x7f1aac11d180 secure :-1 s=READY pgs=330 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1aa0009490 tx=0x7f1aa000bca0 comp rx=0 tx=0).stop 2026-02-13T02:20:13.824 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:13.821+0000 7f1ab0ae16c0 1 -- 10.20.193.11:0/2649434670 shutdown_connections 2026-02-13T02:20:13.824 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:13.821+0000 7f1ab0ae16c0 1 --2- 10.20.193.11:0/2649434670 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f1a840b5680 0x7f1a840d5b30 unknown :-1 s=CLOSED pgs=227 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:13.824 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:13.821+0000 7f1ab0ae16c0 1 --2- 10.20.193.11:0/2649434670 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f1aac122a80 0x7f1aac122f20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:13.824 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:13.821+0000 7f1ab0ae16c0 1 --2- 10.20.193.11:0/2649434670 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1aac115410 0x7f1aac11d6c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:13.824 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:13.821+0000 7f1ab0ae16c0 1 --2- 10.20.193.11:0/2649434670 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f1aac10f200 0x7f1aac11d180 unknown :-1 s=CLOSED pgs=330 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:13.824 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:13.821+0000 7f1ab0ae16c0 1 -- 10.20.193.11:0/2649434670 >> 10.20.193.11:0/2649434670 conn(0x7f1aac0ecb00 msgr2=0x7f1aac10cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:20:13.824 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:13.821+0000 7f1ab0ae16c0 1 -- 10.20.193.11:0/2649434670 shutdown_connections 2026-02-13T02:20:13.824 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:13.821+0000 7f1ab0ae16c0 1 -- 10.20.193.11:0/2649434670 wait complete. 2026-02-13T02:20:14.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:13 trial060 ceph-mon[14797]: pgmap v224: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T02:20:14.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:13 trial078 ceph-mon[14969]: pgmap v224: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T02:20:14.951 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:14 trial011 ceph-mon[11956]: mgrmap e12: x(active, since 3m), standbys: z, y 2026-02-13T02:20:14.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:14 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/2649434670' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:20:14.999 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:14 trial060 ceph-mon[14797]: mgrmap e12: x(active, since 3m), standbys: z, y 2026-02-13T02:20:15.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:14 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/2649434670' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:20:15.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:14 trial078 ceph-mon[14969]: mgrmap e12: x(active, since 3m), standbys: z, y 2026-02-13T02:20:15.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:14 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/2649434670' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:20:15.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:15 trial011 ceph-mon[11956]: pgmap v225: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 85 B/s wr, 10 op/s 2026-02-13T02:20:16.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:15 trial060 ceph-mon[14797]: pgmap v225: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 85 B/s wr, 10 op/s 2026-02-13T02:20:16.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:15 trial078 ceph-mon[14969]: pgmap v225: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 85 B/s wr, 10 op/s 2026-02-13T02:20:16.862 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:20:16.987 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:20:17.113 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:17.109+0000 7f7ce24db6c0 1 -- 10.20.193.11:0/1752351010 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f7cdc10f230 msgr2=0x7f7cdc10f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:20:17.113 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:17.109+0000 7f7ce24db6c0 1 --2- 10.20.193.11:0/1752351010 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f7cdc10f230 0x7f7cdc10f600 secure :-1 s=READY pgs=331 gs=1 cs=0 l=1 c_cookie=12401474514672766785 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7cc80099a0 tx=0x7f7cc802ed20 comp rx=0 tx=0).stop 2026-02-13T02:20:17.114 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:17.109+0000 7f7ce24db6c0 1 -- 10.20.193.11:0/1752351010 shutdown_connections 2026-02-13T02:20:17.114 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:17.109+0000 7f7ce24db6c0 1 --2- 10.20.193.11:0/1752351010 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f7cdc115440 0x7f7cdc175de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:17.114 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:17.109+0000 7f7ce24db6c0 1 --2- 10.20.193.11:0/1752351010 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f7cdc10fc20 0x7f7cdc114c60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:17.114 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:17.109+0000 7f7ce24db6c0 1 --2- 10.20.193.11:0/1752351010 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f7cdc10f230 0x7f7cdc10f600 unknown :-1 s=CLOSED pgs=331 gs=1 cs=0 l=1 c_cookie=12401474514672766785 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:17.114 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:17.109+0000 7f7ce24db6c0 1 -- 10.20.193.11:0/1752351010 >> 10.20.193.11:0/1752351010 conn(0x7f7cdc0ecb30 msgr2=0x7f7cdc10cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:20:17.114 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:17.109+0000 7f7ce24db6c0 1 -- 10.20.193.11:0/1752351010 shutdown_connections 2026-02-13T02:20:17.114 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:17.109+0000 7f7ce24db6c0 1 -- 10.20.193.11:0/1752351010 wait complete. 2026-02-13T02:20:17.114 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:17.109+0000 7f7ce24db6c0 1 Processor -- start 2026-02-13T02:20:17.114 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:17.109+0000 7f7ce24db6c0 1 -- start start 2026-02-13T02:20:17.114 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:17.109+0000 7f7ce24db6c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f7cdc10f230 0x7f7cdc11d1e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:20:17.114 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:17.109+0000 7f7ce24db6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f7cdc115440 0x7f7cdc11d720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:20:17.115 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:17.109+0000 7f7ce24db6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f7cdc122ae0 0x7f7cdc122f80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:20:17.115 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:17.109+0000 7f7ce24db6c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f7cdc1234f0 con 0x7f7cdc115440 2026-02-13T02:20:17.115 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:17.109+0000 7f7ce24db6c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f7cdc123660 con 0x7f7cdc10f230 2026-02-13T02:20:17.115 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:17.109+0000 7f7ce24db6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f7cdc123820 con 0x7f7cdc122ae0 2026-02-13T02:20:17.115 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:17.109+0000 7f7cdb7fe6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f7cdc115440 0x7f7cdc11d720 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:20:17.115 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:17.109+0000 7f7cdb7fe6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f7cdc115440 0x7f7cdc11d720 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:57806/0 (socket says 10.20.193.11:57806) 2026-02-13T02:20:17.115 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:17.109+0000 7f7cdb7fe6c0 1 -- 10.20.193.11:0/2573079150 learned_addr learned my addr 10.20.193.11:0/2573079150 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:20:17.115 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:17.110+0000 7f7cdbfff6c0 1 --2- 10.20.193.11:0/2573079150 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f7cdc10f230 0x7f7cdc11d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:20:17.115 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:17.110+0000 7f7ce0a4d6c0 1 --2- 10.20.193.11:0/2573079150 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f7cdc122ae0 0x7f7cdc122f80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:20:17.115 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:17.110+0000 7f7cdb7fe6c0 1 -- 10.20.193.11:0/2573079150 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f7cdc122ae0 msgr2=0x7f7cdc122f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:20:17.115 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:17.110+0000 7f7cdb7fe6c0 1 --2- 10.20.193.11:0/2573079150 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f7cdc122ae0 0x7f7cdc122f80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:17.116 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:17.110+0000 7f7cdb7fe6c0 1 -- 10.20.193.11:0/2573079150 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f7cdc10f230 msgr2=0x7f7cdc11d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:20:17.116 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:17.110+0000 7f7cdb7fe6c0 1 --2- 10.20.193.11:0/2573079150 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f7cdc10f230 0x7f7cdc11d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:17.116 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:17.110+0000 7f7cdb7fe6c0 1 -- 10.20.193.11:0/2573079150 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cc8009590 con 0x7f7cdc115440 2026-02-13T02:20:17.116 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:17.110+0000 7f7cdbfff6c0 1 --2- 10.20.193.11:0/2573079150 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f7cdc10f230 0x7f7cdc11d1e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T02:20:17.116 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:17.110+0000 7f7ce0a4d6c0 1 --2- 10.20.193.11:0/2573079150 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f7cdc122ae0 0x7f7cdc122f80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T02:20:17.116 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:17.110+0000 7f7cdb7fe6c0 1 --2- 10.20.193.11:0/2573079150 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f7cdc115440 0x7f7cdc11d720 secure :-1 s=READY pgs=332 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7ccc005dc0 tx=0x7f7ccc00bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:20:17.116 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:17.110+0000 7f7cd97fa6c0 1 -- 10.20.193.11:0/2573079150 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7ccc004250 con 0x7f7cdc115440 2026-02-13T02:20:17.116 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:17.110+0000 7f7cd97fa6c0 1 -- 10.20.193.11:0/2573079150 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f7ccc009070 con 0x7f7cdc115440 2026-02-13T02:20:17.116 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:17.110+0000 7f7ce24db6c0 1 -- 10.20.193.11:0/2573079150 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cdc163cd0 con 0x7f7cdc115440 2026-02-13T02:20:17.116 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:17.110+0000 7f7cd97fa6c0 1 -- 10.20.193.11:0/2573079150 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7ccc00cdc0 con 0x7f7cdc115440 2026-02-13T02:20:17.116 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:17.110+0000 7f7ce24db6c0 1 -- 10.20.193.11:0/2573079150 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cdc1641b0 con 0x7f7cdc115440 2026-02-13T02:20:17.117 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:17.110+0000 7f7ce24db6c0 1 -- 10.20.193.11:0/2573079150 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cdc110500 con 0x7f7cdc115440 2026-02-13T02:20:17.117 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:17.112+0000 7f7cd97fa6c0 1 -- 10.20.193.11:0/2573079150 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7f7ccc0028c0 con 0x7f7cdc115440 2026-02-13T02:20:17.118 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:17.112+0000 7f7cd97fa6c0 1 --2- 10.20.193.11:0/2573079150 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f7cb00b5680 0x7f7cb00d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:20:17.118 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:17.112+0000 7f7cd97fa6c0 1 -- 10.20.193.11:0/2573079150 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7965+0+0 (secure 0 0 0) 0x7f7ccc0e3a30 con 0x7f7cdc115440 2026-02-13T02:20:17.118 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:17.112+0000 7f7cdbfff6c0 1 --2- 10.20.193.11:0/2573079150 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f7cb00b5680 0x7f7cb00d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:20:17.118 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:17.112+0000 7f7cdbfff6c0 1 --2- 10.20.193.11:0/2573079150 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f7cb00b5680 0x7f7cb00d5b30 secure :-1 s=READY pgs=228 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7cc80023e0 tx=0x7f7cc8031f90 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:20:17.118 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:17.113+0000 7f7cd97fa6c0 1 -- 10.20.193.11:0/2573079150 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f7ccc0a64f0 con 0x7f7cdc115440 2026-02-13T02:20:17.231 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:17.229+0000 7f7ce24db6c0 1 -- 10.20.193.11:0/2573079150 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f7cdc10f600 con 0x7f7cdc115440 2026-02-13T02:20:17.232 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:17.229+0000 7f7cd97fa6c0 1 -- 10.20.193.11:0/2573079150 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f7ccc0a96a0 con 0x7f7cdc115440 2026-02-13T02:20:17.232 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:20:17.232 INFO:teuthology.orchestra.run.trial011.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:20:17.234 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:17.231+0000 7f7ce24db6c0 1 -- 10.20.193.11:0/2573079150 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f7cb00b5680 msgr2=0x7f7cb00d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:20:17.234 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:17.231+0000 7f7ce24db6c0 1 --2- 10.20.193.11:0/2573079150 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f7cb00b5680 0x7f7cb00d5b30 secure :-1 s=READY pgs=228 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7cc80023e0 tx=0x7f7cc8031f90 comp rx=0 tx=0).stop 2026-02-13T02:20:17.234 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:17.231+0000 7f7ce24db6c0 1 -- 10.20.193.11:0/2573079150 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f7cdc115440 msgr2=0x7f7cdc11d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:20:17.234 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:17.231+0000 7f7ce24db6c0 1 --2- 10.20.193.11:0/2573079150 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f7cdc115440 0x7f7cdc11d720 secure :-1 s=READY pgs=332 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7ccc005dc0 tx=0x7f7ccc00bbb0 comp rx=0 tx=0).stop 2026-02-13T02:20:17.234 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:17.231+0000 7f7ce24db6c0 1 -- 10.20.193.11:0/2573079150 shutdown_connections 2026-02-13T02:20:17.234 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:17.231+0000 7f7ce24db6c0 1 --2- 10.20.193.11:0/2573079150 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f7cb00b5680 0x7f7cb00d5b30 unknown :-1 s=CLOSED pgs=228 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:17.234 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:17.231+0000 7f7ce24db6c0 1 --2- 10.20.193.11:0/2573079150 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f7cdc122ae0 0x7f7cdc122f80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:17.234 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:17.231+0000 7f7ce24db6c0 1 --2- 10.20.193.11:0/2573079150 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f7cdc115440 0x7f7cdc11d720 unknown :-1 s=CLOSED pgs=332 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:17.234 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:17.231+0000 7f7ce24db6c0 1 --2- 10.20.193.11:0/2573079150 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f7cdc10f230 0x7f7cdc11d1e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:17.234 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:17.231+0000 7f7ce24db6c0 1 -- 10.20.193.11:0/2573079150 >> 10.20.193.11:0/2573079150 conn(0x7f7cdc0ecb30 msgr2=0x7f7cdc10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:20:17.234 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:17.231+0000 7f7ce24db6c0 1 -- 10.20.193.11:0/2573079150 shutdown_connections 2026-02-13T02:20:17.235 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:17.231+0000 7f7ce24db6c0 1 -- 10.20.193.11:0/2573079150 wait complete. 2026-02-13T02:20:17.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:17 trial011 ceph-mon[11956]: pgmap v226: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.5 KiB/s rd, 341 B/s wr, 10 op/s 2026-02-13T02:20:17.962 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:17 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/2573079150' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:20:18.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:17 trial060 ceph-mon[14797]: pgmap v226: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.5 KiB/s rd, 341 B/s wr, 10 op/s 2026-02-13T02:20:18.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:17 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/2573079150' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:20:18.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:17 trial078 ceph-mon[14969]: pgmap v226: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.5 KiB/s rd, 341 B/s wr, 10 op/s 2026-02-13T02:20:18.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:17 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/2573079150' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:20:19.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:19 trial011 ceph-mon[11956]: pgmap v227: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 10 op/s 2026-02-13T02:20:20.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:19 trial060 ceph-mon[14797]: pgmap v227: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 10 op/s 2026-02-13T02:20:20.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:19 trial078 ceph-mon[14969]: pgmap v227: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 10 op/s 2026-02-13T02:20:20.273 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:20:20.398 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:20:20.515 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:20.511+0000 7f1f18bd36c0 1 -- 10.20.193.11:0/2516649012 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f1f1410fbf0 msgr2=0x7f1f14114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:20:20.516 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:20.511+0000 7f1f18bd36c0 1 --2- 10.20.193.11:0/2516649012 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f1f1410fbf0 0x7f1f14114c30 secure :-1 s=READY pgs=333 gs=1 cs=0 l=1 c_cookie=5683711243779239391 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1efc0099a0 tx=0x7f1efc02ed20 comp rx=0 tx=0).stop 2026-02-13T02:20:20.516 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:20.511+0000 7f1f18bd36c0 1 -- 10.20.193.11:0/2516649012 shutdown_connections 2026-02-13T02:20:20.516 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:20.511+0000 7f1f18bd36c0 1 --2- 10.20.193.11:0/2516649012 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1f14115410 0x7f1f14175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:20.516 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:20.511+0000 7f1f18bd36c0 1 --2- 10.20.193.11:0/2516649012 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f1f1410fbf0 0x7f1f14114c30 unknown :-1 s=CLOSED pgs=333 gs=1 cs=0 l=1 c_cookie=5683711243779239391 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:20.516 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:20.511+0000 7f1f18bd36c0 1 --2- 10.20.193.11:0/2516649012 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f1f1410f200 0x7f1f1410f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:20.516 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:20.511+0000 7f1f18bd36c0 1 -- 10.20.193.11:0/2516649012 >> 10.20.193.11:0/2516649012 conn(0x7f1f140ecb00 msgr2=0x7f1f1410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:20:20.516 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:20.511+0000 7f1f18bd36c0 1 -- 10.20.193.11:0/2516649012 shutdown_connections 2026-02-13T02:20:20.517 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:20.511+0000 7f1f18bd36c0 1 -- 10.20.193.11:0/2516649012 wait complete. 2026-02-13T02:20:20.517 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:20.511+0000 7f1f18bd36c0 1 Processor -- start 2026-02-13T02:20:20.517 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:20.511+0000 7f1f18bd36c0 1 -- start start 2026-02-13T02:20:20.517 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:20.512+0000 7f1f18bd36c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f1f1410f200 0x7f1f140666e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:20:20.517 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:20.512+0000 7f1f18bd36c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f1f14115410 0x7f1f14175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:20:20.517 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:20.512+0000 7f1f18bd36c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1f14062940 0x7f1f14062de0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:20:20.517 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:20.512+0000 7f1f18bd36c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f1f14063570 con 0x7f1f1410f200 2026-02-13T02:20:20.517 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:20.512+0000 7f1f18bd36c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f1f140636e0 con 0x7f1f14115410 2026-02-13T02:20:20.517 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:20.512+0000 7f1f18bd36c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f1f140ff3a0 con 0x7f1f14062940 2026-02-13T02:20:20.517 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:20.512+0000 7f1f125756c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f1f1410f200 0x7f1f140666e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:20:20.517 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:20.512+0000 7f1f125756c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f1f1410f200 0x7f1f140666e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:57820/0 (socket says 10.20.193.11:57820) 2026-02-13T02:20:20.518 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:20.512+0000 7f1f125756c0 1 -- 10.20.193.11:0/65369647 learned_addr learned my addr 10.20.193.11:0/65369647 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:20:20.518 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:20.512+0000 7f1f11d746c0 1 --2- 10.20.193.11:0/65369647 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f1f14115410 0x7f1f14175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:20:20.518 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:20.512+0000 7f1f12d766c0 1 --2- 10.20.193.11:0/65369647 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1f14062940 0x7f1f14062de0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:20:20.518 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:20.512+0000 7f1f125756c0 1 -- 10.20.193.11:0/65369647 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1f14062940 msgr2=0x7f1f14062de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:20:20.518 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:20.512+0000 7f1f125756c0 1 --2- 10.20.193.11:0/65369647 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1f14062940 0x7f1f14062de0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:20.518 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:20.512+0000 7f1f125756c0 1 -- 10.20.193.11:0/65369647 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f1f14115410 msgr2=0x7f1f14175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:20:20.518 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:20.512+0000 7f1f125756c0 1 --2- 10.20.193.11:0/65369647 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f1f14115410 0x7f1f14175cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:20.518 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:20.512+0000 7f1f125756c0 1 -- 10.20.193.11:0/65369647 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1efc009590 con 0x7f1f1410f200 2026-02-13T02:20:20.518 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:20.512+0000 7f1f125756c0 1 --2- 10.20.193.11:0/65369647 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f1f1410f200 0x7f1f140666e0 secure :-1 s=READY pgs=334 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1f0800b6c0 tx=0x7f1f0800bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:20:20.518 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:20.512+0000 7f1efb7fe6c0 1 -- 10.20.193.11:0/65369647 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1f080044a0 con 0x7f1f1410f200 2026-02-13T02:20:20.518 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:20.512+0000 7f1f18bd36c0 1 -- 10.20.193.11:0/65369647 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f140ff680 con 0x7f1f1410f200 2026-02-13T02:20:20.519 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:20.512+0000 7f1efb7fe6c0 1 -- 10.20.193.11:0/65369647 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1f0800be50 con 0x7f1f1410f200 2026-02-13T02:20:20.519 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:20.512+0000 7f1efb7fe6c0 1 -- 10.20.193.11:0/65369647 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1f0800cdc0 con 0x7f1f1410f200 2026-02-13T02:20:20.519 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:20.512+0000 7f1f18bd36c0 1 -- 10.20.193.11:0/65369647 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f140ffbb0 con 0x7f1f1410f200 2026-02-13T02:20:20.519 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:20.513+0000 7f1f18bd36c0 1 -- 10.20.193.11:0/65369647 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f141104d0 con 0x7f1f1410f200 2026-02-13T02:20:20.520 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:20.514+0000 7f1efb7fe6c0 1 -- 10.20.193.11:0/65369647 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7f1f080026b0 con 0x7f1f1410f200 2026-02-13T02:20:20.520 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:20.515+0000 7f1efb7fe6c0 1 --2- 10.20.193.11:0/65369647 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f1eec0b5680 0x7f1eec0d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:20:20.520 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:20.515+0000 7f1efb7fe6c0 1 -- 10.20.193.11:0/65369647 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7965+0+0 (secure 0 0 0) 0x7f1f080e3720 con 0x7f1f1410f200 2026-02-13T02:20:20.520 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:20.515+0000 7f1f11d746c0 1 --2- 10.20.193.11:0/65369647 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f1eec0b5680 0x7f1eec0d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:20:20.521 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:20.515+0000 7f1efb7fe6c0 1 -- 10.20.193.11:0/65369647 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f1f080a62b0 con 0x7f1f1410f200 2026-02-13T02:20:20.521 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:20.515+0000 7f1f11d746c0 1 --2- 10.20.193.11:0/65369647 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f1eec0b5680 0x7f1eec0d5b30 secure :-1 s=READY pgs=229 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1efc009260 tx=0x7f1efc0023a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:20:20.633 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:20.630+0000 7f1f18bd36c0 1 -- 10.20.193.11:0/65369647 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f1f14063c40 con 0x7f1f1410f200 2026-02-13T02:20:20.633 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:20.631+0000 7f1efb7fe6c0 1 -- 10.20.193.11:0/65369647 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f1f080a93d0 con 0x7f1f1410f200 2026-02-13T02:20:20.633 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:20:20.633 INFO:teuthology.orchestra.run.trial011.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:20:20.634 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:20.632+0000 7f1f18bd36c0 1 -- 10.20.193.11:0/65369647 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f1eec0b5680 msgr2=0x7f1eec0d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:20:20.634 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:20.632+0000 7f1f18bd36c0 1 --2- 10.20.193.11:0/65369647 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f1eec0b5680 0x7f1eec0d5b30 secure :-1 s=READY pgs=229 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1efc009260 tx=0x7f1efc0023a0 comp rx=0 tx=0).stop 2026-02-13T02:20:20.635 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:20.632+0000 7f1f18bd36c0 1 -- 10.20.193.11:0/65369647 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f1f1410f200 msgr2=0x7f1f140666e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:20:20.635 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:20.632+0000 7f1f18bd36c0 1 --2- 10.20.193.11:0/65369647 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f1f1410f200 0x7f1f140666e0 secure :-1 s=READY pgs=334 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1f0800b6c0 tx=0x7f1f0800bb90 comp rx=0 tx=0).stop 2026-02-13T02:20:20.635 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:20.632+0000 7f1f18bd36c0 1 -- 10.20.193.11:0/65369647 shutdown_connections 2026-02-13T02:20:20.635 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:20.632+0000 7f1f18bd36c0 1 --2- 10.20.193.11:0/65369647 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f1eec0b5680 0x7f1eec0d5b30 unknown :-1 s=CLOSED pgs=229 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:20.635 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:20.632+0000 7f1f18bd36c0 1 --2- 10.20.193.11:0/65369647 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f1f14115410 0x7f1f14175cb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:20.635 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:20.632+0000 7f1f18bd36c0 1 --2- 10.20.193.11:0/65369647 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1f14062940 0x7f1f14062de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:20.635 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:20.632+0000 7f1f18bd36c0 1 --2- 10.20.193.11:0/65369647 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f1f1410f200 0x7f1f140666e0 unknown :-1 s=CLOSED pgs=334 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:20.635 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:20.632+0000 7f1f18bd36c0 1 -- 10.20.193.11:0/65369647 >> 10.20.193.11:0/65369647 conn(0x7f1f140ecb00 msgr2=0x7f1f1410d860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:20:20.635 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:20.632+0000 7f1f18bd36c0 1 -- 10.20.193.11:0/65369647 shutdown_connections 2026-02-13T02:20:20.636 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:20.632+0000 7f1f18bd36c0 1 -- 10.20.193.11:0/65369647 wait complete. 2026-02-13T02:20:21.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:21 trial011 ceph-mon[11956]: pgmap v228: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 10 op/s 2026-02-13T02:20:21.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:21 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/65369647' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:20:22.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:21 trial060 ceph-mon[14797]: pgmap v228: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 10 op/s 2026-02-13T02:20:22.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:21 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/65369647' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:20:22.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:21 trial078 ceph-mon[14969]: pgmap v228: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 10 op/s 2026-02-13T02:20:22.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:21 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/65369647' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:20:23.673 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:20:23.799 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:20:23.857 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:23 trial011 ceph-mon[11956]: pgmap v229: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 6.0 KiB/s rd, 426 B/s wr, 11 op/s 2026-02-13T02:20:23.918 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:23.914+0000 7f62defcc6c0 1 -- 10.20.193.11:0/1826051180 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f62d8115410 msgr2=0x7f62d8175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:20:23.918 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:23.914+0000 7f62defcc6c0 1 --2- 10.20.193.11:0/1826051180 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f62d8115410 0x7f62d8175db0 secure :-1 s=READY pgs=335 gs=1 cs=0 l=1 c_cookie=11182883708402537620 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f62d400aa70 tx=0x7f62d402fde0 comp rx=0 tx=0).stop 2026-02-13T02:20:23.918 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:23.914+0000 7f62defcc6c0 1 -- 10.20.193.11:0/1826051180 shutdown_connections 2026-02-13T02:20:23.918 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:23.914+0000 7f62defcc6c0 1 --2- 10.20.193.11:0/1826051180 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f62d8115410 0x7f62d8175db0 unknown :-1 s=CLOSED pgs=335 gs=1 cs=0 l=1 c_cookie=11182883708402537620 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:23.918 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:23.914+0000 7f62defcc6c0 1 --2- 10.20.193.11:0/1826051180 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f62d810fbf0 0x7f62d8114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:23.918 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:23.914+0000 7f62defcc6c0 1 --2- 10.20.193.11:0/1826051180 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f62d810f200 0x7f62d810f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:23.919 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:23.914+0000 7f62defcc6c0 1 -- 10.20.193.11:0/1826051180 >> 10.20.193.11:0/1826051180 conn(0x7f62d80ecb00 msgr2=0x7f62d810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:20:23.919 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:23.914+0000 7f62defcc6c0 1 -- 10.20.193.11:0/1826051180 shutdown_connections 2026-02-13T02:20:23.919 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:23.914+0000 7f62defcc6c0 1 -- 10.20.193.11:0/1826051180 wait complete. 2026-02-13T02:20:23.919 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:23.914+0000 7f62defcc6c0 1 Processor -- start 2026-02-13T02:20:23.919 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:23.914+0000 7f62defcc6c0 1 -- start start 2026-02-13T02:20:23.919 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:23.915+0000 7f62defcc6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f62d810f200 0x7f62d811d180 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:20:23.919 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:23.915+0000 7f62defcc6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f62d8115410 0x7f62d811d6c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:20:23.919 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:23.915+0000 7f62defcc6c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f62d8122a80 0x7f62d8122f20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:20:23.919 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:23.915+0000 7f62defcc6c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f62d8123490 con 0x7f62d8115410 2026-02-13T02:20:23.919 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:23.915+0000 7f62defcc6c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f62d8123600 con 0x7f62d8122a80 2026-02-13T02:20:23.920 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:23.915+0000 7f62defcc6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f62d81237c0 con 0x7f62d810f200 2026-02-13T02:20:23.920 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:23.915+0000 7f62cffff6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f62d8115410 0x7f62d811d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:20:23.920 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:23.915+0000 7f62cffff6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f62d8115410 0x7f62d811d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:57032/0 (socket says 10.20.193.11:57032) 2026-02-13T02:20:23.920 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:23.915+0000 7f62cffff6c0 1 -- 10.20.193.11:0/3548646715 learned_addr learned my addr 10.20.193.11:0/3548646715 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:20:23.920 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:23.915+0000 7f62dcd3d6c0 1 --2- 10.20.193.11:0/3548646715 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f62d810f200 0x7f62d811d180 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:20:23.920 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:23.915+0000 7f62dd53e6c0 1 --2- 10.20.193.11:0/3548646715 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f62d8122a80 0x7f62d8122f20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:20:23.920 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:23.915+0000 7f62cffff6c0 1 -- 10.20.193.11:0/3548646715 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f62d810f200 msgr2=0x7f62d811d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:20:23.920 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:23.915+0000 7f62cffff6c0 1 --2- 10.20.193.11:0/3548646715 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f62d810f200 0x7f62d811d180 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:23.920 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:23.915+0000 7f62cffff6c0 1 -- 10.20.193.11:0/3548646715 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f62d8122a80 msgr2=0x7f62d8122f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:20:23.920 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:23.915+0000 7f62cffff6c0 1 --2- 10.20.193.11:0/3548646715 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f62d8122a80 0x7f62d8122f20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:23.921 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:23.915+0000 7f62cffff6c0 1 -- 10.20.193.11:0/3548646715 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62d400a660 con 0x7f62d8115410 2026-02-13T02:20:23.921 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:23.915+0000 7f62dd53e6c0 1 --2- 10.20.193.11:0/3548646715 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f62d8122a80 0x7f62d8122f20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:20:23.921 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:23.915+0000 7f62cffff6c0 1 --2- 10.20.193.11:0/3548646715 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f62d8115410 0x7f62d811d6c0 secure :-1 s=READY pgs=336 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f62c000b6c0 tx=0x7f62c000bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:20:23.921 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:23.915+0000 7f62cdffb6c0 1 -- 10.20.193.11:0/3548646715 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f62c0004250 con 0x7f62d8115410 2026-02-13T02:20:23.921 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:23.915+0000 7f62cdffb6c0 1 -- 10.20.193.11:0/3548646715 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f62c0009070 con 0x7f62d8115410 2026-02-13T02:20:23.921 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:23.915+0000 7f62defcc6c0 1 -- 10.20.193.11:0/3548646715 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62d8163c70 con 0x7f62d8115410 2026-02-13T02:20:23.921 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:23.915+0000 7f62cdffb6c0 1 -- 10.20.193.11:0/3548646715 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f62c000cd20 con 0x7f62d8115410 2026-02-13T02:20:23.921 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:23.915+0000 7f62defcc6c0 1 -- 10.20.193.11:0/3548646715 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62d8164100 con 0x7f62d8115410 2026-02-13T02:20:23.921 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:23.915+0000 7f62defcc6c0 1 -- 10.20.193.11:0/3548646715 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62d81104d0 con 0x7f62d8115410 2026-02-13T02:20:23.922 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:23.917+0000 7f62cdffb6c0 1 -- 10.20.193.11:0/3548646715 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7f62c00028c0 con 0x7f62d8115410 2026-02-13T02:20:23.922 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:23.917+0000 7f62cdffb6c0 1 --2- 10.20.193.11:0/3548646715 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f62b40b5680 0x7f62b40d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:20:23.923 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:23.917+0000 7f62cdffb6c0 1 -- 10.20.193.11:0/3548646715 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7965+0+0 (secure 0 0 0) 0x7f62c00e39c0 con 0x7f62d8115410 2026-02-13T02:20:23.923 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:23.917+0000 7f62dcd3d6c0 1 --2- 10.20.193.11:0/3548646715 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f62b40b5680 0x7f62b40d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:20:23.923 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:23.918+0000 7f62dcd3d6c0 1 --2- 10.20.193.11:0/3548646715 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f62b40b5680 0x7f62b40d5b30 secure :-1 s=READY pgs=230 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f62c8004750 tx=0x7f62c8009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:20:23.923 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:23.918+0000 7f62cdffb6c0 1 -- 10.20.193.11:0/3548646715 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f62c00a6480 con 0x7f62d8115410 2026-02-13T02:20:24.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:23 trial060 ceph-mon[14797]: pgmap v229: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 6.0 KiB/s rd, 426 B/s wr, 11 op/s 2026-02-13T02:20:24.036 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:24.034+0000 7f62defcc6c0 1 -- 10.20.193.11:0/3548646715 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f62d810f5d0 con 0x7f62d8115410 2026-02-13T02:20:24.036 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:24.034+0000 7f62cdffb6c0 1 -- 10.20.193.11:0/3548646715 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f62c00a9630 con 0x7f62d8115410 2026-02-13T02:20:24.036 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:20:24.036 INFO:teuthology.orchestra.run.trial011.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:20:24.038 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:24.035+0000 7f62defcc6c0 1 -- 10.20.193.11:0/3548646715 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f62b40b5680 msgr2=0x7f62b40d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:20:24.038 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:24.035+0000 7f62defcc6c0 1 --2- 10.20.193.11:0/3548646715 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f62b40b5680 0x7f62b40d5b30 secure :-1 s=READY pgs=230 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f62c8004750 tx=0x7f62c8009260 comp rx=0 tx=0).stop 2026-02-13T02:20:24.038 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:24.035+0000 7f62defcc6c0 1 -- 10.20.193.11:0/3548646715 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f62d8115410 msgr2=0x7f62d811d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:20:24.038 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:24.035+0000 7f62defcc6c0 1 --2- 10.20.193.11:0/3548646715 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f62d8115410 0x7f62d811d6c0 secure :-1 s=READY pgs=336 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f62c000b6c0 tx=0x7f62c000bb90 comp rx=0 tx=0).stop 2026-02-13T02:20:24.038 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:24.035+0000 7f62defcc6c0 1 -- 10.20.193.11:0/3548646715 shutdown_connections 2026-02-13T02:20:24.038 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:24.035+0000 7f62defcc6c0 1 --2- 10.20.193.11:0/3548646715 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f62b40b5680 0x7f62b40d5b30 unknown :-1 s=CLOSED pgs=230 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:24.038 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:24.035+0000 7f62defcc6c0 1 --2- 10.20.193.11:0/3548646715 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f62d8122a80 0x7f62d8122f20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:24.039 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:24.035+0000 7f62defcc6c0 1 --2- 10.20.193.11:0/3548646715 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f62d8115410 0x7f62d811d6c0 unknown :-1 s=CLOSED pgs=336 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:24.039 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:24.035+0000 7f62defcc6c0 1 --2- 10.20.193.11:0/3548646715 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f62d810f200 0x7f62d811d180 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:24.039 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:24.035+0000 7f62defcc6c0 1 -- 10.20.193.11:0/3548646715 >> 10.20.193.11:0/3548646715 conn(0x7f62d80ecb00 msgr2=0x7f62d810cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:20:24.039 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:24.035+0000 7f62defcc6c0 1 -- 10.20.193.11:0/3548646715 shutdown_connections 2026-02-13T02:20:24.039 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:24.035+0000 7f62defcc6c0 1 -- 10.20.193.11:0/3548646715 wait complete. 2026-02-13T02:20:24.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:23 trial078 ceph-mon[14969]: pgmap v229: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 6.0 KiB/s rd, 426 B/s wr, 11 op/s 2026-02-13T02:20:24.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:24 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/3548646715' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:20:25.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:24 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/3548646715' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:20:25.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:24 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/3548646715' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:20:25.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:25 trial011 ceph-mon[11956]: pgmap v230: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 10 op/s 2026-02-13T02:20:26.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:25 trial060 ceph-mon[14797]: pgmap v230: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 10 op/s 2026-02-13T02:20:26.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:25 trial078 ceph-mon[14969]: pgmap v230: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 10 op/s 2026-02-13T02:20:27.076 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:20:27.201 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:20:27.321 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:27.317+0000 7ffa4a67c6c0 1 -- 10.20.193.11:0/1148104436 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7ffa44115410 msgr2=0x7ffa44175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:20:27.321 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:27.317+0000 7ffa4a67c6c0 1 --2- 10.20.193.11:0/1148104436 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7ffa44115410 0x7ffa44175db0 secure :-1 s=READY pgs=337 gs=1 cs=0 l=1 c_cookie=14808625014869059767 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffa3800aa70 tx=0x7ffa3802fde0 comp rx=0 tx=0).stop 2026-02-13T02:20:27.321 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:27.317+0000 7ffa4a67c6c0 1 -- 10.20.193.11:0/1148104436 shutdown_connections 2026-02-13T02:20:27.321 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:27.317+0000 7ffa4a67c6c0 1 --2- 10.20.193.11:0/1148104436 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7ffa4410fbf0 0x7ffa44114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:27.321 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:27.317+0000 7ffa4a67c6c0 1 --2- 10.20.193.11:0/1148104436 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7ffa44115410 0x7ffa44175db0 unknown :-1 s=CLOSED pgs=337 gs=1 cs=0 l=1 c_cookie=14808625014869059767 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:27.321 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:27.317+0000 7ffa4a67c6c0 1 --2- 10.20.193.11:0/1148104436 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ffa4410f200 0x7ffa4410f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:27.322 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:27.317+0000 7ffa4a67c6c0 1 -- 10.20.193.11:0/1148104436 >> 10.20.193.11:0/1148104436 conn(0x7ffa440ecb00 msgr2=0x7ffa4410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:20:27.322 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:27.317+0000 7ffa4a67c6c0 1 -- 10.20.193.11:0/1148104436 shutdown_connections 2026-02-13T02:20:27.322 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:27.317+0000 7ffa4a67c6c0 1 -- 10.20.193.11:0/1148104436 wait complete. 2026-02-13T02:20:27.322 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:27.317+0000 7ffa4a67c6c0 1 Processor -- start 2026-02-13T02:20:27.322 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:27.317+0000 7ffa4a67c6c0 1 -- start start 2026-02-13T02:20:27.322 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:27.317+0000 7ffa4a67c6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ffa4410f200 0x7ffa4411d1f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:20:27.322 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:27.317+0000 7ffa4a67c6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7ffa44115410 0x7ffa4411d730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:20:27.322 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:27.317+0000 7ffa4a67c6c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7ffa44122af0 0x7ffa44122f90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:20:27.322 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:27.317+0000 7ffa4a67c6c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7ffa441234d0 con 0x7ffa44115410 2026-02-13T02:20:27.322 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:27.317+0000 7ffa4a67c6c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7ffa44123640 con 0x7ffa44122af0 2026-02-13T02:20:27.322 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:27.317+0000 7ffa4a67c6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7ffa44123800 con 0x7ffa4410f200 2026-02-13T02:20:27.323 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:27.317+0000 7ffa437fe6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7ffa44115410 0x7ffa4411d730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:20:27.323 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:27.317+0000 7ffa437fe6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7ffa44115410 0x7ffa4411d730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:57056/0 (socket says 10.20.193.11:57056) 2026-02-13T02:20:27.323 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:27.317+0000 7ffa437fe6c0 1 -- 10.20.193.11:0/2170055730 learned_addr learned my addr 10.20.193.11:0/2170055730 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:20:27.323 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:27.317+0000 7ffa43fff6c0 1 --2- 10.20.193.11:0/2170055730 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ffa4410f200 0x7ffa4411d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:20:27.323 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:27.317+0000 7ffa48bee6c0 1 --2- 10.20.193.11:0/2170055730 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7ffa44122af0 0x7ffa44122f90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:20:27.323 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:27.317+0000 7ffa437fe6c0 1 -- 10.20.193.11:0/2170055730 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ffa4410f200 msgr2=0x7ffa4411d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:20:27.323 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:27.317+0000 7ffa437fe6c0 1 --2- 10.20.193.11:0/2170055730 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ffa4410f200 0x7ffa4411d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:27.323 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:27.317+0000 7ffa437fe6c0 1 -- 10.20.193.11:0/2170055730 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7ffa44122af0 msgr2=0x7ffa44122f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:20:27.323 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:27.317+0000 7ffa437fe6c0 1 --2- 10.20.193.11:0/2170055730 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7ffa44122af0 0x7ffa44122f90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:27.323 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:27.317+0000 7ffa437fe6c0 1 -- 10.20.193.11:0/2170055730 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa3800a660 con 0x7ffa44115410 2026-02-13T02:20:27.323 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:27.318+0000 7ffa437fe6c0 1 --2- 10.20.193.11:0/2170055730 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7ffa44115410 0x7ffa4411d730 secure :-1 s=READY pgs=338 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffa3400b650 tx=0x7ffa3400bb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:20:27.323 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:27.318+0000 7ffa417fa6c0 1 -- 10.20.193.11:0/2170055730 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ffa340044a0 con 0x7ffa44115410 2026-02-13T02:20:27.324 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:27.318+0000 7ffa417fa6c0 1 -- 10.20.193.11:0/2170055730 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ffa34009030 con 0x7ffa44115410 2026-02-13T02:20:27.324 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:27.318+0000 7ffa4a67c6c0 1 -- 10.20.193.11:0/2170055730 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa44163c80 con 0x7ffa44115410 2026-02-13T02:20:27.324 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:27.318+0000 7ffa417fa6c0 1 -- 10.20.193.11:0/2170055730 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ffa3400ccb0 con 0x7ffa44115410 2026-02-13T02:20:27.324 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:27.318+0000 7ffa4a67c6c0 1 -- 10.20.193.11:0/2170055730 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa441641b0 con 0x7ffa44115410 2026-02-13T02:20:27.324 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:27.318+0000 7ffa4a67c6c0 1 -- 10.20.193.11:0/2170055730 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa441104d0 con 0x7ffa44115410 2026-02-13T02:20:27.324 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:27.319+0000 7ffa417fa6c0 1 -- 10.20.193.11:0/2170055730 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7ffa340026b0 con 0x7ffa44115410 2026-02-13T02:20:27.325 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:27.320+0000 7ffa417fa6c0 1 --2- 10.20.193.11:0/2170055730 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7ffa180b5680 0x7ffa180d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:20:27.325 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:27.320+0000 7ffa43fff6c0 1 --2- 10.20.193.11:0/2170055730 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7ffa180b5680 0x7ffa180d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:20:27.325 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:27.320+0000 7ffa417fa6c0 1 -- 10.20.193.11:0/2170055730 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7965+0+0 (secure 0 0 0) 0x7ffa340e38b0 con 0x7ffa44115410 2026-02-13T02:20:27.325 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:27.320+0000 7ffa43fff6c0 1 --2- 10.20.193.11:0/2170055730 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7ffa180b5680 0x7ffa180d5b30 secure :-1 s=READY pgs=231 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffa30005fd0 tx=0x7ffa30009590 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:20:27.325 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:27.321+0000 7ffa417fa6c0 1 -- 10.20.193.11:0/2170055730 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7ffa340a6370 con 0x7ffa44115410 2026-02-13T02:20:27.438 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:27.436+0000 7ffa4a67c6c0 1 -- 10.20.193.11:0/2170055730 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ffa4411e340 con 0x7ffa44115410 2026-02-13T02:20:27.438 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:27.436+0000 7ffa417fa6c0 1 -- 10.20.193.11:0/2170055730 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7ffa340a9520 con 0x7ffa44115410 2026-02-13T02:20:27.438 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:20:27.438 INFO:teuthology.orchestra.run.trial011.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:20:27.439 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:27.437+0000 7ffa4a67c6c0 1 -- 10.20.193.11:0/2170055730 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7ffa180b5680 msgr2=0x7ffa180d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:20:27.440 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:27.437+0000 7ffa4a67c6c0 1 --2- 10.20.193.11:0/2170055730 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7ffa180b5680 0x7ffa180d5b30 secure :-1 s=READY pgs=231 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffa30005fd0 tx=0x7ffa30009590 comp rx=0 tx=0).stop 2026-02-13T02:20:27.440 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:27.437+0000 7ffa4a67c6c0 1 -- 10.20.193.11:0/2170055730 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7ffa44115410 msgr2=0x7ffa4411d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:20:27.440 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:27.437+0000 7ffa4a67c6c0 1 --2- 10.20.193.11:0/2170055730 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7ffa44115410 0x7ffa4411d730 secure :-1 s=READY pgs=338 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffa3400b650 tx=0x7ffa3400bb20 comp rx=0 tx=0).stop 2026-02-13T02:20:27.440 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:27.437+0000 7ffa4a67c6c0 1 -- 10.20.193.11:0/2170055730 shutdown_connections 2026-02-13T02:20:27.440 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:27.437+0000 7ffa4a67c6c0 1 --2- 10.20.193.11:0/2170055730 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7ffa180b5680 0x7ffa180d5b30 unknown :-1 s=CLOSED pgs=231 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:27.440 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:27.437+0000 7ffa4a67c6c0 1 --2- 10.20.193.11:0/2170055730 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7ffa44122af0 0x7ffa44122f90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:27.440 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:27.437+0000 7ffa4a67c6c0 1 --2- 10.20.193.11:0/2170055730 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7ffa44115410 0x7ffa4411d730 unknown :-1 s=CLOSED pgs=338 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:27.440 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:27.437+0000 7ffa4a67c6c0 1 --2- 10.20.193.11:0/2170055730 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ffa4410f200 0x7ffa4411d1f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:27.440 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:27.437+0000 7ffa4a67c6c0 1 -- 10.20.193.11:0/2170055730 >> 10.20.193.11:0/2170055730 conn(0x7ffa440ecb00 msgr2=0x7ffa4410cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:20:27.440 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:27.437+0000 7ffa4a67c6c0 1 -- 10.20.193.11:0/2170055730 shutdown_connections 2026-02-13T02:20:27.440 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:27.437+0000 7ffa4a67c6c0 1 -- 10.20.193.11:0/2170055730 wait complete. 2026-02-13T02:20:27.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:27 trial011 ceph-mon[11956]: pgmap v231: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.6 KiB/s rd, 341 B/s wr, 10 op/s 2026-02-13T02:20:27.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:27 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/2170055730' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:20:28.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:27 trial060 ceph-mon[14797]: pgmap v231: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.6 KiB/s rd, 341 B/s wr, 10 op/s 2026-02-13T02:20:28.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:27 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/2170055730' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:20:28.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:27 trial078 ceph-mon[14969]: pgmap v231: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.6 KiB/s rd, 341 B/s wr, 10 op/s 2026-02-13T02:20:28.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:27 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/2170055730' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:20:29.951 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:29 trial011 ceph-mon[11956]: pgmap v232: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 9 op/s 2026-02-13T02:20:30.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:29 trial060 ceph-mon[14797]: pgmap v232: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 9 op/s 2026-02-13T02:20:30.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:29 trial078 ceph-mon[14969]: pgmap v232: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 9 op/s 2026-02-13T02:20:30.477 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:20:30.602 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:20:30.722 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:30.717+0000 7f9a5b8846c0 1 -- 10.20.193.11:0/3362513786 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f9a5410fc20 msgr2=0x7f9a54114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:20:30.722 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:30.717+0000 7f9a5b8846c0 1 --2- 10.20.193.11:0/3362513786 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f9a5410fc20 0x7f9a54114c60 secure :-1 s=READY pgs=339 gs=1 cs=0 l=1 c_cookie=14704663959582842513 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9a480099a0 tx=0x7f9a4802ed20 comp rx=0 tx=0).stop 2026-02-13T02:20:30.722 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:30.717+0000 7f9a5b8846c0 1 -- 10.20.193.11:0/3362513786 shutdown_connections 2026-02-13T02:20:30.722 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:30.717+0000 7f9a5b8846c0 1 --2- 10.20.193.11:0/3362513786 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f9a54115440 0x7f9a54175de0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:30.723 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:30.717+0000 7f9a5b8846c0 1 --2- 10.20.193.11:0/3362513786 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f9a5410fc20 0x7f9a54114c60 unknown :-1 s=CLOSED pgs=339 gs=1 cs=0 l=1 c_cookie=14704663959582842513 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:30.723 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:30.717+0000 7f9a5b8846c0 1 --2- 10.20.193.11:0/3362513786 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f9a5410f230 0x7f9a5410f600 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:30.723 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:30.717+0000 7f9a5b8846c0 1 -- 10.20.193.11:0/3362513786 >> 10.20.193.11:0/3362513786 conn(0x7f9a540ecb30 msgr2=0x7f9a5410cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:20:30.723 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:30.717+0000 7f9a5b8846c0 1 -- 10.20.193.11:0/3362513786 shutdown_connections 2026-02-13T02:20:30.723 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:30.717+0000 7f9a5b8846c0 1 -- 10.20.193.11:0/3362513786 wait complete. 2026-02-13T02:20:30.723 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:30.718+0000 7f9a5b8846c0 1 Processor -- start 2026-02-13T02:20:30.723 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:30.718+0000 7f9a5b8846c0 1 -- start start 2026-02-13T02:20:30.723 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:30.718+0000 7f9a5b8846c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f9a5410f230 0x7f9a540f4ac0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:20:30.723 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:30.718+0000 7f9a5b8846c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f9a54115440 0x7f9a54175ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:20:30.723 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:30.718+0000 7f9a5b8846c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f9a540f50f0 0x7f9a540fa3c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:20:30.723 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:30.718+0000 7f9a5b8846c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f9a540f57e0 con 0x7f9a540f50f0 2026-02-13T02:20:30.723 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:30.718+0000 7f9a5b8846c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9a540fa900 con 0x7f9a54115440 2026-02-13T02:20:30.724 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:30.718+0000 7f9a5b8846c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f9a540faac0 con 0x7f9a5410f230 2026-02-13T02:20:30.724 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:30.718+0000 7f9a59df66c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f9a540f50f0 0x7f9a540fa3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:20:30.724 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:30.718+0000 7f9a59df66c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f9a540f50f0 0x7f9a540fa3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:57082/0 (socket says 10.20.193.11:57082) 2026-02-13T02:20:30.724 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:30.718+0000 7f9a59df66c0 1 -- 10.20.193.11:0/787125247 learned_addr learned my addr 10.20.193.11:0/787125247 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:20:30.724 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:30.718+0000 7f9a595f56c0 1 --2- 10.20.193.11:0/787125247 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f9a5410f230 0x7f9a540f4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:20:30.724 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:30.718+0000 7f9a58df46c0 1 --2- 10.20.193.11:0/787125247 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f9a54115440 0x7f9a54175ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:20:30.724 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:30.718+0000 7f9a59df66c0 1 -- 10.20.193.11:0/787125247 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f9a5410f230 msgr2=0x7f9a540f4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:20:30.724 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:30.718+0000 7f9a59df66c0 1 --2- 10.20.193.11:0/787125247 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f9a5410f230 0x7f9a540f4ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:30.724 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:30.718+0000 7f9a59df66c0 1 -- 10.20.193.11:0/787125247 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f9a54115440 msgr2=0x7f9a54175ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:20:30.724 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:30.718+0000 7f9a59df66c0 1 --2- 10.20.193.11:0/787125247 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f9a54115440 0x7f9a54175ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:30.724 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:30.718+0000 7f9a59df66c0 1 -- 10.20.193.11:0/787125247 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a48009590 con 0x7f9a540f50f0 2026-02-13T02:20:30.724 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:30.718+0000 7f9a59df66c0 1 --2- 10.20.193.11:0/787125247 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f9a540f50f0 0x7f9a540fa3c0 secure :-1 s=READY pgs=340 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9a5000c6c0 tx=0x7f9a5000cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:20:30.725 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:30.718+0000 7f9a427fc6c0 1 -- 10.20.193.11:0/787125247 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9a50003a30 con 0x7f9a540f50f0 2026-02-13T02:20:30.725 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:30.718+0000 7f9a5b8846c0 1 -- 10.20.193.11:0/787125247 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a540fada0 con 0x7f9a540f50f0 2026-02-13T02:20:30.725 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:30.718+0000 7f9a427fc6c0 1 -- 10.20.193.11:0/787125247 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9a50005500 con 0x7f9a540f50f0 2026-02-13T02:20:30.725 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:30.718+0000 7f9a427fc6c0 1 -- 10.20.193.11:0/787125247 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9a5000dd80 con 0x7f9a540f50f0 2026-02-13T02:20:30.725 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:30.718+0000 7f9a5b8846c0 1 -- 10.20.193.11:0/787125247 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a540fb530 con 0x7f9a540f50f0 2026-02-13T02:20:30.725 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:30.719+0000 7f9a5b8846c0 1 -- 10.20.193.11:0/787125247 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a54110500 con 0x7f9a540f50f0 2026-02-13T02:20:30.725 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:30.720+0000 7f9a427fc6c0 1 -- 10.20.193.11:0/787125247 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7f9a50005080 con 0x7f9a540f50f0 2026-02-13T02:20:30.726 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:30.721+0000 7f9a427fc6c0 1 --2- 10.20.193.11:0/787125247 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f9a300b5600 0x7f9a300d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:20:30.726 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:30.721+0000 7f9a427fc6c0 1 -- 10.20.193.11:0/787125247 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7965+0+0 (secure 0 0 0) 0x7f9a500e48b0 con 0x7f9a540f50f0 2026-02-13T02:20:30.726 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:30.721+0000 7f9a595f56c0 1 --2- 10.20.193.11:0/787125247 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f9a300b5600 0x7f9a300d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:20:30.726 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:30.721+0000 7f9a427fc6c0 1 -- 10.20.193.11:0/787125247 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f9a500e4d30 con 0x7f9a540f50f0 2026-02-13T02:20:30.726 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:30.721+0000 7f9a595f56c0 1 --2- 10.20.193.11:0/787125247 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f9a300b5600 0x7f9a300d5ab0 secure :-1 s=READY pgs=232 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9a44005980 tx=0x7f9a44005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:20:30.838 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:30.836+0000 7f9a5b8846c0 1 -- 10.20.193.11:0/787125247 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f9a540f5c10 con 0x7f9a540f50f0 2026-02-13T02:20:30.838 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:30.836+0000 7f9a427fc6c0 1 -- 10.20.193.11:0/787125247 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f9a500a7370 con 0x7f9a540f50f0 2026-02-13T02:20:30.839 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:20:30.839 INFO:teuthology.orchestra.run.trial011.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:20:30.840 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:30.837+0000 7f9a5b8846c0 1 -- 10.20.193.11:0/787125247 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f9a300b5600 msgr2=0x7f9a300d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:20:30.840 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:30.837+0000 7f9a5b8846c0 1 --2- 10.20.193.11:0/787125247 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f9a300b5600 0x7f9a300d5ab0 secure :-1 s=READY pgs=232 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9a44005980 tx=0x7f9a44005910 comp rx=0 tx=0).stop 2026-02-13T02:20:30.840 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:30.837+0000 7f9a5b8846c0 1 -- 10.20.193.11:0/787125247 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f9a540f50f0 msgr2=0x7f9a540fa3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:20:30.840 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:30.837+0000 7f9a5b8846c0 1 --2- 10.20.193.11:0/787125247 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f9a540f50f0 0x7f9a540fa3c0 secure :-1 s=READY pgs=340 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9a5000c6c0 tx=0x7f9a5000cb90 comp rx=0 tx=0).stop 2026-02-13T02:20:30.840 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:30.837+0000 7f9a5b8846c0 1 -- 10.20.193.11:0/787125247 shutdown_connections 2026-02-13T02:20:30.840 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:30.837+0000 7f9a5b8846c0 1 --2- 10.20.193.11:0/787125247 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f9a300b5600 0x7f9a300d5ab0 unknown :-1 s=CLOSED pgs=232 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:30.840 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:30.837+0000 7f9a5b8846c0 1 --2- 10.20.193.11:0/787125247 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f9a54115440 0x7f9a54175ce0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:30.840 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:30.837+0000 7f9a5b8846c0 1 --2- 10.20.193.11:0/787125247 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f9a540f50f0 0x7f9a540fa3c0 unknown :-1 s=CLOSED pgs=340 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:30.840 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:30.837+0000 7f9a5b8846c0 1 --2- 10.20.193.11:0/787125247 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f9a5410f230 0x7f9a540f4ac0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:30.841 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:30.837+0000 7f9a5b8846c0 1 -- 10.20.193.11:0/787125247 >> 10.20.193.11:0/787125247 conn(0x7f9a540ecb30 msgr2=0x7f9a5410d6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:20:30.841 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:30.837+0000 7f9a5b8846c0 1 -- 10.20.193.11:0/787125247 shutdown_connections 2026-02-13T02:20:30.841 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:30.837+0000 7f9a5b8846c0 1 -- 10.20.193.11:0/787125247 wait complete. 2026-02-13T02:20:31.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:31 trial011 ceph-mon[11956]: pgmap v233: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:20:31.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:31 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/787125247' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:20:32.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:31 trial060 ceph-mon[14797]: pgmap v233: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:20:32.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:31 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/787125247' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:20:32.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:31 trial078 ceph-mon[14969]: pgmap v233: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:20:32.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:31 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/787125247' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:20:33.878 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:20:33.905 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:33 trial011 ceph-mon[11956]: pgmap v234: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T02:20:34.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:33 trial060 ceph-mon[14797]: pgmap v234: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T02:20:34.005 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:20:34.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:33 trial078 ceph-mon[14969]: pgmap v234: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T02:20:34.124 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:34.119+0000 7f1e177076c0 1 -- 10.20.193.11:0/2513105306 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f1e1010cfe0 msgr2=0x7f1e101118b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:20:34.124 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:34.119+0000 7f1e177076c0 1 --2- 10.20.193.11:0/2513105306 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f1e1010cfe0 0x7f1e101118b0 secure :-1 s=READY pgs=341 gs=1 cs=0 l=1 c_cookie=1645441478342503236 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1e040099a0 tx=0x7f1e0402ed20 comp rx=0 tx=0).stop 2026-02-13T02:20:34.124 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:34.119+0000 7f1e177076c0 1 -- 10.20.193.11:0/2513105306 shutdown_connections 2026-02-13T02:20:34.124 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:34.119+0000 7f1e177076c0 1 --2- 10.20.193.11:0/2513105306 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f1e10112090 0x7f1e10172a30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:34.124 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:34.119+0000 7f1e177076c0 1 --2- 10.20.193.11:0/2513105306 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f1e1010cfe0 0x7f1e101118b0 unknown :-1 s=CLOSED pgs=341 gs=1 cs=0 l=1 c_cookie=1645441478342503236 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:34.124 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:34.119+0000 7f1e177076c0 1 --2- 10.20.193.11:0/2513105306 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1e1010c5f0 0x7f1e1010c9c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:34.125 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:34.119+0000 7f1e177076c0 1 -- 10.20.193.11:0/2513105306 >> 10.20.193.11:0/2513105306 conn(0x7f1e10062e00 msgr2=0x7f1e10109660 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:20:34.125 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:34.119+0000 7f1e177076c0 1 -- 10.20.193.11:0/2513105306 shutdown_connections 2026-02-13T02:20:34.125 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:34.119+0000 7f1e177076c0 1 -- 10.20.193.11:0/2513105306 wait complete. 2026-02-13T02:20:34.125 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:34.120+0000 7f1e177076c0 1 Processor -- start 2026-02-13T02:20:34.125 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:34.120+0000 7f1e177076c0 1 -- start start 2026-02-13T02:20:34.125 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:34.120+0000 7f1e177076c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f1e1010c5f0 0x7f1e100f4640 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:20:34.125 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:34.120+0000 7f1e177076c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f1e10112090 0x7f1e10172930 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:20:34.125 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:34.120+0000 7f1e177076c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1e100f4c70 0x7f1e100f9f40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:20:34.125 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:34.120+0000 7f1e177076c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f1e100f5360 con 0x7f1e10112090 2026-02-13T02:20:34.125 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:34.120+0000 7f1e177076c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f1e100fa480 con 0x7f1e1010c5f0 2026-02-13T02:20:34.126 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:34.120+0000 7f1e177076c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f1e100fa640 con 0x7f1e100f4c70 2026-02-13T02:20:34.126 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:34.120+0000 7f1e14c776c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f1e10112090 0x7f1e10172930 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:20:34.126 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:34.120+0000 7f1e14c776c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f1e10112090 0x7f1e10172930 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:50616/0 (socket says 10.20.193.11:50616) 2026-02-13T02:20:34.126 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:34.120+0000 7f1e14c776c0 1 -- 10.20.193.11:0/4028275188 learned_addr learned my addr 10.20.193.11:0/4028275188 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:20:34.126 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:34.120+0000 7f1e154786c0 1 --2- 10.20.193.11:0/4028275188 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f1e1010c5f0 0x7f1e100f4640 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:20:34.126 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:34.120+0000 7f1e15c796c0 1 --2- 10.20.193.11:0/4028275188 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1e100f4c70 0x7f1e100f9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:20:34.126 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:34.120+0000 7f1e14c776c0 1 -- 10.20.193.11:0/4028275188 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1e100f4c70 msgr2=0x7f1e100f9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:20:34.126 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:34.120+0000 7f1e14c776c0 1 --2- 10.20.193.11:0/4028275188 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1e100f4c70 0x7f1e100f9f40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:34.126 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:34.120+0000 7f1e14c776c0 1 -- 10.20.193.11:0/4028275188 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f1e1010c5f0 msgr2=0x7f1e100f4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:20:34.126 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:34.120+0000 7f1e14c776c0 1 --2- 10.20.193.11:0/4028275188 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f1e1010c5f0 0x7f1e100f4640 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:34.126 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:34.120+0000 7f1e14c776c0 1 -- 10.20.193.11:0/4028275188 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e04009590 con 0x7f1e10112090 2026-02-13T02:20:34.126 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:34.120+0000 7f1e15c796c0 1 --2- 10.20.193.11:0/4028275188 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1e100f4c70 0x7f1e100f9f40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:20:34.127 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:34.120+0000 7f1e14c776c0 1 --2- 10.20.193.11:0/4028275188 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f1e10112090 0x7f1e10172930 secure :-1 s=READY pgs=342 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1e04031f90 tx=0x7f1e040047f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:20:34.127 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:34.120+0000 7f1dfe7fc6c0 1 -- 10.20.193.11:0/4028275188 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1e04002ae0 con 0x7f1e10112090 2026-02-13T02:20:34.127 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:34.120+0000 7f1dfe7fc6c0 1 -- 10.20.193.11:0/4028275188 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1e04002c40 con 0x7f1e10112090 2026-02-13T02:20:34.127 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:34.120+0000 7f1e177076c0 1 -- 10.20.193.11:0/4028275188 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e100fa8c0 con 0x7f1e10112090 2026-02-13T02:20:34.127 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:34.120+0000 7f1dfe7fc6c0 1 -- 10.20.193.11:0/4028275188 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1e040312b0 con 0x7f1e10112090 2026-02-13T02:20:34.127 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:34.120+0000 7f1e177076c0 1 -- 10.20.193.11:0/4028275188 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e100fad90 con 0x7f1e10112090 2026-02-13T02:20:34.127 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:34.121+0000 7f1e177076c0 1 -- 10.20.193.11:0/4028275188 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e1005f220 con 0x7f1e10112090 2026-02-13T02:20:34.127 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:34.122+0000 7f1dfe7fc6c0 1 -- 10.20.193.11:0/4028275188 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7f1e04007260 con 0x7f1e10112090 2026-02-13T02:20:34.128 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:34.123+0000 7f1dfe7fc6c0 1 --2- 10.20.193.11:0/4028275188 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f1dec0b5680 0x7f1dec0d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:20:34.128 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:34.123+0000 7f1e154786c0 1 --2- 10.20.193.11:0/4028275188 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f1dec0b5680 0x7f1dec0d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:20:34.128 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:34.123+0000 7f1dfe7fc6c0 1 -- 10.20.193.11:0/4028275188 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7965+0+0 (secure 0 0 0) 0x7f1e04107ba0 con 0x7f1e10112090 2026-02-13T02:20:34.128 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:34.123+0000 7f1dfe7fc6c0 1 -- 10.20.193.11:0/4028275188 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f1e040ce100 con 0x7f1e10112090 2026-02-13T02:20:34.129 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:34.123+0000 7f1e154786c0 1 --2- 10.20.193.11:0/4028275188 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f1dec0b5680 0x7f1dec0d5b30 secure :-1 s=READY pgs=233 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1e00005980 tx=0x7f1e00005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:20:34.240 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:34.238+0000 7f1e177076c0 1 -- 10.20.193.11:0/4028275188 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f1e1010c9c0 con 0x7f1e10112090 2026-02-13T02:20:34.240 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:34.238+0000 7f1dfe7fc6c0 1 -- 10.20.193.11:0/4028275188 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f1e040d0170 con 0x7f1e10112090 2026-02-13T02:20:34.241 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:20:34.241 INFO:teuthology.orchestra.run.trial011.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:20:34.242 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:34.239+0000 7f1e177076c0 1 -- 10.20.193.11:0/4028275188 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f1dec0b5680 msgr2=0x7f1dec0d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:20:34.242 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:34.239+0000 7f1e177076c0 1 --2- 10.20.193.11:0/4028275188 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f1dec0b5680 0x7f1dec0d5b30 secure :-1 s=READY pgs=233 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1e00005980 tx=0x7f1e00005910 comp rx=0 tx=0).stop 2026-02-13T02:20:34.242 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:34.239+0000 7f1e177076c0 1 -- 10.20.193.11:0/4028275188 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f1e10112090 msgr2=0x7f1e10172930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:20:34.242 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:34.239+0000 7f1e177076c0 1 --2- 10.20.193.11:0/4028275188 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f1e10112090 0x7f1e10172930 secure :-1 s=READY pgs=342 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1e04031f90 tx=0x7f1e040047f0 comp rx=0 tx=0).stop 2026-02-13T02:20:34.242 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:34.239+0000 7f1e177076c0 1 -- 10.20.193.11:0/4028275188 shutdown_connections 2026-02-13T02:20:34.242 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:34.239+0000 7f1e177076c0 1 --2- 10.20.193.11:0/4028275188 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f1dec0b5680 0x7f1dec0d5b30 unknown :-1 s=CLOSED pgs=233 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:34.242 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:34.239+0000 7f1e177076c0 1 --2- 10.20.193.11:0/4028275188 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1e100f4c70 0x7f1e100f9f40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:34.242 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:34.239+0000 7f1e177076c0 1 --2- 10.20.193.11:0/4028275188 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f1e10112090 0x7f1e10172930 unknown :-1 s=CLOSED pgs=342 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:34.242 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:34.239+0000 7f1e177076c0 1 --2- 10.20.193.11:0/4028275188 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f1e1010c5f0 0x7f1e100f4640 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:34.243 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:34.239+0000 7f1e177076c0 1 -- 10.20.193.11:0/4028275188 >> 10.20.193.11:0/4028275188 conn(0x7f1e10062e00 msgr2=0x7f1e10110710 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:20:34.243 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:34.239+0000 7f1e177076c0 1 -- 10.20.193.11:0/4028275188 shutdown_connections 2026-02-13T02:20:34.243 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:34.239+0000 7f1e177076c0 1 -- 10.20.193.11:0/4028275188 wait complete. 2026-02-13T02:20:34.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:34 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/4028275188' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:20:35.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:34 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/4028275188' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:20:35.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:34 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/4028275188' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:20:35.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:35 trial011 ceph-mon[11956]: pgmap v235: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:20:36.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:35 trial060 ceph-mon[14797]: pgmap v235: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:20:36.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:35 trial078 ceph-mon[14969]: pgmap v235: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:20:37.279 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:20:37.405 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:20:37.522 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:37.520+0000 7f821dabb6c0 1 -- 10.20.193.11:0/2161238158 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f821810bd00 msgr2=0x7f8218175a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:20:37.522 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:37.520+0000 7f821dabb6c0 1 --2- 10.20.193.11:0/2161238158 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f821810bd00 0x7f8218175a70 secure :-1 s=READY pgs=343 gs=1 cs=0 l=1 c_cookie=9148153198500907775 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f820c00aa40 tx=0x7f820c02fde0 comp rx=0 tx=0).stop 2026-02-13T02:20:37.522 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:37.520+0000 7f821dabb6c0 1 -- 10.20.193.11:0/2161238158 shutdown_connections 2026-02-13T02:20:37.522 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:37.520+0000 7f821dabb6c0 1 --2- 10.20.193.11:0/2161238158 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f821810bd00 0x7f8218175a70 unknown :-1 s=CLOSED pgs=343 gs=1 cs=0 l=1 c_cookie=9148153198500907775 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:37.523 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:37.520+0000 7f821dabb6c0 1 --2- 10.20.193.11:0/2161238158 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f821810b120 0x7f821810b550 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:37.523 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:37.520+0000 7f821dabb6c0 1 --2- 10.20.193.11:0/2161238158 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f821810dad0 0x7f821810dea0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:37.523 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:37.520+0000 7f821dabb6c0 1 -- 10.20.193.11:0/2161238158 >> 10.20.193.11:0/2161238158 conn(0x7f8218062e00 msgr2=0x7f8218109660 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:20:37.523 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:37.520+0000 7f821dabb6c0 1 -- 10.20.193.11:0/2161238158 shutdown_connections 2026-02-13T02:20:37.523 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:37.520+0000 7f821dabb6c0 1 -- 10.20.193.11:0/2161238158 wait complete. 2026-02-13T02:20:37.523 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:37.520+0000 7f821dabb6c0 1 Processor -- start 2026-02-13T02:20:37.523 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:37.520+0000 7f821dabb6c0 1 -- start start 2026-02-13T02:20:37.523 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:37.520+0000 7f821dabb6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f821810b120 0x7f82180f5140 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:20:37.523 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:37.520+0000 7f821dabb6c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f821810bd00 0x7f82180f5680 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:20:37.523 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:37.520+0000 7f821dabb6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f821810dad0 0x7f82180faa40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:20:37.523 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:37.520+0000 7f821dabb6c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f82180fb090 con 0x7f821810dad0 2026-02-13T02:20:37.523 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:37.520+0000 7f821dabb6c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f82180fb200 con 0x7f821810bd00 2026-02-13T02:20:37.523 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:37.520+0000 7f821dabb6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f82180fb3c0 con 0x7f821810b120 2026-02-13T02:20:37.523 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:37.520+0000 7f8217fff6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f821810dad0 0x7f82180faa40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:20:37.523 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:37.520+0000 7f8217fff6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f821810dad0 0x7f82180faa40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:50642/0 (socket says 10.20.193.11:50642) 2026-02-13T02:20:37.523 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:37.520+0000 7f8217fff6c0 1 -- 10.20.193.11:0/391181748 learned_addr learned my addr 10.20.193.11:0/391181748 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:20:37.523 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:37.520+0000 7f8217fff6c0 1 -- 10.20.193.11:0/391181748 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f821810b120 msgr2=0x7f82180f5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:20:37.523 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:37.520+0000 7f8217fff6c0 1 --2- 10.20.193.11:0/391181748 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f821810b120 0x7f82180f5140 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:37.523 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:37.520+0000 7f8216ffd6c0 1 --2- 10.20.193.11:0/391181748 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f821810bd00 0x7f82180f5680 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:20:37.523 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:37.520+0000 7f8217fff6c0 1 -- 10.20.193.11:0/391181748 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f821810bd00 msgr2=0x7f82180f5680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:20:37.523 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:37.520+0000 7f8217fff6c0 1 --2- 10.20.193.11:0/391181748 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f821810bd00 0x7f82180f5680 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:37.523 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:37.520+0000 7f8217fff6c0 1 -- 10.20.193.11:0/391181748 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f820c00a660 con 0x7f821810dad0 2026-02-13T02:20:37.523 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:37.520+0000 7f8216ffd6c0 1 --2- 10.20.193.11:0/391181748 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f821810bd00 0x7f82180f5680 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:20:37.523 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:37.520+0000 7f8217fff6c0 1 --2- 10.20.193.11:0/391181748 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f821810dad0 0x7f82180faa40 secure :-1 s=READY pgs=344 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f820c00ab40 tx=0x7f820c0054b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:20:37.523 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:37.521+0000 7f8214ff96c0 1 -- 10.20.193.11:0/391181748 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f820c003a30 con 0x7f821810dad0 2026-02-13T02:20:37.523 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:37.521+0000 7f8214ff96c0 1 -- 10.20.193.11:0/391181748 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f820c003b90 con 0x7f821810dad0 2026-02-13T02:20:37.523 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:37.521+0000 7f8214ff96c0 1 -- 10.20.193.11:0/391181748 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f820c038380 con 0x7f821810dad0 2026-02-13T02:20:37.524 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:37.521+0000 7f821dabb6c0 1 -- 10.20.193.11:0/391181748 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82180fb640 con 0x7f821810dad0 2026-02-13T02:20:37.524 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:37.521+0000 7f821dabb6c0 1 -- 10.20.193.11:0/391181748 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82180fb8c0 con 0x7f821810dad0 2026-02-13T02:20:37.524 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:37.521+0000 7f821dabb6c0 1 -- 10.20.193.11:0/391181748 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f821810c130 con 0x7f821810dad0 2026-02-13T02:20:37.524 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:37.522+0000 7f8214ff96c0 1 -- 10.20.193.11:0/391181748 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7f820c003d00 con 0x7f821810dad0 2026-02-13T02:20:37.525 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:37.523+0000 7f8214ff96c0 1 --2- 10.20.193.11:0/391181748 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f81ec0b5680 0x7f81ec0d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:20:37.525 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:37.523+0000 7f8214ff96c0 1 -- 10.20.193.11:0/391181748 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7965+0+0 (secure 0 0 0) 0x7f820c108d20 con 0x7f821810dad0 2026-02-13T02:20:37.525 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:37.523+0000 7f82177fe6c0 1 --2- 10.20.193.11:0/391181748 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f81ec0b5680 0x7f81ec0d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:20:37.525 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:37.523+0000 7f8214ff96c0 1 -- 10.20.193.11:0/391181748 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f820c0cb820 con 0x7f821810dad0 2026-02-13T02:20:37.525 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:37.523+0000 7f82177fe6c0 1 --2- 10.20.193.11:0/391181748 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f81ec0b5680 0x7f81ec0d5b30 secure :-1 s=READY pgs=234 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8204004750 tx=0x7f8204009410 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:20:37.640 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:37.639+0000 7f821dabb6c0 1 -- 10.20.193.11:0/391181748 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f821810b550 con 0x7f821810dad0 2026-02-13T02:20:37.640 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:37.639+0000 7f8214ff96c0 1 -- 10.20.193.11:0/391181748 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f820c0ce9d0 con 0x7f821810dad0 2026-02-13T02:20:37.641 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:20:37.641 INFO:teuthology.orchestra.run.trial011.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:20:37.641 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:37.640+0000 7f821dabb6c0 1 -- 10.20.193.11:0/391181748 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f81ec0b5680 msgr2=0x7f81ec0d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:20:37.641 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:37.640+0000 7f821dabb6c0 1 --2- 10.20.193.11:0/391181748 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f81ec0b5680 0x7f81ec0d5b30 secure :-1 s=READY pgs=234 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8204004750 tx=0x7f8204009410 comp rx=0 tx=0).stop 2026-02-13T02:20:37.641 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:37.640+0000 7f821dabb6c0 1 -- 10.20.193.11:0/391181748 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f821810dad0 msgr2=0x7f82180faa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:20:37.641 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:37.640+0000 7f821dabb6c0 1 --2- 10.20.193.11:0/391181748 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f821810dad0 0x7f82180faa40 secure :-1 s=READY pgs=344 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f820c00ab40 tx=0x7f820c0054b0 comp rx=0 tx=0).stop 2026-02-13T02:20:37.642 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:37.640+0000 7f821dabb6c0 1 -- 10.20.193.11:0/391181748 shutdown_connections 2026-02-13T02:20:37.642 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:37.640+0000 7f821dabb6c0 1 --2- 10.20.193.11:0/391181748 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f81ec0b5680 0x7f81ec0d5b30 unknown :-1 s=CLOSED pgs=234 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:37.642 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:37.640+0000 7f821dabb6c0 1 --2- 10.20.193.11:0/391181748 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f821810bd00 0x7f82180f5680 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:37.642 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:37.640+0000 7f821dabb6c0 1 --2- 10.20.193.11:0/391181748 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f821810dad0 0x7f82180faa40 unknown :-1 s=CLOSED pgs=344 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:37.642 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:37.640+0000 7f821dabb6c0 1 --2- 10.20.193.11:0/391181748 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f821810b120 0x7f82180f5140 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:37.642 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:37.640+0000 7f821dabb6c0 1 -- 10.20.193.11:0/391181748 >> 10.20.193.11:0/391181748 conn(0x7f8218062e00 msgr2=0x7f82180efa00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:20:37.642 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:37.640+0000 7f821dabb6c0 1 -- 10.20.193.11:0/391181748 shutdown_connections 2026-02-13T02:20:37.642 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:37.640+0000 7f821dabb6c0 1 -- 10.20.193.11:0/391181748 wait complete. 2026-02-13T02:20:37.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:37 trial011 ceph-mon[11956]: pgmap v236: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:20:38.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:37 trial060 ceph-mon[14797]: pgmap v236: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:20:38.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:37 trial078 ceph-mon[14969]: pgmap v236: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:20:38.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:38 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/391181748' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:20:39.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:38 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/391181748' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:20:39.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:38 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/391181748' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:20:39.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:39 trial011 ceph-mon[11956]: pgmap v237: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:20:40.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:39 trial060 ceph-mon[14797]: pgmap v237: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:20:40.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:39 trial078 ceph-mon[14969]: pgmap v237: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:20:40.680 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:20:40.808 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:20:40.922 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:40.918+0000 7fd669eb86c0 1 -- 10.20.193.11:0/36085545 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fd66410fc20 msgr2=0x7fd664114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:20:40.922 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:40.918+0000 7fd669eb86c0 1 --2- 10.20.193.11:0/36085545 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fd66410fc20 0x7fd664114c60 secure :-1 s=READY pgs=345 gs=1 cs=0 l=1 c_cookie=4561049405157911340 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd6540099a0 tx=0x7fd65402ed20 comp rx=0 tx=0).stop 2026-02-13T02:20:40.922 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:40.918+0000 7fd669eb86c0 1 -- 10.20.193.11:0/36085545 shutdown_connections 2026-02-13T02:20:40.922 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:40.918+0000 7fd669eb86c0 1 --2- 10.20.193.11:0/36085545 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fd664115440 0x7fd664175de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:40.922 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:40.918+0000 7fd669eb86c0 1 --2- 10.20.193.11:0/36085545 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fd66410fc20 0x7fd664114c60 unknown :-1 s=CLOSED pgs=345 gs=1 cs=0 l=1 c_cookie=4561049405157911340 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:40.922 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:40.918+0000 7fd669eb86c0 1 --2- 10.20.193.11:0/36085545 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd66410f230 0x7fd66410f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:40.922 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:40.918+0000 7fd669eb86c0 1 -- 10.20.193.11:0/36085545 >> 10.20.193.11:0/36085545 conn(0x7fd6640ecb30 msgr2=0x7fd66410cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:20:40.923 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:40.918+0000 7fd669eb86c0 1 -- 10.20.193.11:0/36085545 shutdown_connections 2026-02-13T02:20:40.923 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:40.918+0000 7fd669eb86c0 1 -- 10.20.193.11:0/36085545 wait complete. 2026-02-13T02:20:40.923 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:40.918+0000 7fd669eb86c0 1 Processor -- start 2026-02-13T02:20:40.923 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:40.918+0000 7fd669eb86c0 1 -- start start 2026-02-13T02:20:40.923 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:40.918+0000 7fd669eb86c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd66410f230 0x7fd6640f4c50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:20:40.923 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:40.918+0000 7fd669eb86c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fd664115440 0x7fd664175ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:20:40.923 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:40.918+0000 7fd669eb86c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fd6640f5280 0x7fd6640fa550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:20:40.923 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:40.918+0000 7fd669eb86c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7fd6640f5970 con 0x7fd664115440 2026-02-13T02:20:40.923 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:40.918+0000 7fd669eb86c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd6640faa90 con 0x7fd6640f5280 2026-02-13T02:20:40.923 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:40.918+0000 7fd669eb86c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fd6640fac50 con 0x7fd66410f230 2026-02-13T02:20:40.923 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:40.918+0000 7fd662ffd6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fd664115440 0x7fd664175ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:20:40.923 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:40.918+0000 7fd662ffd6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fd664115440 0x7fd664175ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:47412/0 (socket says 10.20.193.11:47412) 2026-02-13T02:20:40.924 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:40.918+0000 7fd662ffd6c0 1 -- 10.20.193.11:0/741091733 learned_addr learned my addr 10.20.193.11:0/741091733 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:20:40.924 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:40.918+0000 7fd663fff6c0 1 --2- 10.20.193.11:0/741091733 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fd6640f5280 0x7fd6640fa550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:20:40.924 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:40.918+0000 7fd6637fe6c0 1 --2- 10.20.193.11:0/741091733 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd66410f230 0x7fd6640f4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:20:40.924 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:40.919+0000 7fd662ffd6c0 1 -- 10.20.193.11:0/741091733 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd66410f230 msgr2=0x7fd6640f4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:20:40.924 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:40.919+0000 7fd662ffd6c0 1 --2- 10.20.193.11:0/741091733 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd66410f230 0x7fd6640f4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:40.924 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:40.919+0000 7fd662ffd6c0 1 -- 10.20.193.11:0/741091733 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fd6640f5280 msgr2=0x7fd6640fa550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:20:40.924 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:40.919+0000 7fd662ffd6c0 1 --2- 10.20.193.11:0/741091733 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fd6640f5280 0x7fd6640fa550 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:40.924 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:40.919+0000 7fd662ffd6c0 1 -- 10.20.193.11:0/741091733 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd654009590 con 0x7fd664115440 2026-02-13T02:20:40.924 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:40.919+0000 7fd6637fe6c0 1 --2- 10.20.193.11:0/741091733 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd66410f230 0x7fd6640f4c50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:20:40.924 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:40.919+0000 7fd662ffd6c0 1 --2- 10.20.193.11:0/741091733 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fd664115440 0x7fd664175ce0 secure :-1 s=READY pgs=346 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd654031f90 tx=0x7fd6540047f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:20:40.924 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:40.919+0000 7fd660ff96c0 1 -- 10.20.193.11:0/741091733 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd654002ae0 con 0x7fd664115440 2026-02-13T02:20:40.924 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:40.919+0000 7fd660ff96c0 1 -- 10.20.193.11:0/741091733 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd654002c40 con 0x7fd664115440 2026-02-13T02:20:40.925 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:40.919+0000 7fd669eb86c0 1 -- 10.20.193.11:0/741091733 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6640faed0 con 0x7fd664115440 2026-02-13T02:20:40.925 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:40.919+0000 7fd660ff96c0 1 -- 10.20.193.11:0/741091733 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd6540312b0 con 0x7fd664115440 2026-02-13T02:20:40.925 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:40.919+0000 7fd669eb86c0 1 -- 10.20.193.11:0/741091733 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6640fb3a0 con 0x7fd664115440 2026-02-13T02:20:40.925 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:40.919+0000 7fd669eb86c0 1 -- 10.20.193.11:0/741091733 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd664110500 con 0x7fd664115440 2026-02-13T02:20:40.926 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:40.920+0000 7fd660ff96c0 1 -- 10.20.193.11:0/741091733 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7fd654007260 con 0x7fd664115440 2026-02-13T02:20:40.926 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:40.921+0000 7fd660ff96c0 1 --2- 10.20.193.11:0/741091733 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fd6380b5680 0x7fd6380d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:20:40.926 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:40.921+0000 7fd660ff96c0 1 -- 10.20.193.11:0/741091733 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7965+0+0 (secure 0 0 0) 0x7fd654107bb0 con 0x7fd664115440 2026-02-13T02:20:40.926 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:40.921+0000 7fd6637fe6c0 1 --2- 10.20.193.11:0/741091733 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fd6380b5680 0x7fd6380d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:20:40.926 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:40.921+0000 7fd6637fe6c0 1 --2- 10.20.193.11:0/741091733 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fd6380b5680 0x7fd6380d5b30 secure :-1 s=READY pgs=235 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd650004750 tx=0x7fd650005f10 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:20:40.926 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:40.922+0000 7fd660ff96c0 1 -- 10.20.193.11:0/741091733 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fd6540ca670 con 0x7fd664115440 2026-02-13T02:20:41.041 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:41.039+0000 7fd669eb86c0 1 -- 10.20.193.11:0/741091733 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fd66410f600 con 0x7fd664115440 2026-02-13T02:20:41.041 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:41.039+0000 7fd660ff96c0 1 -- 10.20.193.11:0/741091733 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fd6540077d0 con 0x7fd664115440 2026-02-13T02:20:41.042 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:20:41.042 INFO:teuthology.orchestra.run.trial011.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:20:41.043 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:41.040+0000 7fd669eb86c0 1 -- 10.20.193.11:0/741091733 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fd6380b5680 msgr2=0x7fd6380d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:20:41.043 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:41.040+0000 7fd669eb86c0 1 --2- 10.20.193.11:0/741091733 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fd6380b5680 0x7fd6380d5b30 secure :-1 s=READY pgs=235 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd650004750 tx=0x7fd650005f10 comp rx=0 tx=0).stop 2026-02-13T02:20:41.043 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:41.040+0000 7fd669eb86c0 1 -- 10.20.193.11:0/741091733 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fd664115440 msgr2=0x7fd664175ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:20:41.043 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:41.040+0000 7fd669eb86c0 1 --2- 10.20.193.11:0/741091733 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fd664115440 0x7fd664175ce0 secure :-1 s=READY pgs=346 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd654031f90 tx=0x7fd6540047f0 comp rx=0 tx=0).stop 2026-02-13T02:20:41.043 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:41.040+0000 7fd669eb86c0 1 -- 10.20.193.11:0/741091733 shutdown_connections 2026-02-13T02:20:41.043 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:41.040+0000 7fd669eb86c0 1 --2- 10.20.193.11:0/741091733 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fd6380b5680 0x7fd6380d5b30 unknown :-1 s=CLOSED pgs=235 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:41.043 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:41.040+0000 7fd669eb86c0 1 --2- 10.20.193.11:0/741091733 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fd6640f5280 0x7fd6640fa550 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:41.043 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:41.040+0000 7fd669eb86c0 1 --2- 10.20.193.11:0/741091733 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fd664115440 0x7fd664175ce0 unknown :-1 s=CLOSED pgs=346 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:41.043 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:41.040+0000 7fd669eb86c0 1 --2- 10.20.193.11:0/741091733 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd66410f230 0x7fd6640f4c50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:41.044 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:41.040+0000 7fd669eb86c0 1 -- 10.20.193.11:0/741091733 >> 10.20.193.11:0/741091733 conn(0x7fd6640ecb30 msgr2=0x7fd664111c00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:20:41.044 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:41.040+0000 7fd669eb86c0 1 -- 10.20.193.11:0/741091733 shutdown_connections 2026-02-13T02:20:41.044 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:41.040+0000 7fd669eb86c0 1 -- 10.20.193.11:0/741091733 wait complete. 2026-02-13T02:20:41.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:41 trial011 ceph-mon[11956]: pgmap v238: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:20:41.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:41 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/741091733' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:20:42.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:41 trial060 ceph-mon[14797]: pgmap v238: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:20:42.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:41 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/741091733' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:20:42.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:41 trial078 ceph-mon[14969]: pgmap v238: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:20:42.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:41 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/741091733' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:20:43.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:43 trial011 ceph-mon[11956]: pgmap v239: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T02:20:44.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:43 trial060 ceph-mon[14797]: pgmap v239: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T02:20:44.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:43 trial078 ceph-mon[14969]: pgmap v239: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T02:20:44.083 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:20:44.209 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:20:44.327 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:44.322+0000 7f5d7eec76c0 1 -- 10.20.193.11:0/486708791 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f5d7810bd00 msgr2=0x7f5d78175a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:20:44.327 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:44.322+0000 7f5d7eec76c0 1 --2- 10.20.193.11:0/486708791 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f5d7810bd00 0x7f5d78175a70 secure :-1 s=READY pgs=347 gs=1 cs=0 l=1 c_cookie=17302714639939838842 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5d7400aa40 tx=0x7f5d7402fde0 comp rx=0 tx=0).stop 2026-02-13T02:20:44.327 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:44.322+0000 7f5d7eec76c0 1 -- 10.20.193.11:0/486708791 shutdown_connections 2026-02-13T02:20:44.327 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:44.322+0000 7f5d7eec76c0 1 --2- 10.20.193.11:0/486708791 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f5d7810bd00 0x7f5d78175a70 unknown :-1 s=CLOSED pgs=347 gs=1 cs=0 l=1 c_cookie=17302714639939838842 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:44.327 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:44.322+0000 7f5d7eec76c0 1 --2- 10.20.193.11:0/486708791 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f5d7810b120 0x7f5d7810b550 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:44.327 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:44.322+0000 7f5d7eec76c0 1 --2- 10.20.193.11:0/486708791 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f5d7810dad0 0x7f5d7810dea0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:44.327 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:44.322+0000 7f5d7eec76c0 1 -- 10.20.193.11:0/486708791 >> 10.20.193.11:0/486708791 conn(0x7f5d78062e00 msgr2=0x7f5d78109660 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:20:44.327 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:44.323+0000 7f5d7eec76c0 1 -- 10.20.193.11:0/486708791 shutdown_connections 2026-02-13T02:20:44.328 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:44.323+0000 7f5d7eec76c0 1 -- 10.20.193.11:0/486708791 wait complete. 2026-02-13T02:20:44.328 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:44.323+0000 7f5d7eec76c0 1 Processor -- start 2026-02-13T02:20:44.328 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:44.323+0000 7f5d7eec76c0 1 -- start start 2026-02-13T02:20:44.328 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:44.323+0000 7f5d7eec76c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f5d7810b120 0x7f5d780f51d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:20:44.328 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:44.323+0000 7f5d7eec76c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f5d7810bd00 0x7f5d780f5710 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:20:44.328 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:44.323+0000 7f5d7eec76c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f5d7810dad0 0x7f5d780faad0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:20:44.328 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:44.323+0000 7f5d7eec76c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f5d780fb120 con 0x7f5d7810dad0 2026-02-13T02:20:44.328 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:44.323+0000 7f5d7eec76c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f5d780fb290 con 0x7f5d7810b120 2026-02-13T02:20:44.328 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:44.323+0000 7f5d7eec76c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f5d780fb450 con 0x7f5d7810bd00 2026-02-13T02:20:44.328 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:44.323+0000 7f5d7d4396c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f5d7810dad0 0x7f5d780faad0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:20:44.328 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:44.323+0000 7f5d7d4396c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f5d7810dad0 0x7f5d780faad0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:47434/0 (socket says 10.20.193.11:47434) 2026-02-13T02:20:44.328 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:44.323+0000 7f5d7d4396c0 1 -- 10.20.193.11:0/3162211799 learned_addr learned my addr 10.20.193.11:0/3162211799 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:20:44.329 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:44.323+0000 7f5d7cc386c0 1 --2- 10.20.193.11:0/3162211799 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f5d7810b120 0x7f5d780f51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:20:44.329 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:44.323+0000 7f5d7d4396c0 1 -- 10.20.193.11:0/3162211799 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f5d7810bd00 msgr2=0x7f5d780f5710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:20:44.329 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:44.323+0000 7f5d7d4396c0 1 --2- 10.20.193.11:0/3162211799 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f5d7810bd00 0x7f5d780f5710 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:44.329 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:44.323+0000 7f5d7d4396c0 1 -- 10.20.193.11:0/3162211799 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f5d7810b120 msgr2=0x7f5d780f51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:20:44.329 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:44.323+0000 7f5d7d4396c0 1 --2- 10.20.193.11:0/3162211799 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f5d7810b120 0x7f5d780f51d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:44.329 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:44.323+0000 7f5d7d4396c0 1 -- 10.20.193.11:0/3162211799 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d7400a660 con 0x7f5d7810dad0 2026-02-13T02:20:44.329 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:44.323+0000 7f5d7d4396c0 1 --2- 10.20.193.11:0/3162211799 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f5d7810dad0 0x7f5d780faad0 secure :-1 s=READY pgs=348 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5d7400ab40 tx=0x7f5d740054b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:20:44.329 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:44.323+0000 7f5d6dffb6c0 1 -- 10.20.193.11:0/3162211799 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5d74003a30 con 0x7f5d7810dad0 2026-02-13T02:20:44.329 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:44.323+0000 7f5d6dffb6c0 1 -- 10.20.193.11:0/3162211799 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f5d74003b90 con 0x7f5d7810dad0 2026-02-13T02:20:44.329 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:44.323+0000 7f5d6dffb6c0 1 -- 10.20.193.11:0/3162211799 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5d74038380 con 0x7f5d7810dad0 2026-02-13T02:20:44.329 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:44.323+0000 7f5d7eec76c0 1 -- 10.20.193.11:0/3162211799 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d780fb6d0 con 0x7f5d7810dad0 2026-02-13T02:20:44.329 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:44.323+0000 7f5d7eec76c0 1 -- 10.20.193.11:0/3162211799 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d780fb950 con 0x7f5d7810dad0 2026-02-13T02:20:44.329 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:44.324+0000 7f5d7eec76c0 1 -- 10.20.193.11:0/3162211799 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d7810c130 con 0x7f5d7810dad0 2026-02-13T02:20:44.330 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:44.325+0000 7f5d6dffb6c0 1 -- 10.20.193.11:0/3162211799 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7f5d74003d00 con 0x7f5d7810dad0 2026-02-13T02:20:44.330 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:44.325+0000 7f5d6dffb6c0 1 --2- 10.20.193.11:0/3162211799 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f5d540b5680 0x7f5d540d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:20:44.331 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:44.326+0000 7f5d6dffb6c0 1 -- 10.20.193.11:0/3162211799 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7965+0+0 (secure 0 0 0) 0x7f5d74108cf0 con 0x7f5d7810dad0 2026-02-13T02:20:44.331 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:44.326+0000 7f5d7cc386c0 1 --2- 10.20.193.11:0/3162211799 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f5d540b5680 0x7f5d540d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:20:44.331 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:44.326+0000 7f5d7cc386c0 1 --2- 10.20.193.11:0/3162211799 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f5d540b5680 0x7f5d540d5b30 secure :-1 s=READY pgs=236 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5d68005980 tx=0x7f5d68005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:20:44.331 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:44.326+0000 7f5d6dffb6c0 1 -- 10.20.193.11:0/3162211799 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f5d740cb7f0 con 0x7f5d7810dad0 2026-02-13T02:20:44.447 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:44.444+0000 7f5d7eec76c0 1 -- 10.20.193.11:0/3162211799 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f5d7810b550 con 0x7f5d7810dad0 2026-02-13T02:20:44.447 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:44.445+0000 7f5d6dffb6c0 1 -- 10.20.193.11:0/3162211799 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f5d740ce9a0 con 0x7f5d7810dad0 2026-02-13T02:20:44.447 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:20:44.447 INFO:teuthology.orchestra.run.trial011.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:20:44.448 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:44.446+0000 7f5d7eec76c0 1 -- 10.20.193.11:0/3162211799 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f5d540b5680 msgr2=0x7f5d540d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:20:44.449 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:44.446+0000 7f5d7eec76c0 1 --2- 10.20.193.11:0/3162211799 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f5d540b5680 0x7f5d540d5b30 secure :-1 s=READY pgs=236 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5d68005980 tx=0x7f5d68005910 comp rx=0 tx=0).stop 2026-02-13T02:20:44.449 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:44.446+0000 7f5d7eec76c0 1 -- 10.20.193.11:0/3162211799 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f5d7810dad0 msgr2=0x7f5d780faad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:20:44.449 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:44.446+0000 7f5d7eec76c0 1 --2- 10.20.193.11:0/3162211799 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f5d7810dad0 0x7f5d780faad0 secure :-1 s=READY pgs=348 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5d7400ab40 tx=0x7f5d740054b0 comp rx=0 tx=0).stop 2026-02-13T02:20:44.449 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:44.446+0000 7f5d7eec76c0 1 -- 10.20.193.11:0/3162211799 shutdown_connections 2026-02-13T02:20:44.449 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:44.446+0000 7f5d7eec76c0 1 --2- 10.20.193.11:0/3162211799 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f5d540b5680 0x7f5d540d5b30 unknown :-1 s=CLOSED pgs=236 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:44.449 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:44.446+0000 7f5d7eec76c0 1 --2- 10.20.193.11:0/3162211799 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f5d7810dad0 0x7f5d780faad0 unknown :-1 s=CLOSED pgs=348 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:44.449 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:44.446+0000 7f5d7eec76c0 1 --2- 10.20.193.11:0/3162211799 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f5d7810bd00 0x7f5d780f5710 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:44.449 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:44.446+0000 7f5d7eec76c0 1 --2- 10.20.193.11:0/3162211799 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f5d7810b120 0x7f5d780f51d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:44.449 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:44.446+0000 7f5d7eec76c0 1 -- 10.20.193.11:0/3162211799 >> 10.20.193.11:0/3162211799 conn(0x7f5d78062e00 msgr2=0x7f5d780ee960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:20:44.449 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:44.446+0000 7f5d7eec76c0 1 -- 10.20.193.11:0/3162211799 shutdown_connections 2026-02-13T02:20:44.450 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:44.446+0000 7f5d7eec76c0 1 -- 10.20.193.11:0/3162211799 wait complete. 2026-02-13T02:20:44.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:44 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/3162211799' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:20:45.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:44 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/3162211799' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:20:45.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:44 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/3162211799' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:20:45.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:45 trial011 ceph-mon[11956]: pgmap v240: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:20:46.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:45 trial060 ceph-mon[14797]: pgmap v240: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:20:46.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:45 trial078 ceph-mon[14969]: pgmap v240: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:20:47.486 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:20:47.610 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:20:47.724 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:47.719+0000 7fdb930606c0 1 -- 10.20.193.11:0/2946563197 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fdb8c10fc20 msgr2=0x7fdb8c114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:20:47.724 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:47.719+0000 7fdb930606c0 1 --2- 10.20.193.11:0/2946563197 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fdb8c10fc20 0x7fdb8c114c60 secure :-1 s=READY pgs=349 gs=1 cs=0 l=1 c_cookie=3653111133169156898 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdb740099a0 tx=0x7fdb7402ed20 comp rx=0 tx=0).stop 2026-02-13T02:20:47.724 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:47.719+0000 7fdb930606c0 1 -- 10.20.193.11:0/2946563197 shutdown_connections 2026-02-13T02:20:47.724 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:47.719+0000 7fdb930606c0 1 --2- 10.20.193.11:0/2946563197 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fdb8c115440 0x7fdb8c175de0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:47.724 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:47.719+0000 7fdb930606c0 1 --2- 10.20.193.11:0/2946563197 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fdb8c10fc20 0x7fdb8c114c60 unknown :-1 s=CLOSED pgs=349 gs=1 cs=0 l=1 c_cookie=3653111133169156898 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:47.725 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:47.719+0000 7fdb930606c0 1 --2- 10.20.193.11:0/2946563197 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fdb8c10f230 0x7fdb8c10f600 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:47.725 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:47.719+0000 7fdb930606c0 1 -- 10.20.193.11:0/2946563197 >> 10.20.193.11:0/2946563197 conn(0x7fdb8c0ecb30 msgr2=0x7fdb8c10cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:20:47.725 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:47.719+0000 7fdb930606c0 1 -- 10.20.193.11:0/2946563197 shutdown_connections 2026-02-13T02:20:47.725 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:47.719+0000 7fdb930606c0 1 -- 10.20.193.11:0/2946563197 wait complete. 2026-02-13T02:20:47.725 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:47.719+0000 7fdb930606c0 1 Processor -- start 2026-02-13T02:20:47.725 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:47.719+0000 7fdb930606c0 1 -- start start 2026-02-13T02:20:47.725 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:47.719+0000 7fdb930606c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fdb8c10f230 0x7fdb8c0f4c50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:20:47.725 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:47.719+0000 7fdb930606c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fdb8c115440 0x7fdb8c175ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:20:47.725 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:47.719+0000 7fdb930606c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fdb8c0f5280 0x7fdb8c0fa550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:20:47.725 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:47.719+0000 7fdb930606c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7fdb8c0f5970 con 0x7fdb8c115440 2026-02-13T02:20:47.725 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:47.719+0000 7fdb930606c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7fdb8c0faa90 con 0x7fdb8c10f230 2026-02-13T02:20:47.726 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:47.719+0000 7fdb930606c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fdb8c0fac50 con 0x7fdb8c0f5280 2026-02-13T02:20:47.726 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:47.720+0000 7fdb83fff6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fdb8c115440 0x7fdb8c175ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:20:47.726 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:47.720+0000 7fdb90dd56c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fdb8c10f230 0x7fdb8c0f4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:20:47.726 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:47.720+0000 7fdb83fff6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fdb8c115440 0x7fdb8c175ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:47454/0 (socket says 10.20.193.11:47454) 2026-02-13T02:20:47.726 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:47.720+0000 7fdb83fff6c0 1 -- 10.20.193.11:0/999910770 learned_addr learned my addr 10.20.193.11:0/999910770 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:20:47.726 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:47.720+0000 7fdb915d66c0 1 --2- 10.20.193.11:0/999910770 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fdb8c0f5280 0x7fdb8c0fa550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:20:47.726 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:47.720+0000 7fdb83fff6c0 1 -- 10.20.193.11:0/999910770 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fdb8c0f5280 msgr2=0x7fdb8c0fa550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:20:47.726 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:47.720+0000 7fdb83fff6c0 1 --2- 10.20.193.11:0/999910770 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fdb8c0f5280 0x7fdb8c0fa550 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:47.726 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:47.720+0000 7fdb83fff6c0 1 -- 10.20.193.11:0/999910770 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fdb8c10f230 msgr2=0x7fdb8c0f4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:20:47.726 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:47.720+0000 7fdb83fff6c0 1 --2- 10.20.193.11:0/999910770 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fdb8c10f230 0x7fdb8c0f4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:47.726 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:47.720+0000 7fdb83fff6c0 1 -- 10.20.193.11:0/999910770 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb74009590 con 0x7fdb8c115440 2026-02-13T02:20:47.727 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:47.720+0000 7fdb90dd56c0 1 --2- 10.20.193.11:0/999910770 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fdb8c10f230 0x7fdb8c0f4c50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T02:20:47.727 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:47.720+0000 7fdb83fff6c0 1 --2- 10.20.193.11:0/999910770 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fdb8c115440 0x7fdb8c175ce0 secure :-1 s=READY pgs=350 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdb74031f90 tx=0x7fdb740047f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:20:47.727 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:47.720+0000 7fdb81ffb6c0 1 -- 10.20.193.11:0/999910770 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdb74002ae0 con 0x7fdb8c115440 2026-02-13T02:20:47.727 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:47.720+0000 7fdb930606c0 1 -- 10.20.193.11:0/999910770 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb8c0faed0 con 0x7fdb8c115440 2026-02-13T02:20:47.727 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:47.720+0000 7fdb81ffb6c0 1 -- 10.20.193.11:0/999910770 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fdb74007740 con 0x7fdb8c115440 2026-02-13T02:20:47.727 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:47.720+0000 7fdb81ffb6c0 1 -- 10.20.193.11:0/999910770 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdb74031560 con 0x7fdb8c115440 2026-02-13T02:20:47.727 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:47.720+0000 7fdb930606c0 1 -- 10.20.193.11:0/999910770 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb8c0fb3a0 con 0x7fdb8c115440 2026-02-13T02:20:47.727 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:47.720+0000 7fdb930606c0 1 -- 10.20.193.11:0/999910770 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb8c110500 con 0x7fdb8c115440 2026-02-13T02:20:47.727 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:47.722+0000 7fdb81ffb6c0 1 -- 10.20.193.11:0/999910770 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7fdb74002c40 con 0x7fdb8c115440 2026-02-13T02:20:47.728 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:47.723+0000 7fdb81ffb6c0 1 --2- 10.20.193.11:0/999910770 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fdb680b5600 0x7fdb680d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:20:47.728 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:47.723+0000 7fdb90dd56c0 1 --2- 10.20.193.11:0/999910770 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fdb680b5600 0x7fdb680d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:20:47.728 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:47.723+0000 7fdb81ffb6c0 1 -- 10.20.193.11:0/999910770 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7965+0+0 (secure 0 0 0) 0x7fdb74107b20 con 0x7fdb8c115440 2026-02-13T02:20:47.729 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:47.723+0000 7fdb90dd56c0 1 --2- 10.20.193.11:0/999910770 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fdb680b5600 0x7fdb680d5ab0 secure :-1 s=READY pgs=237 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdb7c004750 tx=0x7fdb7c009390 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:20:47.729 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:47.723+0000 7fdb81ffb6c0 1 -- 10.20.193.11:0/999910770 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fdb740ce080 con 0x7fdb8c115440 2026-02-13T02:20:47.840 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:47.838+0000 7fdb930606c0 1 -- 10.20.193.11:0/999910770 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fdb8c10f600 con 0x7fdb8c115440 2026-02-13T02:20:47.840 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:47 trial011 ceph-mon[11956]: pgmap v241: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:20:47.841 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:47.838+0000 7fdb81ffb6c0 1 -- 10.20.193.11:0/999910770 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fdb740cd7d0 con 0x7fdb8c115440 2026-02-13T02:20:47.841 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:20:47.841 INFO:teuthology.orchestra.run.trial011.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:20:47.842 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:47.839+0000 7fdb930606c0 1 -- 10.20.193.11:0/999910770 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fdb680b5600 msgr2=0x7fdb680d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:20:47.842 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:47.839+0000 7fdb930606c0 1 --2- 10.20.193.11:0/999910770 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fdb680b5600 0x7fdb680d5ab0 secure :-1 s=READY pgs=237 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdb7c004750 tx=0x7fdb7c009390 comp rx=0 tx=0).stop 2026-02-13T02:20:47.842 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:47.839+0000 7fdb930606c0 1 -- 10.20.193.11:0/999910770 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fdb8c115440 msgr2=0x7fdb8c175ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:20:47.842 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:47.839+0000 7fdb930606c0 1 --2- 10.20.193.11:0/999910770 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fdb8c115440 0x7fdb8c175ce0 secure :-1 s=READY pgs=350 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdb74031f90 tx=0x7fdb740047f0 comp rx=0 tx=0).stop 2026-02-13T02:20:47.842 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:47.839+0000 7fdb930606c0 1 -- 10.20.193.11:0/999910770 shutdown_connections 2026-02-13T02:20:47.843 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:47.839+0000 7fdb930606c0 1 --2- 10.20.193.11:0/999910770 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fdb680b5600 0x7fdb680d5ab0 unknown :-1 s=CLOSED pgs=237 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:47.843 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:47.839+0000 7fdb930606c0 1 --2- 10.20.193.11:0/999910770 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fdb8c0f5280 0x7fdb8c0fa550 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:47.843 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:47.839+0000 7fdb930606c0 1 --2- 10.20.193.11:0/999910770 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fdb8c115440 0x7fdb8c175ce0 unknown :-1 s=CLOSED pgs=350 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:47.843 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:47.839+0000 7fdb930606c0 1 --2- 10.20.193.11:0/999910770 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fdb8c10f230 0x7fdb8c0f4c50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:47.843 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:47.839+0000 7fdb930606c0 1 -- 10.20.193.11:0/999910770 >> 10.20.193.11:0/999910770 conn(0x7fdb8c0ecb30 msgr2=0x7fdb8c111c00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:20:47.843 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:47.839+0000 7fdb930606c0 1 -- 10.20.193.11:0/999910770 shutdown_connections 2026-02-13T02:20:47.843 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:47.839+0000 7fdb930606c0 1 -- 10.20.193.11:0/999910770 wait complete. 2026-02-13T02:20:48.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:47 trial060 ceph-mon[14797]: pgmap v241: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:20:48.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:47 trial078 ceph-mon[14969]: pgmap v241: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:20:48.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:48 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/999910770' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:20:49.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:48 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/999910770' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:20:49.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:48 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/999910770' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:20:49.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:49 trial011 ceph-mon[11956]: pgmap v242: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:20:50.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:49 trial060 ceph-mon[14797]: pgmap v242: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:20:50.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:49 trial078 ceph-mon[14969]: pgmap v242: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:20:50.880 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:20:51.007 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:20:51.122 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:51.118+0000 7f90d0ce46c0 1 -- 10.20.193.11:0/647260706 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f90cc10f230 msgr2=0x7f90cc10f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:20:51.123 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:51.118+0000 7f90d0ce46c0 1 --2- 10.20.193.11:0/647260706 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f90cc10f230 0x7f90cc10f600 secure :-1 s=READY pgs=351 gs=1 cs=0 l=1 c_cookie=2262401870018721796 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f90c00099a0 tx=0x7f90c002ed20 comp rx=0 tx=0).stop 2026-02-13T02:20:51.123 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:51.118+0000 7f90d0ce46c0 1 -- 10.20.193.11:0/647260706 shutdown_connections 2026-02-13T02:20:51.123 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:51.118+0000 7f90d0ce46c0 1 --2- 10.20.193.11:0/647260706 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f90cc115440 0x7f90cc175de0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:51.123 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:51.118+0000 7f90d0ce46c0 1 --2- 10.20.193.11:0/647260706 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f90cc10fc20 0x7f90cc114c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:51.123 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:51.118+0000 7f90d0ce46c0 1 --2- 10.20.193.11:0/647260706 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f90cc10f230 0x7f90cc10f600 unknown :-1 s=CLOSED pgs=351 gs=1 cs=0 l=1 c_cookie=2262401870018721796 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:51.123 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:51.118+0000 7f90d0ce46c0 1 -- 10.20.193.11:0/647260706 >> 10.20.193.11:0/647260706 conn(0x7f90cc0ecb30 msgr2=0x7f90cc10cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:20:51.123 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:51.118+0000 7f90d0ce46c0 1 -- 10.20.193.11:0/647260706 shutdown_connections 2026-02-13T02:20:51.123 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:51.118+0000 7f90d0ce46c0 1 -- 10.20.193.11:0/647260706 wait complete. 2026-02-13T02:20:51.123 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:51.119+0000 7f90d0ce46c0 1 Processor -- start 2026-02-13T02:20:51.124 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:51.119+0000 7f90d0ce46c0 1 -- start start 2026-02-13T02:20:51.124 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:51.119+0000 7f90d0ce46c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f90cc10f230 0x7f90cc11d200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:20:51.124 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:51.119+0000 7f90d0ce46c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f90cc115440 0x7f90cc11d740 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:20:51.124 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:51.119+0000 7f90d0ce46c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f90cc122b00 0x7f90cc122fa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:20:51.124 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:51.119+0000 7f90d0ce46c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f90cc123510 con 0x7f90cc10f230 2026-02-13T02:20:51.124 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:51.119+0000 7f90d0ce46c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f90cc123680 con 0x7f90cc122b00 2026-02-13T02:20:51.124 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:51.119+0000 7f90d0ce46c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f90cc123840 con 0x7f90cc115440 2026-02-13T02:20:51.124 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:51.119+0000 7f90ca5756c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f90cc10f230 0x7f90cc11d200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:20:51.124 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:51.119+0000 7f90ca5756c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f90cc10f230 0x7f90cc11d200 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:40922/0 (socket says 10.20.193.11:40922) 2026-02-13T02:20:51.124 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:51.119+0000 7f90ca5756c0 1 -- 10.20.193.11:0/3271236225 learned_addr learned my addr 10.20.193.11:0/3271236225 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:20:51.124 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:51.119+0000 7f90cad766c0 1 --2- 10.20.193.11:0/3271236225 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f90cc122b00 0x7f90cc122fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:20:51.124 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:51.119+0000 7f90c9d746c0 1 --2- 10.20.193.11:0/3271236225 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f90cc115440 0x7f90cc11d740 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:20:51.125 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:51.119+0000 7f90ca5756c0 1 -- 10.20.193.11:0/3271236225 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f90cc115440 msgr2=0x7f90cc11d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:20:51.125 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:51.119+0000 7f90ca5756c0 1 --2- 10.20.193.11:0/3271236225 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f90cc115440 0x7f90cc11d740 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:51.125 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:51.119+0000 7f90ca5756c0 1 -- 10.20.193.11:0/3271236225 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f90cc122b00 msgr2=0x7f90cc122fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:20:51.125 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:51.119+0000 7f90ca5756c0 1 --2- 10.20.193.11:0/3271236225 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f90cc122b00 0x7f90cc122fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:51.125 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:51.119+0000 7f90ca5756c0 1 -- 10.20.193.11:0/3271236225 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90c0009590 con 0x7f90cc10f230 2026-02-13T02:20:51.125 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:51.119+0000 7f90ca5756c0 1 --2- 10.20.193.11:0/3271236225 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f90cc10f230 0x7f90cc11d200 secure :-1 s=READY pgs=352 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f90c0031fd0 tx=0x7f90c00047f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:20:51.125 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:51.119+0000 7f90b37fe6c0 1 -- 10.20.193.11:0/3271236225 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f90c0002ae0 con 0x7f90cc10f230 2026-02-13T02:20:51.125 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:51.119+0000 7f90d0ce46c0 1 -- 10.20.193.11:0/3271236225 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90cc163c90 con 0x7f90cc10f230 2026-02-13T02:20:51.125 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:51.119+0000 7f90b37fe6c0 1 -- 10.20.193.11:0/3271236225 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f90c0007740 con 0x7f90cc10f230 2026-02-13T02:20:51.125 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:51.119+0000 7f90b37fe6c0 1 -- 10.20.193.11:0/3271236225 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f90c0037590 con 0x7f90cc10f230 2026-02-13T02:20:51.125 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:51.119+0000 7f90d0ce46c0 1 -- 10.20.193.11:0/3271236225 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90cc164110 con 0x7f90cc10f230 2026-02-13T02:20:51.125 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:51.120+0000 7f90d0ce46c0 1 -- 10.20.193.11:0/3271236225 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90cc110500 con 0x7f90cc10f230 2026-02-13T02:20:51.126 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:51.121+0000 7f90b37fe6c0 1 -- 10.20.193.11:0/3271236225 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7f90c0002ce0 con 0x7f90cc10f230 2026-02-13T02:20:51.127 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:51.122+0000 7f90b37fe6c0 1 --2- 10.20.193.11:0/3271236225 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f90a40b5600 0x7f90a40d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:20:51.127 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:51.122+0000 7f90c9d746c0 1 --2- 10.20.193.11:0/3271236225 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f90a40b5600 0x7f90a40d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:20:51.127 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:51.123+0000 7f90b37fe6c0 1 -- 10.20.193.11:0/3271236225 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7965+0+0 (secure 0 0 0) 0x7f90c0107c30 con 0x7f90cc10f230 2026-02-13T02:20:51.127 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:51.123+0000 7f90c9d746c0 1 --2- 10.20.193.11:0/3271236225 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f90a40b5600 0x7f90a40d5ab0 secure :-1 s=READY pgs=238 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f90b4005fd0 tx=0x7f90b4005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:20:51.127 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:51.123+0000 7f90b37fe6c0 1 -- 10.20.193.11:0/3271236225 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f90c0108120 con 0x7f90cc10f230 2026-02-13T02:20:51.238 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:51.236+0000 7f90d0ce46c0 1 -- 10.20.193.11:0/3271236225 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f90cc10f600 con 0x7f90cc10f230 2026-02-13T02:20:51.239 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:51.236+0000 7f90b37fe6c0 1 -- 10.20.193.11:0/3271236225 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f90c00ca730 con 0x7f90cc10f230 2026-02-13T02:20:51.239 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:20:51.239 INFO:teuthology.orchestra.run.trial011.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:20:51.240 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:51.237+0000 7f90d0ce46c0 1 -- 10.20.193.11:0/3271236225 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f90a40b5600 msgr2=0x7f90a40d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:20:51.240 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:51.237+0000 7f90d0ce46c0 1 --2- 10.20.193.11:0/3271236225 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f90a40b5600 0x7f90a40d5ab0 secure :-1 s=READY pgs=238 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f90b4005fd0 tx=0x7f90b4005910 comp rx=0 tx=0).stop 2026-02-13T02:20:51.241 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:51.237+0000 7f90d0ce46c0 1 -- 10.20.193.11:0/3271236225 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f90cc10f230 msgr2=0x7f90cc11d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:20:51.241 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:51.237+0000 7f90d0ce46c0 1 --2- 10.20.193.11:0/3271236225 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f90cc10f230 0x7f90cc11d200 secure :-1 s=READY pgs=352 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f90c0031fd0 tx=0x7f90c00047f0 comp rx=0 tx=0).stop 2026-02-13T02:20:51.241 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:51.237+0000 7f90d0ce46c0 1 -- 10.20.193.11:0/3271236225 shutdown_connections 2026-02-13T02:20:51.241 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:51.237+0000 7f90d0ce46c0 1 --2- 10.20.193.11:0/3271236225 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f90a40b5600 0x7f90a40d5ab0 unknown :-1 s=CLOSED pgs=238 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:51.241 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:51.237+0000 7f90d0ce46c0 1 --2- 10.20.193.11:0/3271236225 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f90cc122b00 0x7f90cc122fa0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:51.242 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:51.237+0000 7f90d0ce46c0 1 --2- 10.20.193.11:0/3271236225 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f90cc115440 0x7f90cc11d740 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:51.242 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:51.237+0000 7f90d0ce46c0 1 --2- 10.20.193.11:0/3271236225 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f90cc10f230 0x7f90cc11d200 unknown :-1 s=CLOSED pgs=352 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:51.242 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:51.237+0000 7f90d0ce46c0 1 -- 10.20.193.11:0/3271236225 >> 10.20.193.11:0/3271236225 conn(0x7f90cc0ecb30 msgr2=0x7f90cc10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:20:51.242 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:51.238+0000 7f90d0ce46c0 1 -- 10.20.193.11:0/3271236225 shutdown_connections 2026-02-13T02:20:51.242 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:51.238+0000 7f90d0ce46c0 1 -- 10.20.193.11:0/3271236225 wait complete. 2026-02-13T02:20:51.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:51 trial011 ceph-mon[11956]: pgmap v243: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:20:51.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:51 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/3271236225' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:20:52.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:51 trial060 ceph-mon[14797]: pgmap v243: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:20:52.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:51 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/3271236225' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:20:52.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:51 trial078 ceph-mon[14969]: pgmap v243: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:20:52.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:51 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/3271236225' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:20:53.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:53 trial011 ceph-mon[11956]: pgmap v244: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T02:20:54.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:53 trial060 ceph-mon[14797]: pgmap v244: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T02:20:54.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:53 trial078 ceph-mon[14969]: pgmap v244: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T02:20:54.280 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:20:54.408 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:20:54.526 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:54.521+0000 7fa42f8d56c0 1 -- 10.20.193.11:0/1046257245 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fa42810f200 msgr2=0x7fa42810f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:20:54.526 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:54.521+0000 7fa42f8d56c0 1 --2- 10.20.193.11:0/1046257245 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fa42810f200 0x7fa42810f5d0 secure :-1 s=READY pgs=353 gs=1 cs=0 l=1 c_cookie=13047404094751594947 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa4180099a0 tx=0x7fa41802ed20 comp rx=0 tx=0).stop 2026-02-13T02:20:54.526 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:54.521+0000 7fa42f8d56c0 1 -- 10.20.193.11:0/1046257245 shutdown_connections 2026-02-13T02:20:54.526 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:54.521+0000 7fa42f8d56c0 1 --2- 10.20.193.11:0/1046257245 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fa42810fbf0 0x7fa428114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:54.526 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:54.521+0000 7fa42f8d56c0 1 --2- 10.20.193.11:0/1046257245 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa428115410 0x7fa428175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:54.526 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:54.521+0000 7fa42f8d56c0 1 --2- 10.20.193.11:0/1046257245 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fa42810f200 0x7fa42810f5d0 unknown :-1 s=CLOSED pgs=353 gs=1 cs=0 l=1 c_cookie=13047404094751594947 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:54.527 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:54.521+0000 7fa42f8d56c0 1 -- 10.20.193.11:0/1046257245 >> 10.20.193.11:0/1046257245 conn(0x7fa4280ecb00 msgr2=0x7fa42810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:20:54.527 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:54.521+0000 7fa42f8d56c0 1 -- 10.20.193.11:0/1046257245 shutdown_connections 2026-02-13T02:20:54.527 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:54.521+0000 7fa42f8d56c0 1 -- 10.20.193.11:0/1046257245 wait complete. 2026-02-13T02:20:54.527 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:54.522+0000 7fa42f8d56c0 1 Processor -- start 2026-02-13T02:20:54.527 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:54.522+0000 7fa42f8d56c0 1 -- start start 2026-02-13T02:20:54.527 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:54.522+0000 7fa42f8d56c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fa42810f200 0x7fa42811d1b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:20:54.527 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:54.522+0000 7fa42f8d56c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fa428115410 0x7fa42811d6f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:20:54.527 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:54.522+0000 7fa42f8d56c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa428122ab0 0x7fa428122f50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:20:54.527 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:54.522+0000 7fa42f8d56c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7fa4281234c0 con 0x7fa42810f200 2026-02-13T02:20:54.527 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:54.522+0000 7fa42f8d56c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa428123630 con 0x7fa428115410 2026-02-13T02:20:54.527 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:54.522+0000 7fa42f8d56c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa4281237f0 con 0x7fa428122ab0 2026-02-13T02:20:54.528 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:54.522+0000 7fa42d6466c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fa42810f200 0x7fa42811d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:20:54.528 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:54.522+0000 7fa42d6466c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fa42810f200 0x7fa42811d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:40932/0 (socket says 10.20.193.11:40932) 2026-02-13T02:20:54.528 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:54.522+0000 7fa42d6466c0 1 -- 10.20.193.11:0/849231593 learned_addr learned my addr 10.20.193.11:0/849231593 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:20:54.528 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:54.522+0000 7fa42ce456c0 1 --2- 10.20.193.11:0/849231593 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fa428115410 0x7fa42811d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:20:54.528 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:54.522+0000 7fa42d6466c0 1 -- 10.20.193.11:0/849231593 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa428122ab0 msgr2=0x7fa428122f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:20:54.528 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:54.522+0000 7fa42d6466c0 1 --2- 10.20.193.11:0/849231593 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa428122ab0 0x7fa428122f50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:54.528 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:54.522+0000 7fa42d6466c0 1 -- 10.20.193.11:0/849231593 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fa428115410 msgr2=0x7fa42811d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:20:54.528 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:54.522+0000 7fa42d6466c0 1 --2- 10.20.193.11:0/849231593 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fa428115410 0x7fa42811d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:54.528 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:54.522+0000 7fa42d6466c0 1 -- 10.20.193.11:0/849231593 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa418009590 con 0x7fa42810f200 2026-02-13T02:20:54.528 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:54.522+0000 7fa42d6466c0 1 --2- 10.20.193.11:0/849231593 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fa42810f200 0x7fa42811d1b0 secure :-1 s=READY pgs=354 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa418031fd0 tx=0x7fa4180047f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:20:54.528 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:54.522+0000 7fa4167fc6c0 1 -- 10.20.193.11:0/849231593 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa418002ae0 con 0x7fa42810f200 2026-02-13T02:20:54.528 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:54.522+0000 7fa4167fc6c0 1 -- 10.20.193.11:0/849231593 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa418002c40 con 0x7fa42810f200 2026-02-13T02:20:54.529 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:54.522+0000 7fa42f8d56c0 1 -- 10.20.193.11:0/849231593 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa428163c40 con 0x7fa42810f200 2026-02-13T02:20:54.529 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:54.522+0000 7fa4167fc6c0 1 -- 10.20.193.11:0/849231593 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa4180372f0 con 0x7fa42810f200 2026-02-13T02:20:54.529 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:54.522+0000 7fa42f8d56c0 1 -- 10.20.193.11:0/849231593 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4281640c0 con 0x7fa42810f200 2026-02-13T02:20:54.529 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:54.523+0000 7fa42f8d56c0 1 -- 10.20.193.11:0/849231593 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4281104d0 con 0x7fa42810f200 2026-02-13T02:20:54.529 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:54.524+0000 7fa4167fc6c0 1 -- 10.20.193.11:0/849231593 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7fa4180077d0 con 0x7fa42810f200 2026-02-13T02:20:54.530 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:54.524+0000 7fa4167fc6c0 1 --2- 10.20.193.11:0/849231593 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fa4040b5680 0x7fa4040d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:20:54.530 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:54.525+0000 7fa4167fc6c0 1 -- 10.20.193.11:0/849231593 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7965+0+0 (secure 0 0 0) 0x7fa418107ca0 con 0x7fa42810f200 2026-02-13T02:20:54.530 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:54.525+0000 7fa42ce456c0 1 --2- 10.20.193.11:0/849231593 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fa4040b5680 0x7fa4040d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:20:54.530 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:54.525+0000 7fa42ce456c0 1 --2- 10.20.193.11:0/849231593 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fa4040b5680 0x7fa4040d5b30 secure :-1 s=READY pgs=239 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa428123b40 tx=0x7fa41c0094b0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:20:54.530 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:54.525+0000 7fa4167fc6c0 1 -- 10.20.193.11:0/849231593 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fa4180ca760 con 0x7fa42810f200 2026-02-13T02:20:54.641 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:54.639+0000 7fa42f8d56c0 1 -- 10.20.193.11:0/849231593 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fa42810fbf0 con 0x7fa42810f200 2026-02-13T02:20:54.642 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:54.639+0000 7fa4167fc6c0 1 -- 10.20.193.11:0/849231593 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fa4180cd910 con 0x7fa42810f200 2026-02-13T02:20:54.642 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:20:54.642 INFO:teuthology.orchestra.run.trial011.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:20:54.643 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:54.641+0000 7fa42f8d56c0 1 -- 10.20.193.11:0/849231593 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fa4040b5680 msgr2=0x7fa4040d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:20:54.643 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:54.641+0000 7fa42f8d56c0 1 --2- 10.20.193.11:0/849231593 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fa4040b5680 0x7fa4040d5b30 secure :-1 s=READY pgs=239 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa428123b40 tx=0x7fa41c0094b0 comp rx=0 tx=0).stop 2026-02-13T02:20:54.643 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:54.641+0000 7fa42f8d56c0 1 -- 10.20.193.11:0/849231593 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fa42810f200 msgr2=0x7fa42811d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:20:54.643 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:54.641+0000 7fa42f8d56c0 1 --2- 10.20.193.11:0/849231593 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fa42810f200 0x7fa42811d1b0 secure :-1 s=READY pgs=354 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa418031fd0 tx=0x7fa4180047f0 comp rx=0 tx=0).stop 2026-02-13T02:20:54.643 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:54.641+0000 7fa42f8d56c0 1 -- 10.20.193.11:0/849231593 shutdown_connections 2026-02-13T02:20:54.644 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:54.641+0000 7fa42f8d56c0 1 --2- 10.20.193.11:0/849231593 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fa4040b5680 0x7fa4040d5b30 unknown :-1 s=CLOSED pgs=239 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:54.644 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:54.641+0000 7fa42f8d56c0 1 --2- 10.20.193.11:0/849231593 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fa428115410 0x7fa42811d6f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:54.644 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:54.641+0000 7fa42f8d56c0 1 --2- 10.20.193.11:0/849231593 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa428122ab0 0x7fa428122f50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:54.644 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:54.641+0000 7fa42f8d56c0 1 --2- 10.20.193.11:0/849231593 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fa42810f200 0x7fa42811d1b0 unknown :-1 s=CLOSED pgs=354 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:54.644 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:54.641+0000 7fa42f8d56c0 1 -- 10.20.193.11:0/849231593 >> 10.20.193.11:0/849231593 conn(0x7fa4280ecb00 msgr2=0x7fa42810cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:20:54.644 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:54.641+0000 7fa42f8d56c0 1 -- 10.20.193.11:0/849231593 shutdown_connections 2026-02-13T02:20:54.644 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:54.641+0000 7fa42f8d56c0 1 -- 10.20.193.11:0/849231593 wait complete. 2026-02-13T02:20:54.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:54 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/849231593' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:20:55.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:54 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/849231593' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:20:55.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:54 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/849231593' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:20:55.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:55 trial011 ceph-mon[11956]: pgmap v245: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:20:56.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:55 trial060 ceph-mon[14797]: pgmap v245: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:20:56.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:55 trial078 ceph-mon[14969]: pgmap v245: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:20:57.681 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:20:57.806 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:20:57.920 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:57 trial011 ceph-mon[11956]: pgmap v246: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:20:57.926 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:57.921+0000 7faca10c86c0 1 -- 10.20.193.11:0/524151759 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fac9c10fbf0 msgr2=0x7fac9c114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:20:57.926 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:57.921+0000 7faca10c86c0 1 --2- 10.20.193.11:0/524151759 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fac9c10fbf0 0x7fac9c114c30 secure :-1 s=READY pgs=355 gs=1 cs=0 l=1 c_cookie=16474846785641278858 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fac840099a0 tx=0x7fac8402ed20 comp rx=0 tx=0).stop 2026-02-13T02:20:57.926 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:57.921+0000 7faca10c86c0 1 -- 10.20.193.11:0/524151759 shutdown_connections 2026-02-13T02:20:57.926 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:57.921+0000 7faca10c86c0 1 --2- 10.20.193.11:0/524151759 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fac9c115410 0x7fac9c175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:57.926 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:57.921+0000 7faca10c86c0 1 --2- 10.20.193.11:0/524151759 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fac9c10fbf0 0x7fac9c114c30 unknown :-1 s=CLOSED pgs=355 gs=1 cs=0 l=1 c_cookie=16474846785641278858 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:57.926 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:57.921+0000 7faca10c86c0 1 --2- 10.20.193.11:0/524151759 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fac9c10f200 0x7fac9c10f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:57.926 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:57.921+0000 7faca10c86c0 1 -- 10.20.193.11:0/524151759 >> 10.20.193.11:0/524151759 conn(0x7fac9c0ecb00 msgr2=0x7fac9c10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:20:57.926 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:57.921+0000 7faca10c86c0 1 -- 10.20.193.11:0/524151759 shutdown_connections 2026-02-13T02:20:57.926 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:57.921+0000 7faca10c86c0 1 -- 10.20.193.11:0/524151759 wait complete. 2026-02-13T02:20:57.927 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:57.921+0000 7faca10c86c0 1 Processor -- start 2026-02-13T02:20:57.927 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:57.921+0000 7faca10c86c0 1 -- start start 2026-02-13T02:20:57.927 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:57.921+0000 7faca10c86c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fac9c10f200 0x7fac9c0f4ba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:20:57.927 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:57.921+0000 7faca10c86c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fac9c115410 0x7fac9c175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:20:57.927 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:57.921+0000 7faca10c86c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fac9c0f51d0 0x7fac9c0fa4a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:20:57.927 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:57.921+0000 7faca10c86c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7fac9c0f58c0 con 0x7fac9c115410 2026-02-13T02:20:57.927 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:57.921+0000 7faca10c86c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7fac9c0fa9e0 con 0x7fac9c0f51d0 2026-02-13T02:20:57.927 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:57.921+0000 7faca10c86c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fac9c0faba0 con 0x7fac9c10f200 2026-02-13T02:20:57.927 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:57.921+0000 7fac9a5756c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fac9c115410 0x7fac9c175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:20:57.927 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:57.921+0000 7fac9a5756c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fac9c115410 0x7fac9c175cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:40962/0 (socket says 10.20.193.11:40962) 2026-02-13T02:20:57.927 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:57.921+0000 7fac9a5756c0 1 -- 10.20.193.11:0/343197731 learned_addr learned my addr 10.20.193.11:0/343197731 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:20:57.927 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:57.921+0000 7fac9ad766c0 1 --2- 10.20.193.11:0/343197731 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fac9c10f200 0x7fac9c0f4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:20:57.928 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:57.921+0000 7fac9b5776c0 1 --2- 10.20.193.11:0/343197731 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fac9c0f51d0 0x7fac9c0fa4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:20:57.928 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:57.921+0000 7fac9a5756c0 1 -- 10.20.193.11:0/343197731 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fac9c10f200 msgr2=0x7fac9c0f4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:20:57.928 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:57.921+0000 7fac9a5756c0 1 --2- 10.20.193.11:0/343197731 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fac9c10f200 0x7fac9c0f4ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:57.928 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:57.921+0000 7fac9a5756c0 1 -- 10.20.193.11:0/343197731 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fac9c0f51d0 msgr2=0x7fac9c0fa4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:20:57.928 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:57.921+0000 7fac9a5756c0 1 --2- 10.20.193.11:0/343197731 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fac9c0f51d0 0x7fac9c0fa4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:57.928 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:57.921+0000 7fac9a5756c0 1 -- 10.20.193.11:0/343197731 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac84009590 con 0x7fac9c115410 2026-02-13T02:20:57.928 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:57.921+0000 7fac9a5756c0 1 --2- 10.20.193.11:0/343197731 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fac9c115410 0x7fac9c175cb0 secure :-1 s=READY pgs=356 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fac84031f90 tx=0x7fac840047f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:20:57.928 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:57.922+0000 7fac7bfff6c0 1 -- 10.20.193.11:0/343197731 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fac84002ae0 con 0x7fac9c115410 2026-02-13T02:20:57.928 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:57.922+0000 7fac7bfff6c0 1 -- 10.20.193.11:0/343197731 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fac84002c40 con 0x7fac9c115410 2026-02-13T02:20:57.928 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:57.922+0000 7faca10c86c0 1 -- 10.20.193.11:0/343197731 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac9c0fae20 con 0x7fac9c115410 2026-02-13T02:20:57.928 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:57.922+0000 7fac7bfff6c0 1 -- 10.20.193.11:0/343197731 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fac840312b0 con 0x7fac9c115410 2026-02-13T02:20:57.928 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:57.922+0000 7faca10c86c0 1 -- 10.20.193.11:0/343197731 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac9c0fb2a0 con 0x7fac9c115410 2026-02-13T02:20:57.929 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:57.922+0000 7faca10c86c0 1 -- 10.20.193.11:0/343197731 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac9c1104d0 con 0x7fac9c115410 2026-02-13T02:20:57.929 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:57.923+0000 7fac7bfff6c0 1 -- 10.20.193.11:0/343197731 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7fac84007260 con 0x7fac9c115410 2026-02-13T02:20:57.930 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:57.924+0000 7fac7bfff6c0 1 --2- 10.20.193.11:0/343197731 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fac700b5600 0x7fac700d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:20:57.930 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:57.924+0000 7fac9ad766c0 1 --2- 10.20.193.11:0/343197731 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fac700b5600 0x7fac700d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:20:57.930 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:57.924+0000 7fac7bfff6c0 1 -- 10.20.193.11:0/343197731 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7965+0+0 (secure 0 0 0) 0x7fac84107c30 con 0x7fac9c115410 2026-02-13T02:20:57.930 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:57.924+0000 7fac7bfff6c0 1 -- 10.20.193.11:0/343197731 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fac840ca6f0 con 0x7fac9c115410 2026-02-13T02:20:57.930 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:57.924+0000 7fac9ad766c0 1 --2- 10.20.193.11:0/343197731 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fac700b5600 0x7fac700d5ab0 secure :-1 s=READY pgs=240 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fac90005980 tx=0x7fac90005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:20:58.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:57 trial060 ceph-mon[14797]: pgmap v246: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:20:58.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:57 trial078 ceph-mon[14969]: pgmap v246: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:20:58.044 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:58.041+0000 7faca10c86c0 1 -- 10.20.193.11:0/343197731 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fac9c10f5d0 con 0x7fac9c115410 2026-02-13T02:20:58.044 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:58.041+0000 7fac7bfff6c0 1 -- 10.20.193.11:0/343197731 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fac840077d0 con 0x7fac9c115410 2026-02-13T02:20:58.045 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:20:58.045 INFO:teuthology.orchestra.run.trial011.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:20:58.046 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:58.043+0000 7faca10c86c0 1 -- 10.20.193.11:0/343197731 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fac700b5600 msgr2=0x7fac700d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:20:58.046 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:58.043+0000 7faca10c86c0 1 --2- 10.20.193.11:0/343197731 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fac700b5600 0x7fac700d5ab0 secure :-1 s=READY pgs=240 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fac90005980 tx=0x7fac90005910 comp rx=0 tx=0).stop 2026-02-13T02:20:58.046 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:58.043+0000 7faca10c86c0 1 -- 10.20.193.11:0/343197731 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fac9c115410 msgr2=0x7fac9c175cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:20:58.046 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:58.043+0000 7faca10c86c0 1 --2- 10.20.193.11:0/343197731 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fac9c115410 0x7fac9c175cb0 secure :-1 s=READY pgs=356 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fac84031f90 tx=0x7fac840047f0 comp rx=0 tx=0).stop 2026-02-13T02:20:58.046 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:58.043+0000 7faca10c86c0 1 -- 10.20.193.11:0/343197731 shutdown_connections 2026-02-13T02:20:58.046 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:58.043+0000 7faca10c86c0 1 --2- 10.20.193.11:0/343197731 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fac700b5600 0x7fac700d5ab0 unknown :-1 s=CLOSED pgs=240 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:58.047 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:58.043+0000 7faca10c86c0 1 --2- 10.20.193.11:0/343197731 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fac9c0f51d0 0x7fac9c0fa4a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:58.047 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:58.043+0000 7faca10c86c0 1 --2- 10.20.193.11:0/343197731 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fac9c115410 0x7fac9c175cb0 unknown :-1 s=CLOSED pgs=356 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:58.047 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:58.043+0000 7faca10c86c0 1 --2- 10.20.193.11:0/343197731 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fac9c10f200 0x7fac9c0f4ba0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:20:58.047 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:58.043+0000 7faca10c86c0 1 -- 10.20.193.11:0/343197731 >> 10.20.193.11:0/343197731 conn(0x7fac9c0ecb00 msgr2=0x7fac9c10d7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:20:58.047 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:58.043+0000 7faca10c86c0 1 -- 10.20.193.11:0/343197731 shutdown_connections 2026-02-13T02:20:58.047 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:20:58.043+0000 7faca10c86c0 1 -- 10.20.193.11:0/343197731 wait complete. 2026-02-13T02:20:58.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:58 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/343197731' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:20:58.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:58 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:20:59.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:58 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/343197731' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:20:59.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:58 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:20:59.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:58 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/343197731' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:20:59.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:58 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:20:59.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:59 trial011 ceph-mon[11956]: pgmap v247: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:20:59.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:59 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:20:59.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:59 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:20:59.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:59 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:20:59.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:59 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:20:59.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:59 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:20:59.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:59 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:20:59.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:59 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:20:59.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:59 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:20:59.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:59 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:20:59.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:59 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:20:59.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:59 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:20:59.954 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:20:59 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:21:00.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:59 trial060 ceph-mon[14797]: pgmap v247: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:21:00.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:59 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:21:00.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:59 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:21:00.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:59 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:21:00.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:59 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:21:00.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:59 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:21:00.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:59 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:21:00.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:59 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:21:00.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:59 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:21:00.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:59 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:21:00.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:59 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:21:00.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:59 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:21:00.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:20:59 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:21:00.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:59 trial078 ceph-mon[14969]: pgmap v247: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:21:00.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:59 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:21:00.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:59 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:21:00.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:59 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:21:00.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:59 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:21:00.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:59 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:21:00.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:59 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:21:00.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:59 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:21:00.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:59 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:21:00.043 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:59 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:21:00.043 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:59 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:21:00.043 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:59 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:21:00.043 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:20:59 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:21:00.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:21:00 trial011 ceph-mon[11956]: pgmap v248: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.1 KiB/s rd, 10 op/s 2026-02-13T02:21:01.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:21:00 trial060 ceph-mon[14797]: pgmap v248: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.1 KiB/s rd, 10 op/s 2026-02-13T02:21:01.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:21:00 trial078 ceph-mon[14969]: pgmap v248: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.1 KiB/s rd, 10 op/s 2026-02-13T02:21:01.084 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:21:01.209 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:21:01.337 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:01.333+0000 7f81716c76c0 1 -- 10.20.193.11:0/1887389145 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f816c115410 msgr2=0x7f816c175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:21:01.338 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:01.333+0000 7f81716c76c0 1 --2- 10.20.193.11:0/1887389145 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f816c115410 0x7f816c175db0 secure :-1 s=READY pgs=357 gs=1 cs=0 l=1 c_cookie=7571600697846781239 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f815c00aa70 tx=0x7f815c02fde0 comp rx=0 tx=0).stop 2026-02-13T02:21:01.338 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:01.333+0000 7f81716c76c0 1 -- 10.20.193.11:0/1887389145 shutdown_connections 2026-02-13T02:21:01.338 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:01.333+0000 7f81716c76c0 1 --2- 10.20.193.11:0/1887389145 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f816c115410 0x7f816c175db0 unknown :-1 s=CLOSED pgs=357 gs=1 cs=0 l=1 c_cookie=7571600697846781239 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:01.338 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:01.333+0000 7f81716c76c0 1 --2- 10.20.193.11:0/1887389145 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f816c10fbf0 0x7f816c114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:01.338 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:01.333+0000 7f81716c76c0 1 --2- 10.20.193.11:0/1887389145 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f816c10f200 0x7f816c10f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:01.338 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:01.333+0000 7f81716c76c0 1 -- 10.20.193.11:0/1887389145 >> 10.20.193.11:0/1887389145 conn(0x7f816c0ecb00 msgr2=0x7f816c10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:21:01.338 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:01.333+0000 7f81716c76c0 1 -- 10.20.193.11:0/1887389145 shutdown_connections 2026-02-13T02:21:01.338 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:01.333+0000 7f81716c76c0 1 -- 10.20.193.11:0/1887389145 wait complete. 2026-02-13T02:21:01.338 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:01.333+0000 7f81716c76c0 1 Processor -- start 2026-02-13T02:21:01.338 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:01.333+0000 7f81716c76c0 1 -- start start 2026-02-13T02:21:01.339 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:01.333+0000 7f81716c76c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f816c10f200 0x7f816c11d170 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:21:01.339 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:01.333+0000 7f81716c76c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f816c115410 0x7f816c11d6b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:21:01.339 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:01.333+0000 7f81716c76c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f816c122a70 0x7f816c122f10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:21:01.339 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:01.333+0000 7f81716c76c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f816c123450 con 0x7f816c115410 2026-02-13T02:21:01.339 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:01.333+0000 7f81716c76c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f816c1235c0 con 0x7f816c10f200 2026-02-13T02:21:01.339 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:01.333+0000 7f81716c76c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f816c123780 con 0x7f816c122a70 2026-02-13T02:21:01.339 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:01.334+0000 7f816a7fc6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f816c115410 0x7f816c11d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:21:01.339 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:01.334+0000 7f816a7fc6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f816c115410 0x7f816c11d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:52940/0 (socket says 10.20.193.11:52940) 2026-02-13T02:21:01.339 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:01.334+0000 7f816a7fc6c0 1 -- 10.20.193.11:0/1528702379 learned_addr learned my addr 10.20.193.11:0/1528702379 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:21:01.339 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:01.334+0000 7f816b7fe6c0 1 --2- 10.20.193.11:0/1528702379 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f816c122a70 0x7f816c122f10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:21:01.339 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:01.334+0000 7f816affd6c0 1 --2- 10.20.193.11:0/1528702379 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f816c10f200 0x7f816c11d170 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:21:01.340 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:01.334+0000 7f816a7fc6c0 1 -- 10.20.193.11:0/1528702379 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f816c122a70 msgr2=0x7f816c122f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:21:01.340 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:01.334+0000 7f816a7fc6c0 1 --2- 10.20.193.11:0/1528702379 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f816c122a70 0x7f816c122f10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:01.340 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:01.334+0000 7f816a7fc6c0 1 -- 10.20.193.11:0/1528702379 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f816c10f200 msgr2=0x7f816c11d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:21:01.340 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:01.334+0000 7f816a7fc6c0 1 --2- 10.20.193.11:0/1528702379 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f816c10f200 0x7f816c11d170 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:01.340 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:01.334+0000 7f816a7fc6c0 1 -- 10.20.193.11:0/1528702379 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f815c00a660 con 0x7f816c115410 2026-02-13T02:21:01.340 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:01.334+0000 7f816affd6c0 1 --2- 10.20.193.11:0/1528702379 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f816c10f200 0x7f816c11d170 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:21:01.340 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:01.334+0000 7f816b7fe6c0 1 --2- 10.20.193.11:0/1528702379 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f816c122a70 0x7f816c122f10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:21:01.340 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:01.334+0000 7f816a7fc6c0 1 --2- 10.20.193.11:0/1528702379 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f816c115410 0x7f816c11d6b0 secure :-1 s=READY pgs=358 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f815400b6c0 tx=0x7f815400bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:21:01.340 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:01.334+0000 7f814bfff6c0 1 -- 10.20.193.11:0/1528702379 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8154004250 con 0x7f816c115410 2026-02-13T02:21:01.340 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:01.334+0000 7f814bfff6c0 1 -- 10.20.193.11:0/1528702379 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f8154009070 con 0x7f816c115410 2026-02-13T02:21:01.340 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:01.334+0000 7f81716c76c0 1 -- 10.20.193.11:0/1528702379 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f816c163c00 con 0x7f816c115410 2026-02-13T02:21:01.340 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:01.334+0000 7f814bfff6c0 1 -- 10.20.193.11:0/1528702379 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f815400cd20 con 0x7f816c115410 2026-02-13T02:21:01.341 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:01.334+0000 7f81716c76c0 1 -- 10.20.193.11:0/1528702379 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f816c164090 con 0x7f816c115410 2026-02-13T02:21:01.341 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:01.334+0000 7f81716c76c0 1 -- 10.20.193.11:0/1528702379 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f816c1104d0 con 0x7f816c115410 2026-02-13T02:21:01.341 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:01.336+0000 7f814bfff6c0 1 -- 10.20.193.11:0/1528702379 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7f81540028c0 con 0x7f816c115410 2026-02-13T02:21:01.342 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:01.336+0000 7f814bfff6c0 1 --2- 10.20.193.11:0/1528702379 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f81400b5600 0x7f81400d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:21:01.342 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:01.336+0000 7f816affd6c0 1 --2- 10.20.193.11:0/1528702379 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f81400b5600 0x7f81400d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:21:01.342 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:01.336+0000 7f814bfff6c0 1 -- 10.20.193.11:0/1528702379 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7965+0+0 (secure 0 0 0) 0x7f81540e3990 con 0x7f816c115410 2026-02-13T02:21:01.342 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:01.337+0000 7f816affd6c0 1 --2- 10.20.193.11:0/1528702379 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f81400b5600 0x7f81400d5ab0 secure :-1 s=READY pgs=241 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8160004750 tx=0x7f8160005e50 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:21:01.342 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:01.337+0000 7f814bfff6c0 1 -- 10.20.193.11:0/1528702379 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f81540a6490 con 0x7f816c115410 2026-02-13T02:21:01.467 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:01.465+0000 7f81716c76c0 1 -- 10.20.193.11:0/1528702379 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f816c11e2c0 con 0x7f816c115410 2026-02-13T02:21:01.467 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:01.465+0000 7f814bfff6c0 1 -- 10.20.193.11:0/1528702379 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f81540a9640 con 0x7f816c115410 2026-02-13T02:21:01.468 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:21:01.468 INFO:teuthology.orchestra.run.trial011.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:21:01.469 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:01.466+0000 7f81716c76c0 1 -- 10.20.193.11:0/1528702379 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f81400b5600 msgr2=0x7f81400d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:21:01.469 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:01.466+0000 7f81716c76c0 1 --2- 10.20.193.11:0/1528702379 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f81400b5600 0x7f81400d5ab0 secure :-1 s=READY pgs=241 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8160004750 tx=0x7f8160005e50 comp rx=0 tx=0).stop 2026-02-13T02:21:01.469 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:01.466+0000 7f81716c76c0 1 -- 10.20.193.11:0/1528702379 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f816c115410 msgr2=0x7f816c11d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:21:01.469 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:01.466+0000 7f81716c76c0 1 --2- 10.20.193.11:0/1528702379 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f816c115410 0x7f816c11d6b0 secure :-1 s=READY pgs=358 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f815400b6c0 tx=0x7f815400bb90 comp rx=0 tx=0).stop 2026-02-13T02:21:01.469 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:01.466+0000 7f81716c76c0 1 -- 10.20.193.11:0/1528702379 shutdown_connections 2026-02-13T02:21:01.469 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:01.466+0000 7f81716c76c0 1 --2- 10.20.193.11:0/1528702379 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f81400b5600 0x7f81400d5ab0 unknown :-1 s=CLOSED pgs=241 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:01.469 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:01.466+0000 7f81716c76c0 1 --2- 10.20.193.11:0/1528702379 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f816c122a70 0x7f816c122f10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:01.469 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:01.466+0000 7f81716c76c0 1 --2- 10.20.193.11:0/1528702379 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f816c115410 0x7f816c11d6b0 unknown :-1 s=CLOSED pgs=358 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:01.470 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:01.466+0000 7f81716c76c0 1 --2- 10.20.193.11:0/1528702379 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f816c10f200 0x7f816c11d170 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:01.470 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:01.466+0000 7f81716c76c0 1 -- 10.20.193.11:0/1528702379 >> 10.20.193.11:0/1528702379 conn(0x7f816c0ecb00 msgr2=0x7f816c10cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:21:01.470 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:01.466+0000 7f81716c76c0 1 -- 10.20.193.11:0/1528702379 shutdown_connections 2026-02-13T02:21:01.470 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:01.466+0000 7f81716c76c0 1 -- 10.20.193.11:0/1528702379 wait complete. 2026-02-13T02:21:01.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:21:01 trial011 ceph-mon[11956]: pgmap v249: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 10 op/s 2026-02-13T02:21:01.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:21:01 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/1528702379' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:21:02.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:21:01 trial060 ceph-mon[14797]: pgmap v249: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 10 op/s 2026-02-13T02:21:02.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:21:01 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/1528702379' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:21:02.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:21:01 trial078 ceph-mon[14969]: pgmap v249: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 10 op/s 2026-02-13T02:21:02.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:21:01 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/1528702379' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:21:03.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:21:03 trial011 ceph-mon[11956]: pgmap v250: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 10 op/s 2026-02-13T02:21:04.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:21:03 trial060 ceph-mon[14797]: pgmap v250: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 10 op/s 2026-02-13T02:21:04.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:21:03 trial078 ceph-mon[14969]: pgmap v250: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 10 op/s 2026-02-13T02:21:04.507 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:21:04.632 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:21:04.749 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:04.745+0000 7fb8ce67c6c0 1 -- 10.20.193.11:0/1124088553 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fb8c810fc20 msgr2=0x7fb8c8114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:21:04.749 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:04.745+0000 7fb8ce67c6c0 1 --2- 10.20.193.11:0/1124088553 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fb8c810fc20 0x7fb8c8114c60 secure :-1 s=READY pgs=359 gs=1 cs=0 l=1 c_cookie=6117825387306645046 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb8b80099a0 tx=0x7fb8b802ed20 comp rx=0 tx=0).stop 2026-02-13T02:21:04.749 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:04.745+0000 7fb8ce67c6c0 1 -- 10.20.193.11:0/1124088553 shutdown_connections 2026-02-13T02:21:04.749 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:04.745+0000 7fb8ce67c6c0 1 --2- 10.20.193.11:0/1124088553 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb8c8115440 0x7fb8c8175de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:04.749 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:04.745+0000 7fb8ce67c6c0 1 --2- 10.20.193.11:0/1124088553 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fb8c810fc20 0x7fb8c8114c60 unknown :-1 s=CLOSED pgs=359 gs=1 cs=0 l=1 c_cookie=6117825387306645046 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:04.749 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:04.745+0000 7fb8ce67c6c0 1 --2- 10.20.193.11:0/1124088553 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fb8c810f230 0x7fb8c810f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:04.749 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:04.745+0000 7fb8ce67c6c0 1 -- 10.20.193.11:0/1124088553 >> 10.20.193.11:0/1124088553 conn(0x7fb8c80ecb30 msgr2=0x7fb8c810cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:21:04.749 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:04.745+0000 7fb8ce67c6c0 1 -- 10.20.193.11:0/1124088553 shutdown_connections 2026-02-13T02:21:04.750 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:04.745+0000 7fb8ce67c6c0 1 -- 10.20.193.11:0/1124088553 wait complete. 2026-02-13T02:21:04.750 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:04.745+0000 7fb8ce67c6c0 1 Processor -- start 2026-02-13T02:21:04.750 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:04.745+0000 7fb8ce67c6c0 1 -- start start 2026-02-13T02:21:04.750 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:04.745+0000 7fb8ce67c6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb8c810f230 0x7fb8c80f4c50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:21:04.750 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:04.745+0000 7fb8ce67c6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fb8c8115440 0x7fb8c8175ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:21:04.750 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:04.745+0000 7fb8ce67c6c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fb8c80f5280 0x7fb8c80fa550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:21:04.750 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:04.745+0000 7fb8ce67c6c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7fb8c80f5970 con 0x7fb8c8115440 2026-02-13T02:21:04.750 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:04.745+0000 7fb8ce67c6c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb8c80faa90 con 0x7fb8c80f5280 2026-02-13T02:21:04.750 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:04.745+0000 7fb8ce67c6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fb8c80fac50 con 0x7fb8c810f230 2026-02-13T02:21:04.750 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:04.745+0000 7fb8c77fe6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fb8c8115440 0x7fb8c8175ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:21:04.750 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:04.745+0000 7fb8c77fe6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fb8c8115440 0x7fb8c8175ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:52948/0 (socket says 10.20.193.11:52948) 2026-02-13T02:21:04.751 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:04.745+0000 7fb8c77fe6c0 1 -- 10.20.193.11:0/3242074021 learned_addr learned my addr 10.20.193.11:0/3242074021 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:21:04.751 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:04.746+0000 7fb8c7fff6c0 1 --2- 10.20.193.11:0/3242074021 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb8c810f230 0x7fb8c80f4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:21:04.751 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:04.746+0000 7fb8ccbf26c0 1 --2- 10.20.193.11:0/3242074021 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fb8c80f5280 0x7fb8c80fa550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:21:04.751 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:04.746+0000 7fb8c77fe6c0 1 -- 10.20.193.11:0/3242074021 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb8c810f230 msgr2=0x7fb8c80f4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:21:04.751 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:04.746+0000 7fb8c77fe6c0 1 --2- 10.20.193.11:0/3242074021 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb8c810f230 0x7fb8c80f4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:04.751 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:04.746+0000 7fb8c77fe6c0 1 -- 10.20.193.11:0/3242074021 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fb8c80f5280 msgr2=0x7fb8c80fa550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:21:04.751 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:04.746+0000 7fb8c77fe6c0 1 --2- 10.20.193.11:0/3242074021 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fb8c80f5280 0x7fb8c80fa550 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:04.751 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:04.746+0000 7fb8c77fe6c0 1 -- 10.20.193.11:0/3242074021 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8b8009590 con 0x7fb8c8115440 2026-02-13T02:21:04.751 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:04.746+0000 7fb8c77fe6c0 1 --2- 10.20.193.11:0/3242074021 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fb8c8115440 0x7fb8c8175ce0 secure :-1 s=READY pgs=360 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb8b8031f90 tx=0x7fb8b80047f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:21:04.751 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:04.746+0000 7fb8c57fa6c0 1 -- 10.20.193.11:0/3242074021 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb8b8002ae0 con 0x7fb8c8115440 2026-02-13T02:21:04.751 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:04.746+0000 7fb8c57fa6c0 1 -- 10.20.193.11:0/3242074021 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb8b8002c40 con 0x7fb8c8115440 2026-02-13T02:21:04.751 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:04.746+0000 7fb8ce67c6c0 1 -- 10.20.193.11:0/3242074021 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8c80faed0 con 0x7fb8c8115440 2026-02-13T02:21:04.752 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:04.746+0000 7fb8c57fa6c0 1 -- 10.20.193.11:0/3242074021 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb8b80312b0 con 0x7fb8c8115440 2026-02-13T02:21:04.752 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:04.746+0000 7fb8ce67c6c0 1 -- 10.20.193.11:0/3242074021 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8c80fb350 con 0x7fb8c8115440 2026-02-13T02:21:04.752 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:04.746+0000 7fb8ce67c6c0 1 -- 10.20.193.11:0/3242074021 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8c8110500 con 0x7fb8c8115440 2026-02-13T02:21:04.753 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:04.747+0000 7fb8c57fa6c0 1 -- 10.20.193.11:0/3242074021 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7fb8b8007260 con 0x7fb8c8115440 2026-02-13T02:21:04.753 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:04.748+0000 7fb8c57fa6c0 1 --2- 10.20.193.11:0/3242074021 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fb89c0b5600 0x7fb89c0d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:21:04.753 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:04.748+0000 7fb8c57fa6c0 1 -- 10.20.193.11:0/3242074021 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7965+0+0 (secure 0 0 0) 0x7fb8b8107c30 con 0x7fb8c8115440 2026-02-13T02:21:04.753 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:04.748+0000 7fb8c7fff6c0 1 --2- 10.20.193.11:0/3242074021 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fb89c0b5600 0x7fb89c0d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:21:04.753 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:04.748+0000 7fb8c7fff6c0 1 --2- 10.20.193.11:0/3242074021 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fb89c0b5600 0x7fb89c0d5ab0 secure :-1 s=READY pgs=242 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb8b4005980 tx=0x7fb8b40094b0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:21:04.753 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:04.748+0000 7fb8c57fa6c0 1 -- 10.20.193.11:0/3242074021 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fb8b80ca6f0 con 0x7fb8c8115440 2026-02-13T02:21:04.865 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:04.863+0000 7fb8ce67c6c0 1 -- 10.20.193.11:0/3242074021 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fb8c810f600 con 0x7fb8c8115440 2026-02-13T02:21:04.865 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:04.863+0000 7fb8c57fa6c0 1 -- 10.20.193.11:0/3242074021 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fb8b80077d0 con 0x7fb8c8115440 2026-02-13T02:21:04.865 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:21:04.866 INFO:teuthology.orchestra.run.trial011.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:21:04.867 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:04.864+0000 7fb8ce67c6c0 1 -- 10.20.193.11:0/3242074021 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fb89c0b5600 msgr2=0x7fb89c0d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:21:04.867 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:04.864+0000 7fb8ce67c6c0 1 --2- 10.20.193.11:0/3242074021 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fb89c0b5600 0x7fb89c0d5ab0 secure :-1 s=READY pgs=242 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb8b4005980 tx=0x7fb8b40094b0 comp rx=0 tx=0).stop 2026-02-13T02:21:04.867 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:04.864+0000 7fb8ce67c6c0 1 -- 10.20.193.11:0/3242074021 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fb8c8115440 msgr2=0x7fb8c8175ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:21:04.867 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:04.864+0000 7fb8ce67c6c0 1 --2- 10.20.193.11:0/3242074021 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fb8c8115440 0x7fb8c8175ce0 secure :-1 s=READY pgs=360 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb8b8031f90 tx=0x7fb8b80047f0 comp rx=0 tx=0).stop 2026-02-13T02:21:04.867 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:04.864+0000 7fb8ce67c6c0 1 -- 10.20.193.11:0/3242074021 shutdown_connections 2026-02-13T02:21:04.867 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:04.864+0000 7fb8ce67c6c0 1 --2- 10.20.193.11:0/3242074021 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fb89c0b5600 0x7fb89c0d5ab0 unknown :-1 s=CLOSED pgs=242 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:04.867 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:04.864+0000 7fb8ce67c6c0 1 --2- 10.20.193.11:0/3242074021 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fb8c80f5280 0x7fb8c80fa550 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:04.867 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:04.864+0000 7fb8ce67c6c0 1 --2- 10.20.193.11:0/3242074021 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fb8c8115440 0x7fb8c8175ce0 unknown :-1 s=CLOSED pgs=360 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:04.867 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:04.864+0000 7fb8ce67c6c0 1 --2- 10.20.193.11:0/3242074021 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb8c810f230 0x7fb8c80f4c50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:04.868 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:04.864+0000 7fb8ce67c6c0 1 -- 10.20.193.11:0/3242074021 >> 10.20.193.11:0/3242074021 conn(0x7fb8c80ecb30 msgr2=0x7fb8c810d850 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:21:04.868 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:04.865+0000 7fb8ce67c6c0 1 -- 10.20.193.11:0/3242074021 shutdown_connections 2026-02-13T02:21:04.868 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:04.865+0000 7fb8ce67c6c0 1 -- 10.20.193.11:0/3242074021 wait complete. 2026-02-13T02:21:05.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:21:05 trial011 ceph-mon[11956]: pgmap v251: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 10 op/s 2026-02-13T02:21:05.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:21:05 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/3242074021' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:21:06.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:21:05 trial060 ceph-mon[14797]: pgmap v251: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 10 op/s 2026-02-13T02:21:06.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:21:05 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/3242074021' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:21:06.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:21:05 trial078 ceph-mon[14969]: pgmap v251: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 10 op/s 2026-02-13T02:21:06.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:21:05 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/3242074021' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:21:07.905 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:21:07.932 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:21:07 trial011 ceph-mon[11956]: pgmap v252: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 8 op/s 2026-02-13T02:21:08.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:21:07 trial060 ceph-mon[14797]: pgmap v252: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 8 op/s 2026-02-13T02:21:08.032 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:21:08.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:21:07 trial078 ceph-mon[14969]: pgmap v252: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 8 op/s 2026-02-13T02:21:08.144 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:08.139+0000 7ff4c322d6c0 1 -- 10.20.193.11:0/3390054334 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7ff4bc10f230 msgr2=0x7ff4bc10f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:21:08.144 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:08.139+0000 7ff4c322d6c0 1 --2- 10.20.193.11:0/3390054334 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7ff4bc10f230 0x7ff4bc10f600 secure :-1 s=READY pgs=361 gs=1 cs=0 l=1 c_cookie=9559236200686162502 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff4ac0099a0 tx=0x7ff4ac02ed20 comp rx=0 tx=0).stop 2026-02-13T02:21:08.144 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:08.139+0000 7ff4c322d6c0 1 -- 10.20.193.11:0/3390054334 shutdown_connections 2026-02-13T02:21:08.144 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:08.139+0000 7ff4c322d6c0 1 --2- 10.20.193.11:0/3390054334 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7ff4bc10fc20 0x7ff4bc114c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:08.144 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:08.139+0000 7ff4c322d6c0 1 --2- 10.20.193.11:0/3390054334 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff4bc115440 0x7ff4bc175de0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:08.144 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:08.139+0000 7ff4c322d6c0 1 --2- 10.20.193.11:0/3390054334 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7ff4bc10f230 0x7ff4bc10f600 unknown :-1 s=CLOSED pgs=361 gs=1 cs=0 l=1 c_cookie=9559236200686162502 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:08.144 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:08.139+0000 7ff4c322d6c0 1 -- 10.20.193.11:0/3390054334 >> 10.20.193.11:0/3390054334 conn(0x7ff4bc0ecb30 msgr2=0x7ff4bc10cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:21:08.145 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:08.140+0000 7ff4c322d6c0 1 -- 10.20.193.11:0/3390054334 shutdown_connections 2026-02-13T02:21:08.145 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:08.140+0000 7ff4c322d6c0 1 -- 10.20.193.11:0/3390054334 wait complete. 2026-02-13T02:21:08.145 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:08.140+0000 7ff4c322d6c0 1 Processor -- start 2026-02-13T02:21:08.145 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:08.140+0000 7ff4c322d6c0 1 -- start start 2026-02-13T02:21:08.145 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:08.140+0000 7ff4c322d6c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7ff4bc10f230 0x7ff4bc11d1c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:21:08.145 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:08.140+0000 7ff4c322d6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7ff4bc115440 0x7ff4bc11d700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:21:08.145 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:08.140+0000 7ff4c322d6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff4bc122ac0 0x7ff4bc122f60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:21:08.145 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:08.140+0000 7ff4c322d6c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7ff4bc1234d0 con 0x7ff4bc115440 2026-02-13T02:21:08.145 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:08.140+0000 7ff4c322d6c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff4bc123640 con 0x7ff4bc10f230 2026-02-13T02:21:08.145 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:08.140+0000 7ff4c322d6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7ff4bc123800 con 0x7ff4bc122ac0 2026-02-13T02:21:08.145 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:08.140+0000 7ff4b3fff6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7ff4bc115440 0x7ff4bc11d700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:21:08.145 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:08.140+0000 7ff4b3fff6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7ff4bc115440 0x7ff4bc11d700 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:52966/0 (socket says 10.20.193.11:52966) 2026-02-13T02:21:08.145 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:08.140+0000 7ff4b3fff6c0 1 -- 10.20.193.11:0/1227919526 learned_addr learned my addr 10.20.193.11:0/1227919526 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:21:08.146 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:08.140+0000 7ff4c179f6c0 1 --2- 10.20.193.11:0/1227919526 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff4bc122ac0 0x7ff4bc122f60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:21:08.146 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:08.140+0000 7ff4c0f9e6c0 1 --2- 10.20.193.11:0/1227919526 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7ff4bc10f230 0x7ff4bc11d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:21:08.146 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:08.140+0000 7ff4b3fff6c0 1 -- 10.20.193.11:0/1227919526 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff4bc122ac0 msgr2=0x7ff4bc122f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:21:08.146 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:08.140+0000 7ff4b3fff6c0 1 --2- 10.20.193.11:0/1227919526 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff4bc122ac0 0x7ff4bc122f60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:08.146 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:08.140+0000 7ff4b3fff6c0 1 -- 10.20.193.11:0/1227919526 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7ff4bc10f230 msgr2=0x7ff4bc11d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:21:08.146 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:08.140+0000 7ff4b3fff6c0 1 --2- 10.20.193.11:0/1227919526 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7ff4bc10f230 0x7ff4bc11d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:08.146 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:08.140+0000 7ff4b3fff6c0 1 -- 10.20.193.11:0/1227919526 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4ac009590 con 0x7ff4bc115440 2026-02-13T02:21:08.146 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:08.140+0000 7ff4c179f6c0 1 --2- 10.20.193.11:0/1227919526 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff4bc122ac0 0x7ff4bc122f60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T02:21:08.146 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:08.140+0000 7ff4b3fff6c0 1 --2- 10.20.193.11:0/1227919526 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7ff4bc115440 0x7ff4bc11d700 secure :-1 s=READY pgs=362 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff4a4005dc0 tx=0x7ff4a400bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:21:08.146 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:08.141+0000 7ff4b1ffb6c0 1 -- 10.20.193.11:0/1227919526 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff4a4004250 con 0x7ff4bc115440 2026-02-13T02:21:08.146 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:08.141+0000 7ff4b1ffb6c0 1 -- 10.20.193.11:0/1227919526 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7ff4a4009070 con 0x7ff4bc115440 2026-02-13T02:21:08.146 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:08.141+0000 7ff4b1ffb6c0 1 -- 10.20.193.11:0/1227919526 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff4a400cdc0 con 0x7ff4bc115440 2026-02-13T02:21:08.147 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:08.141+0000 7ff4c322d6c0 1 -- 10.20.193.11:0/1227919526 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4bc163cb0 con 0x7ff4bc115440 2026-02-13T02:21:08.147 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:08.141+0000 7ff4c322d6c0 1 -- 10.20.193.11:0/1227919526 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4bc164190 con 0x7ff4bc115440 2026-02-13T02:21:08.147 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:08.141+0000 7ff4c322d6c0 1 -- 10.20.193.11:0/1227919526 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4bc110500 con 0x7ff4bc115440 2026-02-13T02:21:08.148 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:08.143+0000 7ff4b1ffb6c0 1 -- 10.20.193.11:0/1227919526 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7ff4a40028c0 con 0x7ff4bc115440 2026-02-13T02:21:08.148 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:08.143+0000 7ff4b1ffb6c0 1 --2- 10.20.193.11:0/1227919526 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7ff4980b5680 0x7ff4980d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:21:08.148 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:08.143+0000 7ff4c0f9e6c0 1 --2- 10.20.193.11:0/1227919526 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7ff4980b5680 0x7ff4980d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:21:08.148 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:08.144+0000 7ff4b1ffb6c0 1 -- 10.20.193.11:0/1227919526 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7965+0+0 (secure 0 0 0) 0x7ff4a40e3a10 con 0x7ff4bc115440 2026-02-13T02:21:08.148 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:08.144+0000 7ff4b1ffb6c0 1 -- 10.20.193.11:0/1227919526 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7ff4a411c5e0 con 0x7ff4bc115440 2026-02-13T02:21:08.148 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:08.144+0000 7ff4c0f9e6c0 1 --2- 10.20.193.11:0/1227919526 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7ff4980b5680 0x7ff4980d5b30 secure :-1 s=READY pgs=243 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff4ac0023e0 tx=0x7ff4ac031f90 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:21:08.260 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:08.258+0000 7ff4c322d6c0 1 -- 10.20.193.11:0/1227919526 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ff4bc10f600 con 0x7ff4bc115440 2026-02-13T02:21:08.260 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:08.258+0000 7ff4b1ffb6c0 1 -- 10.20.193.11:0/1227919526 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7ff4a40a6510 con 0x7ff4bc115440 2026-02-13T02:21:08.261 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:21:08.261 INFO:teuthology.orchestra.run.trial011.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:21:08.262 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:08.259+0000 7ff4c322d6c0 1 -- 10.20.193.11:0/1227919526 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7ff4980b5680 msgr2=0x7ff4980d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:21:08.262 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:08.259+0000 7ff4c322d6c0 1 --2- 10.20.193.11:0/1227919526 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7ff4980b5680 0x7ff4980d5b30 secure :-1 s=READY pgs=243 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff4ac0023e0 tx=0x7ff4ac031f90 comp rx=0 tx=0).stop 2026-02-13T02:21:08.262 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:08.259+0000 7ff4c322d6c0 1 -- 10.20.193.11:0/1227919526 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7ff4bc115440 msgr2=0x7ff4bc11d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:21:08.262 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:08.259+0000 7ff4c322d6c0 1 --2- 10.20.193.11:0/1227919526 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7ff4bc115440 0x7ff4bc11d700 secure :-1 s=READY pgs=362 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff4a4005dc0 tx=0x7ff4a400bbb0 comp rx=0 tx=0).stop 2026-02-13T02:21:08.262 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:08.259+0000 7ff4c322d6c0 1 -- 10.20.193.11:0/1227919526 shutdown_connections 2026-02-13T02:21:08.262 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:08.259+0000 7ff4c322d6c0 1 --2- 10.20.193.11:0/1227919526 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7ff4980b5680 0x7ff4980d5b30 unknown :-1 s=CLOSED pgs=243 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:08.262 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:08.259+0000 7ff4c322d6c0 1 --2- 10.20.193.11:0/1227919526 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7ff4bc122ac0 0x7ff4bc122f60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:08.262 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:08.259+0000 7ff4c322d6c0 1 --2- 10.20.193.11:0/1227919526 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7ff4bc115440 0x7ff4bc11d700 unknown :-1 s=CLOSED pgs=362 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:08.262 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:08.259+0000 7ff4c322d6c0 1 --2- 10.20.193.11:0/1227919526 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7ff4bc10f230 0x7ff4bc11d1c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:08.263 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:08.259+0000 7ff4c322d6c0 1 -- 10.20.193.11:0/1227919526 >> 10.20.193.11:0/1227919526 conn(0x7ff4bc0ecb30 msgr2=0x7ff4bc10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:21:08.263 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:08.259+0000 7ff4c322d6c0 1 -- 10.20.193.11:0/1227919526 shutdown_connections 2026-02-13T02:21:08.263 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:08.259+0000 7ff4c322d6c0 1 -- 10.20.193.11:0/1227919526 wait complete. 2026-02-13T02:21:08.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:21:08 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/1227919526' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:21:09.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:21:08 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/1227919526' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:21:09.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:21:08 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/1227919526' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:21:09.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:21:09 trial011 ceph-mon[11956]: pgmap v253: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 10 op/s 2026-02-13T02:21:10.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:21:09 trial060 ceph-mon[14797]: pgmap v253: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 10 op/s 2026-02-13T02:21:10.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:21:09 trial078 ceph-mon[14969]: pgmap v253: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 10 op/s 2026-02-13T02:21:11.300 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:21:11.426 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:21:11.548 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:11.544+0000 7fcea93316c0 1 -- 10.20.193.11:0/1940431390 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fcea410f200 msgr2=0x7fcea410f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:21:11.548 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:11.544+0000 7fcea93316c0 1 --2- 10.20.193.11:0/1940431390 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fcea410f200 0x7fcea410f5d0 secure :-1 s=READY pgs=363 gs=1 cs=0 l=1 c_cookie=2937498930102004574 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fce980099a0 tx=0x7fce9802ed20 comp rx=0 tx=0).stop 2026-02-13T02:21:11.549 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:11.544+0000 7fcea93316c0 1 -- 10.20.193.11:0/1940431390 shutdown_connections 2026-02-13T02:21:11.549 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:11.544+0000 7fcea93316c0 1 --2- 10.20.193.11:0/1940431390 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fcea410fbf0 0x7fcea4114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:11.549 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:11.544+0000 7fcea93316c0 1 --2- 10.20.193.11:0/1940431390 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fcea4115410 0x7fcea4175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:11.549 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:11.544+0000 7fcea93316c0 1 --2- 10.20.193.11:0/1940431390 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fcea410f200 0x7fcea410f5d0 unknown :-1 s=CLOSED pgs=363 gs=1 cs=0 l=1 c_cookie=2937498930102004574 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:11.549 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:11.544+0000 7fcea93316c0 1 -- 10.20.193.11:0/1940431390 >> 10.20.193.11:0/1940431390 conn(0x7fcea40ecb00 msgr2=0x7fcea410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:21:11.549 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:11.544+0000 7fcea93316c0 1 -- 10.20.193.11:0/1940431390 shutdown_connections 2026-02-13T02:21:11.549 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:11.544+0000 7fcea93316c0 1 -- 10.20.193.11:0/1940431390 wait complete. 2026-02-13T02:21:11.549 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:11.545+0000 7fcea93316c0 1 Processor -- start 2026-02-13T02:21:11.549 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:11.545+0000 7fcea93316c0 1 -- start start 2026-02-13T02:21:11.549 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:11.545+0000 7fcea93316c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fcea410f200 0x7fcea411d190 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:21:11.549 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:11.545+0000 7fcea93316c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fcea4115410 0x7fcea411d6d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:21:11.549 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:11.545+0000 7fcea93316c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fcea4122a90 0x7fcea4122f30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:21:11.550 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:11.545+0000 7fcea93316c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7fcea41234a0 con 0x7fcea4115410 2026-02-13T02:21:11.550 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:11.545+0000 7fcea93316c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7fcea4123610 con 0x7fcea4122a90 2026-02-13T02:21:11.550 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:11.545+0000 7fcea93316c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fcea41237d0 con 0x7fcea410f200 2026-02-13T02:21:11.550 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:11.545+0000 7fcea27fc6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fcea4115410 0x7fcea411d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:21:11.550 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:11.545+0000 7fcea27fc6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fcea4115410 0x7fcea411d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:45794/0 (socket says 10.20.193.11:45794) 2026-02-13T02:21:11.550 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:11.545+0000 7fcea27fc6c0 1 -- 10.20.193.11:0/176636887 learned_addr learned my addr 10.20.193.11:0/176636887 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:21:11.550 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:11.545+0000 7fcea37fe6c0 1 --2- 10.20.193.11:0/176636887 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fcea4122a90 0x7fcea4122f30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:21:11.550 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:11.545+0000 7fcea2ffd6c0 1 --2- 10.20.193.11:0/176636887 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fcea410f200 0x7fcea411d190 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:21:11.550 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:11.545+0000 7fcea27fc6c0 1 -- 10.20.193.11:0/176636887 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fcea410f200 msgr2=0x7fcea411d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:21:11.550 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:11.545+0000 7fcea27fc6c0 1 --2- 10.20.193.11:0/176636887 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fcea410f200 0x7fcea411d190 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:11.550 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:11.545+0000 7fcea27fc6c0 1 -- 10.20.193.11:0/176636887 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fcea4122a90 msgr2=0x7fcea4122f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:21:11.550 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:11.545+0000 7fcea27fc6c0 1 --2- 10.20.193.11:0/176636887 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fcea4122a90 0x7fcea4122f30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:11.551 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:11.545+0000 7fcea27fc6c0 1 -- 10.20.193.11:0/176636887 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce98009590 con 0x7fcea4115410 2026-02-13T02:21:11.551 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:11.545+0000 7fcea2ffd6c0 1 --2- 10.20.193.11:0/176636887 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fcea410f200 0x7fcea411d190 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:21:11.551 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:11.545+0000 7fcea27fc6c0 1 --2- 10.20.193.11:0/176636887 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fcea4115410 0x7fcea411d6d0 secure :-1 s=READY pgs=364 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fce8c005fd0 tx=0x7fce8c00bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:21:11.551 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:11.545+0000 7fce83fff6c0 1 -- 10.20.193.11:0/176636887 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fce8c004280 con 0x7fcea4115410 2026-02-13T02:21:11.551 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:11.545+0000 7fce83fff6c0 1 -- 10.20.193.11:0/176636887 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fce8c0043e0 con 0x7fcea4115410 2026-02-13T02:21:11.551 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:11.545+0000 7fce83fff6c0 1 -- 10.20.193.11:0/176636887 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fce8c00ce10 con 0x7fcea4115410 2026-02-13T02:21:11.551 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:11.545+0000 7fcea93316c0 1 -- 10.20.193.11:0/176636887 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcea4163c80 con 0x7fcea4115410 2026-02-13T02:21:11.551 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:11.545+0000 7fcea93316c0 1 -- 10.20.193.11:0/176636887 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcea4164160 con 0x7fcea4115410 2026-02-13T02:21:11.551 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:11.546+0000 7fcea93316c0 1 -- 10.20.193.11:0/176636887 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcea41104d0 con 0x7fcea4115410 2026-02-13T02:21:11.552 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:11.547+0000 7fce83fff6c0 1 -- 10.20.193.11:0/176636887 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7fce8c0026b0 con 0x7fcea4115410 2026-02-13T02:21:11.553 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:11.548+0000 7fce83fff6c0 1 --2- 10.20.193.11:0/176636887 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fce780b5680 0x7fce780d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:21:11.553 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:11.548+0000 7fcea2ffd6c0 1 --2- 10.20.193.11:0/176636887 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fce780b5680 0x7fce780d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:21:11.553 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:11.548+0000 7fce83fff6c0 1 -- 10.20.193.11:0/176636887 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7965+0+0 (secure 0 0 0) 0x7fce8c0e39a0 con 0x7fcea4115410 2026-02-13T02:21:11.553 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:11.548+0000 7fce83fff6c0 1 -- 10.20.193.11:0/176636887 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fce8c0a6460 con 0x7fcea4115410 2026-02-13T02:21:11.553 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:11.548+0000 7fcea2ffd6c0 1 --2- 10.20.193.11:0/176636887 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fce780b5680 0x7fce780d5b30 secure :-1 s=READY pgs=244 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fce98009970 tx=0x7fce980023a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:21:11.666 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:11.664+0000 7fcea93316c0 1 -- 10.20.193.11:0/176636887 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fcea410f5d0 con 0x7fcea4115410 2026-02-13T02:21:11.666 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:11.664+0000 7fce83fff6c0 1 -- 10.20.193.11:0/176636887 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fce8c0a9610 con 0x7fcea4115410 2026-02-13T02:21:11.666 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:21:11.667 INFO:teuthology.orchestra.run.trial011.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:21:11.668 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:11.666+0000 7fcea93316c0 1 -- 10.20.193.11:0/176636887 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fce780b5680 msgr2=0x7fce780d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:21:11.668 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:11.666+0000 7fcea93316c0 1 --2- 10.20.193.11:0/176636887 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fce780b5680 0x7fce780d5b30 secure :-1 s=READY pgs=244 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fce98009970 tx=0x7fce980023a0 comp rx=0 tx=0).stop 2026-02-13T02:21:11.668 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:11.666+0000 7fcea93316c0 1 -- 10.20.193.11:0/176636887 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fcea4115410 msgr2=0x7fcea411d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:21:11.668 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:11.666+0000 7fcea93316c0 1 --2- 10.20.193.11:0/176636887 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fcea4115410 0x7fcea411d6d0 secure :-1 s=READY pgs=364 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fce8c005fd0 tx=0x7fce8c00bca0 comp rx=0 tx=0).stop 2026-02-13T02:21:11.668 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:11.666+0000 7fcea93316c0 1 -- 10.20.193.11:0/176636887 shutdown_connections 2026-02-13T02:21:11.669 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:11.666+0000 7fcea93316c0 1 --2- 10.20.193.11:0/176636887 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fce780b5680 0x7fce780d5b30 unknown :-1 s=CLOSED pgs=244 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:11.669 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:11.666+0000 7fcea93316c0 1 --2- 10.20.193.11:0/176636887 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fcea4122a90 0x7fcea4122f30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:11.669 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:11.666+0000 7fcea93316c0 1 --2- 10.20.193.11:0/176636887 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fcea4115410 0x7fcea411d6d0 unknown :-1 s=CLOSED pgs=364 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:11.669 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:11.666+0000 7fcea93316c0 1 --2- 10.20.193.11:0/176636887 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fcea410f200 0x7fcea411d190 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:11.669 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:11.666+0000 7fcea93316c0 1 -- 10.20.193.11:0/176636887 >> 10.20.193.11:0/176636887 conn(0x7fcea40ecb00 msgr2=0x7fcea410cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:21:11.669 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:11.666+0000 7fcea93316c0 1 -- 10.20.193.11:0/176636887 shutdown_connections 2026-02-13T02:21:11.669 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:11.666+0000 7fcea93316c0 1 -- 10.20.193.11:0/176636887 wait complete. 2026-02-13T02:21:11.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:21:11 trial011 ceph-mon[11956]: pgmap v254: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 9 op/s 2026-02-13T02:21:11.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:21:11 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/176636887' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:21:12.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:21:11 trial060 ceph-mon[14797]: pgmap v254: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 9 op/s 2026-02-13T02:21:12.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:21:11 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/176636887' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:21:12.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:21:11 trial078 ceph-mon[14969]: pgmap v254: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 9 op/s 2026-02-13T02:21:12.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:21:11 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/176636887' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:21:13.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:21:13 trial011 ceph-mon[11956]: pgmap v255: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T02:21:14.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:21:13 trial060 ceph-mon[14797]: pgmap v255: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T02:21:14.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:21:13 trial078 ceph-mon[14969]: pgmap v255: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T02:21:14.707 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:21:14.830 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:21:14.948 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:14.943+0000 7f61f65b06c0 1 -- 10.20.193.11:0/819185544 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f61f010f200 msgr2=0x7f61f010f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:21:14.948 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:14.943+0000 7f61f65b06c0 1 --2- 10.20.193.11:0/819185544 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f61f010f200 0x7f61f010f5d0 secure :-1 s=READY pgs=365 gs=1 cs=0 l=1 c_cookie=262112654554373270 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f61dc0099a0 tx=0x7f61dc02ed20 comp rx=0 tx=0).stop 2026-02-13T02:21:14.948 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:14.943+0000 7f61f65b06c0 1 -- 10.20.193.11:0/819185544 shutdown_connections 2026-02-13T02:21:14.948 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:14.943+0000 7f61f65b06c0 1 --2- 10.20.193.11:0/819185544 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f61f0115410 0x7f61f0175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:14.948 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:14.943+0000 7f61f65b06c0 1 --2- 10.20.193.11:0/819185544 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f61f010fbf0 0x7f61f0114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:14.948 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:14.943+0000 7f61f65b06c0 1 --2- 10.20.193.11:0/819185544 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f61f010f200 0x7f61f010f5d0 unknown :-1 s=CLOSED pgs=365 gs=1 cs=0 l=1 c_cookie=262112654554373270 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:14.948 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:14.943+0000 7f61f65b06c0 1 -- 10.20.193.11:0/819185544 >> 10.20.193.11:0/819185544 conn(0x7f61f00ecb00 msgr2=0x7f61f010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:21:14.948 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:14.943+0000 7f61f65b06c0 1 -- 10.20.193.11:0/819185544 shutdown_connections 2026-02-13T02:21:14.948 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:14.943+0000 7f61f65b06c0 1 -- 10.20.193.11:0/819185544 wait complete. 2026-02-13T02:21:14.949 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:14.944+0000 7f61f65b06c0 1 Processor -- start 2026-02-13T02:21:14.949 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:14.944+0000 7f61f65b06c0 1 -- start start 2026-02-13T02:21:14.949 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:14.944+0000 7f61f65b06c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f61f010f200 0x7f61f011d1e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:21:14.949 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:14.944+0000 7f61f65b06c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f61f0115410 0x7f61f011d720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:21:14.949 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:14.944+0000 7f61f65b06c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f61f0122ae0 0x7f61f0122f80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:21:14.949 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:14.944+0000 7f61f65b06c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f61f01234f0 con 0x7f61f010f200 2026-02-13T02:21:14.949 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:14.944+0000 7f61f65b06c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f61f0123660 con 0x7f61f0115410 2026-02-13T02:21:14.949 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:14.944+0000 7f61f65b06c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f61f0123820 con 0x7f61f0122ae0 2026-02-13T02:21:14.949 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:14.944+0000 7f61effff6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f61f010f200 0x7f61f011d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:21:14.949 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:14.944+0000 7f61effff6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f61f010f200 0x7f61f011d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:45802/0 (socket says 10.20.193.11:45802) 2026-02-13T02:21:14.949 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:14.944+0000 7f61effff6c0 1 -- 10.20.193.11:0/2862937289 learned_addr learned my addr 10.20.193.11:0/2862937289 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:21:14.949 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:14.944+0000 7f61ef7fe6c0 1 --2- 10.20.193.11:0/2862937289 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f61f0115410 0x7f61f011d720 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:21:14.950 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:14.944+0000 7f61f4b226c0 1 --2- 10.20.193.11:0/2862937289 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f61f0122ae0 0x7f61f0122f80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:21:14.950 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:14.944+0000 7f61effff6c0 1 -- 10.20.193.11:0/2862937289 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f61f0122ae0 msgr2=0x7f61f0122f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:21:14.950 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:14.944+0000 7f61effff6c0 1 --2- 10.20.193.11:0/2862937289 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f61f0122ae0 0x7f61f0122f80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:14.950 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:14.944+0000 7f61effff6c0 1 -- 10.20.193.11:0/2862937289 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f61f0115410 msgr2=0x7f61f011d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:21:14.950 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:14.944+0000 7f61effff6c0 1 --2- 10.20.193.11:0/2862937289 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f61f0115410 0x7f61f011d720 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:14.950 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:14.944+0000 7f61effff6c0 1 -- 10.20.193.11:0/2862937289 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61dc009590 con 0x7f61f010f200 2026-02-13T02:21:14.950 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:14.944+0000 7f61effff6c0 1 --2- 10.20.193.11:0/2862937289 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f61f010f200 0x7f61f011d1e0 secure :-1 s=READY pgs=366 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f61dc031fd0 tx=0x7f61dc0047f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:21:14.950 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:14.944+0000 7f61ed7fa6c0 1 -- 10.20.193.11:0/2862937289 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f61dc002ae0 con 0x7f61f010f200 2026-02-13T02:21:14.950 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:14.944+0000 7f61f65b06c0 1 -- 10.20.193.11:0/2862937289 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61f0163c70 con 0x7f61f010f200 2026-02-13T02:21:14.950 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:14.944+0000 7f61ed7fa6c0 1 -- 10.20.193.11:0/2862937289 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f61dc007740 con 0x7f61f010f200 2026-02-13T02:21:14.950 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:14.944+0000 7f61ed7fa6c0 1 -- 10.20.193.11:0/2862937289 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f61dc037590 con 0x7f61f010f200 2026-02-13T02:21:14.950 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:14.944+0000 7f61f65b06c0 1 -- 10.20.193.11:0/2862937289 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61f01640f0 con 0x7f61f010f200 2026-02-13T02:21:14.950 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:14.945+0000 7f61f65b06c0 1 -- 10.20.193.11:0/2862937289 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61f01104d0 con 0x7f61f010f200 2026-02-13T02:21:14.952 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:14.946+0000 7f61ed7fa6c0 1 -- 10.20.193.11:0/2862937289 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7f61dc002ce0 con 0x7f61f010f200 2026-02-13T02:21:14.952 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:14.947+0000 7f61ed7fa6c0 1 --2- 10.20.193.11:0/2862937289 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f61c40b5680 0x7f61c40d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:21:14.952 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:14.947+0000 7f61ed7fa6c0 1 -- 10.20.193.11:0/2862937289 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7965+0+0 (secure 0 0 0) 0x7f61dc107c80 con 0x7f61f010f200 2026-02-13T02:21:14.952 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:14.947+0000 7f61ef7fe6c0 1 --2- 10.20.193.11:0/2862937289 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f61c40b5680 0x7f61c40d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:21:14.952 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:14.947+0000 7f61ef7fe6c0 1 --2- 10.20.193.11:0/2862937289 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f61c40b5680 0x7f61c40d5b30 secure :-1 s=READY pgs=245 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f61e0005980 tx=0x7f61e0005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:21:14.952 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:14.947+0000 7f61ed7fa6c0 1 -- 10.20.193.11:0/2862937289 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f61dc0ca740 con 0x7f61f010f200 2026-02-13T02:21:15.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:21:14 trial060 ceph-mon[14797]: pgmap v256: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:21:15.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:21:14 trial078 ceph-mon[14969]: pgmap v256: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:21:15.069 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:15.067+0000 7f61f65b06c0 1 -- 10.20.193.11:0/2862937289 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f61f010fbf0 con 0x7f61f010f200 2026-02-13T02:21:15.069 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:21:14 trial011 ceph-mon[11956]: pgmap v256: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:21:15.070 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:15.067+0000 7f61ed7fa6c0 1 -- 10.20.193.11:0/2862937289 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f61dc0cd8f0 con 0x7f61f010f200 2026-02-13T02:21:15.070 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:21:15.070 INFO:teuthology.orchestra.run.trial011.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:21:15.071 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:15.069+0000 7f61f65b06c0 1 -- 10.20.193.11:0/2862937289 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f61c40b5680 msgr2=0x7f61c40d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:21:15.071 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:15.069+0000 7f61f65b06c0 1 --2- 10.20.193.11:0/2862937289 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f61c40b5680 0x7f61c40d5b30 secure :-1 s=READY pgs=245 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f61e0005980 tx=0x7f61e0005910 comp rx=0 tx=0).stop 2026-02-13T02:21:15.071 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:15.069+0000 7f61f65b06c0 1 -- 10.20.193.11:0/2862937289 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f61f010f200 msgr2=0x7f61f011d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:21:15.071 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:15.069+0000 7f61f65b06c0 1 --2- 10.20.193.11:0/2862937289 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f61f010f200 0x7f61f011d1e0 secure :-1 s=READY pgs=366 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f61dc031fd0 tx=0x7f61dc0047f0 comp rx=0 tx=0).stop 2026-02-13T02:21:15.072 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:15.069+0000 7f61f65b06c0 1 -- 10.20.193.11:0/2862937289 shutdown_connections 2026-02-13T02:21:15.072 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:15.069+0000 7f61f65b06c0 1 --2- 10.20.193.11:0/2862937289 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f61c40b5680 0x7f61c40d5b30 unknown :-1 s=CLOSED pgs=245 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:15.072 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:15.069+0000 7f61f65b06c0 1 --2- 10.20.193.11:0/2862937289 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f61f0115410 0x7f61f011d720 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:15.072 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:15.069+0000 7f61f65b06c0 1 --2- 10.20.193.11:0/2862937289 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f61f0122ae0 0x7f61f0122f80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:15.072 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:15.069+0000 7f61f65b06c0 1 --2- 10.20.193.11:0/2862937289 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f61f010f200 0x7f61f011d1e0 unknown :-1 s=CLOSED pgs=366 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:15.072 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:15.069+0000 7f61f65b06c0 1 -- 10.20.193.11:0/2862937289 >> 10.20.193.11:0/2862937289 conn(0x7f61f00ecb00 msgr2=0x7f61f010cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:21:15.072 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:15.069+0000 7f61f65b06c0 1 -- 10.20.193.11:0/2862937289 shutdown_connections 2026-02-13T02:21:15.072 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:15.069+0000 7f61f65b06c0 1 -- 10.20.193.11:0/2862937289 wait complete. 2026-02-13T02:21:16.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:21:15 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/2862937289' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:21:16.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:21:15 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/2862937289' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:21:16.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:21:15 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/2862937289' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:21:17.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:21:16 trial060 ceph-mon[14797]: pgmap v257: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 9 op/s 2026-02-13T02:21:17.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:21:16 trial078 ceph-mon[14969]: pgmap v257: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 9 op/s 2026-02-13T02:21:17.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:21:16 trial011 ceph-mon[11956]: pgmap v257: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 9 op/s 2026-02-13T02:21:18.109 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:21:18.236 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:21:18.355 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:18.351+0000 7f6e47c516c0 1 -- 10.20.193.11:0/3925442639 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f6e4010b120 msgr2=0x7f6e4010b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:21:18.355 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:18.351+0000 7f6e47c516c0 1 --2- 10.20.193.11:0/3925442639 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f6e4010b120 0x7f6e4010b550 secure :-1 s=READY pgs=367 gs=1 cs=0 l=1 c_cookie=5380432659113700838 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6e34009970 tx=0x7f6e3402ed50 comp rx=0 tx=0).stop 2026-02-13T02:21:18.356 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:18.351+0000 7f6e47c516c0 1 -- 10.20.193.11:0/3925442639 shutdown_connections 2026-02-13T02:21:18.356 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:18.351+0000 7f6e47c516c0 1 --2- 10.20.193.11:0/3925442639 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6e4010bd00 0x7f6e40175a70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:18.356 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:18.351+0000 7f6e47c516c0 1 --2- 10.20.193.11:0/3925442639 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f6e4010b120 0x7f6e4010b550 unknown :-1 s=CLOSED pgs=367 gs=1 cs=0 l=1 c_cookie=5380432659113700838 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:18.356 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:18.351+0000 7f6e47c516c0 1 --2- 10.20.193.11:0/3925442639 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f6e4010dad0 0x7f6e4010dea0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:18.356 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:18.351+0000 7f6e47c516c0 1 -- 10.20.193.11:0/3925442639 >> 10.20.193.11:0/3925442639 conn(0x7f6e40062e00 msgr2=0x7f6e40109660 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:21:18.356 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:18.351+0000 7f6e47c516c0 1 -- 10.20.193.11:0/3925442639 shutdown_connections 2026-02-13T02:21:18.356 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:18.351+0000 7f6e47c516c0 1 -- 10.20.193.11:0/3925442639 wait complete. 2026-02-13T02:21:18.356 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:18.352+0000 7f6e47c516c0 1 Processor -- start 2026-02-13T02:21:18.356 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:18.352+0000 7f6e47c516c0 1 -- start start 2026-02-13T02:21:18.356 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:18.352+0000 7f6e47c516c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f6e4010b120 0x7f6e400f5250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:21:18.356 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:18.352+0000 7f6e47c516c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f6e4010bd00 0x7f6e400f5790 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:21:18.357 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:18.352+0000 7f6e47c516c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6e4010dad0 0x7f6e400fab00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:21:18.357 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:18.352+0000 7f6e47c516c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f6e400fb150 con 0x7f6e4010b120 2026-02-13T02:21:18.357 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:18.352+0000 7f6e47c516c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6e400fb2c0 con 0x7f6e4010bd00 2026-02-13T02:21:18.357 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:18.352+0000 7f6e47c516c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f6e400fb480 con 0x7f6e4010dad0 2026-02-13T02:21:18.357 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:18.352+0000 7f6e459c26c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f6e4010b120 0x7f6e400f5250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:21:18.357 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:18.352+0000 7f6e459c26c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f6e4010b120 0x7f6e400f5250 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:45816/0 (socket says 10.20.193.11:45816) 2026-02-13T02:21:18.357 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:18.352+0000 7f6e459c26c0 1 -- 10.20.193.11:0/904610306 learned_addr learned my addr 10.20.193.11:0/904610306 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:21:18.357 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:18.352+0000 7f6e451c16c0 1 --2- 10.20.193.11:0/904610306 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f6e4010bd00 0x7f6e400f5790 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:21:18.357 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:18.352+0000 7f6e459c26c0 1 -- 10.20.193.11:0/904610306 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6e4010dad0 msgr2=0x7f6e400fab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:21:18.357 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:18.352+0000 7f6e459c26c0 1 --2- 10.20.193.11:0/904610306 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6e4010dad0 0x7f6e400fab00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:18.357 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:18.352+0000 7f6e459c26c0 1 -- 10.20.193.11:0/904610306 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f6e4010bd00 msgr2=0x7f6e400f5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:21:18.357 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:18.352+0000 7f6e459c26c0 1 --2- 10.20.193.11:0/904610306 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f6e4010bd00 0x7f6e400f5790 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:18.358 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:18.352+0000 7f6e459c26c0 1 -- 10.20.193.11:0/904610306 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e34009590 con 0x7f6e4010b120 2026-02-13T02:21:18.358 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:18.352+0000 7f6e459c26c0 1 --2- 10.20.193.11:0/904610306 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f6e4010b120 0x7f6e400f5250 secure :-1 s=READY pgs=368 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6e300092e0 tx=0x7f6e3000bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:21:18.358 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:18.352+0000 7f6e2effd6c0 1 -- 10.20.193.11:0/904610306 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6e30004250 con 0x7f6e4010b120 2026-02-13T02:21:18.358 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:18.352+0000 7f6e2effd6c0 1 -- 10.20.193.11:0/904610306 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f6e300043b0 con 0x7f6e4010b120 2026-02-13T02:21:18.358 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:18.352+0000 7f6e47c516c0 1 -- 10.20.193.11:0/904610306 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e400fb760 con 0x7f6e4010b120 2026-02-13T02:21:18.358 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:18.352+0000 7f6e2effd6c0 1 -- 10.20.193.11:0/904610306 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6e3000cde0 con 0x7f6e4010b120 2026-02-13T02:21:18.358 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:18.352+0000 7f6e47c516c0 1 -- 10.20.193.11:0/904610306 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e40172bf0 con 0x7f6e4010b120 2026-02-13T02:21:18.358 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:18.353+0000 7f6e47c516c0 1 -- 10.20.193.11:0/904610306 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e4010c130 con 0x7f6e4010b120 2026-02-13T02:21:18.359 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:18.354+0000 7f6e2effd6c0 1 -- 10.20.193.11:0/904610306 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7f6e300026b0 con 0x7f6e4010b120 2026-02-13T02:21:18.359 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:18.355+0000 7f6e2effd6c0 1 --2- 10.20.193.11:0/904610306 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f6e1c0b5680 0x7f6e1c0d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:21:18.359 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:18.355+0000 7f6e451c16c0 1 --2- 10.20.193.11:0/904610306 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f6e1c0b5680 0x7f6e1c0d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:21:18.359 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:18.355+0000 7f6e2effd6c0 1 -- 10.20.193.11:0/904610306 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7965+0+0 (secure 0 0 0) 0x7f6e300e3910 con 0x7f6e4010b120 2026-02-13T02:21:18.360 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:18.355+0000 7f6e2effd6c0 1 -- 10.20.193.11:0/904610306 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f6e300a93a0 con 0x7f6e4010b120 2026-02-13T02:21:18.360 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:18.355+0000 7f6e451c16c0 1 --2- 10.20.193.11:0/904610306 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f6e1c0b5680 0x7f6e1c0d5b30 secure :-1 s=READY pgs=246 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6e340023e0 tx=0x7f6e34009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:21:18.474 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:18.472+0000 7f6e47c516c0 1 -- 10.20.193.11:0/904610306 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f6e4010dea0 con 0x7f6e4010b120 2026-02-13T02:21:18.474 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:18.472+0000 7f6e2effd6c0 1 -- 10.20.193.11:0/904610306 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f6e300a9580 con 0x7f6e4010b120 2026-02-13T02:21:18.474 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:21:18.475 INFO:teuthology.orchestra.run.trial011.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:21:18.475 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:18.473+0000 7f6e47c516c0 1 -- 10.20.193.11:0/904610306 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f6e1c0b5680 msgr2=0x7f6e1c0d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:21:18.476 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:18.473+0000 7f6e47c516c0 1 --2- 10.20.193.11:0/904610306 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f6e1c0b5680 0x7f6e1c0d5b30 secure :-1 s=READY pgs=246 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6e340023e0 tx=0x7f6e34009260 comp rx=0 tx=0).stop 2026-02-13T02:21:18.476 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:18.473+0000 7f6e47c516c0 1 -- 10.20.193.11:0/904610306 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f6e4010b120 msgr2=0x7f6e400f5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:21:18.476 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:18.473+0000 7f6e47c516c0 1 --2- 10.20.193.11:0/904610306 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f6e4010b120 0x7f6e400f5250 secure :-1 s=READY pgs=368 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6e300092e0 tx=0x7f6e3000bc50 comp rx=0 tx=0).stop 2026-02-13T02:21:18.476 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:18.473+0000 7f6e47c516c0 1 -- 10.20.193.11:0/904610306 shutdown_connections 2026-02-13T02:21:18.476 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:18.473+0000 7f6e47c516c0 1 --2- 10.20.193.11:0/904610306 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f6e1c0b5680 0x7f6e1c0d5b30 unknown :-1 s=CLOSED pgs=246 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:18.476 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:18.473+0000 7f6e47c516c0 1 --2- 10.20.193.11:0/904610306 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f6e4010bd00 0x7f6e400f5790 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:18.476 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:18.473+0000 7f6e47c516c0 1 --2- 10.20.193.11:0/904610306 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f6e4010dad0 0x7f6e400fab00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:18.476 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:18.473+0000 7f6e47c516c0 1 --2- 10.20.193.11:0/904610306 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f6e4010b120 0x7f6e400f5250 unknown :-1 s=CLOSED pgs=368 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:18.476 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:18.473+0000 7f6e47c516c0 1 -- 10.20.193.11:0/904610306 >> 10.20.193.11:0/904610306 conn(0x7f6e40062e00 msgr2=0x7f6e400efa50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:21:18.476 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:18.473+0000 7f6e47c516c0 1 -- 10.20.193.11:0/904610306 shutdown_connections 2026-02-13T02:21:18.476 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:18.473+0000 7f6e47c516c0 1 -- 10.20.193.11:0/904610306 wait complete. 2026-02-13T02:21:19.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:21:18 trial060 ceph-mon[14797]: pgmap v258: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T02:21:19.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:21:18 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/904610306' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:21:19.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:21:18 trial078 ceph-mon[14969]: pgmap v258: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T02:21:19.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:21:18 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/904610306' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:21:19.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:21:18 trial011 ceph-mon[11956]: pgmap v258: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T02:21:19.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:21:18 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/904610306' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:21:21.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:21:20 trial060 ceph-mon[14797]: pgmap v259: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:21:21.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:21:20 trial078 ceph-mon[14969]: pgmap v259: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:21:21.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:21:20 trial011 ceph-mon[11956]: pgmap v259: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:21:21.513 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:21:21.634 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:21:21.753 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:21.752+0000 7f7b1b3dc6c0 1 -- 10.20.193.11:0/568044244 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f7b141557c0 msgr2=0x7f7b14175ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:21:21.754 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:21.752+0000 7f7b1b3dc6c0 1 --2- 10.20.193.11:0/568044244 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f7b141557c0 0x7f7b14175ba0 secure :-1 s=READY pgs=369 gs=1 cs=0 l=1 c_cookie=5405507187939541128 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7b1000aa40 tx=0x7f7b1002fde0 comp rx=0 tx=0).stop 2026-02-13T02:21:21.754 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:21.752+0000 7f7b1b3dc6c0 1 -- 10.20.193.11:0/568044244 shutdown_connections 2026-02-13T02:21:21.754 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:21.752+0000 7f7b1b3dc6c0 1 --2- 10.20.193.11:0/568044244 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f7b141557c0 0x7f7b14175ba0 unknown :-1 s=CLOSED pgs=369 gs=1 cs=0 l=1 c_cookie=5405507187939541128 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:21.754 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:21.752+0000 7f7b1b3dc6c0 1 --2- 10.20.193.11:0/568044244 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f7b1410c3a0 0x7f7b14155280 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:21.754 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:21.752+0000 7f7b1b3dc6c0 1 --2- 10.20.193.11:0/568044244 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f7b1410ba90 0x7f7b1410be60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:21.754 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:21.752+0000 7f7b1b3dc6c0 1 -- 10.20.193.11:0/568044244 >> 10.20.193.11:0/568044244 conn(0x7f7b140e9770 msgr2=0x7f7b14109b80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:21:21.754 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:21.752+0000 7f7b1b3dc6c0 1 -- 10.20.193.11:0/568044244 shutdown_connections 2026-02-13T02:21:21.754 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:21.752+0000 7f7b1b3dc6c0 1 -- 10.20.193.11:0/568044244 wait complete. 2026-02-13T02:21:21.754 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:21.752+0000 7f7b1b3dc6c0 1 Processor -- start 2026-02-13T02:21:21.754 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:21.752+0000 7f7b1b3dc6c0 1 -- start start 2026-02-13T02:21:21.754 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:21.752+0000 7f7b1b3dc6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f7b1410ba90 0x7f7b14160450 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:21:21.754 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:21.752+0000 7f7b1b3dc6c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f7b1410c3a0 0x7f7b14160990 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:21:21.754 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:21.752+0000 7f7b1b3dc6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f7b141557c0 0x7f7b14165d50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:21:21.754 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:21.752+0000 7f7b1b3dc6c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f7b141663a0 con 0x7f7b1410ba90 2026-02-13T02:21:21.755 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:21.752+0000 7f7b1b3dc6c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f7b14166510 con 0x7f7b1410c3a0 2026-02-13T02:21:21.755 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:21.752+0000 7f7b1b3dc6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f7b141666d0 con 0x7f7b141557c0 2026-02-13T02:21:21.755 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:21.752+0000 7f7b1914d6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f7b1410ba90 0x7f7b14160450 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:21:21.755 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:21.752+0000 7f7b1914d6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f7b1410ba90 0x7f7b14160450 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:56230/0 (socket says 10.20.193.11:56230) 2026-02-13T02:21:21.755 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:21.752+0000 7f7b1914d6c0 1 -- 10.20.193.11:0/2546453653 learned_addr learned my addr 10.20.193.11:0/2546453653 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:21:21.755 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:21.753+0000 7f7b1994e6c0 1 --2- 10.20.193.11:0/2546453653 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f7b141557c0 0x7f7b14165d50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:21:21.755 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:21.753+0000 7f7b1894c6c0 1 --2- 10.20.193.11:0/2546453653 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f7b1410c3a0 0x7f7b14160990 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:21:21.755 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:21.753+0000 7f7b1914d6c0 1 -- 10.20.193.11:0/2546453653 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f7b141557c0 msgr2=0x7f7b14165d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:21:21.755 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:21.753+0000 7f7b1914d6c0 1 --2- 10.20.193.11:0/2546453653 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f7b141557c0 0x7f7b14165d50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:21.755 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:21.753+0000 7f7b1914d6c0 1 -- 10.20.193.11:0/2546453653 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f7b1410c3a0 msgr2=0x7f7b14160990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:21:21.755 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:21.753+0000 7f7b1914d6c0 1 --2- 10.20.193.11:0/2546453653 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f7b1410c3a0 0x7f7b14160990 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:21.755 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:21.753+0000 7f7b1914d6c0 1 -- 10.20.193.11:0/2546453653 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b1000a660 con 0x7f7b1410ba90 2026-02-13T02:21:21.755 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:21.753+0000 7f7b1914d6c0 1 --2- 10.20.193.11:0/2546453653 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f7b1410ba90 0x7f7b14160450 secure :-1 s=READY pgs=370 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7b0400b6c0 tx=0x7f7b0400bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:21:21.755 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:21.753+0000 7f7b027fc6c0 1 -- 10.20.193.11:0/2546453653 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7b040044a0 con 0x7f7b1410ba90 2026-02-13T02:21:21.755 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:21.753+0000 7f7b027fc6c0 1 -- 10.20.193.11:0/2546453653 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f7b0400be50 con 0x7f7b1410ba90 2026-02-13T02:21:21.755 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:21.753+0000 7f7b1b3dc6c0 1 -- 10.20.193.11:0/2546453653 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b141669b0 con 0x7f7b1410ba90 2026-02-13T02:21:21.755 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:21.753+0000 7f7b027fc6c0 1 -- 10.20.193.11:0/2546453653 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7b0400cdc0 con 0x7f7b1410ba90 2026-02-13T02:21:21.755 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:21.753+0000 7f7b1b3dc6c0 1 -- 10.20.193.11:0/2546453653 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b14152480 con 0x7f7b1410ba90 2026-02-13T02:21:21.755 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:21.753+0000 7f7b1b3dc6c0 1 -- 10.20.193.11:0/2546453653 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b1405fb30 con 0x7f7b1410ba90 2026-02-13T02:21:21.756 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:21.754+0000 7f7b027fc6c0 1 -- 10.20.193.11:0/2546453653 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7f7b040026b0 con 0x7f7b1410ba90 2026-02-13T02:21:21.757 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:21.755+0000 7f7b027fc6c0 1 --2- 10.20.193.11:0/2546453653 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f7af00b5680 0x7f7af00d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:21:21.757 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:21.755+0000 7f7b1894c6c0 1 --2- 10.20.193.11:0/2546453653 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f7af00b5680 0x7f7af00d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:21:21.757 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:21.755+0000 7f7b027fc6c0 1 -- 10.20.193.11:0/2546453653 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7965+0+0 (secure 0 0 0) 0x7f7b040e3820 con 0x7f7b1410ba90 2026-02-13T02:21:21.757 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:21.756+0000 7f7b1894c6c0 1 --2- 10.20.193.11:0/2546453653 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f7af00b5680 0x7f7af00d5b30 secure :-1 s=READY pgs=247 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7b08005980 tx=0x7f7b08005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:21:21.757 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:21.756+0000 7f7b027fc6c0 1 -- 10.20.193.11:0/2546453653 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f7b040a9d40 con 0x7f7b1410ba90 2026-02-13T02:21:21.871 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:21.869+0000 7f7b1b3dc6c0 1 -- 10.20.193.11:0/2546453653 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f7b141615a0 con 0x7f7b1410ba90 2026-02-13T02:21:21.871 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:21.869+0000 7f7b027fc6c0 1 -- 10.20.193.11:0/2546453653 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f7b040abdb0 con 0x7f7b1410ba90 2026-02-13T02:21:21.872 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:21:21.872 INFO:teuthology.orchestra.run.trial011.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:21:21.873 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:21.870+0000 7f7b1b3dc6c0 1 -- 10.20.193.11:0/2546453653 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f7af00b5680 msgr2=0x7f7af00d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:21:21.873 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:21.870+0000 7f7b1b3dc6c0 1 --2- 10.20.193.11:0/2546453653 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f7af00b5680 0x7f7af00d5b30 secure :-1 s=READY pgs=247 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7b08005980 tx=0x7f7b08005910 comp rx=0 tx=0).stop 2026-02-13T02:21:21.873 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:21.870+0000 7f7b1b3dc6c0 1 -- 10.20.193.11:0/2546453653 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f7b1410ba90 msgr2=0x7f7b14160450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:21:21.873 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:21.870+0000 7f7b1b3dc6c0 1 --2- 10.20.193.11:0/2546453653 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f7b1410ba90 0x7f7b14160450 secure :-1 s=READY pgs=370 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7b0400b6c0 tx=0x7f7b0400bb90 comp rx=0 tx=0).stop 2026-02-13T02:21:21.873 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:21.870+0000 7f7b1b3dc6c0 1 -- 10.20.193.11:0/2546453653 shutdown_connections 2026-02-13T02:21:21.873 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:21.870+0000 7f7b1b3dc6c0 1 --2- 10.20.193.11:0/2546453653 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f7af00b5680 0x7f7af00d5b30 unknown :-1 s=CLOSED pgs=247 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:21.873 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:21.870+0000 7f7b1b3dc6c0 1 --2- 10.20.193.11:0/2546453653 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f7b1410c3a0 0x7f7b14160990 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:21.873 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:21.870+0000 7f7b1b3dc6c0 1 --2- 10.20.193.11:0/2546453653 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f7b141557c0 0x7f7b14165d50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:21.873 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:21.870+0000 7f7b1b3dc6c0 1 --2- 10.20.193.11:0/2546453653 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f7b1410ba90 0x7f7b14160450 unknown :-1 s=CLOSED pgs=370 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:21.873 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:21.870+0000 7f7b1b3dc6c0 1 -- 10.20.193.11:0/2546453653 >> 10.20.193.11:0/2546453653 conn(0x7f7b140e9770 msgr2=0x7f7b14109b50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:21:21.874 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:21.870+0000 7f7b1b3dc6c0 1 -- 10.20.193.11:0/2546453653 shutdown_connections 2026-02-13T02:21:21.874 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:21.870+0000 7f7b1b3dc6c0 1 -- 10.20.193.11:0/2546453653 wait complete. 2026-02-13T02:21:23.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:21:22 trial060 ceph-mon[14797]: pgmap v260: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T02:21:23.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:21:22 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/2546453653' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:21:23.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:21:22 trial078 ceph-mon[14969]: pgmap v260: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T02:21:23.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:21:22 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/2546453653' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:21:23.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:21:22 trial011 ceph-mon[11956]: pgmap v260: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T02:21:23.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:21:22 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/2546453653' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:21:24.912 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:21:25.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:21:24 trial060 ceph-mon[14797]: pgmap v261: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:21:25.036 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:21:25.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:21:24 trial078 ceph-mon[14969]: pgmap v261: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:21:25.056 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:21:24 trial011 ceph-mon[11956]: pgmap v261: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:21:25.157 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:25.152+0000 7fa5ad9e46c0 1 -- 10.20.193.11:0/1965673273 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fa5a810fc20 msgr2=0x7fa5a8114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:21:25.157 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:25.152+0000 7fa5ad9e46c0 1 --2- 10.20.193.11:0/1965673273 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fa5a810fc20 0x7fa5a8114c60 secure :-1 s=READY pgs=371 gs=1 cs=0 l=1 c_cookie=16727954013010449685 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa5900099a0 tx=0x7fa59002ed20 comp rx=0 tx=0).stop 2026-02-13T02:21:25.157 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:25.152+0000 7fa5ad9e46c0 1 -- 10.20.193.11:0/1965673273 shutdown_connections 2026-02-13T02:21:25.157 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:25.152+0000 7fa5ad9e46c0 1 --2- 10.20.193.11:0/1965673273 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fa5a8115440 0x7fa5a8175de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:25.157 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:25.152+0000 7fa5ad9e46c0 1 --2- 10.20.193.11:0/1965673273 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fa5a810fc20 0x7fa5a8114c60 unknown :-1 s=CLOSED pgs=371 gs=1 cs=0 l=1 c_cookie=16727954013010449685 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:25.157 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:25.152+0000 7fa5ad9e46c0 1 --2- 10.20.193.11:0/1965673273 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa5a810f230 0x7fa5a810f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:25.157 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:25.152+0000 7fa5ad9e46c0 1 -- 10.20.193.11:0/1965673273 >> 10.20.193.11:0/1965673273 conn(0x7fa5a80ecb30 msgr2=0x7fa5a810cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:21:25.157 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:25.153+0000 7fa5ad9e46c0 1 -- 10.20.193.11:0/1965673273 shutdown_connections 2026-02-13T02:21:25.157 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:25.153+0000 7fa5ad9e46c0 1 -- 10.20.193.11:0/1965673273 wait complete. 2026-02-13T02:21:25.158 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:25.153+0000 7fa5ad9e46c0 1 Processor -- start 2026-02-13T02:21:25.158 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:25.153+0000 7fa5ad9e46c0 1 -- start start 2026-02-13T02:21:25.158 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:25.153+0000 7fa5ad9e46c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fa5a810f230 0x7fa5a80f4be0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:21:25.158 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:25.153+0000 7fa5ad9e46c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fa5a8115440 0x7fa5a8175ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:21:25.158 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:25.153+0000 7fa5ad9e46c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa5a80f5210 0x7fa5a80fa490 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:21:25.158 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:25.153+0000 7fa5ad9e46c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7fa5a80f5900 con 0x7fa5a8115440 2026-02-13T02:21:25.158 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:25.153+0000 7fa5ad9e46c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa5a80fa9d0 con 0x7fa5a810f230 2026-02-13T02:21:25.158 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:25.153+0000 7fa5ad9e46c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa5a80fab90 con 0x7fa5a80f5210 2026-02-13T02:21:25.158 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:25.153+0000 7fa5a67fc6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fa5a8115440 0x7fa5a8175ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:21:25.158 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:25.153+0000 7fa5a67fc6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fa5a8115440 0x7fa5a8175ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:56252/0 (socket says 10.20.193.11:56252) 2026-02-13T02:21:25.158 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:25.153+0000 7fa5a67fc6c0 1 -- 10.20.193.11:0/1671557227 learned_addr learned my addr 10.20.193.11:0/1671557227 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:21:25.159 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:25.153+0000 7fa5a6ffd6c0 1 --2- 10.20.193.11:0/1671557227 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fa5a810f230 0x7fa5a80f4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:21:25.159 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:25.153+0000 7fa5a77fe6c0 1 --2- 10.20.193.11:0/1671557227 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa5a80f5210 0x7fa5a80fa490 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:21:25.159 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:25.153+0000 7fa5a67fc6c0 1 -- 10.20.193.11:0/1671557227 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa5a80f5210 msgr2=0x7fa5a80fa490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:21:25.159 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:25.153+0000 7fa5a67fc6c0 1 --2- 10.20.193.11:0/1671557227 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa5a80f5210 0x7fa5a80fa490 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:25.159 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:25.153+0000 7fa5a67fc6c0 1 -- 10.20.193.11:0/1671557227 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fa5a810f230 msgr2=0x7fa5a80f4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:21:25.159 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:25.153+0000 7fa5a67fc6c0 1 --2- 10.20.193.11:0/1671557227 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fa5a810f230 0x7fa5a80f4be0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:25.159 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:25.153+0000 7fa5a67fc6c0 1 -- 10.20.193.11:0/1671557227 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa590009590 con 0x7fa5a8115440 2026-02-13T02:21:25.159 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:25.153+0000 7fa5a67fc6c0 1 --2- 10.20.193.11:0/1671557227 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fa5a8115440 0x7fa5a8175ce0 secure :-1 s=READY pgs=372 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa590031f90 tx=0x7fa5900047f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:21:25.159 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:25.153+0000 7fa5ac9de6c0 1 -- 10.20.193.11:0/1671557227 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa590002ae0 con 0x7fa5a8115440 2026-02-13T02:21:25.159 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:25.153+0000 7fa5ac9de6c0 1 -- 10.20.193.11:0/1671557227 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa590002c40 con 0x7fa5a8115440 2026-02-13T02:21:25.159 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:25.153+0000 7fa5ad9e46c0 1 -- 10.20.193.11:0/1671557227 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5a80fae10 con 0x7fa5a8115440 2026-02-13T02:21:25.159 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:25.153+0000 7fa5ac9de6c0 1 -- 10.20.193.11:0/1671557227 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa5900312b0 con 0x7fa5a8115440 2026-02-13T02:21:25.159 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:25.153+0000 7fa5ad9e46c0 1 -- 10.20.193.11:0/1671557227 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5a80fb2e0 con 0x7fa5a8115440 2026-02-13T02:21:25.160 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:25.154+0000 7fa5ad9e46c0 1 -- 10.20.193.11:0/1671557227 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5a8110500 con 0x7fa5a8115440 2026-02-13T02:21:25.160 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:25.155+0000 7fa5ac9de6c0 1 -- 10.20.193.11:0/1671557227 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7fa590007260 con 0x7fa5a8115440 2026-02-13T02:21:25.161 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:25.156+0000 7fa5ac9de6c0 1 --2- 10.20.193.11:0/1671557227 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fa57c0b5680 0x7fa57c0d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:21:25.161 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:25.156+0000 7fa5a6ffd6c0 1 --2- 10.20.193.11:0/1671557227 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fa57c0b5680 0x7fa57c0d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:21:25.161 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:25.156+0000 7fa5ac9de6c0 1 -- 10.20.193.11:0/1671557227 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7965+0+0 (secure 0 0 0) 0x7fa590107bb0 con 0x7fa5a8115440 2026-02-13T02:21:25.161 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:25.156+0000 7fa5ac9de6c0 1 -- 10.20.193.11:0/1671557227 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fa5900cd640 con 0x7fa5a8115440 2026-02-13T02:21:25.161 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:25.156+0000 7fa5a6ffd6c0 1 --2- 10.20.193.11:0/1671557227 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fa57c0b5680 0x7fa57c0d5b30 secure :-1 s=READY pgs=248 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa59c005980 tx=0x7fa59c005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:21:25.272 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:25.270+0000 7fa5ad9e46c0 1 -- 10.20.193.11:0/1671557227 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fa5a810f600 con 0x7fa5a8115440 2026-02-13T02:21:25.272 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:25.270+0000 7fa5ac9de6c0 1 -- 10.20.193.11:0/1671557227 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fa5900cd820 con 0x7fa5a8115440 2026-02-13T02:21:25.272 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:21:25.273 INFO:teuthology.orchestra.run.trial011.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:21:25.274 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:25.271+0000 7fa5ad9e46c0 1 -- 10.20.193.11:0/1671557227 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fa57c0b5680 msgr2=0x7fa57c0d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:21:25.274 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:25.271+0000 7fa5ad9e46c0 1 --2- 10.20.193.11:0/1671557227 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fa57c0b5680 0x7fa57c0d5b30 secure :-1 s=READY pgs=248 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa59c005980 tx=0x7fa59c005910 comp rx=0 tx=0).stop 2026-02-13T02:21:25.274 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:25.271+0000 7fa5ad9e46c0 1 -- 10.20.193.11:0/1671557227 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fa5a8115440 msgr2=0x7fa5a8175ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:21:25.274 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:25.271+0000 7fa5ad9e46c0 1 --2- 10.20.193.11:0/1671557227 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fa5a8115440 0x7fa5a8175ce0 secure :-1 s=READY pgs=372 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa590031f90 tx=0x7fa5900047f0 comp rx=0 tx=0).stop 2026-02-13T02:21:25.274 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:25.271+0000 7fa5ad9e46c0 1 -- 10.20.193.11:0/1671557227 shutdown_connections 2026-02-13T02:21:25.274 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:25.271+0000 7fa5ad9e46c0 1 --2- 10.20.193.11:0/1671557227 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fa57c0b5680 0x7fa57c0d5b30 unknown :-1 s=CLOSED pgs=248 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:25.274 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:25.271+0000 7fa5ad9e46c0 1 --2- 10.20.193.11:0/1671557227 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa5a80f5210 0x7fa5a80fa490 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:25.274 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:25.271+0000 7fa5ad9e46c0 1 --2- 10.20.193.11:0/1671557227 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fa5a8115440 0x7fa5a8175ce0 unknown :-1 s=CLOSED pgs=372 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:25.274 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:25.271+0000 7fa5ad9e46c0 1 --2- 10.20.193.11:0/1671557227 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fa5a810f230 0x7fa5a80f4be0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:25.275 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:25.271+0000 7fa5ad9e46c0 1 -- 10.20.193.11:0/1671557227 >> 10.20.193.11:0/1671557227 conn(0x7fa5a80ecb30 msgr2=0x7fa5a8113c60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:21:25.275 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:25.271+0000 7fa5ad9e46c0 1 -- 10.20.193.11:0/1671557227 shutdown_connections 2026-02-13T02:21:25.275 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:25.271+0000 7fa5ad9e46c0 1 -- 10.20.193.11:0/1671557227 wait complete. 2026-02-13T02:21:26.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:21:25 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/1671557227' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:21:26.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:21:25 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/1671557227' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:21:26.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:21:25 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/1671557227' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:21:27.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:21:26 trial060 ceph-mon[14797]: pgmap v262: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 9 op/s 2026-02-13T02:21:27.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:21:26 trial078 ceph-mon[14969]: pgmap v262: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 9 op/s 2026-02-13T02:21:27.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:21:26 trial011 ceph-mon[11956]: pgmap v262: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 9 op/s 2026-02-13T02:21:28.311 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:21:28.437 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:21:28.555 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:28.552+0000 7f0fdb4716c0 1 -- 10.20.193.11:0/4011566878 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f0fd410bd00 msgr2=0x7f0fd4175a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:21:28.556 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:28.552+0000 7f0fdb4716c0 1 --2- 10.20.193.11:0/4011566878 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f0fd410bd00 0x7f0fd4175a70 secure :-1 s=READY pgs=373 gs=1 cs=0 l=1 c_cookie=4157217071030104219 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0fd000aa40 tx=0x7f0fd002fde0 comp rx=0 tx=0).stop 2026-02-13T02:21:28.556 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:28.552+0000 7f0fdb4716c0 1 -- 10.20.193.11:0/4011566878 shutdown_connections 2026-02-13T02:21:28.556 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:28.552+0000 7f0fdb4716c0 1 --2- 10.20.193.11:0/4011566878 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f0fd410b120 0x7f0fd410b550 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:28.556 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:28.552+0000 7f0fdb4716c0 1 --2- 10.20.193.11:0/4011566878 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f0fd410bd00 0x7f0fd4175a70 unknown :-1 s=CLOSED pgs=373 gs=1 cs=0 l=1 c_cookie=4157217071030104219 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:28.556 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:28.552+0000 7f0fdb4716c0 1 --2- 10.20.193.11:0/4011566878 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f0fd410dad0 0x7f0fd410dea0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:28.556 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:28.552+0000 7f0fdb4716c0 1 -- 10.20.193.11:0/4011566878 >> 10.20.193.11:0/4011566878 conn(0x7f0fd4062e00 msgr2=0x7f0fd4109660 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:21:28.556 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:28.552+0000 7f0fdb4716c0 1 -- 10.20.193.11:0/4011566878 shutdown_connections 2026-02-13T02:21:28.556 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:28.552+0000 7f0fdb4716c0 1 -- 10.20.193.11:0/4011566878 wait complete. 2026-02-13T02:21:28.556 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:28.552+0000 7f0fdb4716c0 1 Processor -- start 2026-02-13T02:21:28.556 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:28.552+0000 7f0fdb4716c0 1 -- start start 2026-02-13T02:21:28.557 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:28.552+0000 7f0fdb4716c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f0fd410b120 0x7f0fd4115b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:21:28.557 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:28.552+0000 7f0fdb4716c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f0fd410bd00 0x7f0fd4116050 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:21:28.557 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:28.552+0000 7f0fdb4716c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f0fd410dad0 0x7f0fd411b410 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:21:28.557 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:28.552+0000 7f0fdb4716c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f0fd411ba60 con 0x7f0fd410bd00 2026-02-13T02:21:28.557 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:28.552+0000 7f0fdb4716c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f0fd411bbd0 con 0x7f0fd410b120 2026-02-13T02:21:28.557 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:28.552+0000 7f0fdb4716c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f0fd411bd90 con 0x7f0fd410dad0 2026-02-13T02:21:28.557 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:28.552+0000 7f0fd89e16c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f0fd410bd00 0x7f0fd4116050 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:21:28.557 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:28.552+0000 7f0fd89e16c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f0fd410bd00 0x7f0fd4116050 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:56268/0 (socket says 10.20.193.11:56268) 2026-02-13T02:21:28.557 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:28.552+0000 7f0fd89e16c0 1 -- 10.20.193.11:0/624594945 learned_addr learned my addr 10.20.193.11:0/624594945 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:21:28.557 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:28.552+0000 7f0fd91e26c0 1 --2- 10.20.193.11:0/624594945 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f0fd410b120 0x7f0fd4115b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:21:28.557 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:28.552+0000 7f0fd99e36c0 1 --2- 10.20.193.11:0/624594945 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f0fd410dad0 0x7f0fd411b410 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:21:28.557 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:28.552+0000 7f0fd89e16c0 1 -- 10.20.193.11:0/624594945 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f0fd410dad0 msgr2=0x7f0fd411b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:21:28.558 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:28.552+0000 7f0fd89e16c0 1 --2- 10.20.193.11:0/624594945 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f0fd410dad0 0x7f0fd411b410 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:28.558 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:28.552+0000 7f0fd89e16c0 1 -- 10.20.193.11:0/624594945 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f0fd410b120 msgr2=0x7f0fd4115b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:21:28.558 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:28.552+0000 7f0fd89e16c0 1 --2- 10.20.193.11:0/624594945 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f0fd410b120 0x7f0fd4115b10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:28.558 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:28.553+0000 7f0fd89e16c0 1 -- 10.20.193.11:0/624594945 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fd000a660 con 0x7f0fd410bd00 2026-02-13T02:21:28.558 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:28.553+0000 7f0fd91e26c0 1 --2- 10.20.193.11:0/624594945 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f0fd410b120 0x7f0fd4115b10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T02:21:28.558 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:28.553+0000 7f0fd99e36c0 1 --2- 10.20.193.11:0/624594945 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f0fd410dad0 0x7f0fd411b410 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T02:21:28.558 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:28.553+0000 7f0fd89e16c0 1 --2- 10.20.193.11:0/624594945 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f0fd410bd00 0x7f0fd4116050 secure :-1 s=READY pgs=374 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0fc800b710 tx=0x7f0fc800bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:21:28.558 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:28.553+0000 7f0fc27fc6c0 1 -- 10.20.193.11:0/624594945 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0fc8004250 con 0x7f0fd410bd00 2026-02-13T02:21:28.558 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:28.553+0000 7f0fc27fc6c0 1 -- 10.20.193.11:0/624594945 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f0fc8009070 con 0x7f0fd410bd00 2026-02-13T02:21:28.558 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:28.553+0000 7f0fc27fc6c0 1 -- 10.20.193.11:0/624594945 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0fc800cd70 con 0x7f0fd410bd00 2026-02-13T02:21:28.558 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:28.553+0000 7f0fdb4716c0 1 -- 10.20.193.11:0/624594945 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fd411c070 con 0x7f0fd410bd00 2026-02-13T02:21:28.558 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:28.553+0000 7f0fdb4716c0 1 -- 10.20.193.11:0/624594945 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fd415c750 con 0x7f0fd410bd00 2026-02-13T02:21:28.559 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:28.553+0000 7f0fdb4716c0 1 -- 10.20.193.11:0/624594945 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fd410c130 con 0x7f0fd410bd00 2026-02-13T02:21:28.560 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:28.554+0000 7f0fc27fc6c0 1 -- 10.20.193.11:0/624594945 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7f0fc80028c0 con 0x7f0fd410bd00 2026-02-13T02:21:28.560 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:28.555+0000 7f0fc27fc6c0 1 --2- 10.20.193.11:0/624594945 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f0fb00b5680 0x7f0fb00d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:21:28.560 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:28.555+0000 7f0fd91e26c0 1 --2- 10.20.193.11:0/624594945 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f0fb00b5680 0x7f0fb00d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:21:28.560 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:28.555+0000 7f0fc27fc6c0 1 -- 10.20.193.11:0/624594945 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7965+0+0 (secure 0 0 0) 0x7f0fc80e3a50 con 0x7f0fd410bd00 2026-02-13T02:21:28.560 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:28.556+0000 7f0fd91e26c0 1 --2- 10.20.193.11:0/624594945 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f0fb00b5680 0x7f0fb00d5b30 secure :-1 s=READY pgs=249 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0fc4004750 tx=0x7f0fc4009630 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:21:28.560 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:28.556+0000 7f0fc27fc6c0 1 -- 10.20.193.11:0/624594945 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f0fc80a6510 con 0x7f0fd410bd00 2026-02-13T02:21:28.671 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:28.669+0000 7f0fdb4716c0 1 -- 10.20.193.11:0/624594945 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f0fd4116c90 con 0x7f0fd410bd00 2026-02-13T02:21:28.672 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:28.670+0000 7f0fc27fc6c0 1 -- 10.20.193.11:0/624594945 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f0fc80a96c0 con 0x7f0fd410bd00 2026-02-13T02:21:28.672 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:21:28.672 INFO:teuthology.orchestra.run.trial011.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:21:28.673 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:28.671+0000 7f0fdb4716c0 1 -- 10.20.193.11:0/624594945 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f0fb00b5680 msgr2=0x7f0fb00d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:21:28.673 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:28.671+0000 7f0fdb4716c0 1 --2- 10.20.193.11:0/624594945 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f0fb00b5680 0x7f0fb00d5b30 secure :-1 s=READY pgs=249 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0fc4004750 tx=0x7f0fc4009630 comp rx=0 tx=0).stop 2026-02-13T02:21:28.673 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:28.671+0000 7f0fdb4716c0 1 -- 10.20.193.11:0/624594945 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f0fd410bd00 msgr2=0x7f0fd4116050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:21:28.673 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:28.671+0000 7f0fdb4716c0 1 --2- 10.20.193.11:0/624594945 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f0fd410bd00 0x7f0fd4116050 secure :-1 s=READY pgs=374 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0fc800b710 tx=0x7f0fc800bbe0 comp rx=0 tx=0).stop 2026-02-13T02:21:28.673 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:28.671+0000 7f0fdb4716c0 1 -- 10.20.193.11:0/624594945 shutdown_connections 2026-02-13T02:21:28.674 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:28.671+0000 7f0fdb4716c0 1 --2- 10.20.193.11:0/624594945 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f0fb00b5680 0x7f0fb00d5b30 unknown :-1 s=CLOSED pgs=249 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:28.674 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:28.671+0000 7f0fdb4716c0 1 --2- 10.20.193.11:0/624594945 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f0fd410dad0 0x7f0fd411b410 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:28.674 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:28.671+0000 7f0fdb4716c0 1 --2- 10.20.193.11:0/624594945 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f0fd410bd00 0x7f0fd4116050 unknown :-1 s=CLOSED pgs=374 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:28.674 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:28.671+0000 7f0fdb4716c0 1 --2- 10.20.193.11:0/624594945 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f0fd410b120 0x7f0fd4115b10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:28.674 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:28.671+0000 7f0fdb4716c0 1 -- 10.20.193.11:0/624594945 >> 10.20.193.11:0/624594945 conn(0x7f0fd4062e00 msgr2=0x7f0fd4058a60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:21:28.674 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:28.671+0000 7f0fdb4716c0 1 -- 10.20.193.11:0/624594945 shutdown_connections 2026-02-13T02:21:28.674 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:28.671+0000 7f0fdb4716c0 1 -- 10.20.193.11:0/624594945 wait complete. 2026-02-13T02:21:28.951 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:21:28 trial011 ceph-mon[11956]: pgmap v263: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T02:21:28.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:21:28 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/624594945' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:21:28.999 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:21:28 trial060 ceph-mon[14797]: pgmap v263: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T02:21:29.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:21:28 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/624594945' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:21:29.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:21:28 trial078 ceph-mon[14969]: pgmap v263: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T02:21:29.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:21:28 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/624594945' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:21:31.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:21:30 trial060 ceph-mon[14797]: pgmap v264: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:21:31.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:21:30 trial078 ceph-mon[14969]: pgmap v264: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:21:31.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:21:30 trial011 ceph-mon[11956]: pgmap v264: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:21:31.711 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:21:31.836 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:21:31.948 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:31.944+0000 7f9d4c1106c0 1 -- 10.20.193.11:0/1532850928 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f9d4410fbf0 msgr2=0x7f9d44114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:21:31.948 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:31.944+0000 7f9d4c1106c0 1 --2- 10.20.193.11:0/1532850928 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f9d4410fbf0 0x7f9d44114c30 secure :-1 s=READY pgs=375 gs=1 cs=0 l=1 c_cookie=14738469291088404734 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9d380099a0 tx=0x7f9d3802ed20 comp rx=0 tx=0).stop 2026-02-13T02:21:31.948 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:31.944+0000 7f9d4c1106c0 1 -- 10.20.193.11:0/1532850928 shutdown_connections 2026-02-13T02:21:31.949 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:31.944+0000 7f9d4c1106c0 1 --2- 10.20.193.11:0/1532850928 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f9d44115410 0x7f9d44175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:31.949 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:31.944+0000 7f9d4c1106c0 1 --2- 10.20.193.11:0/1532850928 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f9d4410fbf0 0x7f9d44114c30 unknown :-1 s=CLOSED pgs=375 gs=1 cs=0 l=1 c_cookie=14738469291088404734 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:31.949 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:31.944+0000 7f9d4c1106c0 1 --2- 10.20.193.11:0/1532850928 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f9d4410f200 0x7f9d4410f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:31.949 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:31.944+0000 7f9d4c1106c0 1 -- 10.20.193.11:0/1532850928 >> 10.20.193.11:0/1532850928 conn(0x7f9d440ecb00 msgr2=0x7f9d4410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:21:31.949 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:31.944+0000 7f9d4c1106c0 1 -- 10.20.193.11:0/1532850928 shutdown_connections 2026-02-13T02:21:31.949 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:31.944+0000 7f9d4c1106c0 1 -- 10.20.193.11:0/1532850928 wait complete. 2026-02-13T02:21:31.949 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:31.944+0000 7f9d4c1106c0 1 Processor -- start 2026-02-13T02:21:31.949 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:31.944+0000 7f9d4c1106c0 1 -- start start 2026-02-13T02:21:31.949 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:31.945+0000 7f9d4c1106c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f9d4410f200 0x7f9d440f4c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:21:31.949 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:31.945+0000 7f9d4c1106c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f9d44115410 0x7f9d44175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:21:31.949 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:31.945+0000 7f9d4c1106c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f9d440f5270 0x7f9d440fa540 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:21:31.950 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:31.945+0000 7f9d4c1106c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f9d440f5960 con 0x7f9d440f5270 2026-02-13T02:21:31.950 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:31.945+0000 7f9d4c1106c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9d440faa80 con 0x7f9d44115410 2026-02-13T02:21:31.950 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:31.945+0000 7f9d4c1106c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f9d440fac40 con 0x7f9d4410f200 2026-02-13T02:21:31.950 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:31.945+0000 7f9d4a6866c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f9d440f5270 0x7f9d440fa540 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:21:31.950 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:31.945+0000 7f9d4a6866c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f9d440f5270 0x7f9d440fa540 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:60018/0 (socket says 10.20.193.11:60018) 2026-02-13T02:21:31.950 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:31.945+0000 7f9d4a6866c0 1 -- 10.20.193.11:0/3281242881 learned_addr learned my addr 10.20.193.11:0/3281242881 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:21:31.950 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:31.945+0000 7f9d496846c0 1 --2- 10.20.193.11:0/3281242881 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f9d44115410 0x7f9d44175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:21:31.950 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:31.945+0000 7f9d49e856c0 1 --2- 10.20.193.11:0/3281242881 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f9d4410f200 0x7f9d440f4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:21:31.950 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:31.945+0000 7f9d4a6866c0 1 -- 10.20.193.11:0/3281242881 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f9d4410f200 msgr2=0x7f9d440f4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:21:31.950 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:31.945+0000 7f9d4a6866c0 1 --2- 10.20.193.11:0/3281242881 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f9d4410f200 0x7f9d440f4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:31.950 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:31.945+0000 7f9d4a6866c0 1 -- 10.20.193.11:0/3281242881 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f9d44115410 msgr2=0x7f9d44175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:21:31.950 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:31.945+0000 7f9d4a6866c0 1 --2- 10.20.193.11:0/3281242881 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f9d44115410 0x7f9d44175cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:31.951 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:31.945+0000 7f9d4a6866c0 1 -- 10.20.193.11:0/3281242881 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d38009590 con 0x7f9d440f5270 2026-02-13T02:21:31.951 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:31.945+0000 7f9d49e856c0 1 --2- 10.20.193.11:0/3281242881 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f9d4410f200 0x7f9d440f4c40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:21:31.951 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:31.945+0000 7f9d4a6866c0 1 --2- 10.20.193.11:0/3281242881 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f9d440f5270 0x7f9d440fa540 secure :-1 s=READY pgs=376 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9d40006ea0 tx=0x7f9d4000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:21:31.951 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:31.945+0000 7f9d32ffd6c0 1 -- 10.20.193.11:0/3281242881 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9d40003a30 con 0x7f9d440f5270 2026-02-13T02:21:31.951 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:31.945+0000 7f9d32ffd6c0 1 -- 10.20.193.11:0/3281242881 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9d40005510 con 0x7f9d440f5270 2026-02-13T02:21:31.951 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:31.945+0000 7f9d4c1106c0 1 -- 10.20.193.11:0/3281242881 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d440faf20 con 0x7f9d440f5270 2026-02-13T02:21:31.951 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:31.945+0000 7f9d32ffd6c0 1 -- 10.20.193.11:0/3281242881 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9d4000dd70 con 0x7f9d440f5270 2026-02-13T02:21:31.951 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:31.945+0000 7f9d4c1106c0 1 -- 10.20.193.11:0/3281242881 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d440fb3b0 con 0x7f9d440f5270 2026-02-13T02:21:31.951 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:31.945+0000 7f9d4c1106c0 1 -- 10.20.193.11:0/3281242881 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d441104d0 con 0x7f9d440f5270 2026-02-13T02:21:31.951 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:31.947+0000 7f9d32ffd6c0 1 -- 10.20.193.11:0/3281242881 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7f9d40003b90 con 0x7f9d440f5270 2026-02-13T02:21:31.952 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:31.947+0000 7f9d32ffd6c0 1 --2- 10.20.193.11:0/3281242881 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f9d200b5600 0x7f9d200d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:21:31.952 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:31.947+0000 7f9d49e856c0 1 --2- 10.20.193.11:0/3281242881 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f9d200b5600 0x7f9d200d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:21:31.953 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:31.947+0000 7f9d32ffd6c0 1 -- 10.20.193.11:0/3281242881 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7965+0+0 (secure 0 0 0) 0x7f9d400e48c0 con 0x7f9d440f5270 2026-02-13T02:21:31.953 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:31.948+0000 7f9d49e856c0 1 --2- 10.20.193.11:0/3281242881 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f9d200b5600 0x7f9d200d5ab0 secure :-1 s=READY pgs=250 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9d34004750 tx=0x7f9d34005f10 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:21:31.953 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:31.948+0000 7f9d32ffd6c0 1 -- 10.20.193.11:0/3281242881 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f9d400a7380 con 0x7f9d440f5270 2026-02-13T02:21:32.064 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:32.062+0000 7f9d4c1106c0 1 -- 10.20.193.11:0/3281242881 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f9d4410f5d0 con 0x7f9d440f5270 2026-02-13T02:21:32.064 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:32.062+0000 7f9d32ffd6c0 1 -- 10.20.193.11:0/3281242881 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f9d400aa530 con 0x7f9d440f5270 2026-02-13T02:21:32.065 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:21:32.065 INFO:teuthology.orchestra.run.trial011.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:21:32.066 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:32.063+0000 7f9d4c1106c0 1 -- 10.20.193.11:0/3281242881 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f9d200b5600 msgr2=0x7f9d200d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:21:32.066 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:32.063+0000 7f9d4c1106c0 1 --2- 10.20.193.11:0/3281242881 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f9d200b5600 0x7f9d200d5ab0 secure :-1 s=READY pgs=250 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9d34004750 tx=0x7f9d34005f10 comp rx=0 tx=0).stop 2026-02-13T02:21:32.066 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:32.063+0000 7f9d4c1106c0 1 -- 10.20.193.11:0/3281242881 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f9d440f5270 msgr2=0x7f9d440fa540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:21:32.066 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:32.063+0000 7f9d4c1106c0 1 --2- 10.20.193.11:0/3281242881 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f9d440f5270 0x7f9d440fa540 secure :-1 s=READY pgs=376 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9d40006ea0 tx=0x7f9d4000cca0 comp rx=0 tx=0).stop 2026-02-13T02:21:32.066 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:32.063+0000 7f9d4c1106c0 1 -- 10.20.193.11:0/3281242881 shutdown_connections 2026-02-13T02:21:32.066 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:32.063+0000 7f9d4c1106c0 1 --2- 10.20.193.11:0/3281242881 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f9d200b5600 0x7f9d200d5ab0 unknown :-1 s=CLOSED pgs=250 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:32.066 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:32.063+0000 7f9d4c1106c0 1 --2- 10.20.193.11:0/3281242881 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f9d44115410 0x7f9d44175cb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:32.067 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:32.063+0000 7f9d4c1106c0 1 --2- 10.20.193.11:0/3281242881 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f9d440f5270 0x7f9d440fa540 unknown :-1 s=CLOSED pgs=376 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:32.067 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:32.063+0000 7f9d4c1106c0 1 --2- 10.20.193.11:0/3281242881 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f9d4410f200 0x7f9d440f4c40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:32.067 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:32.063+0000 7f9d4c1106c0 1 -- 10.20.193.11:0/3281242881 >> 10.20.193.11:0/3281242881 conn(0x7f9d440ecb00 msgr2=0x7f9d4410d860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:21:32.067 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:32.063+0000 7f9d4c1106c0 1 -- 10.20.193.11:0/3281242881 shutdown_connections 2026-02-13T02:21:32.067 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:32.063+0000 7f9d4c1106c0 1 -- 10.20.193.11:0/3281242881 wait complete. 2026-02-13T02:21:33.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:21:32 trial060 ceph-mon[14797]: pgmap v265: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T02:21:33.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:21:32 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/3281242881' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:21:33.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:21:32 trial078 ceph-mon[14969]: pgmap v265: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T02:21:33.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:21:32 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/3281242881' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:21:33.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:21:32 trial011 ceph-mon[11956]: pgmap v265: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T02:21:33.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:21:32 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/3281242881' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:21:35.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:21:34 trial060 ceph-mon[14797]: pgmap v266: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:21:35.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:21:34 trial078 ceph-mon[14969]: pgmap v266: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:21:35.104 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:21:35.131 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:21:34 trial011 ceph-mon[11956]: pgmap v266: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:21:35.228 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:21:35.341 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:35.338+0000 7f79652f06c0 1 -- 10.20.193.11:0/3826838339 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f796010fbf0 msgr2=0x7f7960114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:21:35.342 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:35.338+0000 7f79652f06c0 1 --2- 10.20.193.11:0/3826838339 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f796010fbf0 0x7f7960114c30 secure :-1 s=READY pgs=377 gs=1 cs=0 l=1 c_cookie=17267436007158410129 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f79480099a0 tx=0x7f794802ed20 comp rx=0 tx=0).stop 2026-02-13T02:21:35.342 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:35.338+0000 7f79652f06c0 1 -- 10.20.193.11:0/3826838339 shutdown_connections 2026-02-13T02:21:35.342 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:35.338+0000 7f79652f06c0 1 --2- 10.20.193.11:0/3826838339 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f7960115410 0x7f7960175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:35.342 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:35.338+0000 7f79652f06c0 1 --2- 10.20.193.11:0/3826838339 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f796010fbf0 0x7f7960114c30 unknown :-1 s=CLOSED pgs=377 gs=1 cs=0 l=1 c_cookie=17267436007158410129 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:35.342 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:35.338+0000 7f79652f06c0 1 --2- 10.20.193.11:0/3826838339 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f796010f200 0x7f796010f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:35.342 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:35.338+0000 7f79652f06c0 1 -- 10.20.193.11:0/3826838339 >> 10.20.193.11:0/3826838339 conn(0x7f79600ecb00 msgr2=0x7f796010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:21:35.342 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:35.338+0000 7f79652f06c0 1 -- 10.20.193.11:0/3826838339 shutdown_connections 2026-02-13T02:21:35.342 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:35.338+0000 7f79652f06c0 1 -- 10.20.193.11:0/3826838339 wait complete. 2026-02-13T02:21:35.342 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:35.338+0000 7f79652f06c0 1 Processor -- start 2026-02-13T02:21:35.342 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:35.338+0000 7f79652f06c0 1 -- start start 2026-02-13T02:21:35.342 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:35.338+0000 7f79652f06c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f796010f200 0x7f79600f4b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:21:35.343 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:35.338+0000 7f79652f06c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f7960115410 0x7f7960175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:21:35.343 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:35.338+0000 7f79652f06c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f79600f5140 0x7f79600fa410 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:21:35.343 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:35.338+0000 7f79652f06c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f79600f5830 con 0x7f7960115410 2026-02-13T02:21:35.343 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:35.338+0000 7f79652f06c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f79600fa950 con 0x7f79600f5140 2026-02-13T02:21:35.343 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:35.338+0000 7f79652f06c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f79600fab10 con 0x7f796010f200 2026-02-13T02:21:35.343 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:35.338+0000 7f795e7fc6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f7960115410 0x7f7960175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:21:35.343 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:35.338+0000 7f795e7fc6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f7960115410 0x7f7960175cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:60032/0 (socket says 10.20.193.11:60032) 2026-02-13T02:21:35.343 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:35.338+0000 7f795e7fc6c0 1 -- 10.20.193.11:0/131290555 learned_addr learned my addr 10.20.193.11:0/131290555 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:21:35.343 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:35.338+0000 7f795e7fc6c0 1 -- 10.20.193.11:0/131290555 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f796010f200 msgr2=0x7f79600f4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:21:35.343 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:35.338+0000 7f795e7fc6c0 1 --2- 10.20.193.11:0/131290555 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f796010f200 0x7f79600f4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:35.343 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:35.339+0000 7f795e7fc6c0 1 -- 10.20.193.11:0/131290555 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f79600f5140 msgr2=0x7f79600fa410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:21:35.344 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:35.339+0000 7f795e7fc6c0 1 --2- 10.20.193.11:0/131290555 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f79600f5140 0x7f79600fa410 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:35.344 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:35.339+0000 7f795e7fc6c0 1 -- 10.20.193.11:0/131290555 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7948009590 con 0x7f7960115410 2026-02-13T02:21:35.344 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:35.339+0000 7f795e7fc6c0 1 --2- 10.20.193.11:0/131290555 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f7960115410 0x7f7960175cb0 secure :-1 s=READY pgs=378 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7948031f90 tx=0x7f794802f9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:21:35.344 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:35.339+0000 7f7937fff6c0 1 -- 10.20.193.11:0/131290555 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f79480028d0 con 0x7f7960115410 2026-02-13T02:21:35.344 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:35.339+0000 7f79652f06c0 1 -- 10.20.193.11:0/131290555 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79600fad90 con 0x7f7960115410 2026-02-13T02:21:35.344 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:35.339+0000 7f7937fff6c0 1 -- 10.20.193.11:0/131290555 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f7948007260 con 0x7f7960115410 2026-02-13T02:21:35.344 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:35.339+0000 7f7937fff6c0 1 -- 10.20.193.11:0/131290555 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f79480312b0 con 0x7f7960115410 2026-02-13T02:21:35.344 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:35.339+0000 7f79652f06c0 1 -- 10.20.193.11:0/131290555 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79600fb210 con 0x7f7960115410 2026-02-13T02:21:35.344 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:35.339+0000 7f79652f06c0 1 -- 10.20.193.11:0/131290555 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79601104d0 con 0x7f7960115410 2026-02-13T02:21:35.345 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:35.340+0000 7f7937fff6c0 1 -- 10.20.193.11:0/131290555 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7f79480073d0 con 0x7f7960115410 2026-02-13T02:21:35.345 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:35.341+0000 7f7937fff6c0 1 --2- 10.20.193.11:0/131290555 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f79300b5600 0x7f79300d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:21:35.346 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:35.341+0000 7f795effd6c0 1 --2- 10.20.193.11:0/131290555 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f79300b5600 0x7f79300d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:21:35.346 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:35.341+0000 7f7937fff6c0 1 -- 10.20.193.11:0/131290555 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7965+0+0 (secure 0 0 0) 0x7f7948107b70 con 0x7f7960115410 2026-02-13T02:21:35.346 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:35.341+0000 7f7937fff6c0 1 -- 10.20.193.11:0/131290555 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f79480cd7e0 con 0x7f7960115410 2026-02-13T02:21:35.346 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:35.341+0000 7f795effd6c0 1 --2- 10.20.193.11:0/131290555 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f79300b5600 0x7f79300d5ab0 secure :-1 s=READY pgs=251 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7954004750 tx=0x7f79540096a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:21:35.460 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:35.458+0000 7f79652f06c0 1 -- 10.20.193.11:0/131290555 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f796010fbf0 con 0x7f7960115410 2026-02-13T02:21:35.460 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:35.458+0000 7f7937fff6c0 1 -- 10.20.193.11:0/131290555 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f79480cd9c0 con 0x7f7960115410 2026-02-13T02:21:35.461 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:21:35.461 INFO:teuthology.orchestra.run.trial011.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:21:35.462 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:35.459+0000 7f79652f06c0 1 -- 10.20.193.11:0/131290555 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f79300b5600 msgr2=0x7f79300d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:21:35.462 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:35.459+0000 7f79652f06c0 1 --2- 10.20.193.11:0/131290555 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f79300b5600 0x7f79300d5ab0 secure :-1 s=READY pgs=251 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7954004750 tx=0x7f79540096a0 comp rx=0 tx=0).stop 2026-02-13T02:21:35.462 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:35.459+0000 7f79652f06c0 1 -- 10.20.193.11:0/131290555 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f7960115410 msgr2=0x7f7960175cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:21:35.462 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:35.459+0000 7f79652f06c0 1 --2- 10.20.193.11:0/131290555 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f7960115410 0x7f7960175cb0 secure :-1 s=READY pgs=378 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7948031f90 tx=0x7f794802f9f0 comp rx=0 tx=0).stop 2026-02-13T02:21:35.462 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:35.459+0000 7f79652f06c0 1 -- 10.20.193.11:0/131290555 shutdown_connections 2026-02-13T02:21:35.462 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:35.459+0000 7f79652f06c0 1 --2- 10.20.193.11:0/131290555 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f79300b5600 0x7f79300d5ab0 unknown :-1 s=CLOSED pgs=251 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:35.462 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:35.459+0000 7f79652f06c0 1 --2- 10.20.193.11:0/131290555 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f79600f5140 0x7f79600fa410 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:35.462 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:35.459+0000 7f79652f06c0 1 --2- 10.20.193.11:0/131290555 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f7960115410 0x7f7960175cb0 unknown :-1 s=CLOSED pgs=378 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:35.462 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:35.459+0000 7f79652f06c0 1 --2- 10.20.193.11:0/131290555 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f796010f200 0x7f79600f4b10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:35.462 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:35.459+0000 7f79652f06c0 1 -- 10.20.193.11:0/131290555 >> 10.20.193.11:0/131290555 conn(0x7f79600ecb00 msgr2=0x7f7960113a90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:21:35.463 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:35.459+0000 7f79652f06c0 1 -- 10.20.193.11:0/131290555 shutdown_connections 2026-02-13T02:21:35.463 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:35.459+0000 7f79652f06c0 1 -- 10.20.193.11:0/131290555 wait complete. 2026-02-13T02:21:36.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:21:35 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/131290555' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:21:36.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:21:35 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/131290555' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:21:36.250 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:21:35 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/131290555' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:21:37.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:21:36 trial078 ceph-mon[14969]: pgmap v267: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 9 op/s 2026-02-13T02:21:37.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:21:36 trial011 ceph-mon[11956]: pgmap v267: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 9 op/s 2026-02-13T02:21:37.250 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:21:36 trial060 ceph-mon[14797]: pgmap v267: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 9 op/s 2026-02-13T02:21:38.500 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:21:38.627 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:21:38.745 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:38.743+0000 7f42e95956c0 1 -- 10.20.193.11:0/2086234512 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f42e410fbf0 msgr2=0x7f42e4114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:21:38.745 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:38.743+0000 7f42e95956c0 1 --2- 10.20.193.11:0/2086234512 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f42e410fbf0 0x7f42e4114c30 secure :-1 s=READY pgs=379 gs=1 cs=0 l=1 c_cookie=1700394797305377585 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f42cc0099a0 tx=0x7f42cc02ed20 comp rx=0 tx=0).stop 2026-02-13T02:21:38.745 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:38.743+0000 7f42e95956c0 1 -- 10.20.193.11:0/2086234512 shutdown_connections 2026-02-13T02:21:38.745 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:38.743+0000 7f42e95956c0 1 --2- 10.20.193.11:0/2086234512 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f42e4115410 0x7f42e4175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:38.745 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:38.743+0000 7f42e95956c0 1 --2- 10.20.193.11:0/2086234512 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f42e410fbf0 0x7f42e4114c30 unknown :-1 s=CLOSED pgs=379 gs=1 cs=0 l=1 c_cookie=1700394797305377585 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:38.745 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:38.743+0000 7f42e95956c0 1 --2- 10.20.193.11:0/2086234512 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f42e410f200 0x7f42e410f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:38.745 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:38.743+0000 7f42e95956c0 1 -- 10.20.193.11:0/2086234512 >> 10.20.193.11:0/2086234512 conn(0x7f42e40ecb00 msgr2=0x7f42e410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:21:38.745 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:38.743+0000 7f42e95956c0 1 -- 10.20.193.11:0/2086234512 shutdown_connections 2026-02-13T02:21:38.745 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:38.743+0000 7f42e95956c0 1 -- 10.20.193.11:0/2086234512 wait complete. 2026-02-13T02:21:38.746 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:38.743+0000 7f42e95956c0 1 Processor -- start 2026-02-13T02:21:38.746 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:38.743+0000 7f42e95956c0 1 -- start start 2026-02-13T02:21:38.746 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:38.744+0000 7f42e95956c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f42e410f200 0x7f42e40f4c50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:21:38.746 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:38.744+0000 7f42e95956c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f42e4115410 0x7f42e4175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:21:38.746 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:38.744+0000 7f42e95956c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f42e40f5280 0x7f42e40fa550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:21:38.746 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:38.744+0000 7f42e95956c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f42e40f5970 con 0x7f42e4115410 2026-02-13T02:21:38.746 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:38.744+0000 7f42e95956c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f42e40faa90 con 0x7f42e410f200 2026-02-13T02:21:38.746 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:38.744+0000 7f42e95956c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f42e40fac50 con 0x7f42e40f5280 2026-02-13T02:21:38.746 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:38.744+0000 7f42e27fc6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f42e4115410 0x7f42e4175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:21:38.746 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:38.744+0000 7f42e27fc6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f42e4115410 0x7f42e4175cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:60048/0 (socket says 10.20.193.11:60048) 2026-02-13T02:21:38.746 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:38.744+0000 7f42e27fc6c0 1 -- 10.20.193.11:0/2224113177 learned_addr learned my addr 10.20.193.11:0/2224113177 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:21:38.746 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:38.744+0000 7f42e37fe6c0 1 --2- 10.20.193.11:0/2224113177 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f42e40f5280 0x7f42e40fa550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:21:38.746 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:38.744+0000 7f42e2ffd6c0 1 --2- 10.20.193.11:0/2224113177 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f42e410f200 0x7f42e40f4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:21:38.746 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:38.744+0000 7f42e27fc6c0 1 -- 10.20.193.11:0/2224113177 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f42e40f5280 msgr2=0x7f42e40fa550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:21:38.746 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:38.744+0000 7f42e27fc6c0 1 --2- 10.20.193.11:0/2224113177 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f42e40f5280 0x7f42e40fa550 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:38.746 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:38.744+0000 7f42e27fc6c0 1 -- 10.20.193.11:0/2224113177 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f42e410f200 msgr2=0x7f42e40f4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:21:38.746 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:38.744+0000 7f42e27fc6c0 1 --2- 10.20.193.11:0/2224113177 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f42e410f200 0x7f42e40f4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:38.746 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:38.744+0000 7f42e27fc6c0 1 -- 10.20.193.11:0/2224113177 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42cc009590 con 0x7f42e4115410 2026-02-13T02:21:38.746 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:38.744+0000 7f42e2ffd6c0 1 --2- 10.20.193.11:0/2224113177 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f42e410f200 0x7f42e40f4c50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:21:38.746 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:38.744+0000 7f42e27fc6c0 1 --2- 10.20.193.11:0/2224113177 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f42e4115410 0x7f42e4175cb0 secure :-1 s=READY pgs=380 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f42cc031f90 tx=0x7f42cc0047f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:21:38.746 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:38.744+0000 7f42c3fff6c0 1 -- 10.20.193.11:0/2224113177 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f42cc002ae0 con 0x7f42e4115410 2026-02-13T02:21:38.746 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:38.744+0000 7f42c3fff6c0 1 -- 10.20.193.11:0/2224113177 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f42cc002c40 con 0x7f42e4115410 2026-02-13T02:21:38.746 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:38.744+0000 7f42e95956c0 1 -- 10.20.193.11:0/2224113177 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42e40faed0 con 0x7f42e4115410 2026-02-13T02:21:38.746 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:38.744+0000 7f42c3fff6c0 1 -- 10.20.193.11:0/2224113177 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f42cc0312b0 con 0x7f42e4115410 2026-02-13T02:21:38.746 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:38.744+0000 7f42e95956c0 1 -- 10.20.193.11:0/2224113177 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42e40fb3a0 con 0x7f42e4115410 2026-02-13T02:21:38.746 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:38.744+0000 7f42e95956c0 1 -- 10.20.193.11:0/2224113177 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42e41104d0 con 0x7f42e4115410 2026-02-13T02:21:38.747 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:38.746+0000 7f42c3fff6c0 1 -- 10.20.193.11:0/2224113177 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7f42cc007260 con 0x7f42e4115410 2026-02-13T02:21:38.748 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:38.747+0000 7f42c3fff6c0 1 --2- 10.20.193.11:0/2224113177 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f42b80b5680 0x7f42b80d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:21:38.748 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:38.747+0000 7f42e2ffd6c0 1 --2- 10.20.193.11:0/2224113177 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f42b80b5680 0x7f42b80d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:21:38.748 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:38.747+0000 7f42c3fff6c0 1 -- 10.20.193.11:0/2224113177 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7965+0+0 (secure 0 0 0) 0x7f42cc107bc0 con 0x7f42e4115410 2026-02-13T02:21:38.748 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:38.747+0000 7f42e2ffd6c0 1 --2- 10.20.193.11:0/2224113177 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f42b80b5680 0x7f42b80d5b30 secure :-1 s=READY pgs=252 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f42d8004750 tx=0x7f42d8005f10 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:21:38.748 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:38.747+0000 7f42c3fff6c0 1 -- 10.20.193.11:0/2224113177 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f42cc0ca680 con 0x7f42e4115410 2026-02-13T02:21:38.865 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:38.863+0000 7f42e95956c0 1 -- 10.20.193.11:0/2224113177 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f42e410f5d0 con 0x7f42e4115410 2026-02-13T02:21:38.865 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:21:38 trial011 ceph-mon[11956]: pgmap v268: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T02:21:38.866 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:38.863+0000 7f42c3fff6c0 1 -- 10.20.193.11:0/2224113177 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f42cc0077d0 con 0x7f42e4115410 2026-02-13T02:21:38.866 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:21:38.867 INFO:teuthology.orchestra.run.trial011.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:21:38.867 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:38.864+0000 7f42e95956c0 1 -- 10.20.193.11:0/2224113177 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f42b80b5680 msgr2=0x7f42b80d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:21:38.868 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:38.864+0000 7f42e95956c0 1 --2- 10.20.193.11:0/2224113177 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f42b80b5680 0x7f42b80d5b30 secure :-1 s=READY pgs=252 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f42d8004750 tx=0x7f42d8005f10 comp rx=0 tx=0).stop 2026-02-13T02:21:38.868 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:38.864+0000 7f42e95956c0 1 -- 10.20.193.11:0/2224113177 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f42e4115410 msgr2=0x7f42e4175cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:21:38.868 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:38.864+0000 7f42e95956c0 1 --2- 10.20.193.11:0/2224113177 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f42e4115410 0x7f42e4175cb0 secure :-1 s=READY pgs=380 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f42cc031f90 tx=0x7f42cc0047f0 comp rx=0 tx=0).stop 2026-02-13T02:21:38.868 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:38.864+0000 7f42e95956c0 1 -- 10.20.193.11:0/2224113177 shutdown_connections 2026-02-13T02:21:38.868 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:38.864+0000 7f42e95956c0 1 --2- 10.20.193.11:0/2224113177 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f42b80b5680 0x7f42b80d5b30 unknown :-1 s=CLOSED pgs=252 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:38.868 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:38.864+0000 7f42e95956c0 1 --2- 10.20.193.11:0/2224113177 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f42e40f5280 0x7f42e40fa550 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:38.868 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:38.864+0000 7f42e95956c0 1 --2- 10.20.193.11:0/2224113177 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f42e4115410 0x7f42e4175cb0 unknown :-1 s=CLOSED pgs=380 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:38.868 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:38.864+0000 7f42e95956c0 1 --2- 10.20.193.11:0/2224113177 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f42e410f200 0x7f42e40f4c50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:38.868 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:38.864+0000 7f42e95956c0 1 -- 10.20.193.11:0/2224113177 >> 10.20.193.11:0/2224113177 conn(0x7f42e40ecb00 msgr2=0x7f42e410d900 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:21:38.868 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:38.864+0000 7f42e95956c0 1 -- 10.20.193.11:0/2224113177 shutdown_connections 2026-02-13T02:21:38.869 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:38.865+0000 7f42e95956c0 1 -- 10.20.193.11:0/2224113177 wait complete. 2026-02-13T02:21:39.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:21:38 trial078 ceph-mon[14969]: pgmap v268: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T02:21:39.250 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:21:38 trial060 ceph-mon[14797]: pgmap v268: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T02:21:40.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:21:39 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/2224113177' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:21:40.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:21:39 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/2224113177' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:21:40.250 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:21:39 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/2224113177' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:21:41.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:21:40 trial078 ceph-mon[14969]: pgmap v269: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:21:41.103 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:21:40 trial011 ceph-mon[11956]: pgmap v269: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:21:41.151 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:21:40 trial060 ceph-mon[14797]: pgmap v269: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:21:41.907 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:21:42.035 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:21:42.158 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:42.152+0000 7febf95bf6c0 1 -- 10.20.193.11:0/3283437899 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7febf410bd00 msgr2=0x7febf4175a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:21:42.158 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:42.152+0000 7febf95bf6c0 1 --2- 10.20.193.11:0/3283437899 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7febf410bd00 0x7febf4175a70 secure :-1 s=READY pgs=381 gs=1 cs=0 l=1 c_cookie=15831479306748059036 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7febe400aa40 tx=0x7febe402fde0 comp rx=0 tx=0).stop 2026-02-13T02:21:42.158 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:42.152+0000 7febf95bf6c0 1 -- 10.20.193.11:0/3283437899 shutdown_connections 2026-02-13T02:21:42.158 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:42.152+0000 7febf95bf6c0 1 --2- 10.20.193.11:0/3283437899 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7febf410bd00 0x7febf4175a70 unknown :-1 s=CLOSED pgs=381 gs=1 cs=0 l=1 c_cookie=15831479306748059036 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:42.158 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:42.152+0000 7febf95bf6c0 1 --2- 10.20.193.11:0/3283437899 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7febf410b120 0x7febf410b550 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:42.158 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:42.152+0000 7febf95bf6c0 1 --2- 10.20.193.11:0/3283437899 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7febf410dad0 0x7febf410dea0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:42.158 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:42.152+0000 7febf95bf6c0 1 -- 10.20.193.11:0/3283437899 >> 10.20.193.11:0/3283437899 conn(0x7febf4062e00 msgr2=0x7febf4109660 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:21:42.158 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:42.152+0000 7febf95bf6c0 1 -- 10.20.193.11:0/3283437899 shutdown_connections 2026-02-13T02:21:42.159 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:42.152+0000 7febf95bf6c0 1 -- 10.20.193.11:0/3283437899 wait complete. 2026-02-13T02:21:42.159 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:42.153+0000 7febf95bf6c0 1 Processor -- start 2026-02-13T02:21:42.159 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:42.153+0000 7febf95bf6c0 1 -- start start 2026-02-13T02:21:42.159 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:42.153+0000 7febf95bf6c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7febf410b120 0x7febf40f51d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:21:42.159 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:42.153+0000 7febf95bf6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7febf410bd00 0x7febf40f5710 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:21:42.159 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:42.153+0000 7febf95bf6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7febf410dad0 0x7febf40faad0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:21:42.159 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:42.153+0000 7febf95bf6c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7febf40fb120 con 0x7febf410bd00 2026-02-13T02:21:42.159 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:42.153+0000 7febf95bf6c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7febf40fb290 con 0x7febf410b120 2026-02-13T02:21:42.159 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:42.153+0000 7febf95bf6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7febf40fb450 con 0x7febf410dad0 2026-02-13T02:21:42.159 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:42.153+0000 7febf27fc6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7febf410bd00 0x7febf40f5710 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:21:42.159 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:42.153+0000 7febf27fc6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7febf410bd00 0x7febf40f5710 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:50462/0 (socket says 10.20.193.11:50462) 2026-02-13T02:21:42.159 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:42.153+0000 7febf27fc6c0 1 -- 10.20.193.11:0/2201653391 learned_addr learned my addr 10.20.193.11:0/2201653391 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:21:42.160 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:42.153+0000 7febf37fe6c0 1 --2- 10.20.193.11:0/2201653391 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7febf410dad0 0x7febf40faad0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:21:42.160 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:42.153+0000 7febf2ffd6c0 1 --2- 10.20.193.11:0/2201653391 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7febf410b120 0x7febf40f51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:21:42.160 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:42.153+0000 7febf27fc6c0 1 -- 10.20.193.11:0/2201653391 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7febf410dad0 msgr2=0x7febf40faad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:21:42.160 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:42.153+0000 7febf27fc6c0 1 --2- 10.20.193.11:0/2201653391 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7febf410dad0 0x7febf40faad0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:42.160 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:42.153+0000 7febf27fc6c0 1 -- 10.20.193.11:0/2201653391 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7febf410b120 msgr2=0x7febf40f51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:21:42.160 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:42.153+0000 7febf27fc6c0 1 --2- 10.20.193.11:0/2201653391 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7febf410b120 0x7febf40f51d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:42.160 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:42.153+0000 7febf27fc6c0 1 -- 10.20.193.11:0/2201653391 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febe400a660 con 0x7febf410bd00 2026-02-13T02:21:42.160 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:42.153+0000 7febf2ffd6c0 1 --2- 10.20.193.11:0/2201653391 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7febf410b120 0x7febf40f51d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:21:42.160 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:42.153+0000 7febf27fc6c0 1 --2- 10.20.193.11:0/2201653391 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7febf410bd00 0x7febf40f5710 secure :-1 s=READY pgs=382 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7febdc005dc0 tx=0x7febdc00bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:21:42.160 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:42.153+0000 7febd3fff6c0 1 -- 10.20.193.11:0/2201653391 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7febdc004250 con 0x7febf410bd00 2026-02-13T02:21:42.160 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:42.153+0000 7febd3fff6c0 1 -- 10.20.193.11:0/2201653391 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7febdc009070 con 0x7febf410bd00 2026-02-13T02:21:42.160 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:42.153+0000 7febd3fff6c0 1 -- 10.20.193.11:0/2201653391 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7febdc00cde0 con 0x7febf410bd00 2026-02-13T02:21:42.161 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:42.153+0000 7febf95bf6c0 1 -- 10.20.193.11:0/2201653391 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febf40fb730 con 0x7febf410bd00 2026-02-13T02:21:42.161 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:42.153+0000 7febf95bf6c0 1 -- 10.20.193.11:0/2201653391 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febf4172bf0 con 0x7febf410bd00 2026-02-13T02:21:42.161 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:42.154+0000 7febf95bf6c0 1 -- 10.20.193.11:0/2201653391 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febf410c130 con 0x7febf410bd00 2026-02-13T02:21:42.161 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:42.155+0000 7febd3fff6c0 1 -- 10.20.193.11:0/2201653391 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7febdc0028c0 con 0x7febf410bd00 2026-02-13T02:21:42.162 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:42.156+0000 7febd3fff6c0 1 --2- 10.20.193.11:0/2201653391 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7febc80b5680 0x7febc80d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:21:42.162 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:42.156+0000 7febf2ffd6c0 1 --2- 10.20.193.11:0/2201653391 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7febc80b5680 0x7febc80d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:21:42.162 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:42.156+0000 7febd3fff6c0 1 -- 10.20.193.11:0/2201653391 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7965+0+0 (secure 0 0 0) 0x7febdc0e39c0 con 0x7febf410bd00 2026-02-13T02:21:42.162 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:42.156+0000 7febf2ffd6c0 1 --2- 10.20.193.11:0/2201653391 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7febc80b5680 0x7febc80d5b30 secure :-1 s=READY pgs=253 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7febe8004750 tx=0x7febe8009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:21:42.162 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:42.156+0000 7febd3fff6c0 1 -- 10.20.193.11:0/2201653391 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7febdc0a9ee0 con 0x7febf410bd00 2026-02-13T02:21:42.276 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:42.273+0000 7febf95bf6c0 1 -- 10.20.193.11:0/2201653391 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7febf410b550 con 0x7febf410bd00 2026-02-13T02:21:42.276 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:42.273+0000 7febd3fff6c0 1 -- 10.20.193.11:0/2201653391 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7febdc070540 con 0x7febf410bd00 2026-02-13T02:21:42.277 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:21:42.277 INFO:teuthology.orchestra.run.trial011.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:21:42.278 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:42.274+0000 7febf95bf6c0 1 -- 10.20.193.11:0/2201653391 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7febc80b5680 msgr2=0x7febc80d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:21:42.278 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:42.274+0000 7febf95bf6c0 1 --2- 10.20.193.11:0/2201653391 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7febc80b5680 0x7febc80d5b30 secure :-1 s=READY pgs=253 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7febe8004750 tx=0x7febe8009260 comp rx=0 tx=0).stop 2026-02-13T02:21:42.278 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:42.274+0000 7febf95bf6c0 1 -- 10.20.193.11:0/2201653391 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7febf410bd00 msgr2=0x7febf40f5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:21:42.278 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:42.274+0000 7febf95bf6c0 1 --2- 10.20.193.11:0/2201653391 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7febf410bd00 0x7febf40f5710 secure :-1 s=READY pgs=382 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7febdc005dc0 tx=0x7febdc00bbb0 comp rx=0 tx=0).stop 2026-02-13T02:21:42.278 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:42.274+0000 7febf95bf6c0 1 -- 10.20.193.11:0/2201653391 shutdown_connections 2026-02-13T02:21:42.278 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:42.274+0000 7febf95bf6c0 1 --2- 10.20.193.11:0/2201653391 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7febc80b5680 0x7febc80d5b30 unknown :-1 s=CLOSED pgs=253 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:42.279 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:42.274+0000 7febf95bf6c0 1 --2- 10.20.193.11:0/2201653391 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7febf410dad0 0x7febf40faad0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:42.279 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:42.274+0000 7febf95bf6c0 1 --2- 10.20.193.11:0/2201653391 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7febf410bd00 0x7febf40f5710 unknown :-1 s=CLOSED pgs=382 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:42.279 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:42.274+0000 7febf95bf6c0 1 --2- 10.20.193.11:0/2201653391 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7febf410b120 0x7febf40f51d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:42.279 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:42.274+0000 7febf95bf6c0 1 -- 10.20.193.11:0/2201653391 >> 10.20.193.11:0/2201653391 conn(0x7febf4062e00 msgr2=0x7febf40ee960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:21:42.279 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:42.274+0000 7febf95bf6c0 1 -- 10.20.193.11:0/2201653391 shutdown_connections 2026-02-13T02:21:42.279 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:42.274+0000 7febf95bf6c0 1 -- 10.20.193.11:0/2201653391 wait complete. 2026-02-13T02:21:43.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:21:42 trial078 ceph-mon[14969]: pgmap v270: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T02:21:43.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:21:42 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/2201653391' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:21:43.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:21:42 trial011 ceph-mon[11956]: pgmap v270: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T02:21:43.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:21:42 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/2201653391' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:21:43.250 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:21:42 trial060 ceph-mon[14797]: pgmap v270: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T02:21:43.250 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:21:42 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/2201653391' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:21:45.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:21:44 trial078 ceph-mon[14969]: pgmap v271: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:21:45.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:21:44 trial011 ceph-mon[11956]: pgmap v271: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:21:45.250 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:21:44 trial060 ceph-mon[14797]: pgmap v271: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:21:45.315 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:21:45.445 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:21:45.576 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:45.572+0000 7f9c07ffc6c0 1 -- 10.20.193.11:0/3085866706 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f9c0010fbf0 msgr2=0x7f9c00114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:21:45.576 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:45.572+0000 7f9c07ffc6c0 1 --2- 10.20.193.11:0/3085866706 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f9c0010fbf0 0x7f9c00114c30 secure :-1 s=READY pgs=383 gs=1 cs=0 l=1 c_cookie=5576779409381189279 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9bf40099a0 tx=0x7f9bf402ed50 comp rx=0 tx=0).stop 2026-02-13T02:21:45.576 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:45.572+0000 7f9c07ffc6c0 1 -- 10.20.193.11:0/3085866706 shutdown_connections 2026-02-13T02:21:45.576 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:45.572+0000 7f9c07ffc6c0 1 --2- 10.20.193.11:0/3085866706 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f9c00115410 0x7f9c00175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:45.577 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:45.572+0000 7f9c07ffc6c0 1 --2- 10.20.193.11:0/3085866706 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f9c0010fbf0 0x7f9c00114c30 unknown :-1 s=CLOSED pgs=383 gs=1 cs=0 l=1 c_cookie=5576779409381189279 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:45.577 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:45.572+0000 7f9c07ffc6c0 1 --2- 10.20.193.11:0/3085866706 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f9c0010f200 0x7f9c0010f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:45.577 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:45.572+0000 7f9c07ffc6c0 1 -- 10.20.193.11:0/3085866706 >> 10.20.193.11:0/3085866706 conn(0x7f9c000ecb00 msgr2=0x7f9c0010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:21:45.577 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:45.572+0000 7f9c07ffc6c0 1 -- 10.20.193.11:0/3085866706 shutdown_connections 2026-02-13T02:21:45.577 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:45.572+0000 7f9c07ffc6c0 1 -- 10.20.193.11:0/3085866706 wait complete. 2026-02-13T02:21:45.577 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:45.572+0000 7f9c07ffc6c0 1 Processor -- start 2026-02-13T02:21:45.577 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:45.572+0000 7f9c07ffc6c0 1 -- start start 2026-02-13T02:21:45.577 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:45.573+0000 7f9c07ffc6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f9c0010f200 0x7f9c000f4af0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:21:45.577 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:45.573+0000 7f9c07ffc6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f9c00115410 0x7f9c00175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:21:45.577 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:45.573+0000 7f9c07ffc6c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f9c000f5120 0x7f9c000fa3f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:21:45.577 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:45.573+0000 7f9c07ffc6c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f9c000f5780 con 0x7f9c0010f200 2026-02-13T02:21:45.577 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:45.573+0000 7f9c07ffc6c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9c000fa930 con 0x7f9c000f5120 2026-02-13T02:21:45.578 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:45.573+0000 7f9c07ffc6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f9c000faaf0 con 0x7f9c00115410 2026-02-13T02:21:45.578 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:45.573+0000 7f9c05d6d6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f9c0010f200 0x7f9c000f4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:21:45.578 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:45.573+0000 7f9c05d6d6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f9c0010f200 0x7f9c000f4af0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:50478/0 (socket says 10.20.193.11:50478) 2026-02-13T02:21:45.578 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:45.573+0000 7f9c05d6d6c0 1 -- 10.20.193.11:0/3469548866 learned_addr learned my addr 10.20.193.11:0/3469548866 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:21:45.578 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:45.573+0000 7f9c0656e6c0 1 --2- 10.20.193.11:0/3469548866 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f9c000f5120 0x7f9c000fa3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:21:45.578 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:45.573+0000 7f9c0556c6c0 1 --2- 10.20.193.11:0/3469548866 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f9c00115410 0x7f9c00175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:21:45.578 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:45.573+0000 7f9c05d6d6c0 1 -- 10.20.193.11:0/3469548866 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f9c00115410 msgr2=0x7f9c00175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:21:45.578 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:45.573+0000 7f9c05d6d6c0 1 --2- 10.20.193.11:0/3469548866 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f9c00115410 0x7f9c00175cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:45.578 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:45.573+0000 7f9c05d6d6c0 1 -- 10.20.193.11:0/3469548866 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f9c000f5120 msgr2=0x7f9c000fa3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:21:45.578 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:45.573+0000 7f9c05d6d6c0 1 --2- 10.20.193.11:0/3469548866 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f9c000f5120 0x7f9c000fa3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:45.578 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:45.573+0000 7f9c05d6d6c0 1 -- 10.20.193.11:0/3469548866 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bf4009590 con 0x7f9c0010f200 2026-02-13T02:21:45.579 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:45.573+0000 7f9c05d6d6c0 1 --2- 10.20.193.11:0/3469548866 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f9c0010f200 0x7f9c000f4af0 secure :-1 s=READY pgs=384 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9bf000b6c0 tx=0x7f9bf000bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:21:45.579 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:45.573+0000 7f9beeffd6c0 1 -- 10.20.193.11:0/3469548866 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9bf00044a0 con 0x7f9c0010f200 2026-02-13T02:21:45.579 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:45.573+0000 7f9c07ffc6c0 1 -- 10.20.193.11:0/3469548866 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c000fad70 con 0x7f9c0010f200 2026-02-13T02:21:45.579 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:45.573+0000 7f9beeffd6c0 1 -- 10.20.193.11:0/3469548866 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9bf0009030 con 0x7f9c0010f200 2026-02-13T02:21:45.579 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:45.573+0000 7f9beeffd6c0 1 -- 10.20.193.11:0/3469548866 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9bf000ccb0 con 0x7f9c0010f200 2026-02-13T02:21:45.579 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:45.573+0000 7f9c07ffc6c0 1 -- 10.20.193.11:0/3469548866 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c000fb560 con 0x7f9c0010f200 2026-02-13T02:21:45.579 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:45.574+0000 7f9c07ffc6c0 1 -- 10.20.193.11:0/3469548866 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c001104d0 con 0x7f9c0010f200 2026-02-13T02:21:45.580 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:45.575+0000 7f9beeffd6c0 1 -- 10.20.193.11:0/3469548866 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7f9bf0005080 con 0x7f9c0010f200 2026-02-13T02:21:45.580 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:45.576+0000 7f9beeffd6c0 1 --2- 10.20.193.11:0/3469548866 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f9bdc0b5680 0x7f9bdc0d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:21:45.580 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:45.576+0000 7f9beeffd6c0 1 -- 10.20.193.11:0/3469548866 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7965+0+0 (secure 0 0 0) 0x7f9bf00e3770 con 0x7f9c0010f200 2026-02-13T02:21:45.580 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:45.576+0000 7f9c0556c6c0 1 --2- 10.20.193.11:0/3469548866 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f9bdc0b5680 0x7f9bdc0d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:21:45.580 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:45.576+0000 7f9beeffd6c0 1 -- 10.20.193.11:0/3469548866 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f9bf00e3c60 con 0x7f9c0010f200 2026-02-13T02:21:45.581 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:45.576+0000 7f9c0556c6c0 1 --2- 10.20.193.11:0/3469548866 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f9bdc0b5680 0x7f9bdc0d5b30 secure :-1 s=READY pgs=254 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9c000fb480 tx=0x7f9bf40023a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:21:45.692 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:45.690+0000 7f9c07ffc6c0 1 -- 10.20.193.11:0/3469548866 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f9c000f5c40 con 0x7f9c0010f200 2026-02-13T02:21:45.693 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:45.691+0000 7f9beeffd6c0 1 -- 10.20.193.11:0/3469548866 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f9bf00a6300 con 0x7f9c0010f200 2026-02-13T02:21:45.693 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:21:45.693 INFO:teuthology.orchestra.run.trial011.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:21:45.694 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:45.692+0000 7f9c07ffc6c0 1 -- 10.20.193.11:0/3469548866 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f9bdc0b5680 msgr2=0x7f9bdc0d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:21:45.694 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:45.692+0000 7f9c07ffc6c0 1 --2- 10.20.193.11:0/3469548866 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f9bdc0b5680 0x7f9bdc0d5b30 secure :-1 s=READY pgs=254 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9c000fb480 tx=0x7f9bf40023a0 comp rx=0 tx=0).stop 2026-02-13T02:21:45.694 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:45.692+0000 7f9c07ffc6c0 1 -- 10.20.193.11:0/3469548866 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f9c0010f200 msgr2=0x7f9c000f4af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:21:45.695 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:45.692+0000 7f9c07ffc6c0 1 --2- 10.20.193.11:0/3469548866 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f9c0010f200 0x7f9c000f4af0 secure :-1 s=READY pgs=384 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9bf000b6c0 tx=0x7f9bf000bb90 comp rx=0 tx=0).stop 2026-02-13T02:21:45.695 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:45.692+0000 7f9c07ffc6c0 1 -- 10.20.193.11:0/3469548866 shutdown_connections 2026-02-13T02:21:45.695 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:45.692+0000 7f9c07ffc6c0 1 --2- 10.20.193.11:0/3469548866 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f9bdc0b5680 0x7f9bdc0d5b30 unknown :-1 s=CLOSED pgs=254 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:45.695 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:45.692+0000 7f9c07ffc6c0 1 --2- 10.20.193.11:0/3469548866 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f9c000f5120 0x7f9c000fa3f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:45.695 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:45.692+0000 7f9c07ffc6c0 1 --2- 10.20.193.11:0/3469548866 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f9c00115410 0x7f9c00175cb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:45.695 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:45.692+0000 7f9c07ffc6c0 1 --2- 10.20.193.11:0/3469548866 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f9c0010f200 0x7f9c000f4af0 unknown :-1 s=CLOSED pgs=384 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:45.695 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:45.692+0000 7f9c07ffc6c0 1 -- 10.20.193.11:0/3469548866 >> 10.20.193.11:0/3469548866 conn(0x7f9c000ecb00 msgr2=0x7f9c0010d720 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:21:45.695 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:45.692+0000 7f9c07ffc6c0 1 -- 10.20.193.11:0/3469548866 shutdown_connections 2026-02-13T02:21:45.695 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:45.692+0000 7f9c07ffc6c0 1 -- 10.20.193.11:0/3469548866 wait complete. 2026-02-13T02:21:45.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:21:45 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/3469548866' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:21:46.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:21:45 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/3469548866' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:21:46.250 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:21:45 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/3469548866' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:21:47.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:21:46 trial078 ceph-mon[14969]: pgmap v272: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 9 op/s 2026-02-13T02:21:47.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:21:46 trial011 ceph-mon[11956]: pgmap v272: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 9 op/s 2026-02-13T02:21:47.250 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:21:46 trial060 ceph-mon[14797]: pgmap v272: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 9 op/s 2026-02-13T02:21:48.733 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:21:48.857 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:21:48.975 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:48.971+0000 7f4af80606c0 1 -- 10.20.193.11:0/616673046 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f4af010f230 msgr2=0x7f4af010f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:21:48.975 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:48.971+0000 7f4af80606c0 1 --2- 10.20.193.11:0/616673046 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f4af010f230 0x7f4af010f600 secure :-1 s=READY pgs=385 gs=1 cs=0 l=1 c_cookie=3411809055095921303 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4ae00099a0 tx=0x7f4ae002ed20 comp rx=0 tx=0).stop 2026-02-13T02:21:48.975 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:48.971+0000 7f4af80606c0 1 -- 10.20.193.11:0/616673046 shutdown_connections 2026-02-13T02:21:48.975 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:48.971+0000 7f4af80606c0 1 --2- 10.20.193.11:0/616673046 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f4af0115440 0x7f4af0175de0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:48.975 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:48.971+0000 7f4af80606c0 1 --2- 10.20.193.11:0/616673046 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f4af010fc20 0x7f4af0114c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:48.975 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:48.971+0000 7f4af80606c0 1 --2- 10.20.193.11:0/616673046 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f4af010f230 0x7f4af010f600 unknown :-1 s=CLOSED pgs=385 gs=1 cs=0 l=1 c_cookie=3411809055095921303 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:48.976 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:48.971+0000 7f4af80606c0 1 -- 10.20.193.11:0/616673046 >> 10.20.193.11:0/616673046 conn(0x7f4af00ecb30 msgr2=0x7f4af010cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:21:48.976 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:48.971+0000 7f4af80606c0 1 -- 10.20.193.11:0/616673046 shutdown_connections 2026-02-13T02:21:48.976 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:48.971+0000 7f4af80606c0 1 -- 10.20.193.11:0/616673046 wait complete. 2026-02-13T02:21:48.976 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:48.971+0000 7f4af80606c0 1 Processor -- start 2026-02-13T02:21:48.976 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:48.971+0000 7f4af80606c0 1 -- start start 2026-02-13T02:21:48.976 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:48.971+0000 7f4af80606c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f4af010f230 0x7f4af011d200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:21:48.976 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:48.971+0000 7f4af80606c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f4af0115440 0x7f4af011d740 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:21:48.976 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:48.971+0000 7f4af80606c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f4af0122b00 0x7f4af0122fa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:21:48.976 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:48.971+0000 7f4af80606c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f4af0123510 con 0x7f4af0122b00 2026-02-13T02:21:48.976 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:48.971+0000 7f4af80606c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f4af0123680 con 0x7f4af0115440 2026-02-13T02:21:48.976 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:48.971+0000 7f4af80606c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f4af0123840 con 0x7f4af010f230 2026-02-13T02:21:48.977 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:48.972+0000 7f4af65d26c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f4af0122b00 0x7f4af0122fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:21:48.977 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:48.972+0000 7f4af65d26c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f4af0122b00 0x7f4af0122fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:50500/0 (socket says 10.20.193.11:50500) 2026-02-13T02:21:48.977 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:48.972+0000 7f4af65d26c0 1 -- 10.20.193.11:0/3938046787 learned_addr learned my addr 10.20.193.11:0/3938046787 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:21:48.977 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:48.972+0000 7f4af55d06c0 1 --2- 10.20.193.11:0/3938046787 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f4af0115440 0x7f4af011d740 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:21:48.977 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:48.972+0000 7f4af5dd16c0 1 --2- 10.20.193.11:0/3938046787 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f4af010f230 0x7f4af011d200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:21:48.977 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:48.972+0000 7f4af65d26c0 1 -- 10.20.193.11:0/3938046787 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f4af010f230 msgr2=0x7f4af011d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:21:48.977 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:48.972+0000 7f4af65d26c0 1 --2- 10.20.193.11:0/3938046787 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f4af010f230 0x7f4af011d200 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:48.977 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:48.972+0000 7f4af65d26c0 1 -- 10.20.193.11:0/3938046787 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f4af0115440 msgr2=0x7f4af011d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:21:48.977 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:48.972+0000 7f4af65d26c0 1 --2- 10.20.193.11:0/3938046787 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f4af0115440 0x7f4af011d740 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:48.977 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:48.972+0000 7f4af65d26c0 1 -- 10.20.193.11:0/3938046787 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ae0009590 con 0x7f4af0122b00 2026-02-13T02:21:48.977 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:48.972+0000 7f4af65d26c0 1 --2- 10.20.193.11:0/3938046787 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f4af0122b00 0x7f4af0122fa0 secure :-1 s=READY pgs=386 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4aec006ea0 tx=0x7f4aec00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:21:48.977 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:48.972+0000 7f4adeffd6c0 1 -- 10.20.193.11:0/3938046787 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4aec003a30 con 0x7f4af0122b00 2026-02-13T02:21:48.978 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:48.972+0000 7f4adeffd6c0 1 -- 10.20.193.11:0/3938046787 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4aec005510 con 0x7f4af0122b00 2026-02-13T02:21:48.978 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:48.972+0000 7f4af80606c0 1 -- 10.20.193.11:0/3938046787 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4af0163cf0 con 0x7f4af0122b00 2026-02-13T02:21:48.978 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:48.972+0000 7f4adeffd6c0 1 -- 10.20.193.11:0/3938046787 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4aec00dd70 con 0x7f4af0122b00 2026-02-13T02:21:48.978 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:48.972+0000 7f4af80606c0 1 -- 10.20.193.11:0/3938046787 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4af01641d0 con 0x7f4af0122b00 2026-02-13T02:21:48.978 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:48.972+0000 7f4af80606c0 1 -- 10.20.193.11:0/3938046787 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4af0110500 con 0x7f4af0122b00 2026-02-13T02:21:48.979 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:48.973+0000 7f4adeffd6c0 1 -- 10.20.193.11:0/3938046787 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7f4aec003b90 con 0x7f4af0122b00 2026-02-13T02:21:48.979 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:48.974+0000 7f4adeffd6c0 1 --2- 10.20.193.11:0/3938046787 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f4acc0b5680 0x7f4acc0d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:21:48.979 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:48.974+0000 7f4af5dd16c0 1 --2- 10.20.193.11:0/3938046787 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f4acc0b5680 0x7f4acc0d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:21:48.979 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:48.974+0000 7f4adeffd6c0 1 -- 10.20.193.11:0/3938046787 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7965+0+0 (secure 0 0 0) 0x7f4aec0e4b10 con 0x7f4af0122b00 2026-02-13T02:21:48.979 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:48.974+0000 7f4adeffd6c0 1 -- 10.20.193.11:0/3938046787 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f4aec0a75d0 con 0x7f4af0122b00 2026-02-13T02:21:48.979 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:48.974+0000 7f4af5dd16c0 1 --2- 10.20.193.11:0/3938046787 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f4acc0b5680 0x7f4acc0d5b30 secure :-1 s=READY pgs=255 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4ae00023e0 tx=0x7f4ae0031f90 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:21:49.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:21:48 trial078 ceph-mon[14969]: pgmap v273: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T02:21:49.094 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:49.092+0000 7f4af80606c0 1 -- 10.20.193.11:0/3938046787 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f4af011e350 con 0x7f4af0122b00 2026-02-13T02:21:49.094 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:21:48 trial011 ceph-mon[11956]: pgmap v273: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T02:21:49.094 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:49.092+0000 7f4adeffd6c0 1 -- 10.20.193.11:0/3938046787 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f4aec0aa780 con 0x7f4af0122b00 2026-02-13T02:21:49.095 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:21:49.095 INFO:teuthology.orchestra.run.trial011.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:21:49.096 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:49.093+0000 7f4af80606c0 1 -- 10.20.193.11:0/3938046787 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f4acc0b5680 msgr2=0x7f4acc0d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:21:49.096 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:49.093+0000 7f4af80606c0 1 --2- 10.20.193.11:0/3938046787 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f4acc0b5680 0x7f4acc0d5b30 secure :-1 s=READY pgs=255 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4ae00023e0 tx=0x7f4ae0031f90 comp rx=0 tx=0).stop 2026-02-13T02:21:49.096 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:49.093+0000 7f4af80606c0 1 -- 10.20.193.11:0/3938046787 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f4af0122b00 msgr2=0x7f4af0122fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:21:49.096 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:49.093+0000 7f4af80606c0 1 --2- 10.20.193.11:0/3938046787 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f4af0122b00 0x7f4af0122fa0 secure :-1 s=READY pgs=386 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4aec006ea0 tx=0x7f4aec00cca0 comp rx=0 tx=0).stop 2026-02-13T02:21:49.096 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:49.093+0000 7f4af80606c0 1 -- 10.20.193.11:0/3938046787 shutdown_connections 2026-02-13T02:21:49.096 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:49.093+0000 7f4af80606c0 1 --2- 10.20.193.11:0/3938046787 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f4acc0b5680 0x7f4acc0d5b30 unknown :-1 s=CLOSED pgs=255 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:49.096 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:49.093+0000 7f4af80606c0 1 --2- 10.20.193.11:0/3938046787 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f4af0115440 0x7f4af011d740 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:49.097 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:49.093+0000 7f4af80606c0 1 --2- 10.20.193.11:0/3938046787 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f4af0122b00 0x7f4af0122fa0 unknown :-1 s=CLOSED pgs=386 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:49.097 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:49.093+0000 7f4af80606c0 1 --2- 10.20.193.11:0/3938046787 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f4af010f230 0x7f4af011d200 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:49.097 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:49.093+0000 7f4af80606c0 1 -- 10.20.193.11:0/3938046787 >> 10.20.193.11:0/3938046787 conn(0x7f4af00ecb30 msgr2=0x7f4af010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:21:49.097 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:49.093+0000 7f4af80606c0 1 -- 10.20.193.11:0/3938046787 shutdown_connections 2026-02-13T02:21:49.097 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:49.093+0000 7f4af80606c0 1 -- 10.20.193.11:0/3938046787 wait complete. 2026-02-13T02:21:49.250 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:21:48 trial060 ceph-mon[14797]: pgmap v273: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T02:21:50.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:21:49 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/3938046787' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:21:50.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:21:49 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/3938046787' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:21:50.249 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:21:49 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/3938046787' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:21:51.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:21:50 trial078 ceph-mon[14969]: pgmap v274: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:21:51.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:21:50 trial011 ceph-mon[11956]: pgmap v274: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:21:51.250 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:21:50 trial060 ceph-mon[14797]: pgmap v274: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:21:52.134 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:21:52.258 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:21:52.371 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:52.367+0000 7fe46f7976c0 1 -- 10.20.193.11:0/3952870763 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fe468115410 msgr2=0x7fe468175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:21:52.372 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:52.367+0000 7fe46f7976c0 1 --2- 10.20.193.11:0/3952870763 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fe468115410 0x7fe468175db0 secure :-1 s=READY pgs=387 gs=1 cs=0 l=1 c_cookie=16678843321220389054 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe46400aa70 tx=0x7fe46402fde0 comp rx=0 tx=0).stop 2026-02-13T02:21:52.372 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:52.367+0000 7fe46f7976c0 1 -- 10.20.193.11:0/3952870763 shutdown_connections 2026-02-13T02:21:52.372 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:52.367+0000 7fe46f7976c0 1 --2- 10.20.193.11:0/3952870763 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fe46810fbf0 0x7fe468114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:52.372 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:52.367+0000 7fe46f7976c0 1 --2- 10.20.193.11:0/3952870763 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fe468115410 0x7fe468175db0 unknown :-1 s=CLOSED pgs=387 gs=1 cs=0 l=1 c_cookie=16678843321220389054 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:52.372 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:52.367+0000 7fe46f7976c0 1 --2- 10.20.193.11:0/3952870763 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fe46810f200 0x7fe46810f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:52.372 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:52.367+0000 7fe46f7976c0 1 -- 10.20.193.11:0/3952870763 >> 10.20.193.11:0/3952870763 conn(0x7fe4680ecb00 msgr2=0x7fe46810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:21:52.372 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:52.367+0000 7fe46f7976c0 1 -- 10.20.193.11:0/3952870763 shutdown_connections 2026-02-13T02:21:52.372 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:52.367+0000 7fe46f7976c0 1 -- 10.20.193.11:0/3952870763 wait complete. 2026-02-13T02:21:52.372 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:52.367+0000 7fe46f7976c0 1 Processor -- start 2026-02-13T02:21:52.372 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:52.367+0000 7fe46f7976c0 1 -- start start 2026-02-13T02:21:52.373 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:52.367+0000 7fe46f7976c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fe46810f200 0x7fe46811d0b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:21:52.373 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:52.367+0000 7fe46f7976c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fe468115410 0x7fe46811d5f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:21:52.373 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:52.367+0000 7fe46f7976c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fe4681229b0 0x7fe468122e50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:21:52.373 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:52.367+0000 7fe46f7976c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7fe4681233c0 con 0x7fe468115410 2026-02-13T02:21:52.373 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:52.367+0000 7fe46f7976c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe468123530 con 0x7fe4681229b0 2026-02-13T02:21:52.373 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:52.367+0000 7fe46f7976c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fe4681236f0 con 0x7fe46810f200 2026-02-13T02:21:52.373 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:52.367+0000 7fe46cd076c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fe468115410 0x7fe46811d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:21:52.373 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:52.367+0000 7fe46cd076c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fe468115410 0x7fe46811d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:47170/0 (socket says 10.20.193.11:47170) 2026-02-13T02:21:52.373 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:52.367+0000 7fe46cd076c0 1 -- 10.20.193.11:0/2443540040 learned_addr learned my addr 10.20.193.11:0/2443540040 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:21:52.373 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:52.367+0000 7fe46dd096c0 1 --2- 10.20.193.11:0/2443540040 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fe4681229b0 0x7fe468122e50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:21:52.373 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:52.367+0000 7fe46d5086c0 1 --2- 10.20.193.11:0/2443540040 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fe46810f200 0x7fe46811d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:21:52.373 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:52.367+0000 7fe46cd076c0 1 -- 10.20.193.11:0/2443540040 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fe46810f200 msgr2=0x7fe46811d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:21:52.374 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:52.367+0000 7fe46cd076c0 1 --2- 10.20.193.11:0/2443540040 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fe46810f200 0x7fe46811d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:52.374 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:52.367+0000 7fe46cd076c0 1 -- 10.20.193.11:0/2443540040 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fe4681229b0 msgr2=0x7fe468122e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:21:52.374 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:52.367+0000 7fe46cd076c0 1 --2- 10.20.193.11:0/2443540040 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fe4681229b0 0x7fe468122e50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:52.374 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:52.368+0000 7fe46cd076c0 1 -- 10.20.193.11:0/2443540040 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe46400a660 con 0x7fe468115410 2026-02-13T02:21:52.374 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:52.368+0000 7fe46dd096c0 1 --2- 10.20.193.11:0/2443540040 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fe4681229b0 0x7fe468122e50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T02:21:52.374 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:52.368+0000 7fe46d5086c0 1 --2- 10.20.193.11:0/2443540040 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fe46810f200 0x7fe46811d0b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T02:21:52.374 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:52.368+0000 7fe46cd076c0 1 --2- 10.20.193.11:0/2443540040 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fe468115410 0x7fe46811d5f0 secure :-1 s=READY pgs=388 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe45c00b800 tx=0x7fe45c00bcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:21:52.374 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:52.368+0000 7fe4567fc6c0 1 -- 10.20.193.11:0/2443540040 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe45c004a80 con 0x7fe468115410 2026-02-13T02:21:52.374 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:52.368+0000 7fe4567fc6c0 1 -- 10.20.193.11:0/2443540040 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe45c009070 con 0x7fe468115410 2026-02-13T02:21:52.374 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:52.368+0000 7fe46f7976c0 1 -- 10.20.193.11:0/2443540040 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe468163ba0 con 0x7fe468115410 2026-02-13T02:21:52.374 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:52.368+0000 7fe4567fc6c0 1 -- 10.20.193.11:0/2443540040 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe45c00ce70 con 0x7fe468115410 2026-02-13T02:21:52.374 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:52.368+0000 7fe46f7976c0 1 -- 10.20.193.11:0/2443540040 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe468164030 con 0x7fe468115410 2026-02-13T02:21:52.374 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:52.368+0000 7fe46f7976c0 1 -- 10.20.193.11:0/2443540040 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4681104d0 con 0x7fe468115410 2026-02-13T02:21:52.375 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:52.369+0000 7fe4567fc6c0 1 -- 10.20.193.11:0/2443540040 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7fe45c004060 con 0x7fe468115410 2026-02-13T02:21:52.375 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:52.370+0000 7fe4567fc6c0 1 --2- 10.20.193.11:0/2443540040 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fe4440b5600 0x7fe4440d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:21:52.376 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:52.370+0000 7fe46d5086c0 1 --2- 10.20.193.11:0/2443540040 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fe4440b5600 0x7fe4440d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:21:52.376 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:52.370+0000 7fe4567fc6c0 1 -- 10.20.193.11:0/2443540040 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7965+0+0 (secure 0 0 0) 0x7fe45c0e3b30 con 0x7fe468115410 2026-02-13T02:21:52.376 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:52.370+0000 7fe4567fc6c0 1 -- 10.20.193.11:0/2443540040 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fe45c0aa050 con 0x7fe468115410 2026-02-13T02:21:52.376 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:52.371+0000 7fe46d5086c0 1 --2- 10.20.193.11:0/2443540040 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fe4440b5600 0x7fe4440d5ab0 secure :-1 s=READY pgs=256 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe458004750 tx=0x7fe458009630 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:21:52.486 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:52.484+0000 7fe46f7976c0 1 -- 10.20.193.11:0/2443540040 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fe46810f5d0 con 0x7fe468115410 2026-02-13T02:21:52.486 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:52.485+0000 7fe4567fc6c0 1 -- 10.20.193.11:0/2443540040 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fe45c070620 con 0x7fe468115410 2026-02-13T02:21:52.486 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:21:52.486 INFO:teuthology.orchestra.run.trial011.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:21:52.487 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:52.486+0000 7fe46f7976c0 1 -- 10.20.193.11:0/2443540040 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fe4440b5600 msgr2=0x7fe4440d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:21:52.487 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:52.486+0000 7fe46f7976c0 1 --2- 10.20.193.11:0/2443540040 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fe4440b5600 0x7fe4440d5ab0 secure :-1 s=READY pgs=256 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe458004750 tx=0x7fe458009630 comp rx=0 tx=0).stop 2026-02-13T02:21:52.487 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:52.486+0000 7fe46f7976c0 1 -- 10.20.193.11:0/2443540040 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fe468115410 msgr2=0x7fe46811d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:21:52.487 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:52.486+0000 7fe46f7976c0 1 --2- 10.20.193.11:0/2443540040 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fe468115410 0x7fe46811d5f0 secure :-1 s=READY pgs=388 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe45c00b800 tx=0x7fe45c00bcd0 comp rx=0 tx=0).stop 2026-02-13T02:21:52.487 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:52.486+0000 7fe46f7976c0 1 -- 10.20.193.11:0/2443540040 shutdown_connections 2026-02-13T02:21:52.487 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:52.486+0000 7fe46f7976c0 1 --2- 10.20.193.11:0/2443540040 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fe4440b5600 0x7fe4440d5ab0 unknown :-1 s=CLOSED pgs=256 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:52.487 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:52.486+0000 7fe46f7976c0 1 --2- 10.20.193.11:0/2443540040 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fe4681229b0 0x7fe468122e50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:52.487 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:52.486+0000 7fe46f7976c0 1 --2- 10.20.193.11:0/2443540040 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fe468115410 0x7fe46811d5f0 unknown :-1 s=CLOSED pgs=388 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:52.487 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:52.486+0000 7fe46f7976c0 1 --2- 10.20.193.11:0/2443540040 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fe46810f200 0x7fe46811d0b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:52.487 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:52.486+0000 7fe46f7976c0 1 -- 10.20.193.11:0/2443540040 >> 10.20.193.11:0/2443540040 conn(0x7fe4680ecb00 msgr2=0x7fe46810cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:21:52.487 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:52.486+0000 7fe46f7976c0 1 -- 10.20.193.11:0/2443540040 shutdown_connections 2026-02-13T02:21:52.487 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:52.486+0000 7fe46f7976c0 1 -- 10.20.193.11:0/2443540040 wait complete. 2026-02-13T02:21:53.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:21:52 trial078 ceph-mon[14969]: pgmap v275: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T02:21:53.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:21:52 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/2443540040' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:21:53.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:21:52 trial011 ceph-mon[11956]: pgmap v275: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T02:21:53.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:21:52 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/2443540040' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:21:53.250 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:21:52 trial060 ceph-mon[14797]: pgmap v275: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T02:21:53.250 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:21:52 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/2443540040' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:21:55.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:21:54 trial078 ceph-mon[14969]: pgmap v276: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:21:55.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:21:54 trial011 ceph-mon[11956]: pgmap v276: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:21:55.250 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:21:54 trial060 ceph-mon[14797]: pgmap v276: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:21:55.525 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:21:55.653 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:21:55.766 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:55.762+0000 7fc2697906c0 1 -- 10.20.193.11:0/1780092366 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fc26410f200 msgr2=0x7fc26410f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:21:55.766 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:55.762+0000 7fc2697906c0 1 --2- 10.20.193.11:0/1780092366 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fc26410f200 0x7fc26410f5d0 secure :-1 s=READY pgs=389 gs=1 cs=0 l=1 c_cookie=1160476239937827224 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc2580099a0 tx=0x7fc25802ed20 comp rx=0 tx=0).stop 2026-02-13T02:21:55.766 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:55.762+0000 7fc2697906c0 1 -- 10.20.193.11:0/1780092366 shutdown_connections 2026-02-13T02:21:55.766 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:55.762+0000 7fc2697906c0 1 --2- 10.20.193.11:0/1780092366 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fc26410fbf0 0x7fc264114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:55.767 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:55.762+0000 7fc2697906c0 1 --2- 10.20.193.11:0/1780092366 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fc264115410 0x7fc264175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:55.767 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:55.762+0000 7fc2697906c0 1 --2- 10.20.193.11:0/1780092366 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fc26410f200 0x7fc26410f5d0 unknown :-1 s=CLOSED pgs=389 gs=1 cs=0 l=1 c_cookie=1160476239937827224 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:55.767 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:55.762+0000 7fc2697906c0 1 -- 10.20.193.11:0/1780092366 >> 10.20.193.11:0/1780092366 conn(0x7fc2640ecb00 msgr2=0x7fc26410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:21:55.767 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:55.762+0000 7fc2697906c0 1 -- 10.20.193.11:0/1780092366 shutdown_connections 2026-02-13T02:21:55.767 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:55.762+0000 7fc2697906c0 1 -- 10.20.193.11:0/1780092366 wait complete. 2026-02-13T02:21:55.767 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:55.762+0000 7fc2697906c0 1 Processor -- start 2026-02-13T02:21:55.767 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:55.762+0000 7fc2697906c0 1 -- start start 2026-02-13T02:21:55.767 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:55.763+0000 7fc2697906c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fc26410f200 0x7fc26411d180 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:21:55.767 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:55.763+0000 7fc2697906c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fc264115410 0x7fc26411d6c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:21:55.767 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:55.763+0000 7fc2697906c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fc264122a80 0x7fc264122f20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:21:55.767 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:55.763+0000 7fc2697906c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7fc264123460 con 0x7fc264122a80 2026-02-13T02:21:55.768 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:55.763+0000 7fc2697906c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc2641235d0 con 0x7fc264115410 2026-02-13T02:21:55.768 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:55.763+0000 7fc2697906c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc264123790 con 0x7fc26410f200 2026-02-13T02:21:55.768 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:55.763+0000 7fc2637fe6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fc264122a80 0x7fc264122f20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:21:55.768 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:55.763+0000 7fc2637fe6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fc264122a80 0x7fc264122f20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:47198/0 (socket says 10.20.193.11:47198) 2026-02-13T02:21:55.768 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:55.763+0000 7fc2637fe6c0 1 -- 10.20.193.11:0/2083751500 learned_addr learned my addr 10.20.193.11:0/2083751500 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:21:55.768 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:55.763+0000 7fc262ffd6c0 1 --2- 10.20.193.11:0/2083751500 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fc26410f200 0x7fc26411d180 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:21:55.768 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:55.763+0000 7fc2627fc6c0 1 --2- 10.20.193.11:0/2083751500 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fc264115410 0x7fc26411d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:21:55.768 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:55.763+0000 7fc2637fe6c0 1 -- 10.20.193.11:0/2083751500 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fc26410f200 msgr2=0x7fc26411d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:21:55.768 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:55.763+0000 7fc2637fe6c0 1 --2- 10.20.193.11:0/2083751500 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fc26410f200 0x7fc26411d180 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:55.768 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:55.763+0000 7fc2637fe6c0 1 -- 10.20.193.11:0/2083751500 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fc264115410 msgr2=0x7fc26411d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:21:55.768 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:55.763+0000 7fc2637fe6c0 1 --2- 10.20.193.11:0/2083751500 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fc264115410 0x7fc26411d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:55.768 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:55.763+0000 7fc2637fe6c0 1 -- 10.20.193.11:0/2083751500 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc258009590 con 0x7fc264122a80 2026-02-13T02:21:55.769 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:55.763+0000 7fc2637fe6c0 1 --2- 10.20.193.11:0/2083751500 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fc264122a80 0x7fc264122f20 secure :-1 s=READY pgs=390 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc254006ea0 tx=0x7fc25400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:21:55.769 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:55.763+0000 7fc243fff6c0 1 -- 10.20.193.11:0/2083751500 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc254003a30 con 0x7fc264122a80 2026-02-13T02:21:55.769 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:55.763+0000 7fc243fff6c0 1 -- 10.20.193.11:0/2083751500 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fc254005510 con 0x7fc264122a80 2026-02-13T02:21:55.769 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:55.763+0000 7fc2697906c0 1 -- 10.20.193.11:0/2083751500 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc264163c10 con 0x7fc264122a80 2026-02-13T02:21:55.769 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:55.763+0000 7fc243fff6c0 1 -- 10.20.193.11:0/2083751500 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc25400dd70 con 0x7fc264122a80 2026-02-13T02:21:55.769 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:55.763+0000 7fc2697906c0 1 -- 10.20.193.11:0/2083751500 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2641640a0 con 0x7fc264122a80 2026-02-13T02:21:55.769 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:55.763+0000 7fc2697906c0 1 -- 10.20.193.11:0/2083751500 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2641104d0 con 0x7fc264122a80 2026-02-13T02:21:55.770 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:55.765+0000 7fc243fff6c0 1 -- 10.20.193.11:0/2083751500 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7fc254003b90 con 0x7fc264122a80 2026-02-13T02:21:55.770 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:55.765+0000 7fc243fff6c0 1 --2- 10.20.193.11:0/2083751500 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fc2380b5600 0x7fc2380d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:21:55.770 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:55.765+0000 7fc243fff6c0 1 -- 10.20.193.11:0/2083751500 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7965+0+0 (secure 0 0 0) 0x7fc2540e4a80 con 0x7fc264122a80 2026-02-13T02:21:55.770 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:55.765+0000 7fc262ffd6c0 1 --2- 10.20.193.11:0/2083751500 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fc2380b5600 0x7fc2380d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:21:55.770 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:55.765+0000 7fc262ffd6c0 1 --2- 10.20.193.11:0/2083751500 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fc2380b5600 0x7fc2380d5ab0 secure :-1 s=READY pgs=257 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc2580098c0 tx=0x7fc2580023a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:21:55.771 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:55.766+0000 7fc243fff6c0 1 -- 10.20.193.11:0/2083751500 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fc2540a7540 con 0x7fc264122a80 2026-02-13T02:21:55.884 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:55.882+0000 7fc2697906c0 1 -- 10.20.193.11:0/2083751500 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fc26410f5d0 con 0x7fc264122a80 2026-02-13T02:21:55.884 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:55.882+0000 7fc243fff6c0 1 -- 10.20.193.11:0/2083751500 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fc2540aa6f0 con 0x7fc264122a80 2026-02-13T02:21:55.885 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:21:55.885 INFO:teuthology.orchestra.run.trial011.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:21:55.886 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:55.884+0000 7fc2697906c0 1 -- 10.20.193.11:0/2083751500 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fc2380b5600 msgr2=0x7fc2380d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:21:55.886 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:55.884+0000 7fc2697906c0 1 --2- 10.20.193.11:0/2083751500 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fc2380b5600 0x7fc2380d5ab0 secure :-1 s=READY pgs=257 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc2580098c0 tx=0x7fc2580023a0 comp rx=0 tx=0).stop 2026-02-13T02:21:55.886 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:55.884+0000 7fc2697906c0 1 -- 10.20.193.11:0/2083751500 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fc264122a80 msgr2=0x7fc264122f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:21:55.886 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:55.884+0000 7fc2697906c0 1 --2- 10.20.193.11:0/2083751500 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fc264122a80 0x7fc264122f20 secure :-1 s=READY pgs=390 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc254006ea0 tx=0x7fc25400cca0 comp rx=0 tx=0).stop 2026-02-13T02:21:55.886 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:55.884+0000 7fc2697906c0 1 -- 10.20.193.11:0/2083751500 shutdown_connections 2026-02-13T02:21:55.886 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:55.884+0000 7fc2697906c0 1 --2- 10.20.193.11:0/2083751500 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fc2380b5600 0x7fc2380d5ab0 unknown :-1 s=CLOSED pgs=257 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:55.886 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:55.884+0000 7fc2697906c0 1 --2- 10.20.193.11:0/2083751500 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fc264115410 0x7fc26411d6c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:55.886 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:55.884+0000 7fc2697906c0 1 --2- 10.20.193.11:0/2083751500 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fc264122a80 0x7fc264122f20 unknown :-1 s=CLOSED pgs=390 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:55.887 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:55.884+0000 7fc2697906c0 1 --2- 10.20.193.11:0/2083751500 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fc26410f200 0x7fc26411d180 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:55.887 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:55.884+0000 7fc2697906c0 1 -- 10.20.193.11:0/2083751500 >> 10.20.193.11:0/2083751500 conn(0x7fc2640ecb00 msgr2=0x7fc26410cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:21:55.887 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:55.884+0000 7fc2697906c0 1 -- 10.20.193.11:0/2083751500 shutdown_connections 2026-02-13T02:21:55.887 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:55.884+0000 7fc2697906c0 1 -- 10.20.193.11:0/2083751500 wait complete. 2026-02-13T02:21:57.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:21:56 trial078 ceph-mon[14969]: pgmap v277: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 9 op/s 2026-02-13T02:21:57.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:21:56 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/2083751500' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:21:57.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:21:56 trial011 ceph-mon[11956]: pgmap v277: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 9 op/s 2026-02-13T02:21:57.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:21:56 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/2083751500' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:21:57.249 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:21:56 trial060 ceph-mon[14797]: pgmap v277: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 9 op/s 2026-02-13T02:21:57.250 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:21:56 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/2083751500' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:21:58.925 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:21:59.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:21:58 trial078 ceph-mon[14969]: pgmap v278: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T02:21:59.052 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:21:59.073 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:21:58 trial011 ceph-mon[11956]: pgmap v278: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T02:21:59.175 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:59.171+0000 7fcc14d086c0 1 -- 10.20.193.11:0/327434201 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fcc10115440 msgr2=0x7fcc10175de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:21:59.175 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:59.171+0000 7fcc14d086c0 1 --2- 10.20.193.11:0/327434201 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fcc10115440 0x7fcc10175de0 secure :-1 s=READY pgs=391 gs=1 cs=0 l=1 c_cookie=9935927062571987821 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcc0000aa70 tx=0x7fcc0002fde0 comp rx=0 tx=0).stop 2026-02-13T02:21:59.175 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:59.171+0000 7fcc14d086c0 1 -- 10.20.193.11:0/327434201 shutdown_connections 2026-02-13T02:21:59.175 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:59.171+0000 7fcc14d086c0 1 --2- 10.20.193.11:0/327434201 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fcc1010fc20 0x7fcc10114c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:59.175 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:59.171+0000 7fcc14d086c0 1 --2- 10.20.193.11:0/327434201 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fcc10115440 0x7fcc10175de0 unknown :-1 s=CLOSED pgs=391 gs=1 cs=0 l=1 c_cookie=9935927062571987821 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:59.175 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:59.171+0000 7fcc14d086c0 1 --2- 10.20.193.11:0/327434201 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fcc1010f230 0x7fcc1010f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:59.175 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:59.171+0000 7fcc14d086c0 1 -- 10.20.193.11:0/327434201 >> 10.20.193.11:0/327434201 conn(0x7fcc100ecb30 msgr2=0x7fcc1010cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:21:59.176 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:59.171+0000 7fcc14d086c0 1 -- 10.20.193.11:0/327434201 shutdown_connections 2026-02-13T02:21:59.176 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:59.171+0000 7fcc14d086c0 1 -- 10.20.193.11:0/327434201 wait complete. 2026-02-13T02:21:59.176 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:59.171+0000 7fcc14d086c0 1 Processor -- start 2026-02-13T02:21:59.176 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:59.171+0000 7fcc14d086c0 1 -- start start 2026-02-13T02:21:59.176 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:59.171+0000 7fcc14d086c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fcc1010f230 0x7fcc1011d090 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:21:59.176 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:59.171+0000 7fcc14d086c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fcc10115440 0x7fcc1011d5d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:21:59.176 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:59.171+0000 7fcc14d086c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fcc10122990 0x7fcc10122e30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:21:59.176 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:59.171+0000 7fcc14d086c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7fcc101233a0 con 0x7fcc10122990 2026-02-13T02:21:59.176 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:59.171+0000 7fcc14d086c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7fcc10123510 con 0x7fcc1010f230 2026-02-13T02:21:59.176 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:59.171+0000 7fcc14d086c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fcc101236d0 con 0x7fcc10115440 2026-02-13T02:21:59.176 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:59.172+0000 7fcc0ed766c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fcc10122990 0x7fcc10122e30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:21:59.177 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:59.172+0000 7fcc0ed766c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fcc10122990 0x7fcc10122e30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:47214/0 (socket says 10.20.193.11:47214) 2026-02-13T02:21:59.177 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:59.172+0000 7fcc0ed766c0 1 -- 10.20.193.11:0/785557603 learned_addr learned my addr 10.20.193.11:0/785557603 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:21:59.177 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:59.172+0000 7fcc0e5756c0 1 --2- 10.20.193.11:0/785557603 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fcc1010f230 0x7fcc1011d090 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:21:59.177 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:59.172+0000 7fcc0dd746c0 1 --2- 10.20.193.11:0/785557603 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fcc10115440 0x7fcc1011d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:21:59.177 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:59.172+0000 7fcc0ed766c0 1 -- 10.20.193.11:0/785557603 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fcc10115440 msgr2=0x7fcc1011d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:21:59.177 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:59.172+0000 7fcc0ed766c0 1 --2- 10.20.193.11:0/785557603 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fcc10115440 0x7fcc1011d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:59.177 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:59.172+0000 7fcc0ed766c0 1 -- 10.20.193.11:0/785557603 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fcc1010f230 msgr2=0x7fcc1011d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:21:59.177 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:59.172+0000 7fcc0ed766c0 1 --2- 10.20.193.11:0/785557603 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fcc1010f230 0x7fcc1011d090 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:59.177 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:59.172+0000 7fcc0ed766c0 1 -- 10.20.193.11:0/785557603 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc0000a660 con 0x7fcc10122990 2026-02-13T02:21:59.177 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:59.172+0000 7fcc0ed766c0 1 --2- 10.20.193.11:0/785557603 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fcc10122990 0x7fcc10122e30 secure :-1 s=READY pgs=392 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcc000054b0 tx=0x7fcc000054e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:21:59.177 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:59.172+0000 7fcbf77fe6c0 1 -- 10.20.193.11:0/785557603 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcc00003a30 con 0x7fcc10122990 2026-02-13T02:21:59.177 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:59.172+0000 7fcc14d086c0 1 -- 10.20.193.11:0/785557603 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc10163b20 con 0x7fcc10122990 2026-02-13T02:21:59.178 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:59.172+0000 7fcbf77fe6c0 1 -- 10.20.193.11:0/785557603 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fcc00003b90 con 0x7fcc10122990 2026-02-13T02:21:59.178 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:59.172+0000 7fcbf77fe6c0 1 -- 10.20.193.11:0/785557603 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcc000382d0 con 0x7fcc10122990 2026-02-13T02:21:59.178 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:59.172+0000 7fcc14d086c0 1 -- 10.20.193.11:0/785557603 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc10163f50 con 0x7fcc10122990 2026-02-13T02:21:59.178 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:59.172+0000 7fcc14d086c0 1 -- 10.20.193.11:0/785557603 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc10110500 con 0x7fcc10122990 2026-02-13T02:21:59.179 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:59.174+0000 7fcbf77fe6c0 1 -- 10.20.193.11:0/785557603 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7fcc00003d00 con 0x7fcc10122990 2026-02-13T02:21:59.179 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:59.175+0000 7fcbf77fe6c0 1 --2- 10.20.193.11:0/785557603 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fcbe80b5600 0x7fcbe80d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:21:59.179 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:59.175+0000 7fcc0e5756c0 1 --2- 10.20.193.11:0/785557603 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fcbe80b5600 0x7fcbe80d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:21:59.179 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:59.175+0000 7fcbf77fe6c0 1 -- 10.20.193.11:0/785557603 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7965+0+0 (secure 0 0 0) 0x7fcc00108f40 con 0x7fcc10122990 2026-02-13T02:21:59.179 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:59.175+0000 7fcbf77fe6c0 1 -- 10.20.193.11:0/785557603 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fcc000cba00 con 0x7fcc10122990 2026-02-13T02:21:59.179 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:59.175+0000 7fcc0e5756c0 1 --2- 10.20.193.11:0/785557603 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fcbe80b5600 0x7fcbe80d5ab0 secure :-1 s=READY pgs=258 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcc04005980 tx=0x7fcc04005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:21:59.250 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:21:58 trial060 ceph-mon[14797]: pgmap v278: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T02:21:59.293 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:59.291+0000 7fcc14d086c0 1 -- 10.20.193.11:0/785557603 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fcc1010f600 con 0x7fcc10122990 2026-02-13T02:21:59.293 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:59.291+0000 7fcbf77fe6c0 1 -- 10.20.193.11:0/785557603 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fcc000cebb0 con 0x7fcc10122990 2026-02-13T02:21:59.294 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:21:59.294 INFO:teuthology.orchestra.run.trial011.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:21:59.295 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:59.292+0000 7fcc14d086c0 1 -- 10.20.193.11:0/785557603 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fcbe80b5600 msgr2=0x7fcbe80d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:21:59.295 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:59.292+0000 7fcc14d086c0 1 --2- 10.20.193.11:0/785557603 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fcbe80b5600 0x7fcbe80d5ab0 secure :-1 s=READY pgs=258 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcc04005980 tx=0x7fcc04005910 comp rx=0 tx=0).stop 2026-02-13T02:21:59.295 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:59.292+0000 7fcc14d086c0 1 -- 10.20.193.11:0/785557603 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fcc10122990 msgr2=0x7fcc10122e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:21:59.295 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:59.292+0000 7fcc14d086c0 1 --2- 10.20.193.11:0/785557603 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fcc10122990 0x7fcc10122e30 secure :-1 s=READY pgs=392 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcc000054b0 tx=0x7fcc000054e0 comp rx=0 tx=0).stop 2026-02-13T02:21:59.295 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:59.292+0000 7fcc14d086c0 1 -- 10.20.193.11:0/785557603 shutdown_connections 2026-02-13T02:21:59.295 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:59.292+0000 7fcc14d086c0 1 --2- 10.20.193.11:0/785557603 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fcbe80b5600 0x7fcbe80d5ab0 unknown :-1 s=CLOSED pgs=258 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:59.295 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:59.292+0000 7fcc14d086c0 1 --2- 10.20.193.11:0/785557603 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fcc10122990 0x7fcc10122e30 unknown :-1 s=CLOSED pgs=392 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:59.295 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:59.292+0000 7fcc14d086c0 1 --2- 10.20.193.11:0/785557603 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fcc10115440 0x7fcc1011d5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:59.295 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:59.292+0000 7fcc14d086c0 1 --2- 10.20.193.11:0/785557603 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fcc1010f230 0x7fcc1011d090 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:21:59.296 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:59.292+0000 7fcc14d086c0 1 -- 10.20.193.11:0/785557603 >> 10.20.193.11:0/785557603 conn(0x7fcc100ecb30 msgr2=0x7fcc1010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:21:59.296 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:59.292+0000 7fcc14d086c0 1 -- 10.20.193.11:0/785557603 shutdown_connections 2026-02-13T02:21:59.296 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:21:59.292+0000 7fcc14d086c0 1 -- 10.20.193.11:0/785557603 wait complete. 2026-02-13T02:22:00.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:21:59 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/785557603' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:22:00.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:21:59 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:22:00.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:21:59 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/785557603' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:22:00.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:21:59 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:22:00.250 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:21:59 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/785557603' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:22:00.250 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:21:59 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:22:01.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:22:00 trial078 ceph-mon[14969]: pgmap v279: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:22:01.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:22:00 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:22:01.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:22:00 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:22:01.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:22:00 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:22:01.043 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:22:00 trial078 ceph-mon[14969]: pgmap v280: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 10 op/s 2026-02-13T02:22:01.043 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:22:00 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:22:01.043 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:22:00 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:22:01.043 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:22:00 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:22:01.043 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:22:00 trial078 ceph-mon[14969]: pgmap v281: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 3.4 KiB/s rd, 8 op/s 2026-02-13T02:22:01.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:22:00 trial011 ceph-mon[11956]: pgmap v279: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:22:01.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:22:00 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:22:01.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:22:00 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:22:01.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:22:00 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:22:01.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:22:00 trial011 ceph-mon[11956]: pgmap v280: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 10 op/s 2026-02-13T02:22:01.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:22:00 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:22:01.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:22:00 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:22:01.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:22:00 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:22:01.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:22:00 trial011 ceph-mon[11956]: pgmap v281: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 3.4 KiB/s rd, 8 op/s 2026-02-13T02:22:01.250 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:22:00 trial060 ceph-mon[14797]: pgmap v279: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:22:01.250 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:22:00 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:22:01.250 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:22:00 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:22:01.250 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:22:00 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:22:01.250 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:22:00 trial060 ceph-mon[14797]: pgmap v280: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 10 op/s 2026-02-13T02:22:01.250 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:22:00 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:22:01.250 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:22:00 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:22:01.250 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:22:00 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:22:01.250 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:22:00 trial060 ceph-mon[14797]: pgmap v281: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 3.4 KiB/s rd, 8 op/s 2026-02-13T02:22:02.332 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:22:02.458 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:22:02.578 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:02.574+0000 7f46d349f6c0 1 -- 10.20.193.11:0/992070320 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f46cc1557d0 msgr2=0x7f46cc175bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:22:02.578 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:02.574+0000 7f46d349f6c0 1 --2- 10.20.193.11:0/992070320 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f46cc1557d0 0x7f46cc175bb0 secure :-1 s=READY pgs=393 gs=1 cs=0 l=1 c_cookie=7044989996774735531 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f46c800aa40 tx=0x7f46c802fde0 comp rx=0 tx=0).stop 2026-02-13T02:22:02.578 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:02.574+0000 7f46d349f6c0 1 -- 10.20.193.11:0/992070320 shutdown_connections 2026-02-13T02:22:02.578 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:02.574+0000 7f46d349f6c0 1 --2- 10.20.193.11:0/992070320 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f46cc1557d0 0x7f46cc175bb0 unknown :-1 s=CLOSED pgs=393 gs=1 cs=0 l=1 c_cookie=7044989996774735531 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:02.578 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:02.574+0000 7f46d349f6c0 1 --2- 10.20.193.11:0/992070320 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f46cc10c3b0 0x7f46cc155290 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:02.579 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:02.574+0000 7f46d349f6c0 1 --2- 10.20.193.11:0/992070320 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f46cc10baa0 0x7f46cc10be70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:02.579 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:02.574+0000 7f46d349f6c0 1 -- 10.20.193.11:0/992070320 >> 10.20.193.11:0/992070320 conn(0x7f46cc0e9740 msgr2=0x7f46cc109b50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:22:02.579 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:02.574+0000 7f46d349f6c0 1 -- 10.20.193.11:0/992070320 shutdown_connections 2026-02-13T02:22:02.579 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:02.574+0000 7f46d349f6c0 1 -- 10.20.193.11:0/992070320 wait complete. 2026-02-13T02:22:02.579 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:02.574+0000 7f46d349f6c0 1 Processor -- start 2026-02-13T02:22:02.579 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:02.574+0000 7f46d349f6c0 1 -- start start 2026-02-13T02:22:02.579 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:02.574+0000 7f46d349f6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f46cc10baa0 0x7f46cc160470 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:22:02.579 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:02.574+0000 7f46d349f6c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f46cc10c3b0 0x7f46cc1609b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:22:02.579 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:02.574+0000 7f46d349f6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f46cc1557d0 0x7f46cc165d70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:22:02.579 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:02.574+0000 7f46d349f6c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f46cc1663c0 con 0x7f46cc1557d0 2026-02-13T02:22:02.579 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:02.574+0000 7f46d349f6c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f46cc166530 con 0x7f46cc10c3b0 2026-02-13T02:22:02.579 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:02.574+0000 7f46d349f6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f46cc1666f0 con 0x7f46cc10baa0 2026-02-13T02:22:02.580 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:02.574+0000 7f46d1a116c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f46cc1557d0 0x7f46cc165d70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:22:02.580 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:02.574+0000 7f46d1a116c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f46cc1557d0 0x7f46cc165d70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:48180/0 (socket says 10.20.193.11:48180) 2026-02-13T02:22:02.580 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:02.574+0000 7f46d1a116c0 1 -- 10.20.193.11:0/60396682 learned_addr learned my addr 10.20.193.11:0/60396682 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:22:02.580 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:02.574+0000 7f46d0a0f6c0 1 --2- 10.20.193.11:0/60396682 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f46cc10c3b0 0x7f46cc1609b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:22:02.580 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:02.575+0000 7f46d1a116c0 1 -- 10.20.193.11:0/60396682 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f46cc10baa0 msgr2=0x7f46cc160470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:22:02.580 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:02.575+0000 7f46d12106c0 1 --2- 10.20.193.11:0/60396682 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f46cc10baa0 0x7f46cc160470 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:22:02.580 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:02.575+0000 7f46d1a116c0 1 --2- 10.20.193.11:0/60396682 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f46cc10baa0 0x7f46cc160470 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:02.580 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:02.575+0000 7f46d1a116c0 1 -- 10.20.193.11:0/60396682 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f46cc10c3b0 msgr2=0x7f46cc1609b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:22:02.580 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:02.575+0000 7f46d1a116c0 1 --2- 10.20.193.11:0/60396682 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f46cc10c3b0 0x7f46cc1609b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:02.580 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:02.575+0000 7f46d1a116c0 1 -- 10.20.193.11:0/60396682 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46c800a660 con 0x7f46cc1557d0 2026-02-13T02:22:02.580 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:02.575+0000 7f46d12106c0 1 --2- 10.20.193.11:0/60396682 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f46cc10baa0 0x7f46cc160470 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:22:02.580 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:02.575+0000 7f46d1a116c0 1 --2- 10.20.193.11:0/60396682 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f46cc1557d0 0x7f46cc165d70 secure :-1 s=READY pgs=394 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f46c8030af0 tx=0x7f46c80054b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:22:02.581 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:02.575+0000 7f46ba7fc6c0 1 -- 10.20.193.11:0/60396682 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f46c8003a30 con 0x7f46cc1557d0 2026-02-13T02:22:02.581 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:02.575+0000 7f46ba7fc6c0 1 -- 10.20.193.11:0/60396682 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f46c8003b90 con 0x7f46cc1557d0 2026-02-13T02:22:02.581 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:02.575+0000 7f46d349f6c0 1 -- 10.20.193.11:0/60396682 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46cc166970 con 0x7f46cc1557d0 2026-02-13T02:22:02.581 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:02.575+0000 7f46ba7fc6c0 1 -- 10.20.193.11:0/60396682 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f46c8038360 con 0x7f46cc1557d0 2026-02-13T02:22:02.581 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:02.575+0000 7f46d349f6c0 1 -- 10.20.193.11:0/60396682 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46cc152410 con 0x7f46cc1557d0 2026-02-13T02:22:02.581 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:02.575+0000 7f46d349f6c0 1 -- 10.20.193.11:0/60396682 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46cc05fb10 con 0x7f46cc1557d0 2026-02-13T02:22:02.581 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:02.576+0000 7f46ba7fc6c0 1 -- 10.20.193.11:0/60396682 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7f46c8003d00 con 0x7f46cc1557d0 2026-02-13T02:22:02.582 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:02.577+0000 7f46ba7fc6c0 1 --2- 10.20.193.11:0/60396682 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f46a80b5680 0x7f46a80d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:22:02.582 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:02.577+0000 7f46ba7fc6c0 1 -- 10.20.193.11:0/60396682 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7965+0+0 (secure 0 0 0) 0x7f46c8108e30 con 0x7f46cc1557d0 2026-02-13T02:22:02.582 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:02.577+0000 7f46d12106c0 1 --2- 10.20.193.11:0/60396682 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f46a80b5680 0x7f46a80d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:22:02.582 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:02.577+0000 7f46d12106c0 1 --2- 10.20.193.11:0/60396682 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f46a80b5680 0x7f46a80d5b30 secure :-1 s=READY pgs=259 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f46bc004750 tx=0x7f46bc005f10 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:22:02.582 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:02.578+0000 7f46ba7fc6c0 1 -- 10.20.193.11:0/60396682 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f46c80cb8f0 con 0x7f46cc1557d0 2026-02-13T02:22:02.695 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:02.693+0000 7f46d349f6c0 1 -- 10.20.193.11:0/60396682 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f46cc1615c0 con 0x7f46cc1557d0 2026-02-13T02:22:02.695 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:02.693+0000 7f46ba7fc6c0 1 -- 10.20.193.11:0/60396682 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f46c80ceaa0 con 0x7f46cc1557d0 2026-02-13T02:22:02.695 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:22:02.696 INFO:teuthology.orchestra.run.trial011.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:22:02.696 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:02.694+0000 7f46d349f6c0 1 -- 10.20.193.11:0/60396682 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f46a80b5680 msgr2=0x7f46a80d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:22:02.697 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:02.694+0000 7f46d349f6c0 1 --2- 10.20.193.11:0/60396682 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f46a80b5680 0x7f46a80d5b30 secure :-1 s=READY pgs=259 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f46bc004750 tx=0x7f46bc005f10 comp rx=0 tx=0).stop 2026-02-13T02:22:02.697 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:02.694+0000 7f46d349f6c0 1 -- 10.20.193.11:0/60396682 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f46cc1557d0 msgr2=0x7f46cc165d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:22:02.697 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:02.694+0000 7f46d349f6c0 1 --2- 10.20.193.11:0/60396682 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f46cc1557d0 0x7f46cc165d70 secure :-1 s=READY pgs=394 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f46c8030af0 tx=0x7f46c80054b0 comp rx=0 tx=0).stop 2026-02-13T02:22:02.697 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:02.694+0000 7f46d349f6c0 1 -- 10.20.193.11:0/60396682 shutdown_connections 2026-02-13T02:22:02.697 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:02.694+0000 7f46d349f6c0 1 --2- 10.20.193.11:0/60396682 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f46a80b5680 0x7f46a80d5b30 unknown :-1 s=CLOSED pgs=259 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:02.697 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:02.694+0000 7f46d349f6c0 1 --2- 10.20.193.11:0/60396682 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f46cc10c3b0 0x7f46cc1609b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:02.697 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:02.694+0000 7f46d349f6c0 1 --2- 10.20.193.11:0/60396682 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f46cc1557d0 0x7f46cc165d70 unknown :-1 s=CLOSED pgs=394 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:02.697 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:02.694+0000 7f46d349f6c0 1 --2- 10.20.193.11:0/60396682 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f46cc10baa0 0x7f46cc160470 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:02.697 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:02.694+0000 7f46d349f6c0 1 -- 10.20.193.11:0/60396682 >> 10.20.193.11:0/60396682 conn(0x7f46cc0e9740 msgr2=0x7f46cc109b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:22:02.697 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:02.694+0000 7f46d349f6c0 1 -- 10.20.193.11:0/60396682 shutdown_connections 2026-02-13T02:22:02.698 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:02.694+0000 7f46d349f6c0 1 -- 10.20.193.11:0/60396682 wait complete. 2026-02-13T02:22:03.951 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:22:03 trial011 ceph-mon[11956]: pgmap v282: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.1 KiB/s rd, 9 op/s 2026-02-13T02:22:03.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:22:03 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/60396682' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:22:04.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:22:03 trial060 ceph-mon[14797]: pgmap v282: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.1 KiB/s rd, 9 op/s 2026-02-13T02:22:04.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:22:03 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/60396682' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:22:04.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:22:03 trial078 ceph-mon[14969]: pgmap v282: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.1 KiB/s rd, 9 op/s 2026-02-13T02:22:04.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:22:03 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/60396682' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:22:05.735 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:22:05.843 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:22:05 trial078 ceph-mon[14969]: pgmap v283: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 10 op/s 2026-02-13T02:22:05.862 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:22:05.882 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:22:05 trial011 ceph-mon[11956]: pgmap v283: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 10 op/s 2026-02-13T02:22:05.978 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:05.976+0000 7fba55bdf6c0 1 -- 10.20.193.11:0/3884417064 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fba50115410 msgr2=0x7fba50175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:22:05.978 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:05.976+0000 7fba55bdf6c0 1 --2- 10.20.193.11:0/3884417064 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fba50115410 0x7fba50175db0 secure :-1 s=READY pgs=395 gs=1 cs=0 l=1 c_cookie=6737245691359399135 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fba4400aa70 tx=0x7fba4402fde0 comp rx=0 tx=0).stop 2026-02-13T02:22:05.978 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:05.976+0000 7fba55bdf6c0 1 -- 10.20.193.11:0/3884417064 shutdown_connections 2026-02-13T02:22:05.978 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:05.976+0000 7fba55bdf6c0 1 --2- 10.20.193.11:0/3884417064 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fba5010fbf0 0x7fba50114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:05.978 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:05.976+0000 7fba55bdf6c0 1 --2- 10.20.193.11:0/3884417064 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fba50115410 0x7fba50175db0 unknown :-1 s=CLOSED pgs=395 gs=1 cs=0 l=1 c_cookie=6737245691359399135 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:05.978 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:05.976+0000 7fba55bdf6c0 1 --2- 10.20.193.11:0/3884417064 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fba5010f200 0x7fba5010f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:05.978 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:05.976+0000 7fba55bdf6c0 1 -- 10.20.193.11:0/3884417064 >> 10.20.193.11:0/3884417064 conn(0x7fba500ecb00 msgr2=0x7fba5010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:22:05.978 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:05.976+0000 7fba55bdf6c0 1 -- 10.20.193.11:0/3884417064 shutdown_connections 2026-02-13T02:22:05.978 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:05.976+0000 7fba55bdf6c0 1 -- 10.20.193.11:0/3884417064 wait complete. 2026-02-13T02:22:05.979 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:05.977+0000 7fba55bdf6c0 1 Processor -- start 2026-02-13T02:22:05.979 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:05.977+0000 7fba55bdf6c0 1 -- start start 2026-02-13T02:22:05.979 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:05.977+0000 7fba55bdf6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fba5010f200 0x7fba5011d0b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:22:05.979 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:05.977+0000 7fba55bdf6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fba50115410 0x7fba5011d5f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:22:05.979 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:05.977+0000 7fba55bdf6c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fba501229b0 0x7fba50122e50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:22:05.979 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:05.977+0000 7fba55bdf6c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7fba501233c0 con 0x7fba50115410 2026-02-13T02:22:05.979 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:05.977+0000 7fba55bdf6c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7fba50123530 con 0x7fba501229b0 2026-02-13T02:22:05.979 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:05.977+0000 7fba55bdf6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fba501236f0 con 0x7fba5010f200 2026-02-13T02:22:05.979 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:05.977+0000 7fba4effd6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fba50115410 0x7fba5011d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:22:05.979 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:05.977+0000 7fba4effd6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fba50115410 0x7fba5011d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:48196/0 (socket says 10.20.193.11:48196) 2026-02-13T02:22:05.979 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:05.977+0000 7fba4effd6c0 1 -- 10.20.193.11:0/3319295918 learned_addr learned my addr 10.20.193.11:0/3319295918 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:22:05.979 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:05.977+0000 7fba4f7fe6c0 1 --2- 10.20.193.11:0/3319295918 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fba5010f200 0x7fba5011d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:22:05.979 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:05.977+0000 7fba4ffff6c0 1 --2- 10.20.193.11:0/3319295918 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fba501229b0 0x7fba50122e50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:22:05.979 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:05.977+0000 7fba4effd6c0 1 -- 10.20.193.11:0/3319295918 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fba5010f200 msgr2=0x7fba5011d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:22:05.979 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:05.977+0000 7fba4effd6c0 1 --2- 10.20.193.11:0/3319295918 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fba5010f200 0x7fba5011d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:05.980 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:05.977+0000 7fba4effd6c0 1 -- 10.20.193.11:0/3319295918 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fba501229b0 msgr2=0x7fba50122e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:22:05.980 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:05.977+0000 7fba4effd6c0 1 --2- 10.20.193.11:0/3319295918 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fba501229b0 0x7fba50122e50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:05.980 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:05.977+0000 7fba4effd6c0 1 -- 10.20.193.11:0/3319295918 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba4400a660 con 0x7fba50115410 2026-02-13T02:22:05.980 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:05.977+0000 7fba4effd6c0 1 --2- 10.20.193.11:0/3319295918 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fba50115410 0x7fba5011d5f0 secure :-1 s=READY pgs=396 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fba40005dc0 tx=0x7fba4000bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:22:05.980 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:05.977+0000 7fba4cff96c0 1 -- 10.20.193.11:0/3319295918 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fba40004250 con 0x7fba50115410 2026-02-13T02:22:05.980 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:05.977+0000 7fba4cff96c0 1 -- 10.20.193.11:0/3319295918 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fba40009070 con 0x7fba50115410 2026-02-13T02:22:05.980 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:05.977+0000 7fba55bdf6c0 1 -- 10.20.193.11:0/3319295918 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba50163ba0 con 0x7fba50115410 2026-02-13T02:22:05.980 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:05.977+0000 7fba4cff96c0 1 -- 10.20.193.11:0/3319295918 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fba4000cdc0 con 0x7fba50115410 2026-02-13T02:22:05.980 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:05.977+0000 7fba55bdf6c0 1 -- 10.20.193.11:0/3319295918 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba50164030 con 0x7fba50115410 2026-02-13T02:22:05.980 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:05.978+0000 7fba55bdf6c0 1 -- 10.20.193.11:0/3319295918 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba501104d0 con 0x7fba50115410 2026-02-13T02:22:05.981 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:05.979+0000 7fba4cff96c0 1 -- 10.20.193.11:0/3319295918 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7fba400028c0 con 0x7fba50115410 2026-02-13T02:22:05.982 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:05.980+0000 7fba4cff96c0 1 --2- 10.20.193.11:0/3319295918 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fba240b5600 0x7fba240d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:22:05.982 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:05.980+0000 7fba4f7fe6c0 1 --2- 10.20.193.11:0/3319295918 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fba240b5600 0x7fba240d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:22:05.982 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:05.980+0000 7fba4cff96c0 1 -- 10.20.193.11:0/3319295918 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7965+0+0 (secure 0 0 0) 0x7fba400e3a70 con 0x7fba50115410 2026-02-13T02:22:05.982 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:05.980+0000 7fba4cff96c0 1 -- 10.20.193.11:0/3319295918 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fba4011c5e0 con 0x7fba50115410 2026-02-13T02:22:05.982 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:05.980+0000 7fba4f7fe6c0 1 --2- 10.20.193.11:0/3319295918 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fba240b5600 0x7fba240d5ab0 secure :-1 s=READY pgs=260 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fba3c005980 tx=0x7fba3c005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:22:05.999 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:22:05 trial060 ceph-mon[14797]: pgmap v283: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 10 op/s 2026-02-13T02:22:06.096 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:06.095+0000 7fba55bdf6c0 1 -- 10.20.193.11:0/3319295918 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fba5010f5d0 con 0x7fba50115410 2026-02-13T02:22:06.097 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:06.095+0000 7fba4cff96c0 1 -- 10.20.193.11:0/3319295918 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fba400a6570 con 0x7fba50115410 2026-02-13T02:22:06.097 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:22:06.097 INFO:teuthology.orchestra.run.trial011.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:22:06.098 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:06.096+0000 7fba55bdf6c0 1 -- 10.20.193.11:0/3319295918 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fba240b5600 msgr2=0x7fba240d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:22:06.098 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:06.096+0000 7fba55bdf6c0 1 --2- 10.20.193.11:0/3319295918 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fba240b5600 0x7fba240d5ab0 secure :-1 s=READY pgs=260 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fba3c005980 tx=0x7fba3c005910 comp rx=0 tx=0).stop 2026-02-13T02:22:06.098 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:06.096+0000 7fba55bdf6c0 1 -- 10.20.193.11:0/3319295918 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fba50115410 msgr2=0x7fba5011d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:22:06.098 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:06.096+0000 7fba55bdf6c0 1 --2- 10.20.193.11:0/3319295918 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fba50115410 0x7fba5011d5f0 secure :-1 s=READY pgs=396 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fba40005dc0 tx=0x7fba4000bbb0 comp rx=0 tx=0).stop 2026-02-13T02:22:06.098 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:06.096+0000 7fba55bdf6c0 1 -- 10.20.193.11:0/3319295918 shutdown_connections 2026-02-13T02:22:06.098 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:06.096+0000 7fba55bdf6c0 1 --2- 10.20.193.11:0/3319295918 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fba240b5600 0x7fba240d5ab0 unknown :-1 s=CLOSED pgs=260 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:06.098 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:06.096+0000 7fba55bdf6c0 1 --2- 10.20.193.11:0/3319295918 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fba501229b0 0x7fba50122e50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:06.098 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:06.096+0000 7fba55bdf6c0 1 --2- 10.20.193.11:0/3319295918 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fba50115410 0x7fba5011d5f0 unknown :-1 s=CLOSED pgs=396 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:06.098 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:06.096+0000 7fba55bdf6c0 1 --2- 10.20.193.11:0/3319295918 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fba5010f200 0x7fba5011d0b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:06.098 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:06.096+0000 7fba55bdf6c0 1 -- 10.20.193.11:0/3319295918 >> 10.20.193.11:0/3319295918 conn(0x7fba500ecb00 msgr2=0x7fba5010cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:22:06.098 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:06.096+0000 7fba55bdf6c0 1 -- 10.20.193.11:0/3319295918 shutdown_connections 2026-02-13T02:22:06.098 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:06.096+0000 7fba55bdf6c0 1 -- 10.20.193.11:0/3319295918 wait complete. 2026-02-13T02:22:06.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:22:06 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/3319295918' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:22:07.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:22:06 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/3319295918' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:22:07.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:22:06 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/3319295918' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:22:07.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:22:07 trial011 ceph-mon[11956]: pgmap v284: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.1 KiB/s rd, 10 op/s 2026-02-13T02:22:08.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:22:07 trial060 ceph-mon[14797]: pgmap v284: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.1 KiB/s rd, 10 op/s 2026-02-13T02:22:08.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:22:07 trial078 ceph-mon[14969]: pgmap v284: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.1 KiB/s rd, 10 op/s 2026-02-13T02:22:09.138 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:22:09.264 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:22:09.383 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:09.379+0000 7f4dacd8c6c0 1 -- 10.20.193.11:0/2166090034 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f4da810fbf0 msgr2=0x7f4da8114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:22:09.383 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:09.379+0000 7f4dacd8c6c0 1 --2- 10.20.193.11:0/2166090034 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f4da810fbf0 0x7f4da8114c30 secure :-1 s=READY pgs=397 gs=1 cs=0 l=1 c_cookie=16698670928761609173 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4d900099a0 tx=0x7f4d9002ed20 comp rx=0 tx=0).stop 2026-02-13T02:22:09.383 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:09.379+0000 7f4dacd8c6c0 1 -- 10.20.193.11:0/2166090034 shutdown_connections 2026-02-13T02:22:09.383 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:09.379+0000 7f4dacd8c6c0 1 --2- 10.20.193.11:0/2166090034 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f4da8115410 0x7f4da8175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:09.383 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:09.379+0000 7f4dacd8c6c0 1 --2- 10.20.193.11:0/2166090034 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f4da810fbf0 0x7f4da8114c30 unknown :-1 s=CLOSED pgs=397 gs=1 cs=0 l=1 c_cookie=16698670928761609173 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:09.384 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:09.379+0000 7f4dacd8c6c0 1 --2- 10.20.193.11:0/2166090034 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f4da810f200 0x7f4da810f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:09.384 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:09.379+0000 7f4dacd8c6c0 1 -- 10.20.193.11:0/2166090034 >> 10.20.193.11:0/2166090034 conn(0x7f4da80ecb00 msgr2=0x7f4da810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:22:09.384 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:09.379+0000 7f4dacd8c6c0 1 -- 10.20.193.11:0/2166090034 shutdown_connections 2026-02-13T02:22:09.384 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:09.379+0000 7f4dacd8c6c0 1 -- 10.20.193.11:0/2166090034 wait complete. 2026-02-13T02:22:09.384 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:09.380+0000 7f4dacd8c6c0 1 Processor -- start 2026-02-13T02:22:09.384 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:09.380+0000 7f4dacd8c6c0 1 -- start start 2026-02-13T02:22:09.384 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:09.380+0000 7f4dacd8c6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f4da810f200 0x7f4da80f4b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:22:09.384 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:09.380+0000 7f4dacd8c6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f4da8115410 0x7f4da8175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:22:09.384 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:09.380+0000 7f4dacd8c6c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f4da80f5170 0x7f4da80fa3f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:22:09.384 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:09.380+0000 7f4dacd8c6c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f4da80f5860 con 0x7f4da8115410 2026-02-13T02:22:09.384 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:09.380+0000 7f4dacd8c6c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f4da80fa930 con 0x7f4da80f5170 2026-02-13T02:22:09.385 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:09.380+0000 7f4dacd8c6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f4da80faaf0 con 0x7f4da810f200 2026-02-13T02:22:09.385 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:09.380+0000 7f4da5d746c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f4da8115410 0x7f4da8175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:22:09.385 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:09.380+0000 7f4da5d746c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f4da8115410 0x7f4da8175cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:48214/0 (socket says 10.20.193.11:48214) 2026-02-13T02:22:09.385 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:09.380+0000 7f4da5d746c0 1 -- 10.20.193.11:0/3291684053 learned_addr learned my addr 10.20.193.11:0/3291684053 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:22:09.385 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:09.380+0000 7f4da6d766c0 1 --2- 10.20.193.11:0/3291684053 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f4da80f5170 0x7f4da80fa3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:22:09.385 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:09.380+0000 7f4da5d746c0 1 -- 10.20.193.11:0/3291684053 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f4da810f200 msgr2=0x7f4da80f4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:22:09.385 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:09.380+0000 7f4da5d746c0 1 --2- 10.20.193.11:0/3291684053 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f4da810f200 0x7f4da80f4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:09.385 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:09.380+0000 7f4da5d746c0 1 -- 10.20.193.11:0/3291684053 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f4da80f5170 msgr2=0x7f4da80fa3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:22:09.385 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:09.380+0000 7f4da5d746c0 1 --2- 10.20.193.11:0/3291684053 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f4da80f5170 0x7f4da80fa3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:09.385 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:09.380+0000 7f4da5d746c0 1 -- 10.20.193.11:0/3291684053 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d90009590 con 0x7f4da8115410 2026-02-13T02:22:09.385 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:09.380+0000 7f4da5d746c0 1 --2- 10.20.193.11:0/3291684053 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f4da8115410 0x7f4da8175cb0 secure :-1 s=READY pgs=398 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4d90031f90 tx=0x7f4d9002fc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:22:09.386 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:09.380+0000 7f4d8f7fe6c0 1 -- 10.20.193.11:0/3291684053 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4d90002ae0 con 0x7f4da8115410 2026-02-13T02:22:09.386 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:09.380+0000 7f4d8f7fe6c0 1 -- 10.20.193.11:0/3291684053 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f4d90002c40 con 0x7f4da8115410 2026-02-13T02:22:09.386 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:09.380+0000 7f4dacd8c6c0 1 -- 10.20.193.11:0/3291684053 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4da80fad70 con 0x7f4da8115410 2026-02-13T02:22:09.386 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:09.380+0000 7f4d8f7fe6c0 1 -- 10.20.193.11:0/3291684053 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4d900312b0 con 0x7f4da8115410 2026-02-13T02:22:09.386 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:09.380+0000 7f4dacd8c6c0 1 -- 10.20.193.11:0/3291684053 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4da80fb1f0 con 0x7f4da8115410 2026-02-13T02:22:09.386 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:09.381+0000 7f4dacd8c6c0 1 -- 10.20.193.11:0/3291684053 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4da81104d0 con 0x7f4da8115410 2026-02-13T02:22:09.387 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:09.382+0000 7f4d8f7fe6c0 1 -- 10.20.193.11:0/3291684053 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7f4d90007260 con 0x7f4da8115410 2026-02-13T02:22:09.387 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:09.383+0000 7f4d8f7fe6c0 1 --2- 10.20.193.11:0/3291684053 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f4d800b5600 0x7f4d800d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:22:09.387 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:09.383+0000 7f4da65756c0 1 --2- 10.20.193.11:0/3291684053 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f4d800b5600 0x7f4d800d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:22:09.387 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:09.383+0000 7f4d8f7fe6c0 1 -- 10.20.193.11:0/3291684053 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7965+0+0 (secure 0 0 0) 0x7f4d90107c60 con 0x7f4da8115410 2026-02-13T02:22:09.387 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:09.383+0000 7f4da65756c0 1 --2- 10.20.193.11:0/3291684053 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f4d800b5600 0x7f4d800d5ab0 secure :-1 s=READY pgs=261 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4d9c004750 tx=0x7f4d9c0096a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:22:09.387 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:09.384+0000 7f4d8f7fe6c0 1 -- 10.20.193.11:0/3291684053 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f4d900ca760 con 0x7f4da8115410 2026-02-13T02:22:09.502 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:09.500+0000 7f4dacd8c6c0 1 -- 10.20.193.11:0/3291684053 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f4da810f5d0 con 0x7f4da8115410 2026-02-13T02:22:09.503 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:09.500+0000 7f4d8f7fe6c0 1 -- 10.20.193.11:0/3291684053 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f4d90002db0 con 0x7f4da8115410 2026-02-13T02:22:09.503 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:22:09.504 INFO:teuthology.orchestra.run.trial011.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:22:09.505 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:09.501+0000 7f4dacd8c6c0 1 -- 10.20.193.11:0/3291684053 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f4d800b5600 msgr2=0x7f4d800d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:22:09.505 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:09.501+0000 7f4dacd8c6c0 1 --2- 10.20.193.11:0/3291684053 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f4d800b5600 0x7f4d800d5ab0 secure :-1 s=READY pgs=261 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4d9c004750 tx=0x7f4d9c0096a0 comp rx=0 tx=0).stop 2026-02-13T02:22:09.505 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:09.501+0000 7f4dacd8c6c0 1 -- 10.20.193.11:0/3291684053 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f4da8115410 msgr2=0x7f4da8175cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:22:09.505 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:09.501+0000 7f4dacd8c6c0 1 --2- 10.20.193.11:0/3291684053 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f4da8115410 0x7f4da8175cb0 secure :-1 s=READY pgs=398 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4d90031f90 tx=0x7f4d9002fc00 comp rx=0 tx=0).stop 2026-02-13T02:22:09.505 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:09.501+0000 7f4dacd8c6c0 1 -- 10.20.193.11:0/3291684053 shutdown_connections 2026-02-13T02:22:09.505 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:09.501+0000 7f4dacd8c6c0 1 --2- 10.20.193.11:0/3291684053 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f4d800b5600 0x7f4d800d5ab0 unknown :-1 s=CLOSED pgs=261 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:09.505 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:09.501+0000 7f4dacd8c6c0 1 --2- 10.20.193.11:0/3291684053 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f4da80f5170 0x7f4da80fa3f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:09.505 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:09.501+0000 7f4dacd8c6c0 1 --2- 10.20.193.11:0/3291684053 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f4da8115410 0x7f4da8175cb0 unknown :-1 s=CLOSED pgs=398 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:09.505 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:09.501+0000 7f4dacd8c6c0 1 --2- 10.20.193.11:0/3291684053 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f4da810f200 0x7f4da80f4b40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:09.506 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:09.501+0000 7f4dacd8c6c0 1 -- 10.20.193.11:0/3291684053 >> 10.20.193.11:0/3291684053 conn(0x7f4da80ecb00 msgr2=0x7f4da810d760 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:22:09.506 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:09.501+0000 7f4dacd8c6c0 1 -- 10.20.193.11:0/3291684053 shutdown_connections 2026-02-13T02:22:09.506 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:09.501+0000 7f4dacd8c6c0 1 -- 10.20.193.11:0/3291684053 wait complete. 2026-02-13T02:22:09.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:22:09 trial011 ceph-mon[11956]: pgmap v285: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.1 KiB/s rd, 10 op/s 2026-02-13T02:22:09.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:22:09 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/3291684053' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:22:10.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:22:09 trial060 ceph-mon[14797]: pgmap v285: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.1 KiB/s rd, 10 op/s 2026-02-13T02:22:10.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:22:09 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/3291684053' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:22:10.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:22:09 trial078 ceph-mon[14969]: pgmap v285: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.1 KiB/s rd, 10 op/s 2026-02-13T02:22:10.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:22:09 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/3291684053' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:22:11.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:22:11 trial011 ceph-mon[11956]: pgmap v286: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 9 op/s 2026-02-13T02:22:12.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:22:11 trial060 ceph-mon[14797]: pgmap v286: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 9 op/s 2026-02-13T02:22:12.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:22:11 trial078 ceph-mon[14969]: pgmap v286: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 9 op/s 2026-02-13T02:22:12.542 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:22:12.669 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:22:12.776 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:12.772+0000 7f87bcfc16c0 1 -- 10.20.193.11:0/19151443 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f87b810fbf0 msgr2=0x7f87b8114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:22:12.776 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:12.772+0000 7f87bcfc16c0 1 --2- 10.20.193.11:0/19151443 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f87b810fbf0 0x7f87b8114c30 secure :-1 s=READY pgs=399 gs=1 cs=0 l=1 c_cookie=1911804639741242888 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f87a00099a0 tx=0x7f87a002ed20 comp rx=0 tx=0).stop 2026-02-13T02:22:12.776 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:12.772+0000 7f87bcfc16c0 1 -- 10.20.193.11:0/19151443 shutdown_connections 2026-02-13T02:22:12.776 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:12.772+0000 7f87bcfc16c0 1 --2- 10.20.193.11:0/19151443 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f87b8115410 0x7f87b8175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:12.776 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:12.772+0000 7f87bcfc16c0 1 --2- 10.20.193.11:0/19151443 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f87b810fbf0 0x7f87b8114c30 unknown :-1 s=CLOSED pgs=399 gs=1 cs=0 l=1 c_cookie=1911804639741242888 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:12.777 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:12.772+0000 7f87bcfc16c0 1 --2- 10.20.193.11:0/19151443 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f87b810f200 0x7f87b810f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:12.777 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:12.772+0000 7f87bcfc16c0 1 -- 10.20.193.11:0/19151443 >> 10.20.193.11:0/19151443 conn(0x7f87b80ecb00 msgr2=0x7f87b810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:22:12.777 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:12.772+0000 7f87bcfc16c0 1 -- 10.20.193.11:0/19151443 shutdown_connections 2026-02-13T02:22:12.777 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:12.772+0000 7f87bcfc16c0 1 -- 10.20.193.11:0/19151443 wait complete. 2026-02-13T02:22:12.777 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:12.773+0000 7f87bcfc16c0 1 Processor -- start 2026-02-13T02:22:12.777 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:12.773+0000 7f87bcfc16c0 1 -- start start 2026-02-13T02:22:12.777 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:12.773+0000 7f87bcfc16c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f87b810f200 0x7f87b80f4ba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:22:12.777 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:12.773+0000 7f87bcfc16c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f87b8115410 0x7f87b8175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:22:12.777 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:12.773+0000 7f87bcfc16c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f87b80f51d0 0x7f87b80fa4a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:22:12.777 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:12.773+0000 7f87bcfc16c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f87b80f58c0 con 0x7f87b80f51d0 2026-02-13T02:22:12.777 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:12.773+0000 7f87bcfc16c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f87b80fa9e0 con 0x7f87b810f200 2026-02-13T02:22:12.777 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:12.773+0000 7f87bcfc16c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f87b80faba0 con 0x7f87b8115410 2026-02-13T02:22:12.778 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:12.773+0000 7f87b6d766c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f87b80f51d0 0x7f87b80fa4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:22:12.778 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:12.773+0000 7f87b6d766c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f87b80f51d0 0x7f87b80fa4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:36620/0 (socket says 10.20.193.11:36620) 2026-02-13T02:22:12.778 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:12.773+0000 7f87b6d766c0 1 -- 10.20.193.11:0/1604823497 learned_addr learned my addr 10.20.193.11:0/1604823497 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:22:12.778 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:12.773+0000 7f87b65756c0 1 --2- 10.20.193.11:0/1604823497 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f87b810f200 0x7f87b80f4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:22:12.778 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:12.773+0000 7f87b6d766c0 1 -- 10.20.193.11:0/1604823497 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f87b8115410 msgr2=0x7f87b8175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:22:12.778 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:12.773+0000 7f87b6d766c0 1 --2- 10.20.193.11:0/1604823497 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f87b8115410 0x7f87b8175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:12.778 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:12.773+0000 7f87b6d766c0 1 -- 10.20.193.11:0/1604823497 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f87b810f200 msgr2=0x7f87b80f4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:22:12.778 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:12.773+0000 7f87b6d766c0 1 --2- 10.20.193.11:0/1604823497 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f87b810f200 0x7f87b80f4ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:12.778 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:12.773+0000 7f87b6d766c0 1 -- 10.20.193.11:0/1604823497 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87a0009590 con 0x7f87b80f51d0 2026-02-13T02:22:12.778 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:12.773+0000 7f87b65756c0 1 --2- 10.20.193.11:0/1604823497 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f87b810f200 0x7f87b80f4ba0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:22:12.778 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:12.773+0000 7f87b6d766c0 1 --2- 10.20.193.11:0/1604823497 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f87b80f51d0 0x7f87b80fa4a0 secure :-1 s=READY pgs=400 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f87a8006ea0 tx=0x7f87a800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:22:12.778 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:12.773+0000 7f879f7fe6c0 1 -- 10.20.193.11:0/1604823497 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f87a8003a30 con 0x7f87b80f51d0 2026-02-13T02:22:12.778 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:12.773+0000 7f87bcfc16c0 1 -- 10.20.193.11:0/1604823497 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87b80fae80 con 0x7f87b80f51d0 2026-02-13T02:22:12.779 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:12.773+0000 7f879f7fe6c0 1 -- 10.20.193.11:0/1604823497 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f87a8005510 con 0x7f87b80f51d0 2026-02-13T02:22:12.779 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:12.773+0000 7f879f7fe6c0 1 -- 10.20.193.11:0/1604823497 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f87a800dd70 con 0x7f87b80f51d0 2026-02-13T02:22:12.779 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:12.773+0000 7f87bcfc16c0 1 -- 10.20.193.11:0/1604823497 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87b80fb610 con 0x7f87b80f51d0 2026-02-13T02:22:12.779 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:12.774+0000 7f87bcfc16c0 1 -- 10.20.193.11:0/1604823497 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87b80fb360 con 0x7f87b80f51d0 2026-02-13T02:22:12.780 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:12.775+0000 7f879f7fe6c0 1 -- 10.20.193.11:0/1604823497 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7f87a8003b90 con 0x7f87b80f51d0 2026-02-13T02:22:12.780 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:12.776+0000 7f879f7fe6c0 1 --2- 10.20.193.11:0/1604823497 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f87900b5600 0x7f87900d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:22:12.780 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:12.776+0000 7f87b65756c0 1 --2- 10.20.193.11:0/1604823497 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f87900b5600 0x7f87900d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:22:12.780 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:12.776+0000 7f879f7fe6c0 1 -- 10.20.193.11:0/1604823497 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7965+0+0 (secure 0 0 0) 0x7f87a80e4a60 con 0x7f87b80f51d0 2026-02-13T02:22:12.780 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:12.776+0000 7f879f7fe6c0 1 -- 10.20.193.11:0/1604823497 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f87a80a7520 con 0x7f87b80f51d0 2026-02-13T02:22:12.780 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:12.776+0000 7f87b65756c0 1 --2- 10.20.193.11:0/1604823497 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f87900b5600 0x7f87900d5ab0 secure :-1 s=READY pgs=262 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f87ac004750 tx=0x7f87ac005f10 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:22:12.892 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:12.889+0000 7f87bcfc16c0 1 -- 10.20.193.11:0/1604823497 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f87b81104d0 con 0x7f87b80f51d0 2026-02-13T02:22:12.892 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:12.890+0000 7f879f7fe6c0 1 -- 10.20.193.11:0/1604823497 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f87a80aa6d0 con 0x7f87b80f51d0 2026-02-13T02:22:12.892 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:22:12.892 INFO:teuthology.orchestra.run.trial011.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:22:12.893 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:12.891+0000 7f87bcfc16c0 1 -- 10.20.193.11:0/1604823497 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f87900b5600 msgr2=0x7f87900d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:22:12.893 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:12.891+0000 7f87bcfc16c0 1 --2- 10.20.193.11:0/1604823497 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f87900b5600 0x7f87900d5ab0 secure :-1 s=READY pgs=262 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f87ac004750 tx=0x7f87ac005f10 comp rx=0 tx=0).stop 2026-02-13T02:22:12.893 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:12.891+0000 7f87bcfc16c0 1 -- 10.20.193.11:0/1604823497 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f87b80f51d0 msgr2=0x7f87b80fa4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:22:12.894 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:12.891+0000 7f87bcfc16c0 1 --2- 10.20.193.11:0/1604823497 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f87b80f51d0 0x7f87b80fa4a0 secure :-1 s=READY pgs=400 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f87a8006ea0 tx=0x7f87a800cca0 comp rx=0 tx=0).stop 2026-02-13T02:22:12.894 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:12.891+0000 7f87bcfc16c0 1 -- 10.20.193.11:0/1604823497 shutdown_connections 2026-02-13T02:22:12.894 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:12.891+0000 7f87bcfc16c0 1 --2- 10.20.193.11:0/1604823497 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f87900b5600 0x7f87900d5ab0 unknown :-1 s=CLOSED pgs=262 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:12.894 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:12.891+0000 7f87bcfc16c0 1 --2- 10.20.193.11:0/1604823497 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f87b80f51d0 0x7f87b80fa4a0 unknown :-1 s=CLOSED pgs=400 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:12.894 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:12.891+0000 7f87bcfc16c0 1 --2- 10.20.193.11:0/1604823497 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f87b8115410 0x7f87b8175cb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:12.894 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:12.891+0000 7f87bcfc16c0 1 --2- 10.20.193.11:0/1604823497 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f87b810f200 0x7f87b80f4ba0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:12.894 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:12.891+0000 7f87bcfc16c0 1 -- 10.20.193.11:0/1604823497 >> 10.20.193.11:0/1604823497 conn(0x7f87b80ecb00 msgr2=0x7f87b810d7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:22:12.894 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:12.891+0000 7f87bcfc16c0 1 -- 10.20.193.11:0/1604823497 shutdown_connections 2026-02-13T02:22:12.894 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:12.891+0000 7f87bcfc16c0 1 -- 10.20.193.11:0/1604823497 wait complete. 2026-02-13T02:22:13.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:22:13 trial011 ceph-mon[11956]: pgmap v287: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T02:22:13.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:22:13 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/1604823497' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:22:14.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:22:13 trial060 ceph-mon[14797]: pgmap v287: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T02:22:14.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:22:13 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/1604823497' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:22:14.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:22:13 trial078 ceph-mon[14969]: pgmap v287: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T02:22:14.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:22:13 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/1604823497' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:22:15.934 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:22:15.951 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:22:15 trial011 ceph-mon[11956]: pgmap v288: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:22:16.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:22:15 trial060 ceph-mon[14797]: pgmap v288: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:22:16.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:22:15 trial078 ceph-mon[14969]: pgmap v288: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:22:16.061 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:22:16.188 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:16.184+0000 7f89f09876c0 1 -- 10.20.193.11:0/3159814889 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f89e810fc20 msgr2=0x7f89e8114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:22:16.188 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:16.184+0000 7f89f09876c0 1 --2- 10.20.193.11:0/3159814889 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f89e810fc20 0x7f89e8114c60 secure :-1 s=READY pgs=401 gs=1 cs=0 l=1 c_cookie=1284013503477200087 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f89d40099a0 tx=0x7f89d402ed20 comp rx=0 tx=0).stop 2026-02-13T02:22:16.188 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:16.184+0000 7f89f09876c0 1 -- 10.20.193.11:0/3159814889 shutdown_connections 2026-02-13T02:22:16.188 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:16.184+0000 7f89f09876c0 1 --2- 10.20.193.11:0/3159814889 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f89e8115440 0x7f89e8175de0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:16.188 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:16.184+0000 7f89f09876c0 1 --2- 10.20.193.11:0/3159814889 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f89e810fc20 0x7f89e8114c60 unknown :-1 s=CLOSED pgs=401 gs=1 cs=0 l=1 c_cookie=1284013503477200087 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:16.188 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:16.184+0000 7f89f09876c0 1 --2- 10.20.193.11:0/3159814889 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f89e810f230 0x7f89e810f600 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:16.188 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:16.184+0000 7f89f09876c0 1 -- 10.20.193.11:0/3159814889 >> 10.20.193.11:0/3159814889 conn(0x7f89e80ecb30 msgr2=0x7f89e810cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:22:16.189 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:16.184+0000 7f89f09876c0 1 -- 10.20.193.11:0/3159814889 shutdown_connections 2026-02-13T02:22:16.189 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:16.184+0000 7f89f09876c0 1 -- 10.20.193.11:0/3159814889 wait complete. 2026-02-13T02:22:16.189 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:16.184+0000 7f89f09876c0 1 Processor -- start 2026-02-13T02:22:16.189 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:16.184+0000 7f89f09876c0 1 -- start start 2026-02-13T02:22:16.189 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:16.184+0000 7f89f09876c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f89e810f230 0x7f89e80f4c50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:22:16.189 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:16.184+0000 7f89f09876c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f89e8115440 0x7f89e8175ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:22:16.189 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:16.184+0000 7f89f09876c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f89e80f5280 0x7f89e80fa550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:22:16.189 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:16.184+0000 7f89f09876c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f89e80f5970 con 0x7f89e810f230 2026-02-13T02:22:16.189 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:16.184+0000 7f89f09876c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f89e80faa90 con 0x7f89e8115440 2026-02-13T02:22:16.189 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:16.184+0000 7f89f09876c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f89e80fac50 con 0x7f89e80f5280 2026-02-13T02:22:16.189 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:16.184+0000 7f89ee6f86c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f89e810f230 0x7f89e80f4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:22:16.189 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:16.184+0000 7f89ee6f86c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f89e810f230 0x7f89e80f4c50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:36638/0 (socket says 10.20.193.11:36638) 2026-02-13T02:22:16.190 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:16.184+0000 7f89ee6f86c0 1 -- 10.20.193.11:0/2126590574 learned_addr learned my addr 10.20.193.11:0/2126590574 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:22:16.190 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:16.185+0000 7f89edef76c0 1 --2- 10.20.193.11:0/2126590574 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f89e8115440 0x7f89e8175ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:22:16.190 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:16.185+0000 7f89eeef96c0 1 --2- 10.20.193.11:0/2126590574 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f89e80f5280 0x7f89e80fa550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:22:16.190 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:16.185+0000 7f89ee6f86c0 1 -- 10.20.193.11:0/2126590574 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f89e80f5280 msgr2=0x7f89e80fa550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:22:16.190 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:16.185+0000 7f89ee6f86c0 1 --2- 10.20.193.11:0/2126590574 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f89e80f5280 0x7f89e80fa550 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:16.190 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:16.185+0000 7f89ee6f86c0 1 -- 10.20.193.11:0/2126590574 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f89e8115440 msgr2=0x7f89e8175ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:22:16.190 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:16.185+0000 7f89ee6f86c0 1 --2- 10.20.193.11:0/2126590574 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f89e8115440 0x7f89e8175ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:16.190 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:16.185+0000 7f89ee6f86c0 1 -- 10.20.193.11:0/2126590574 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89d4009590 con 0x7f89e810f230 2026-02-13T02:22:16.190 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:16.185+0000 7f89ee6f86c0 1 --2- 10.20.193.11:0/2126590574 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f89e810f230 0x7f89e80f4c50 secure :-1 s=READY pgs=402 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f89e000b710 tx=0x7f89e000bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:22:16.190 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:16.185+0000 7f89d37fe6c0 1 -- 10.20.193.11:0/2126590574 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f89e0004250 con 0x7f89e810f230 2026-02-13T02:22:16.190 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:16.185+0000 7f89d37fe6c0 1 -- 10.20.193.11:0/2126590574 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f89e0002da0 con 0x7f89e810f230 2026-02-13T02:22:16.190 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:16.185+0000 7f89f09876c0 1 -- 10.20.193.11:0/2126590574 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89e80faf30 con 0x7f89e810f230 2026-02-13T02:22:16.191 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:16.185+0000 7f89d37fe6c0 1 -- 10.20.193.11:0/2126590574 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f89e000ce40 con 0x7f89e810f230 2026-02-13T02:22:16.191 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:16.185+0000 7f89f09876c0 1 -- 10.20.193.11:0/2126590574 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89e80fb6c0 con 0x7f89e810f230 2026-02-13T02:22:16.191 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:16.185+0000 7f89f09876c0 1 -- 10.20.193.11:0/2126590574 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89e8110500 con 0x7f89e810f230 2026-02-13T02:22:16.192 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:16.187+0000 7f89d37fe6c0 1 -- 10.20.193.11:0/2126590574 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7f89e000c410 con 0x7f89e810f230 2026-02-13T02:22:16.192 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:16.188+0000 7f89d37fe6c0 1 --2- 10.20.193.11:0/2126590574 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f89c40b5600 0x7f89c40d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:22:16.192 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:16.188+0000 7f89edef76c0 1 --2- 10.20.193.11:0/2126590574 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f89c40b5600 0x7f89c40d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:22:16.192 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:16.188+0000 7f89d37fe6c0 1 -- 10.20.193.11:0/2126590574 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7965+0+0 (secure 0 0 0) 0x7f89e00e3b20 con 0x7f89e810f230 2026-02-13T02:22:16.192 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:16.188+0000 7f89d37fe6c0 1 -- 10.20.193.11:0/2126590574 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f89e011c600 con 0x7f89e810f230 2026-02-13T02:22:16.192 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:16.188+0000 7f89edef76c0 1 --2- 10.20.193.11:0/2126590574 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f89c40b5600 0x7f89c40d5ab0 secure :-1 s=READY pgs=263 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f89d40023e0 tx=0x7f89d4031f90 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:22:16.305 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:16.303+0000 7f89f09876c0 1 -- 10.20.193.11:0/2126590574 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f89e80f5da0 con 0x7f89e810f230 2026-02-13T02:22:16.305 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:16.303+0000 7f89d37fe6c0 1 -- 10.20.193.11:0/2126590574 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f89e00a6620 con 0x7f89e810f230 2026-02-13T02:22:16.305 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:22:16.305 INFO:teuthology.orchestra.run.trial011.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:22:16.306 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:16.304+0000 7f89f09876c0 1 -- 10.20.193.11:0/2126590574 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f89c40b5600 msgr2=0x7f89c40d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:22:16.307 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:16.304+0000 7f89f09876c0 1 --2- 10.20.193.11:0/2126590574 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f89c40b5600 0x7f89c40d5ab0 secure :-1 s=READY pgs=263 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f89d40023e0 tx=0x7f89d4031f90 comp rx=0 tx=0).stop 2026-02-13T02:22:16.307 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:16.304+0000 7f89f09876c0 1 -- 10.20.193.11:0/2126590574 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f89e810f230 msgr2=0x7f89e80f4c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:22:16.307 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:16.304+0000 7f89f09876c0 1 --2- 10.20.193.11:0/2126590574 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f89e810f230 0x7f89e80f4c50 secure :-1 s=READY pgs=402 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f89e000b710 tx=0x7f89e000bbe0 comp rx=0 tx=0).stop 2026-02-13T02:22:16.307 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:16.304+0000 7f89f09876c0 1 -- 10.20.193.11:0/2126590574 shutdown_connections 2026-02-13T02:22:16.307 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:16.304+0000 7f89f09876c0 1 --2- 10.20.193.11:0/2126590574 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f89c40b5600 0x7f89c40d5ab0 unknown :-1 s=CLOSED pgs=263 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:16.307 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:16.304+0000 7f89f09876c0 1 --2- 10.20.193.11:0/2126590574 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f89e8115440 0x7f89e8175ce0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:16.307 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:16.304+0000 7f89f09876c0 1 --2- 10.20.193.11:0/2126590574 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f89e80f5280 0x7f89e80fa550 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:16.307 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:16.304+0000 7f89f09876c0 1 --2- 10.20.193.11:0/2126590574 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f89e810f230 0x7f89e80f4c50 unknown :-1 s=CLOSED pgs=402 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:16.307 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:16.304+0000 7f89f09876c0 1 -- 10.20.193.11:0/2126590574 >> 10.20.193.11:0/2126590574 conn(0x7f89e80ecb30 msgr2=0x7f89e810d850 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:22:16.307 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:16.304+0000 7f89f09876c0 1 -- 10.20.193.11:0/2126590574 shutdown_connections 2026-02-13T02:22:16.307 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:16.304+0000 7f89f09876c0 1 -- 10.20.193.11:0/2126590574 wait complete. 2026-02-13T02:22:16.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:22:16 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/2126590574' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:22:17.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:22:16 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/2126590574' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:22:17.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:22:16 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/2126590574' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:22:17.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:22:17 trial011 ceph-mon[11956]: pgmap v289: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:22:18.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:22:17 trial060 ceph-mon[14797]: pgmap v289: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:22:18.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:22:17 trial078 ceph-mon[14969]: pgmap v289: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:22:19.345 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:22:19.468 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:22:19.595 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:19.591+0000 7f5b46fd76c0 1 -- 10.20.193.11:0/4067542270 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f5b40115440 msgr2=0x7f5b40175de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:22:19.595 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:19.591+0000 7f5b46fd76c0 1 --2- 10.20.193.11:0/4067542270 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f5b40115440 0x7f5b40175de0 secure :-1 s=READY pgs=403 gs=1 cs=0 l=1 c_cookie=4030167946312210653 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5b3c00aa70 tx=0x7f5b3c02fde0 comp rx=0 tx=0).stop 2026-02-13T02:22:19.595 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:19.591+0000 7f5b46fd76c0 1 -- 10.20.193.11:0/4067542270 shutdown_connections 2026-02-13T02:22:19.595 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:19.591+0000 7f5b46fd76c0 1 --2- 10.20.193.11:0/4067542270 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f5b40115440 0x7f5b40175de0 unknown :-1 s=CLOSED pgs=403 gs=1 cs=0 l=1 c_cookie=4030167946312210653 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:19.595 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:19.591+0000 7f5b46fd76c0 1 --2- 10.20.193.11:0/4067542270 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f5b4010fc20 0x7f5b40114c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:19.595 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:19.591+0000 7f5b46fd76c0 1 --2- 10.20.193.11:0/4067542270 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f5b4010f230 0x7f5b4010f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:19.596 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:19.591+0000 7f5b46fd76c0 1 -- 10.20.193.11:0/4067542270 >> 10.20.193.11:0/4067542270 conn(0x7f5b400ecb30 msgr2=0x7f5b4010cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:22:19.596 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:19.591+0000 7f5b46fd76c0 1 -- 10.20.193.11:0/4067542270 shutdown_connections 2026-02-13T02:22:19.596 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:19.591+0000 7f5b46fd76c0 1 -- 10.20.193.11:0/4067542270 wait complete. 2026-02-13T02:22:19.596 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:19.591+0000 7f5b46fd76c0 1 Processor -- start 2026-02-13T02:22:19.596 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:19.591+0000 7f5b46fd76c0 1 -- start start 2026-02-13T02:22:19.596 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:19.591+0000 7f5b46fd76c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f5b4010f230 0x7f5b4011d0c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:22:19.596 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:19.591+0000 7f5b46fd76c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f5b40115440 0x7f5b4011d600 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:22:19.596 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:19.591+0000 7f5b46fd76c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f5b401229c0 0x7f5b40122e60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:22:19.596 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:19.591+0000 7f5b46fd76c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f5b401233d0 con 0x7f5b4010f230 2026-02-13T02:22:19.596 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:19.591+0000 7f5b46fd76c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f5b40123540 con 0x7f5b401229c0 2026-02-13T02:22:19.597 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:19.591+0000 7f5b46fd76c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f5b40123700 con 0x7f5b40115440 2026-02-13T02:22:19.597 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:19.591+0000 7f5b44d486c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f5b4010f230 0x7f5b4011d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:22:19.597 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:19.591+0000 7f5b44d486c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f5b4010f230 0x7f5b4011d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:36664/0 (socket says 10.20.193.11:36664) 2026-02-13T02:22:19.597 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:19.591+0000 7f5b44d486c0 1 -- 10.20.193.11:0/426170005 learned_addr learned my addr 10.20.193.11:0/426170005 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:22:19.597 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:19.591+0000 7f5b37fff6c0 1 --2- 10.20.193.11:0/426170005 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f5b40115440 0x7f5b4011d600 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:22:19.597 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:19.591+0000 7f5b455496c0 1 --2- 10.20.193.11:0/426170005 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f5b401229c0 0x7f5b40122e60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:22:19.597 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:19.591+0000 7f5b44d486c0 1 -- 10.20.193.11:0/426170005 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f5b40115440 msgr2=0x7f5b4011d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:22:19.597 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:19.591+0000 7f5b44d486c0 1 --2- 10.20.193.11:0/426170005 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f5b40115440 0x7f5b4011d600 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:19.597 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:19.591+0000 7f5b44d486c0 1 -- 10.20.193.11:0/426170005 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f5b401229c0 msgr2=0x7f5b40122e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:22:19.597 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:19.591+0000 7f5b44d486c0 1 --2- 10.20.193.11:0/426170005 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f5b401229c0 0x7f5b40122e60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:19.598 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:19.591+0000 7f5b44d486c0 1 -- 10.20.193.11:0/426170005 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b3c00a660 con 0x7f5b4010f230 2026-02-13T02:22:19.598 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:19.591+0000 7f5b44d486c0 1 --2- 10.20.193.11:0/426170005 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f5b4010f230 0x7f5b4011d0c0 secure :-1 s=READY pgs=404 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5b3000b710 tx=0x7f5b3000bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:22:19.598 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:19.592+0000 7f5b35ffb6c0 1 -- 10.20.193.11:0/426170005 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5b30004250 con 0x7f5b4010f230 2026-02-13T02:22:19.598 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:19.592+0000 7f5b35ffb6c0 1 -- 10.20.193.11:0/426170005 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f5b30009070 con 0x7f5b4010f230 2026-02-13T02:22:19.598 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:19.592+0000 7f5b35ffb6c0 1 -- 10.20.193.11:0/426170005 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5b3000cd70 con 0x7f5b4010f230 2026-02-13T02:22:19.598 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:19.592+0000 7f5b46fd76c0 1 -- 10.20.193.11:0/426170005 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b40163bb0 con 0x7f5b4010f230 2026-02-13T02:22:19.598 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:19.592+0000 7f5b46fd76c0 1 -- 10.20.193.11:0/426170005 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b40164040 con 0x7f5b4010f230 2026-02-13T02:22:19.598 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:19.592+0000 7f5b46fd76c0 1 -- 10.20.193.11:0/426170005 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b40110500 con 0x7f5b4010f230 2026-02-13T02:22:19.599 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:19.593+0000 7f5b35ffb6c0 1 -- 10.20.193.11:0/426170005 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7f5b300028c0 con 0x7f5b4010f230 2026-02-13T02:22:19.599 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:19.594+0000 7f5b35ffb6c0 1 --2- 10.20.193.11:0/426170005 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f5b1c0b5680 0x7f5b1c0d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:22:19.599 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:19.594+0000 7f5b37fff6c0 1 --2- 10.20.193.11:0/426170005 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f5b1c0b5680 0x7f5b1c0d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:22:19.599 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:19.594+0000 7f5b35ffb6c0 1 -- 10.20.193.11:0/426170005 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7965+0+0 (secure 0 0 0) 0x7f5b300e3ae0 con 0x7f5b4010f230 2026-02-13T02:22:19.599 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:19.594+0000 7f5b35ffb6c0 1 -- 10.20.193.11:0/426170005 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f5b300a65a0 con 0x7f5b4010f230 2026-02-13T02:22:19.600 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:19.595+0000 7f5b37fff6c0 1 --2- 10.20.193.11:0/426170005 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f5b1c0b5680 0x7f5b1c0d5b30 secure :-1 s=READY pgs=264 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5b28005980 tx=0x7f5b28005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:22:19.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:22:19 trial011 ceph-mon[11956]: pgmap v290: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:22:19.711 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:19.709+0000 7f5b46fd76c0 1 -- 10.20.193.11:0/426170005 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f5b4010fc20 con 0x7f5b4010f230 2026-02-13T02:22:19.711 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:19.709+0000 7f5b35ffb6c0 1 -- 10.20.193.11:0/426170005 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f5b300a9750 con 0x7f5b4010f230 2026-02-13T02:22:19.711 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:22:19.711 INFO:teuthology.orchestra.run.trial011.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:22:19.712 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:19.710+0000 7f5b46fd76c0 1 -- 10.20.193.11:0/426170005 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f5b1c0b5680 msgr2=0x7f5b1c0d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:22:19.712 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:19.710+0000 7f5b46fd76c0 1 --2- 10.20.193.11:0/426170005 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f5b1c0b5680 0x7f5b1c0d5b30 secure :-1 s=READY pgs=264 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5b28005980 tx=0x7f5b28005910 comp rx=0 tx=0).stop 2026-02-13T02:22:19.712 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:19.710+0000 7f5b46fd76c0 1 -- 10.20.193.11:0/426170005 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f5b4010f230 msgr2=0x7f5b4011d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:22:19.712 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:19.710+0000 7f5b46fd76c0 1 --2- 10.20.193.11:0/426170005 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f5b4010f230 0x7f5b4011d0c0 secure :-1 s=READY pgs=404 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5b3000b710 tx=0x7f5b3000bbe0 comp rx=0 tx=0).stop 2026-02-13T02:22:19.713 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:19.710+0000 7f5b46fd76c0 1 -- 10.20.193.11:0/426170005 shutdown_connections 2026-02-13T02:22:19.713 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:19.710+0000 7f5b46fd76c0 1 --2- 10.20.193.11:0/426170005 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f5b1c0b5680 0x7f5b1c0d5b30 unknown :-1 s=CLOSED pgs=264 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:19.713 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:19.710+0000 7f5b46fd76c0 1 --2- 10.20.193.11:0/426170005 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f5b401229c0 0x7f5b40122e60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:19.713 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:19.710+0000 7f5b46fd76c0 1 --2- 10.20.193.11:0/426170005 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f5b40115440 0x7f5b4011d600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:19.713 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:19.710+0000 7f5b46fd76c0 1 --2- 10.20.193.11:0/426170005 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f5b4010f230 0x7f5b4011d0c0 unknown :-1 s=CLOSED pgs=404 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:19.713 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:19.710+0000 7f5b46fd76c0 1 -- 10.20.193.11:0/426170005 >> 10.20.193.11:0/426170005 conn(0x7f5b400ecb30 msgr2=0x7f5b4010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:22:19.713 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:19.710+0000 7f5b46fd76c0 1 -- 10.20.193.11:0/426170005 shutdown_connections 2026-02-13T02:22:19.713 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:19.710+0000 7f5b46fd76c0 1 -- 10.20.193.11:0/426170005 wait complete. 2026-02-13T02:22:20.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:22:19 trial060 ceph-mon[14797]: pgmap v290: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:22:20.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:22:19 trial078 ceph-mon[14969]: pgmap v290: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:22:20.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:22:20 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/426170005' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:22:21.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:22:20 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/426170005' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:22:21.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:22:20 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/426170005' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:22:21.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:22:21 trial011 ceph-mon[11956]: pgmap v291: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:22:22.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:22:21 trial060 ceph-mon[14797]: pgmap v291: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:22:22.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:22:21 trial078 ceph-mon[14969]: pgmap v291: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:22:22.765 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:22:22.891 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:22:23.005 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:23.002+0000 7f9ceadfc6c0 1 -- 10.20.193.11:0/3837925061 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f9ce410fc20 msgr2=0x7f9ce4114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:22:23.005 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:23.002+0000 7f9ceadfc6c0 1 --2- 10.20.193.11:0/3837925061 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f9ce410fc20 0x7f9ce4114c60 secure :-1 s=READY pgs=405 gs=1 cs=0 l=1 c_cookie=10168634650556755660 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9ccc0099a0 tx=0x7f9ccc02ed20 comp rx=0 tx=0).stop 2026-02-13T02:22:23.005 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:23.002+0000 7f9ceadfc6c0 1 -- 10.20.193.11:0/3837925061 shutdown_connections 2026-02-13T02:22:23.006 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:23.002+0000 7f9ceadfc6c0 1 --2- 10.20.193.11:0/3837925061 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f9ce4115440 0x7f9ce4175de0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:23.006 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:23.002+0000 7f9ceadfc6c0 1 --2- 10.20.193.11:0/3837925061 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f9ce410fc20 0x7f9ce4114c60 unknown :-1 s=CLOSED pgs=405 gs=1 cs=0 l=1 c_cookie=10168634650556755660 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:23.006 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:23.002+0000 7f9ceadfc6c0 1 --2- 10.20.193.11:0/3837925061 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f9ce410f230 0x7f9ce410f600 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:23.006 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:23.002+0000 7f9ceadfc6c0 1 -- 10.20.193.11:0/3837925061 >> 10.20.193.11:0/3837925061 conn(0x7f9ce40ecb30 msgr2=0x7f9ce410cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:22:23.006 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:23.002+0000 7f9ceadfc6c0 1 -- 10.20.193.11:0/3837925061 shutdown_connections 2026-02-13T02:22:23.006 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:23.002+0000 7f9ceadfc6c0 1 -- 10.20.193.11:0/3837925061 wait complete. 2026-02-13T02:22:23.006 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:23.002+0000 7f9ceadfc6c0 1 Processor -- start 2026-02-13T02:22:23.006 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:23.002+0000 7f9ceadfc6c0 1 -- start start 2026-02-13T02:22:23.006 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:23.002+0000 7f9ceadfc6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f9ce410f230 0x7f9ce40f4b20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:22:23.006 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:23.002+0000 7f9ceadfc6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f9ce4115440 0x7f9ce4175ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:22:23.006 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:23.002+0000 7f9ceadfc6c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f9ce40f5150 0x7f9ce40fa420 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:22:23.007 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:23.002+0000 7f9ceadfc6c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f9ce40f5840 con 0x7f9ce4115440 2026-02-13T02:22:23.007 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:23.002+0000 7f9ceadfc6c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9ce40fa960 con 0x7f9ce40f5150 2026-02-13T02:22:23.007 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:23.002+0000 7f9ceadfc6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f9ce40fab20 con 0x7f9ce410f230 2026-02-13T02:22:23.007 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:23.002+0000 7f9cdbfff6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f9ce4115440 0x7f9ce4175ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:22:23.007 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:23.002+0000 7f9cdbfff6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f9ce4115440 0x7f9ce4175ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:38838/0 (socket says 10.20.193.11:38838) 2026-02-13T02:22:23.007 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:23.002+0000 7f9cdbfff6c0 1 -- 10.20.193.11:0/4269326984 learned_addr learned my addr 10.20.193.11:0/4269326984 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:22:23.007 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:23.002+0000 7f9ce8b6d6c0 1 --2- 10.20.193.11:0/4269326984 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f9ce410f230 0x7f9ce40f4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:22:23.007 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:23.002+0000 7f9ce936e6c0 1 --2- 10.20.193.11:0/4269326984 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f9ce40f5150 0x7f9ce40fa420 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:22:23.007 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:23.002+0000 7f9cdbfff6c0 1 -- 10.20.193.11:0/4269326984 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f9ce410f230 msgr2=0x7f9ce40f4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:22:23.007 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:23.003+0000 7f9cdbfff6c0 1 --2- 10.20.193.11:0/4269326984 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f9ce410f230 0x7f9ce40f4b20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:23.007 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:23.003+0000 7f9cdbfff6c0 1 -- 10.20.193.11:0/4269326984 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f9ce40f5150 msgr2=0x7f9ce40fa420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:22:23.008 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:23.003+0000 7f9cdbfff6c0 1 --2- 10.20.193.11:0/4269326984 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f9ce40f5150 0x7f9ce40fa420 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:23.008 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:23.003+0000 7f9cdbfff6c0 1 -- 10.20.193.11:0/4269326984 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ccc009590 con 0x7f9ce4115440 2026-02-13T02:22:23.008 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:23.003+0000 7f9ce8b6d6c0 1 --2- 10.20.193.11:0/4269326984 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f9ce410f230 0x7f9ce40f4b20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:22:23.008 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:23.003+0000 7f9ce936e6c0 1 --2- 10.20.193.11:0/4269326984 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f9ce40f5150 0x7f9ce40fa420 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:22:23.008 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:23.003+0000 7f9cdbfff6c0 1 --2- 10.20.193.11:0/4269326984 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f9ce4115440 0x7f9ce4175ce0 secure :-1 s=READY pgs=406 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9ccc031f90 tx=0x7f9ccc0047f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:22:23.008 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:23.003+0000 7f9cd9ffb6c0 1 -- 10.20.193.11:0/4269326984 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9ccc002ae0 con 0x7f9ce4115440 2026-02-13T02:22:23.008 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:23.003+0000 7f9cd9ffb6c0 1 -- 10.20.193.11:0/4269326984 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f9ccc002c40 con 0x7f9ce4115440 2026-02-13T02:22:23.008 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:23.003+0000 7f9ceadfc6c0 1 -- 10.20.193.11:0/4269326984 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ce40fada0 con 0x7f9ce4115440 2026-02-13T02:22:23.008 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:23.003+0000 7f9cd9ffb6c0 1 -- 10.20.193.11:0/4269326984 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9ccc0312b0 con 0x7f9ce4115440 2026-02-13T02:22:23.008 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:23.003+0000 7f9ceadfc6c0 1 -- 10.20.193.11:0/4269326984 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ce40fb220 con 0x7f9ce4115440 2026-02-13T02:22:23.008 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:23.003+0000 7f9ceadfc6c0 1 -- 10.20.193.11:0/4269326984 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ce4110500 con 0x7f9ce4115440 2026-02-13T02:22:23.010 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:23.004+0000 7f9cd9ffb6c0 1 -- 10.20.193.11:0/4269326984 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7f9ccc007260 con 0x7f9ce4115440 2026-02-13T02:22:23.010 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:23.005+0000 7f9cd9ffb6c0 1 --2- 10.20.193.11:0/4269326984 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f9cc00b5600 0x7f9cc00d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:22:23.010 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:23.005+0000 7f9ce8b6d6c0 1 --2- 10.20.193.11:0/4269326984 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f9cc00b5600 0x7f9cc00d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:22:23.010 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:23.005+0000 7f9cd9ffb6c0 1 -- 10.20.193.11:0/4269326984 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7965+0+0 (secure 0 0 0) 0x7f9ccc107d10 con 0x7f9ce4115440 2026-02-13T02:22:23.010 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:23.005+0000 7f9ce8b6d6c0 1 --2- 10.20.193.11:0/4269326984 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f9cc00b5600 0x7f9cc00d5ab0 secure :-1 s=READY pgs=265 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9cd4004750 tx=0x7f9cd4005f10 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:22:23.010 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:23.006+0000 7f9cd9ffb6c0 1 -- 10.20.193.11:0/4269326984 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f9ccc0ca7d0 con 0x7f9ce4115440 2026-02-13T02:22:23.124 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:23.122+0000 7f9ceadfc6c0 1 -- 10.20.193.11:0/4269326984 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f9ce410f600 con 0x7f9ce4115440 2026-02-13T02:22:23.124 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:23.123+0000 7f9cd9ffb6c0 1 -- 10.20.193.11:0/4269326984 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f9ccc0077d0 con 0x7f9ce4115440 2026-02-13T02:22:23.124 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:22:23.124 INFO:teuthology.orchestra.run.trial011.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:22:23.126 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:23.124+0000 7f9ceadfc6c0 1 -- 10.20.193.11:0/4269326984 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f9cc00b5600 msgr2=0x7f9cc00d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:22:23.126 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:23.124+0000 7f9ceadfc6c0 1 --2- 10.20.193.11:0/4269326984 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f9cc00b5600 0x7f9cc00d5ab0 secure :-1 s=READY pgs=265 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9cd4004750 tx=0x7f9cd4005f10 comp rx=0 tx=0).stop 2026-02-13T02:22:23.126 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:23.124+0000 7f9ceadfc6c0 1 -- 10.20.193.11:0/4269326984 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f9ce4115440 msgr2=0x7f9ce4175ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:22:23.126 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:23.124+0000 7f9ceadfc6c0 1 --2- 10.20.193.11:0/4269326984 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f9ce4115440 0x7f9ce4175ce0 secure :-1 s=READY pgs=406 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9ccc031f90 tx=0x7f9ccc0047f0 comp rx=0 tx=0).stop 2026-02-13T02:22:23.126 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:23.124+0000 7f9ceadfc6c0 1 -- 10.20.193.11:0/4269326984 shutdown_connections 2026-02-13T02:22:23.126 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:23.124+0000 7f9ceadfc6c0 1 --2- 10.20.193.11:0/4269326984 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f9cc00b5600 0x7f9cc00d5ab0 unknown :-1 s=CLOSED pgs=265 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:23.126 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:23.124+0000 7f9ceadfc6c0 1 --2- 10.20.193.11:0/4269326984 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f9ce40f5150 0x7f9ce40fa420 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:23.126 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:23.124+0000 7f9ceadfc6c0 1 --2- 10.20.193.11:0/4269326984 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f9ce4115440 0x7f9ce4175ce0 unknown :-1 s=CLOSED pgs=406 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:23.127 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:23.124+0000 7f9ceadfc6c0 1 --2- 10.20.193.11:0/4269326984 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f9ce410f230 0x7f9ce40f4b20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:23.127 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:23.124+0000 7f9ceadfc6c0 1 -- 10.20.193.11:0/4269326984 >> 10.20.193.11:0/4269326984 conn(0x7f9ce40ecb30 msgr2=0x7f9ce410d750 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:22:23.127 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:23.124+0000 7f9ceadfc6c0 1 -- 10.20.193.11:0/4269326984 shutdown_connections 2026-02-13T02:22:23.127 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:23.124+0000 7f9ceadfc6c0 1 -- 10.20.193.11:0/4269326984 wait complete. 2026-02-13T02:22:23.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:22:23 trial011 ceph-mon[11956]: pgmap v292: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T02:22:23.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:22:23 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/4269326984' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:22:24.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:22:23 trial060 ceph-mon[14797]: pgmap v292: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T02:22:24.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:22:23 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/4269326984' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:22:24.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:22:23 trial078 ceph-mon[14969]: pgmap v292: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T02:22:24.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:22:23 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/4269326984' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:22:25.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:22:25 trial011 ceph-mon[11956]: pgmap v293: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:22:26.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:22:25 trial060 ceph-mon[14797]: pgmap v293: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:22:26.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:22:25 trial078 ceph-mon[14969]: pgmap v293: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:22:26.163 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:22:26.287 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:22:26.415 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:26.411+0000 7fe3523d86c0 1 -- 10.20.193.11:0/2652602435 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fe34c113190 msgr2=0x7fe34c173b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:22:26.415 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:26.411+0000 7fe3523d86c0 1 --2- 10.20.193.11:0/2652602435 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fe34c113190 0x7fe34c173b30 secure :-1 s=READY pgs=407 gs=1 cs=0 l=1 c_cookie=1683651341867439165 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe34000aa70 tx=0x7fe34002fde0 comp rx=0 tx=0).stop 2026-02-13T02:22:26.415 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:26.411+0000 7fe3523d86c0 1 -- 10.20.193.11:0/2652602435 shutdown_connections 2026-02-13T02:22:26.415 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:26.411+0000 7fe3523d86c0 1 --2- 10.20.193.11:0/2652602435 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fe34c113190 0x7fe34c173b30 unknown :-1 s=CLOSED pgs=407 gs=1 cs=0 l=1 c_cookie=1683651341867439165 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:26.415 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:26.411+0000 7fe3523d86c0 1 --2- 10.20.193.11:0/2652602435 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fe34c10d970 0x7fe34c1129b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:26.415 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:26.411+0000 7fe3523d86c0 1 --2- 10.20.193.11:0/2652602435 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fe34c10cf80 0x7fe34c10d350 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:26.415 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:26.411+0000 7fe3523d86c0 1 -- 10.20.193.11:0/2652602435 >> 10.20.193.11:0/2652602435 conn(0x7fe34c0ea880 msgr2=0x7fe34c10ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:22:26.415 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:26.411+0000 7fe3523d86c0 1 -- 10.20.193.11:0/2652602435 shutdown_connections 2026-02-13T02:22:26.416 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:26.411+0000 7fe3523d86c0 1 -- 10.20.193.11:0/2652602435 wait complete. 2026-02-13T02:22:26.416 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:26.411+0000 7fe3523d86c0 1 Processor -- start 2026-02-13T02:22:26.416 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:26.411+0000 7fe3523d86c0 1 -- start start 2026-02-13T02:22:26.416 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:26.412+0000 7fe3523d86c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fe34c10cf80 0x7fe34c0f2830 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:22:26.416 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:26.412+0000 7fe3523d86c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fe34c113190 0x7fe34c173a30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:22:26.416 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:26.412+0000 7fe3523d86c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fe34c0f2e60 0x7fe34c0f8130 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:22:26.416 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:26.412+0000 7fe3523d86c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7fe34c0f3550 con 0x7fe34c113190 2026-02-13T02:22:26.416 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:26.412+0000 7fe3523d86c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe34c0f8670 con 0x7fe34c0f2e60 2026-02-13T02:22:26.416 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:26.412+0000 7fe3523d86c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fe34c0f8830 con 0x7fe34c10cf80 2026-02-13T02:22:26.416 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:26.412+0000 7fe34b7fe6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fe34c113190 0x7fe34c173a30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:22:26.416 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:26.412+0000 7fe34b7fe6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fe34c113190 0x7fe34c173a30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:38848/0 (socket says 10.20.193.11:38848) 2026-02-13T02:22:26.416 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:26.412+0000 7fe34b7fe6c0 1 -- 10.20.193.11:0/2763142992 learned_addr learned my addr 10.20.193.11:0/2763142992 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:22:26.417 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:26.412+0000 7fe34bfff6c0 1 --2- 10.20.193.11:0/2763142992 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fe34c10cf80 0x7fe34c0f2830 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:22:26.417 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:26.412+0000 7fe35094a6c0 1 --2- 10.20.193.11:0/2763142992 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fe34c0f2e60 0x7fe34c0f8130 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:22:26.417 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:26.412+0000 7fe34b7fe6c0 1 -- 10.20.193.11:0/2763142992 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fe34c10cf80 msgr2=0x7fe34c0f2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:22:26.417 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:26.412+0000 7fe34b7fe6c0 1 --2- 10.20.193.11:0/2763142992 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fe34c10cf80 0x7fe34c0f2830 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:26.417 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:26.412+0000 7fe34b7fe6c0 1 -- 10.20.193.11:0/2763142992 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fe34c0f2e60 msgr2=0x7fe34c0f8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:22:26.417 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:26.412+0000 7fe34b7fe6c0 1 --2- 10.20.193.11:0/2763142992 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fe34c0f2e60 0x7fe34c0f8130 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:26.417 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:26.412+0000 7fe34b7fe6c0 1 -- 10.20.193.11:0/2763142992 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe34000a660 con 0x7fe34c113190 2026-02-13T02:22:26.417 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:26.412+0000 7fe34b7fe6c0 1 --2- 10.20.193.11:0/2763142992 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fe34c113190 0x7fe34c173a30 secure :-1 s=READY pgs=408 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe33c00b6c0 tx=0x7fe33c00bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:22:26.417 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:26.412+0000 7fe3497fa6c0 1 -- 10.20.193.11:0/2763142992 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe33c004250 con 0x7fe34c113190 2026-02-13T02:22:26.417 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:26.412+0000 7fe3497fa6c0 1 -- 10.20.193.11:0/2763142992 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fe33c009070 con 0x7fe34c113190 2026-02-13T02:22:26.417 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:26.412+0000 7fe3523d86c0 1 -- 10.20.193.11:0/2763142992 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe34c0f8b10 con 0x7fe34c113190 2026-02-13T02:22:26.417 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:26.412+0000 7fe3497fa6c0 1 -- 10.20.193.11:0/2763142992 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe33c00cd50 con 0x7fe34c113190 2026-02-13T02:22:26.417 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:26.412+0000 7fe3523d86c0 1 -- 10.20.193.11:0/2763142992 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe34c0f92a0 con 0x7fe34c113190 2026-02-13T02:22:26.418 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:26.412+0000 7fe3523d86c0 1 -- 10.20.193.11:0/2763142992 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe34c0f8ff0 con 0x7fe34c113190 2026-02-13T02:22:26.419 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:26.414+0000 7fe3497fa6c0 1 -- 10.20.193.11:0/2763142992 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7fe33c0028c0 con 0x7fe34c113190 2026-02-13T02:22:26.419 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:26.414+0000 7fe3497fa6c0 1 --2- 10.20.193.11:0/2763142992 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fe3200b5680 0x7fe3200d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:22:26.419 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:26.414+0000 7fe34bfff6c0 1 --2- 10.20.193.11:0/2763142992 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fe3200b5680 0x7fe3200d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:22:26.419 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:26.415+0000 7fe3497fa6c0 1 -- 10.20.193.11:0/2763142992 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7965+0+0 (secure 0 0 0) 0x7fe33c0e3980 con 0x7fe34c113190 2026-02-13T02:22:26.419 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:26.415+0000 7fe3497fa6c0 1 -- 10.20.193.11:0/2763142992 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fe33c0a9ea0 con 0x7fe34c113190 2026-02-13T02:22:26.419 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:26.415+0000 7fe34bfff6c0 1 --2- 10.20.193.11:0/2763142992 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fe3200b5680 0x7fe3200d5b30 secure :-1 s=READY pgs=266 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe338004750 tx=0x7fe338009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:22:26.531 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:26.528+0000 7fe3523d86c0 1 -- 10.20.193.11:0/2763142992 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fe34c0f3980 con 0x7fe34c113190 2026-02-13T02:22:26.531 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:26.528+0000 7fe3497fa6c0 1 -- 10.20.193.11:0/2763142992 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fe33c0abf10 con 0x7fe34c113190 2026-02-13T02:22:26.531 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:22:26.531 INFO:teuthology.orchestra.run.trial011.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:22:26.532 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:26.529+0000 7fe3523d86c0 1 -- 10.20.193.11:0/2763142992 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fe3200b5680 msgr2=0x7fe3200d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:22:26.533 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:26.529+0000 7fe3523d86c0 1 --2- 10.20.193.11:0/2763142992 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fe3200b5680 0x7fe3200d5b30 secure :-1 s=READY pgs=266 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe338004750 tx=0x7fe338009260 comp rx=0 tx=0).stop 2026-02-13T02:22:26.533 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:26.529+0000 7fe3523d86c0 1 -- 10.20.193.11:0/2763142992 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fe34c113190 msgr2=0x7fe34c173a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:22:26.533 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:26.529+0000 7fe3523d86c0 1 --2- 10.20.193.11:0/2763142992 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fe34c113190 0x7fe34c173a30 secure :-1 s=READY pgs=408 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe33c00b6c0 tx=0x7fe33c00bb90 comp rx=0 tx=0).stop 2026-02-13T02:22:26.533 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:26.529+0000 7fe3523d86c0 1 -- 10.20.193.11:0/2763142992 shutdown_connections 2026-02-13T02:22:26.533 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:26.529+0000 7fe3523d86c0 1 --2- 10.20.193.11:0/2763142992 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fe3200b5680 0x7fe3200d5b30 unknown :-1 s=CLOSED pgs=266 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:26.533 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:26.529+0000 7fe3523d86c0 1 --2- 10.20.193.11:0/2763142992 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fe34c0f2e60 0x7fe34c0f8130 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:26.533 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:26.529+0000 7fe3523d86c0 1 --2- 10.20.193.11:0/2763142992 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fe34c113190 0x7fe34c173a30 unknown :-1 s=CLOSED pgs=408 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:26.533 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:26.529+0000 7fe3523d86c0 1 --2- 10.20.193.11:0/2763142992 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fe34c10cf80 0x7fe34c0f2830 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:26.533 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:26.529+0000 7fe3523d86c0 1 -- 10.20.193.11:0/2763142992 >> 10.20.193.11:0/2763142992 conn(0x7fe34c0ea880 msgr2=0x7fe34c10f7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:22:26.533 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:26.529+0000 7fe3523d86c0 1 -- 10.20.193.11:0/2763142992 shutdown_connections 2026-02-13T02:22:26.533 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:26.529+0000 7fe3523d86c0 1 -- 10.20.193.11:0/2763142992 wait complete. 2026-02-13T02:22:26.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:22:26 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/2763142992' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:22:27.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:22:26 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/2763142992' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:22:27.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:22:26 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/2763142992' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:22:27.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:22:27 trial011 ceph-mon[11956]: pgmap v294: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:22:28.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:22:27 trial060 ceph-mon[14797]: pgmap v294: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:22:28.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:22:27 trial078 ceph-mon[14969]: pgmap v294: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:22:29.570 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:22:29.694 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:22:29.821 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:29.814+0000 7f16d89346c0 1 -- 10.20.193.11:0/3086856905 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f16d0061030 msgr2=0x7f16d01551a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:22:29.821 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:29.814+0000 7f16d89346c0 1 --2- 10.20.193.11:0/3086856905 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f16d0061030 0x7f16d01551a0 secure :-1 s=READY pgs=409 gs=1 cs=0 l=1 c_cookie=5810452837842244739 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f16bc009970 tx=0x7f16bc02ed20 comp rx=0 tx=0).stop 2026-02-13T02:22:29.822 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:29.814+0000 7f16d89346c0 1 -- 10.20.193.11:0/3086856905 shutdown_connections 2026-02-13T02:22:29.822 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:29.814+0000 7f16d89346c0 1 --2- 10.20.193.11:0/3086856905 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f16d01556e0 0x7f16d0175ac0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:29.822 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:29.814+0000 7f16d89346c0 1 --2- 10.20.193.11:0/3086856905 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f16d0061030 0x7f16d01551a0 unknown :-1 s=CLOSED pgs=409 gs=1 cs=0 l=1 c_cookie=5810452837842244739 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:29.822 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:29.814+0000 7f16d89346c0 1 --2- 10.20.193.11:0/3086856905 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f16d0060720 0x7f16d0060af0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:29.822 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:29.814+0000 7f16d89346c0 1 -- 10.20.193.11:0/3086856905 >> 10.20.193.11:0/3086856905 conn(0x7f16d00ea8b0 msgr2=0x7f16d010acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:22:29.822 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:29.814+0000 7f16d89346c0 1 -- 10.20.193.11:0/3086856905 shutdown_connections 2026-02-13T02:22:29.823 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:29.814+0000 7f16d89346c0 1 -- 10.20.193.11:0/3086856905 wait complete. 2026-02-13T02:22:29.823 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:29.814+0000 7f16d89346c0 1 Processor -- start 2026-02-13T02:22:29.823 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:29.814+0000 7f16d89346c0 1 -- start start 2026-02-13T02:22:29.823 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:29.814+0000 7f16d89346c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f16d0060720 0x7f16d01614f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:22:29.823 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:29.814+0000 7f16d89346c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f16d0061030 0x7f16d0161a30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:22:29.823 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:29.814+0000 7f16d89346c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f16d01556e0 0x7f16d0166df0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:22:29.824 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:29.814+0000 7f16d89346c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f16d01673b0 con 0x7f16d0060720 2026-02-13T02:22:29.824 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:29.814+0000 7f16d89346c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f16d0167520 con 0x7f16d01556e0 2026-02-13T02:22:29.824 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:29.814+0000 7f16d89346c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f16d01676e0 con 0x7f16d0061030 2026-02-13T02:22:29.824 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:29.814+0000 7f16d66a96c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f16d0060720 0x7f16d01614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:22:29.824 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:29.814+0000 7f16d66a96c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f16d0060720 0x7f16d01614f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:38868/0 (socket says 10.20.193.11:38868) 2026-02-13T02:22:29.824 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:29.814+0000 7f16d66a96c0 1 -- 10.20.193.11:0/12180772 learned_addr learned my addr 10.20.193.11:0/12180772 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:22:29.825 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:29.815+0000 7f16d5ea86c0 1 --2- 10.20.193.11:0/12180772 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f16d0061030 0x7f16d0161a30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:22:29.825 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:29.815+0000 7f16d66a96c0 1 -- 10.20.193.11:0/12180772 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f16d0061030 msgr2=0x7f16d0161a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:22:29.825 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:29.815+0000 7f16d66a96c0 1 --2- 10.20.193.11:0/12180772 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f16d0061030 0x7f16d0161a30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:29.825 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:29.815+0000 7f16d66a96c0 1 -- 10.20.193.11:0/12180772 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f16d01556e0 msgr2=0x7f16d0166df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:22:29.825 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:29.815+0000 7f16d66a96c0 1 --2- 10.20.193.11:0/12180772 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f16d01556e0 0x7f16d0166df0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:29.825 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:29.815+0000 7f16d66a96c0 1 -- 10.20.193.11:0/12180772 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16bc009590 con 0x7f16d0060720 2026-02-13T02:22:29.826 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:29.815+0000 7f16d66a96c0 1 --2- 10.20.193.11:0/12180772 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f16d0060720 0x7f16d01614f0 secure :-1 s=READY pgs=410 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f16c800b710 tx=0x7f16c800bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:22:29.826 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:29.815+0000 7f16bb7fe6c0 1 -- 10.20.193.11:0/12180772 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f16c8004250 con 0x7f16d0060720 2026-02-13T02:22:29.826 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:29.815+0000 7f16bb7fe6c0 1 -- 10.20.193.11:0/12180772 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f16c8009070 con 0x7f16d0060720 2026-02-13T02:22:29.826 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:29.815+0000 7f16d89346c0 1 -- 10.20.193.11:0/12180772 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16d01679c0 con 0x7f16d0060720 2026-02-13T02:22:29.826 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:29.815+0000 7f16bb7fe6c0 1 -- 10.20.193.11:0/12180772 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f16c800cd70 con 0x7f16d0060720 2026-02-13T02:22:29.826 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:29.815+0000 7f16d89346c0 1 -- 10.20.193.11:0/12180772 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16d0151310 con 0x7f16d0060720 2026-02-13T02:22:29.827 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:29.815+0000 7f16d89346c0 1 -- 10.20.193.11:0/12180772 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16d0061c30 con 0x7f16d0060720 2026-02-13T02:22:29.827 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:29.816+0000 7f16bb7fe6c0 1 -- 10.20.193.11:0/12180772 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7f16c80028c0 con 0x7f16d0060720 2026-02-13T02:22:29.827 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:29.817+0000 7f16bb7fe6c0 1 --2- 10.20.193.11:0/12180772 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f16ac0b5680 0x7f16ac0d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:22:29.827 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:29.817+0000 7f16d5ea86c0 1 --2- 10.20.193.11:0/12180772 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f16ac0b5680 0x7f16ac0d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:22:29.827 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:29.817+0000 7f16bb7fe6c0 1 -- 10.20.193.11:0/12180772 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7965+0+0 (secure 0 0 0) 0x7f16c80e3a50 con 0x7f16d0060720 2026-02-13T02:22:29.827 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:29.817+0000 7f16d5ea86c0 1 --2- 10.20.193.11:0/12180772 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f16ac0b5680 0x7f16ac0d5b30 secure :-1 s=READY pgs=267 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f16bc0023e0 tx=0x7f16bc031f90 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:22:29.828 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:29.817+0000 7f16bb7fe6c0 1 -- 10.20.193.11:0/12180772 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f16c80a6510 con 0x7f16d0060720 2026-02-13T02:22:29.935 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:29.932+0000 7f16d89346c0 1 -- 10.20.193.11:0/12180772 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f16d0162640 con 0x7f16d0060720 2026-02-13T02:22:29.936 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:22:29 trial011 ceph-mon[11956]: pgmap v295: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:22:29.936 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:29.932+0000 7f16bb7fe6c0 1 -- 10.20.193.11:0/12180772 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f16c80a96c0 con 0x7f16d0060720 2026-02-13T02:22:29.937 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:22:29.937 INFO:teuthology.orchestra.run.trial011.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:22:29.938 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:29.934+0000 7f16d89346c0 1 -- 10.20.193.11:0/12180772 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f16ac0b5680 msgr2=0x7f16ac0d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:22:29.938 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:29.934+0000 7f16d89346c0 1 --2- 10.20.193.11:0/12180772 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f16ac0b5680 0x7f16ac0d5b30 secure :-1 s=READY pgs=267 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f16bc0023e0 tx=0x7f16bc031f90 comp rx=0 tx=0).stop 2026-02-13T02:22:29.939 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:29.934+0000 7f16d89346c0 1 -- 10.20.193.11:0/12180772 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f16d0060720 msgr2=0x7f16d01614f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:22:29.939 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:29.934+0000 7f16d89346c0 1 --2- 10.20.193.11:0/12180772 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f16d0060720 0x7f16d01614f0 secure :-1 s=READY pgs=410 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f16c800b710 tx=0x7f16c800bbe0 comp rx=0 tx=0).stop 2026-02-13T02:22:29.939 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:29.934+0000 7f16d89346c0 1 -- 10.20.193.11:0/12180772 shutdown_connections 2026-02-13T02:22:29.939 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:29.934+0000 7f16d89346c0 1 --2- 10.20.193.11:0/12180772 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f16ac0b5680 0x7f16ac0d5b30 unknown :-1 s=CLOSED pgs=267 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:29.939 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:29.934+0000 7f16d89346c0 1 --2- 10.20.193.11:0/12180772 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f16d01556e0 0x7f16d0166df0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:29.939 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:29.934+0000 7f16d89346c0 1 --2- 10.20.193.11:0/12180772 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f16d0061030 0x7f16d0161a30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:29.939 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:29.934+0000 7f16d89346c0 1 --2- 10.20.193.11:0/12180772 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f16d0060720 0x7f16d01614f0 unknown :-1 s=CLOSED pgs=410 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:29.939 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:29.934+0000 7f16d89346c0 1 -- 10.20.193.11:0/12180772 >> 10.20.193.11:0/12180772 conn(0x7f16d00ea8b0 msgr2=0x7f16d010ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:22:29.939 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:29.934+0000 7f16d89346c0 1 -- 10.20.193.11:0/12180772 shutdown_connections 2026-02-13T02:22:29.939 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:29.934+0000 7f16d89346c0 1 -- 10.20.193.11:0/12180772 wait complete. 2026-02-13T02:22:30.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:22:29 trial060 ceph-mon[14797]: pgmap v295: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:22:30.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:22:29 trial078 ceph-mon[14969]: pgmap v295: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:22:30.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:22:30 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/12180772' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:22:31.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:22:30 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/12180772' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:22:31.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:22:30 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/12180772' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:22:31.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:22:31 trial011 ceph-mon[11956]: pgmap v296: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:22:32.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:22:31 trial060 ceph-mon[14797]: pgmap v296: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:22:32.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:22:31 trial078 ceph-mon[14969]: pgmap v296: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:22:32.975 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:22:33.104 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:22:33.216 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:33.212+0000 7f05bf3c16c0 1 -- 10.20.193.11:0/2083762627 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f05b810f200 msgr2=0x7f05b810f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:22:33.216 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:33.212+0000 7f05bf3c16c0 1 --2- 10.20.193.11:0/2083762627 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f05b810f200 0x7f05b810f5d0 secure :-1 s=READY pgs=411 gs=1 cs=0 l=1 c_cookie=7871652871389029561 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f05a80099a0 tx=0x7f05a802ed20 comp rx=0 tx=0).stop 2026-02-13T02:22:33.216 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:33.212+0000 7f05bf3c16c0 1 -- 10.20.193.11:0/2083762627 shutdown_connections 2026-02-13T02:22:33.216 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:33.212+0000 7f05bf3c16c0 1 --2- 10.20.193.11:0/2083762627 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f05b810fbf0 0x7f05b8114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:33.216 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:33.212+0000 7f05bf3c16c0 1 --2- 10.20.193.11:0/2083762627 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f05b8115410 0x7f05b8175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:33.216 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:33.212+0000 7f05bf3c16c0 1 --2- 10.20.193.11:0/2083762627 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f05b810f200 0x7f05b810f5d0 unknown :-1 s=CLOSED pgs=411 gs=1 cs=0 l=1 c_cookie=7871652871389029561 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:33.216 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:33.212+0000 7f05bf3c16c0 1 -- 10.20.193.11:0/2083762627 >> 10.20.193.11:0/2083762627 conn(0x7f05b80ecb00 msgr2=0x7f05b810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:22:33.216 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:33.212+0000 7f05bf3c16c0 1 -- 10.20.193.11:0/2083762627 shutdown_connections 2026-02-13T02:22:33.216 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:33.212+0000 7f05bf3c16c0 1 -- 10.20.193.11:0/2083762627 wait complete. 2026-02-13T02:22:33.216 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:33.212+0000 7f05bf3c16c0 1 Processor -- start 2026-02-13T02:22:33.217 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:33.212+0000 7f05bf3c16c0 1 -- start start 2026-02-13T02:22:33.217 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:33.212+0000 7f05bf3c16c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f05b810f200 0x7f05b811d1b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:22:33.217 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:33.212+0000 7f05bf3c16c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f05b8115410 0x7f05b811d6f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:22:33.217 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:33.212+0000 7f05bf3c16c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f05b8122ab0 0x7f05b8122f50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:22:33.217 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:33.212+0000 7f05bf3c16c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f05b81234c0 con 0x7f05b8115410 2026-02-13T02:22:33.217 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:33.212+0000 7f05bf3c16c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f05b8123630 con 0x7f05b8122ab0 2026-02-13T02:22:33.217 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:33.212+0000 7f05bf3c16c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f05b81237f0 con 0x7f05b810f200 2026-02-13T02:22:33.217 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:33.213+0000 7f05bc9316c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f05b8115410 0x7f05b811d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:22:33.217 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:33.213+0000 7f05bc9316c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f05b8115410 0x7f05b811d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:33900/0 (socket says 10.20.193.11:33900) 2026-02-13T02:22:33.217 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:33.213+0000 7f05bc9316c0 1 -- 10.20.193.11:0/1853421400 learned_addr learned my addr 10.20.193.11:0/1853421400 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:22:33.217 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:33.213+0000 7f05bd1326c0 1 --2- 10.20.193.11:0/1853421400 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f05b810f200 0x7f05b811d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:22:33.218 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:33.213+0000 7f05bd9336c0 1 --2- 10.20.193.11:0/1853421400 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f05b8122ab0 0x7f05b8122f50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:22:33.218 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:33.213+0000 7f05bc9316c0 1 -- 10.20.193.11:0/1853421400 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f05b810f200 msgr2=0x7f05b811d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:22:33.218 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:33.213+0000 7f05bc9316c0 1 --2- 10.20.193.11:0/1853421400 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f05b810f200 0x7f05b811d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:33.218 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:33.213+0000 7f05bc9316c0 1 -- 10.20.193.11:0/1853421400 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f05b8122ab0 msgr2=0x7f05b8122f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:22:33.218 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:33.213+0000 7f05bc9316c0 1 --2- 10.20.193.11:0/1853421400 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f05b8122ab0 0x7f05b8122f50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:33.218 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:33.213+0000 7f05bc9316c0 1 -- 10.20.193.11:0/1853421400 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05a8009590 con 0x7f05b8115410 2026-02-13T02:22:33.218 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:33.213+0000 7f05bd9336c0 1 --2- 10.20.193.11:0/1853421400 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f05b8122ab0 0x7f05b8122f50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T02:22:33.218 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:33.213+0000 7f05bc9316c0 1 --2- 10.20.193.11:0/1853421400 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f05b8115410 0x7f05b811d6f0 secure :-1 s=READY pgs=412 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f05ac005dc0 tx=0x7f05ac00bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:22:33.218 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:33.213+0000 7f05a67fc6c0 1 -- 10.20.193.11:0/1853421400 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f05ac004250 con 0x7f05b8115410 2026-02-13T02:22:33.218 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:33.213+0000 7f05a67fc6c0 1 -- 10.20.193.11:0/1853421400 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f05ac009070 con 0x7f05b8115410 2026-02-13T02:22:33.218 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:33.213+0000 7f05a67fc6c0 1 -- 10.20.193.11:0/1853421400 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f05ac00cdc0 con 0x7f05b8115410 2026-02-13T02:22:33.218 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:33.213+0000 7f05bf3c16c0 1 -- 10.20.193.11:0/1853421400 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05b8163ca0 con 0x7f05b8115410 2026-02-13T02:22:33.218 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:33.213+0000 7f05bf3c16c0 1 -- 10.20.193.11:0/1853421400 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05b8164180 con 0x7f05b8115410 2026-02-13T02:22:33.219 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:33.213+0000 7f05bf3c16c0 1 -- 10.20.193.11:0/1853421400 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05b81104d0 con 0x7f05b8115410 2026-02-13T02:22:33.219 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:33.215+0000 7f05a67fc6c0 1 -- 10.20.193.11:0/1853421400 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7f05ac0028c0 con 0x7f05b8115410 2026-02-13T02:22:33.220 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:33.216+0000 7f05a67fc6c0 1 --2- 10.20.193.11:0/1853421400 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f05940b5680 0x7f05940d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:22:33.220 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:33.216+0000 7f05bd1326c0 1 --2- 10.20.193.11:0/1853421400 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f05940b5680 0x7f05940d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:22:33.220 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:33.216+0000 7f05a67fc6c0 1 -- 10.20.193.11:0/1853421400 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7965+0+0 (secure 0 0 0) 0x7f05ac0e3a10 con 0x7f05b8115410 2026-02-13T02:22:33.220 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:33.216+0000 7f05bd1326c0 1 --2- 10.20.193.11:0/1853421400 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f05940b5680 0x7f05940d5b30 secure :-1 s=READY pgs=268 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f05a80023e0 tx=0x7f05a8031f90 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:22:33.220 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:33.216+0000 7f05a67fc6c0 1 -- 10.20.193.11:0/1853421400 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f05ac0a6510 con 0x7f05b8115410 2026-02-13T02:22:33.335 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:33.333+0000 7f05bf3c16c0 1 -- 10.20.193.11:0/1853421400 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f05b810f5d0 con 0x7f05b8115410 2026-02-13T02:22:33.335 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:33.333+0000 7f05a67fc6c0 1 -- 10.20.193.11:0/1853421400 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f05ac0a96c0 con 0x7f05b8115410 2026-02-13T02:22:33.335 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:22:33.336 INFO:teuthology.orchestra.run.trial011.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:22:33.337 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:33.335+0000 7f05bf3c16c0 1 -- 10.20.193.11:0/1853421400 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f05940b5680 msgr2=0x7f05940d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:22:33.337 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:33.335+0000 7f05bf3c16c0 1 --2- 10.20.193.11:0/1853421400 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f05940b5680 0x7f05940d5b30 secure :-1 s=READY pgs=268 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f05a80023e0 tx=0x7f05a8031f90 comp rx=0 tx=0).stop 2026-02-13T02:22:33.337 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:33.335+0000 7f05bf3c16c0 1 -- 10.20.193.11:0/1853421400 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f05b8115410 msgr2=0x7f05b811d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:22:33.337 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:33.335+0000 7f05bf3c16c0 1 --2- 10.20.193.11:0/1853421400 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f05b8115410 0x7f05b811d6f0 secure :-1 s=READY pgs=412 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f05ac005dc0 tx=0x7f05ac00bbb0 comp rx=0 tx=0).stop 2026-02-13T02:22:33.337 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:33.335+0000 7f05bf3c16c0 1 -- 10.20.193.11:0/1853421400 shutdown_connections 2026-02-13T02:22:33.337 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:33.335+0000 7f05bf3c16c0 1 --2- 10.20.193.11:0/1853421400 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f05940b5680 0x7f05940d5b30 unknown :-1 s=CLOSED pgs=268 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:33.338 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:33.335+0000 7f05bf3c16c0 1 --2- 10.20.193.11:0/1853421400 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f05b8122ab0 0x7f05b8122f50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:33.338 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:33.335+0000 7f05bf3c16c0 1 --2- 10.20.193.11:0/1853421400 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f05b8115410 0x7f05b811d6f0 unknown :-1 s=CLOSED pgs=412 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:33.338 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:33.335+0000 7f05bf3c16c0 1 --2- 10.20.193.11:0/1853421400 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f05b810f200 0x7f05b811d1b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:33.338 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:33.335+0000 7f05bf3c16c0 1 -- 10.20.193.11:0/1853421400 >> 10.20.193.11:0/1853421400 conn(0x7f05b80ecb00 msgr2=0x7f05b810cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:22:33.338 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:33.335+0000 7f05bf3c16c0 1 -- 10.20.193.11:0/1853421400 shutdown_connections 2026-02-13T02:22:33.338 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:33.335+0000 7f05bf3c16c0 1 -- 10.20.193.11:0/1853421400 wait complete. 2026-02-13T02:22:33.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:22:33 trial011 ceph-mon[11956]: pgmap v297: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T02:22:33.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:22:33 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/1853421400' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:22:34.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:22:33 trial060 ceph-mon[14797]: pgmap v297: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T02:22:34.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:22:33 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/1853421400' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:22:34.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:22:33 trial078 ceph-mon[14969]: pgmap v297: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T02:22:34.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:22:33 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/1853421400' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:22:35.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:22:35 trial011 ceph-mon[11956]: pgmap v298: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:22:36.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:22:35 trial060 ceph-mon[14797]: pgmap v298: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:22:36.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:22:35 trial078 ceph-mon[14969]: pgmap v298: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:22:36.377 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:22:36.502 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:22:36.623 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:36.619+0000 7f00d087f6c0 1 -- 10.20.193.11:0/2841387181 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f00c810f230 msgr2=0x7f00c810f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:22:36.623 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:36.619+0000 7f00d087f6c0 1 --2- 10.20.193.11:0/2841387181 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f00c810f230 0x7f00c810f600 secure :-1 s=READY pgs=413 gs=1 cs=0 l=1 c_cookie=3132753642029068043 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f00c00099a0 tx=0x7f00c002ed20 comp rx=0 tx=0).stop 2026-02-13T02:22:36.623 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:36.619+0000 7f00d087f6c0 1 -- 10.20.193.11:0/2841387181 shutdown_connections 2026-02-13T02:22:36.623 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:36.619+0000 7f00d087f6c0 1 --2- 10.20.193.11:0/2841387181 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f00c8115440 0x7f00c8175de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:36.623 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:36.619+0000 7f00d087f6c0 1 --2- 10.20.193.11:0/2841387181 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f00c810fc20 0x7f00c8114c60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:36.623 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:36.619+0000 7f00d087f6c0 1 --2- 10.20.193.11:0/2841387181 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f00c810f230 0x7f00c810f600 unknown :-1 s=CLOSED pgs=413 gs=1 cs=0 l=1 c_cookie=3132753642029068043 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:36.623 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:36.619+0000 7f00d087f6c0 1 -- 10.20.193.11:0/2841387181 >> 10.20.193.11:0/2841387181 conn(0x7f00c80ecb30 msgr2=0x7f00c810cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:22:36.624 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:36.619+0000 7f00d087f6c0 1 -- 10.20.193.11:0/2841387181 shutdown_connections 2026-02-13T02:22:36.624 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:36.619+0000 7f00d087f6c0 1 -- 10.20.193.11:0/2841387181 wait complete. 2026-02-13T02:22:36.624 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:36.619+0000 7f00d087f6c0 1 Processor -- start 2026-02-13T02:22:36.624 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:36.619+0000 7f00d087f6c0 1 -- start start 2026-02-13T02:22:36.624 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:36.619+0000 7f00d087f6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f00c810f230 0x7f00c811c950 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:22:36.624 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:36.619+0000 7f00d087f6c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f00c8115440 0x7f00c811ce90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:22:36.624 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:36.619+0000 7f00d087f6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f00c8122250 0x7f00c81226f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:22:36.624 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:36.619+0000 7f00d087f6c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f00c8122c60 con 0x7f00c810f230 2026-02-13T02:22:36.624 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:36.619+0000 7f00d087f6c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f00c8122dd0 con 0x7f00c8115440 2026-02-13T02:22:36.624 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:36.619+0000 7f00d087f6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f00c8122f90 con 0x7f00c8122250 2026-02-13T02:22:36.624 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:36.619+0000 7f00ce5f06c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f00c810f230 0x7f00c811c950 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:22:36.624 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:36.619+0000 7f00ce5f06c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f00c810f230 0x7f00c811c950 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:33920/0 (socket says 10.20.193.11:33920) 2026-02-13T02:22:36.625 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:36.619+0000 7f00ce5f06c0 1 -- 10.20.193.11:0/2391279374 learned_addr learned my addr 10.20.193.11:0/2391279374 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:22:36.625 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:36.619+0000 7f00cddef6c0 1 --2- 10.20.193.11:0/2391279374 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f00c8115440 0x7f00c811ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:22:36.625 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:36.619+0000 7f00cedf16c0 1 --2- 10.20.193.11:0/2391279374 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f00c8122250 0x7f00c81226f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:22:36.625 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:36.619+0000 7f00ce5f06c0 1 -- 10.20.193.11:0/2391279374 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f00c8122250 msgr2=0x7f00c81226f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:22:36.625 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:36.619+0000 7f00ce5f06c0 1 --2- 10.20.193.11:0/2391279374 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f00c8122250 0x7f00c81226f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:36.625 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:36.619+0000 7f00ce5f06c0 1 -- 10.20.193.11:0/2391279374 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f00c8115440 msgr2=0x7f00c811ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:22:36.625 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:36.619+0000 7f00ce5f06c0 1 --2- 10.20.193.11:0/2391279374 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f00c8115440 0x7f00c811ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:36.625 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:36.619+0000 7f00ce5f06c0 1 -- 10.20.193.11:0/2391279374 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00c0009590 con 0x7f00c810f230 2026-02-13T02:22:36.625 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:36.619+0000 7f00cddef6c0 1 --2- 10.20.193.11:0/2391279374 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f00c8115440 0x7f00c811ce90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T02:22:36.625 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:36.620+0000 7f00ce5f06c0 1 --2- 10.20.193.11:0/2391279374 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f00c810f230 0x7f00c811c950 secure :-1 s=READY pgs=414 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f00c0031fd0 tx=0x7f00c00047f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:22:36.625 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:36.620+0000 7f00b37fe6c0 1 -- 10.20.193.11:0/2391279374 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f00c0002ae0 con 0x7f00c810f230 2026-02-13T02:22:36.625 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:36.620+0000 7f00b37fe6c0 1 -- 10.20.193.11:0/2391279374 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f00c0002c40 con 0x7f00c810f230 2026-02-13T02:22:36.625 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:36.620+0000 7f00d087f6c0 1 -- 10.20.193.11:0/2391279374 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00c81633e0 con 0x7f00c810f230 2026-02-13T02:22:36.626 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:36.620+0000 7f00b37fe6c0 1 -- 10.20.193.11:0/2391279374 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f00c00372f0 con 0x7f00c810f230 2026-02-13T02:22:36.626 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:36.620+0000 7f00d087f6c0 1 -- 10.20.193.11:0/2391279374 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00c8163860 con 0x7f00c810f230 2026-02-13T02:22:36.626 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:36.620+0000 7f00d087f6c0 1 -- 10.20.193.11:0/2391279374 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00c8110500 con 0x7f00c810f230 2026-02-13T02:22:36.626 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:36.621+0000 7f00b37fe6c0 1 -- 10.20.193.11:0/2391279374 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7f00c00077d0 con 0x7f00c810f230 2026-02-13T02:22:36.627 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:36.622+0000 7f00b37fe6c0 1 --2- 10.20.193.11:0/2391279374 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f00a40b5680 0x7f00a40d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:22:36.627 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:36.622+0000 7f00cddef6c0 1 --2- 10.20.193.11:0/2391279374 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f00a40b5680 0x7f00a40d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:22:36.627 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:36.622+0000 7f00b37fe6c0 1 -- 10.20.193.11:0/2391279374 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7965+0+0 (secure 0 0 0) 0x7f00c0107cc0 con 0x7f00c810f230 2026-02-13T02:22:36.627 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:36.622+0000 7f00cddef6c0 1 --2- 10.20.193.11:0/2391279374 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f00a40b5680 0x7f00a40d5b30 secure :-1 s=READY pgs=269 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f00c81232e0 tx=0x7f00b4009630 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:22:36.627 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:36.622+0000 7f00b37fe6c0 1 -- 10.20.193.11:0/2391279374 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f00c00ca780 con 0x7f00c810f230 2026-02-13T02:22:36.739 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:36.737+0000 7f00d087f6c0 1 -- 10.20.193.11:0/2391279374 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f00c810f600 con 0x7f00c810f230 2026-02-13T02:22:36.739 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:36.737+0000 7f00b37fe6c0 1 -- 10.20.193.11:0/2391279374 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f00c00cd930 con 0x7f00c810f230 2026-02-13T02:22:36.739 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:22:36.739 INFO:teuthology.orchestra.run.trial011.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:22:36.740 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:36.738+0000 7f00d087f6c0 1 -- 10.20.193.11:0/2391279374 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f00a40b5680 msgr2=0x7f00a40d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:22:36.740 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:36.738+0000 7f00d087f6c0 1 --2- 10.20.193.11:0/2391279374 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f00a40b5680 0x7f00a40d5b30 secure :-1 s=READY pgs=269 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f00c81232e0 tx=0x7f00b4009630 comp rx=0 tx=0).stop 2026-02-13T02:22:36.740 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:36.738+0000 7f00d087f6c0 1 -- 10.20.193.11:0/2391279374 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f00c810f230 msgr2=0x7f00c811c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:22:36.740 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:36.738+0000 7f00d087f6c0 1 --2- 10.20.193.11:0/2391279374 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f00c810f230 0x7f00c811c950 secure :-1 s=READY pgs=414 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f00c0031fd0 tx=0x7f00c00047f0 comp rx=0 tx=0).stop 2026-02-13T02:22:36.740 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:36.738+0000 7f00d087f6c0 1 -- 10.20.193.11:0/2391279374 shutdown_connections 2026-02-13T02:22:36.740 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:36.738+0000 7f00d087f6c0 1 --2- 10.20.193.11:0/2391279374 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f00a40b5680 0x7f00a40d5b30 unknown :-1 s=CLOSED pgs=269 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:36.741 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:36.738+0000 7f00d087f6c0 1 --2- 10.20.193.11:0/2391279374 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f00c8115440 0x7f00c811ce90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:36.741 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:36.738+0000 7f00d087f6c0 1 --2- 10.20.193.11:0/2391279374 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f00c8122250 0x7f00c81226f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:36.741 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:36.738+0000 7f00d087f6c0 1 --2- 10.20.193.11:0/2391279374 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f00c810f230 0x7f00c811c950 unknown :-1 s=CLOSED pgs=414 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:36.741 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:36.738+0000 7f00d087f6c0 1 -- 10.20.193.11:0/2391279374 >> 10.20.193.11:0/2391279374 conn(0x7f00c80ecb30 msgr2=0x7f00c810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:22:36.741 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:36.738+0000 7f00d087f6c0 1 -- 10.20.193.11:0/2391279374 shutdown_connections 2026-02-13T02:22:36.741 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:36.738+0000 7f00d087f6c0 1 -- 10.20.193.11:0/2391279374 wait complete. 2026-02-13T02:22:37.951 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:22:37 trial011 ceph-mon[11956]: pgmap v299: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:22:37.951 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:22:37 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/2391279374' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:22:37.999 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:22:37 trial060 ceph-mon[14797]: pgmap v299: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:22:38.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:22:37 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/2391279374' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:22:38.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:22:37 trial078 ceph-mon[14969]: pgmap v299: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:22:38.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:22:37 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/2391279374' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:22:39.779 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:22:39.902 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:22:39.922 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:22:39 trial011 ceph-mon[11956]: pgmap v300: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:22:40.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:22:39 trial060 ceph-mon[14797]: pgmap v300: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:22:40.016 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:40.014+0000 7efd5de786c0 1 -- 10.20.193.11:0/2093450551 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7efd5810bd00 msgr2=0x7efd58175a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:22:40.016 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:40.014+0000 7efd5de786c0 1 --2- 10.20.193.11:0/2093450551 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7efd5810bd00 0x7efd58175a70 secure :-1 s=READY pgs=415 gs=1 cs=0 l=1 c_cookie=7097368836359373642 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efd4c00aa40 tx=0x7efd4c02fde0 comp rx=0 tx=0).stop 2026-02-13T02:22:40.016 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:40.014+0000 7efd5de786c0 1 -- 10.20.193.11:0/2093450551 shutdown_connections 2026-02-13T02:22:40.016 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:40.014+0000 7efd5de786c0 1 --2- 10.20.193.11:0/2093450551 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7efd5810bd00 0x7efd58175a70 unknown :-1 s=CLOSED pgs=415 gs=1 cs=0 l=1 c_cookie=7097368836359373642 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:40.016 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:40.014+0000 7efd5de786c0 1 --2- 10.20.193.11:0/2093450551 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7efd5810b120 0x7efd5810b550 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:40.016 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:40.014+0000 7efd5de786c0 1 --2- 10.20.193.11:0/2093450551 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7efd5810dad0 0x7efd5810dea0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:40.016 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:40.014+0000 7efd5de786c0 1 -- 10.20.193.11:0/2093450551 >> 10.20.193.11:0/2093450551 conn(0x7efd58062e00 msgr2=0x7efd58109660 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:22:40.016 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:40.014+0000 7efd5de786c0 1 -- 10.20.193.11:0/2093450551 shutdown_connections 2026-02-13T02:22:40.016 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:40.014+0000 7efd5de786c0 1 -- 10.20.193.11:0/2093450551 wait complete. 2026-02-13T02:22:40.016 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:40.015+0000 7efd5de786c0 1 Processor -- start 2026-02-13T02:22:40.016 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:40.015+0000 7efd5de786c0 1 -- start start 2026-02-13T02:22:40.017 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:40.015+0000 7efd5de786c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7efd5810b120 0x7efd580f51d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:22:40.017 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:40.015+0000 7efd5de786c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7efd5810bd00 0x7efd580f5710 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:22:40.017 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:40.015+0000 7efd5de786c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7efd5810dad0 0x7efd580faad0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:22:40.017 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:40.015+0000 7efd5de786c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7efd580fb120 con 0x7efd5810b120 2026-02-13T02:22:40.017 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:40.015+0000 7efd5de786c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7efd580fb290 con 0x7efd5810bd00 2026-02-13T02:22:40.017 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:40.015+0000 7efd5de786c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7efd580fb450 con 0x7efd5810dad0 2026-02-13T02:22:40.017 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:40.015+0000 7efd577fe6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7efd5810b120 0x7efd580f51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:22:40.017 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:40.015+0000 7efd577fe6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7efd5810b120 0x7efd580f51d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:33926/0 (socket says 10.20.193.11:33926) 2026-02-13T02:22:40.017 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:40.015+0000 7efd577fe6c0 1 -- 10.20.193.11:0/1618440327 learned_addr learned my addr 10.20.193.11:0/1618440327 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:22:40.017 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:40.015+0000 7efd56ffd6c0 1 --2- 10.20.193.11:0/1618440327 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7efd5810bd00 0x7efd580f5710 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:22:40.017 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:40.015+0000 7efd57fff6c0 1 --2- 10.20.193.11:0/1618440327 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7efd5810dad0 0x7efd580faad0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:22:40.017 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:40.015+0000 7efd577fe6c0 1 -- 10.20.193.11:0/1618440327 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7efd5810dad0 msgr2=0x7efd580faad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:22:40.017 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:40.015+0000 7efd577fe6c0 1 --2- 10.20.193.11:0/1618440327 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7efd5810dad0 0x7efd580faad0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:40.017 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:40.015+0000 7efd577fe6c0 1 -- 10.20.193.11:0/1618440327 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7efd5810bd00 msgr2=0x7efd580f5710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:22:40.017 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:40.015+0000 7efd577fe6c0 1 --2- 10.20.193.11:0/1618440327 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7efd5810bd00 0x7efd580f5710 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:40.017 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:40.015+0000 7efd577fe6c0 1 -- 10.20.193.11:0/1618440327 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd4c00a660 con 0x7efd5810b120 2026-02-13T02:22:40.017 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:40.015+0000 7efd57fff6c0 1 --2- 10.20.193.11:0/1618440327 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7efd5810dad0 0x7efd580faad0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:22:40.017 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:40.015+0000 7efd577fe6c0 1 --2- 10.20.193.11:0/1618440327 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7efd5810b120 0x7efd580f51d0 secure :-1 s=READY pgs=416 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efd4400b710 tx=0x7efd4400bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:22:40.017 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:40.015+0000 7efd54ff96c0 1 -- 10.20.193.11:0/1618440327 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efd44004250 con 0x7efd5810b120 2026-02-13T02:22:40.017 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:40.015+0000 7efd5de786c0 1 -- 10.20.193.11:0/1618440327 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd580fb730 con 0x7efd5810b120 2026-02-13T02:22:40.017 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:40.015+0000 7efd54ff96c0 1 -- 10.20.193.11:0/1618440327 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7efd44002da0 con 0x7efd5810b120 2026-02-13T02:22:40.017 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:40.015+0000 7efd54ff96c0 1 -- 10.20.193.11:0/1618440327 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efd440071c0 con 0x7efd5810b120 2026-02-13T02:22:40.017 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:40.015+0000 7efd5de786c0 1 -- 10.20.193.11:0/1618440327 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd58172bf0 con 0x7efd5810b120 2026-02-13T02:22:40.017 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:40.015+0000 7efd5de786c0 1 -- 10.20.193.11:0/1618440327 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd5810c130 con 0x7efd5810b120 2026-02-13T02:22:40.018 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:40.017+0000 7efd54ff96c0 1 -- 10.20.193.11:0/1618440327 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7efd440043b0 con 0x7efd5810b120 2026-02-13T02:22:40.019 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:40.017+0000 7efd54ff96c0 1 --2- 10.20.193.11:0/1618440327 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7efd2c0b5600 0x7efd2c0d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:22:40.019 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:40.017+0000 7efd54ff96c0 1 -- 10.20.193.11:0/1618440327 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7965+0+0 (secure 0 0 0) 0x7efd440e3af0 con 0x7efd5810b120 2026-02-13T02:22:40.019 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:40.017+0000 7efd56ffd6c0 1 --2- 10.20.193.11:0/1618440327 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7efd2c0b5600 0x7efd2c0d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:22:40.019 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:40.017+0000 7efd54ff96c0 1 -- 10.20.193.11:0/1618440327 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7efd440a65b0 con 0x7efd5810b120 2026-02-13T02:22:40.019 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:40.018+0000 7efd56ffd6c0 1 --2- 10.20.193.11:0/1618440327 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7efd2c0b5600 0x7efd2c0d5ab0 secure :-1 s=READY pgs=270 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efd580fbb60 tx=0x7efd48009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:22:40.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:22:39 trial078 ceph-mon[14969]: pgmap v300: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:22:40.135 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:40.134+0000 7efd5de786c0 1 -- 10.20.193.11:0/1618440327 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7efd5810b550 con 0x7efd5810b120 2026-02-13T02:22:40.135 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:40.134+0000 7efd54ff96c0 1 -- 10.20.193.11:0/1618440327 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7efd440a9760 con 0x7efd5810b120 2026-02-13T02:22:40.135 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:22:40.135 INFO:teuthology.orchestra.run.trial011.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:22:40.136 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:40.135+0000 7efd5de786c0 1 -- 10.20.193.11:0/1618440327 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7efd2c0b5600 msgr2=0x7efd2c0d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:22:40.136 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:40.135+0000 7efd5de786c0 1 --2- 10.20.193.11:0/1618440327 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7efd2c0b5600 0x7efd2c0d5ab0 secure :-1 s=READY pgs=270 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efd580fbb60 tx=0x7efd48009260 comp rx=0 tx=0).stop 2026-02-13T02:22:40.136 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:40.135+0000 7efd5de786c0 1 -- 10.20.193.11:0/1618440327 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7efd5810b120 msgr2=0x7efd580f51d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:22:40.136 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:40.135+0000 7efd5de786c0 1 --2- 10.20.193.11:0/1618440327 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7efd5810b120 0x7efd580f51d0 secure :-1 s=READY pgs=416 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efd4400b710 tx=0x7efd4400bbe0 comp rx=0 tx=0).stop 2026-02-13T02:22:40.136 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:40.135+0000 7efd5de786c0 1 -- 10.20.193.11:0/1618440327 shutdown_connections 2026-02-13T02:22:40.137 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:40.135+0000 7efd5de786c0 1 --2- 10.20.193.11:0/1618440327 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7efd2c0b5600 0x7efd2c0d5ab0 unknown :-1 s=CLOSED pgs=270 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:40.137 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:40.135+0000 7efd5de786c0 1 --2- 10.20.193.11:0/1618440327 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7efd5810bd00 0x7efd580f5710 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:40.137 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:40.135+0000 7efd5de786c0 1 --2- 10.20.193.11:0/1618440327 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7efd5810dad0 0x7efd580faad0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:40.137 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:40.135+0000 7efd5de786c0 1 --2- 10.20.193.11:0/1618440327 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7efd5810b120 0x7efd580f51d0 unknown :-1 s=CLOSED pgs=416 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:40.137 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:40.135+0000 7efd5de786c0 1 -- 10.20.193.11:0/1618440327 >> 10.20.193.11:0/1618440327 conn(0x7efd58062e00 msgr2=0x7efd580ee960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:22:40.137 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:40.135+0000 7efd5de786c0 1 -- 10.20.193.11:0/1618440327 shutdown_connections 2026-02-13T02:22:40.137 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:40.135+0000 7efd5de786c0 1 -- 10.20.193.11:0/1618440327 wait complete. 2026-02-13T02:22:40.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:22:40 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/1618440327' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:22:41.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:22:40 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/1618440327' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:22:41.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:22:40 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/1618440327' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:22:41.901 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:22:41 trial060 ceph-mon[14797]: pgmap v301: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:22:41.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:22:41 trial011 ceph-mon[11956]: pgmap v301: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:22:42.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:22:41 trial078 ceph-mon[14969]: pgmap v301: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:22:43.176 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:22:43.299 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:22:43.420 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:43.419+0000 7f96d95696c0 1 -- 10.20.193.11:0/4010242272 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f96d410f200 msgr2=0x7f96d410f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:22:43.420 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:43.419+0000 7f96d95696c0 1 --2- 10.20.193.11:0/4010242272 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f96d410f200 0x7f96d410f5d0 secure :-1 s=READY pgs=417 gs=1 cs=0 l=1 c_cookie=4188016773786465492 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f96c80099a0 tx=0x7f96c802ed20 comp rx=0 tx=0).stop 2026-02-13T02:22:43.420 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:43.419+0000 7f96d95696c0 1 -- 10.20.193.11:0/4010242272 shutdown_connections 2026-02-13T02:22:43.421 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:43.419+0000 7f96d95696c0 1 --2- 10.20.193.11:0/4010242272 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f96d4115410 0x7f96d4175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:43.421 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:43.419+0000 7f96d95696c0 1 --2- 10.20.193.11:0/4010242272 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f96d410fbf0 0x7f96d4114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:43.421 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:43.419+0000 7f96d95696c0 1 --2- 10.20.193.11:0/4010242272 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f96d410f200 0x7f96d410f5d0 unknown :-1 s=CLOSED pgs=417 gs=1 cs=0 l=1 c_cookie=4188016773786465492 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:43.421 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:43.419+0000 7f96d95696c0 1 -- 10.20.193.11:0/4010242272 >> 10.20.193.11:0/4010242272 conn(0x7f96d40ecb00 msgr2=0x7f96d410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:22:43.421 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:43.419+0000 7f96d95696c0 1 -- 10.20.193.11:0/4010242272 shutdown_connections 2026-02-13T02:22:43.421 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:43.419+0000 7f96d95696c0 1 -- 10.20.193.11:0/4010242272 wait complete. 2026-02-13T02:22:43.421 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:43.419+0000 7f96d95696c0 1 Processor -- start 2026-02-13T02:22:43.421 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:43.419+0000 7f96d95696c0 1 -- start start 2026-02-13T02:22:43.421 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:43.419+0000 7f96d95696c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f96d410f200 0x7f96d411d1e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:22:43.421 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:43.419+0000 7f96d95696c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f96d4115410 0x7f96d411d720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:22:43.421 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:43.420+0000 7f96d95696c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f96d4122ae0 0x7f96d4122f80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:22:43.421 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:43.420+0000 7f96d95696c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f96d41234f0 con 0x7f96d410f200 2026-02-13T02:22:43.421 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:43.420+0000 7f96d95696c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f96d4123660 con 0x7f96d4122ae0 2026-02-13T02:22:43.421 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:43.420+0000 7f96d95696c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f96d4123820 con 0x7f96d4115410 2026-02-13T02:22:43.421 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:43.420+0000 7f96d2ffd6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f96d410f200 0x7f96d411d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:22:43.421 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:43.420+0000 7f96d2ffd6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f96d410f200 0x7f96d411d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:42090/0 (socket says 10.20.193.11:42090) 2026-02-13T02:22:43.422 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:43.420+0000 7f96d2ffd6c0 1 -- 10.20.193.11:0/1606073191 learned_addr learned my addr 10.20.193.11:0/1606073191 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:22:43.422 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:43.420+0000 7f96d27fc6c0 1 --2- 10.20.193.11:0/1606073191 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f96d4115410 0x7f96d411d720 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:22:43.422 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:43.420+0000 7f96d37fe6c0 1 --2- 10.20.193.11:0/1606073191 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f96d4122ae0 0x7f96d4122f80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:22:43.422 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:43.420+0000 7f96d2ffd6c0 1 -- 10.20.193.11:0/1606073191 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f96d4115410 msgr2=0x7f96d411d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:22:43.422 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:43.420+0000 7f96d2ffd6c0 1 --2- 10.20.193.11:0/1606073191 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f96d4115410 0x7f96d411d720 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:43.422 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:43.420+0000 7f96d2ffd6c0 1 -- 10.20.193.11:0/1606073191 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f96d4122ae0 msgr2=0x7f96d4122f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:22:43.422 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:43.420+0000 7f96d2ffd6c0 1 --2- 10.20.193.11:0/1606073191 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f96d4122ae0 0x7f96d4122f80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:43.422 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:43.420+0000 7f96d2ffd6c0 1 -- 10.20.193.11:0/1606073191 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96c8009590 con 0x7f96d410f200 2026-02-13T02:22:43.422 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:43.420+0000 7f96d37fe6c0 1 --2- 10.20.193.11:0/1606073191 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f96d4122ae0 0x7f96d4122f80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:22:43.422 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:43.420+0000 7f96d2ffd6c0 1 --2- 10.20.193.11:0/1606073191 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f96d410f200 0x7f96d411d1e0 secure :-1 s=READY pgs=418 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f96c8031fd0 tx=0x7f96c80047f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:22:43.422 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:43.420+0000 7f96b3fff6c0 1 -- 10.20.193.11:0/1606073191 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f96c8002ae0 con 0x7f96d410f200 2026-02-13T02:22:43.422 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:43.420+0000 7f96d95696c0 1 -- 10.20.193.11:0/1606073191 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96d4163c70 con 0x7f96d410f200 2026-02-13T02:22:43.422 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:43.420+0000 7f96b3fff6c0 1 -- 10.20.193.11:0/1606073191 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f96c8007740 con 0x7f96d410f200 2026-02-13T02:22:43.422 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:43.420+0000 7f96b3fff6c0 1 -- 10.20.193.11:0/1606073191 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f96c8037590 con 0x7f96d410f200 2026-02-13T02:22:43.422 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:43.420+0000 7f96d95696c0 1 -- 10.20.193.11:0/1606073191 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96d41640f0 con 0x7f96d410f200 2026-02-13T02:22:43.422 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:43.420+0000 7f96d95696c0 1 -- 10.20.193.11:0/1606073191 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96d41104d0 con 0x7f96d410f200 2026-02-13T02:22:43.423 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:43.422+0000 7f96b3fff6c0 1 -- 10.20.193.11:0/1606073191 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7f96c8002ce0 con 0x7f96d410f200 2026-02-13T02:22:43.424 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:43.423+0000 7f96b3fff6c0 1 --2- 10.20.193.11:0/1606073191 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f96a80b5680 0x7f96a80d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:22:43.424 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:43.423+0000 7f96d27fc6c0 1 --2- 10.20.193.11:0/1606073191 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f96a80b5680 0x7f96a80d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:22:43.424 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:43.423+0000 7f96b3fff6c0 1 -- 10.20.193.11:0/1606073191 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7965+0+0 (secure 0 0 0) 0x7f96c8107c80 con 0x7f96d410f200 2026-02-13T02:22:43.424 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:43.423+0000 7f96b3fff6c0 1 -- 10.20.193.11:0/1606073191 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f96c8108100 con 0x7f96d410f200 2026-02-13T02:22:43.424 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:43.423+0000 7f96d27fc6c0 1 --2- 10.20.193.11:0/1606073191 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f96a80b5680 0x7f96a80d5b30 secure :-1 s=READY pgs=271 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f96bc005980 tx=0x7f96bc005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:22:43.540 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:43.539+0000 7f96d95696c0 1 -- 10.20.193.11:0/1606073191 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f96d410f5d0 con 0x7f96d410f200 2026-02-13T02:22:43.540 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:43.539+0000 7f96b3fff6c0 1 -- 10.20.193.11:0/1606073191 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f96c80ca740 con 0x7f96d410f200 2026-02-13T02:22:43.540 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:22:43.541 INFO:teuthology.orchestra.run.trial011.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:22:43.542 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:43.540+0000 7f96d95696c0 1 -- 10.20.193.11:0/1606073191 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f96a80b5680 msgr2=0x7f96a80d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:22:43.542 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:43.540+0000 7f96d95696c0 1 --2- 10.20.193.11:0/1606073191 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f96a80b5680 0x7f96a80d5b30 secure :-1 s=READY pgs=271 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f96bc005980 tx=0x7f96bc005910 comp rx=0 tx=0).stop 2026-02-13T02:22:43.542 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:43.540+0000 7f96d95696c0 1 -- 10.20.193.11:0/1606073191 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f96d410f200 msgr2=0x7f96d411d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:22:43.542 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:43.540+0000 7f96d95696c0 1 --2- 10.20.193.11:0/1606073191 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f96d410f200 0x7f96d411d1e0 secure :-1 s=READY pgs=418 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f96c8031fd0 tx=0x7f96c80047f0 comp rx=0 tx=0).stop 2026-02-13T02:22:43.542 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:43.540+0000 7f96d95696c0 1 -- 10.20.193.11:0/1606073191 shutdown_connections 2026-02-13T02:22:43.542 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:43.540+0000 7f96d95696c0 1 --2- 10.20.193.11:0/1606073191 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f96a80b5680 0x7f96a80d5b30 unknown :-1 s=CLOSED pgs=271 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:43.542 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:43.540+0000 7f96d95696c0 1 --2- 10.20.193.11:0/1606073191 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f96d4122ae0 0x7f96d4122f80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:43.542 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:43.540+0000 7f96d95696c0 1 --2- 10.20.193.11:0/1606073191 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f96d4115410 0x7f96d411d720 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:43.542 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:43.540+0000 7f96d95696c0 1 --2- 10.20.193.11:0/1606073191 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f96d410f200 0x7f96d411d1e0 unknown :-1 s=CLOSED pgs=418 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:43.542 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:43.540+0000 7f96d95696c0 1 -- 10.20.193.11:0/1606073191 >> 10.20.193.11:0/1606073191 conn(0x7f96d40ecb00 msgr2=0x7f96d410cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:22:43.542 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:43.540+0000 7f96d95696c0 1 -- 10.20.193.11:0/1606073191 shutdown_connections 2026-02-13T02:22:43.542 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:43.540+0000 7f96d95696c0 1 -- 10.20.193.11:0/1606073191 wait complete. 2026-02-13T02:22:43.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:22:43 trial011 ceph-mon[11956]: pgmap v302: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T02:22:43.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:22:43 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/1606073191' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:22:44.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:22:43 trial060 ceph-mon[14797]: pgmap v302: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T02:22:44.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:22:43 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/1606073191' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:22:44.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:22:43 trial078 ceph-mon[14969]: pgmap v302: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T02:22:44.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:22:43 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/1606073191' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:22:45.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:22:45 trial011 ceph-mon[11956]: pgmap v303: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:22:46.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:22:45 trial060 ceph-mon[14797]: pgmap v303: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:22:46.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:22:45 trial078 ceph-mon[14969]: pgmap v303: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:22:46.580 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:22:46.705 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:22:46.818 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:46.814+0000 7f26907a36c0 1 -- 10.20.193.11:0/4106280183 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f268810fbf0 msgr2=0x7f2688114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:22:46.818 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:46.814+0000 7f26907a36c0 1 --2- 10.20.193.11:0/4106280183 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f268810fbf0 0x7f2688114c30 secure :-1 s=READY pgs=419 gs=1 cs=0 l=1 c_cookie=1549662034707643152 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f267c0099a0 tx=0x7f267c02ed20 comp rx=0 tx=0).stop 2026-02-13T02:22:46.818 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:46.814+0000 7f26907a36c0 1 -- 10.20.193.11:0/4106280183 shutdown_connections 2026-02-13T02:22:46.818 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:46.814+0000 7f26907a36c0 1 --2- 10.20.193.11:0/4106280183 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f2688115410 0x7f2688175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:46.819 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:46.814+0000 7f26907a36c0 1 --2- 10.20.193.11:0/4106280183 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f268810fbf0 0x7f2688114c30 unknown :-1 s=CLOSED pgs=419 gs=1 cs=0 l=1 c_cookie=1549662034707643152 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:46.819 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:46.814+0000 7f26907a36c0 1 --2- 10.20.193.11:0/4106280183 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f268810f200 0x7f268810f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:46.819 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:46.814+0000 7f26907a36c0 1 -- 10.20.193.11:0/4106280183 >> 10.20.193.11:0/4106280183 conn(0x7f26880ecb00 msgr2=0x7f268810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:22:46.819 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:46.814+0000 7f26907a36c0 1 -- 10.20.193.11:0/4106280183 shutdown_connections 2026-02-13T02:22:46.819 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:46.814+0000 7f26907a36c0 1 -- 10.20.193.11:0/4106280183 wait complete. 2026-02-13T02:22:46.819 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:46.814+0000 7f26907a36c0 1 Processor -- start 2026-02-13T02:22:46.819 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:46.814+0000 7f26907a36c0 1 -- start start 2026-02-13T02:22:46.819 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:46.815+0000 7f26907a36c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f268810f200 0x7f26880f4c60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:22:46.819 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:46.815+0000 7f26907a36c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f2688115410 0x7f2688175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:22:46.819 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:46.815+0000 7f26907a36c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f26880f5290 0x7f26880fa510 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:22:46.819 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:46.815+0000 7f26907a36c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f26880f5980 con 0x7f2688115410 2026-02-13T02:22:46.820 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:46.815+0000 7f26907a36c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f26880faa50 con 0x7f268810f200 2026-02-13T02:22:46.820 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:46.815+0000 7f26907a36c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f26880fac10 con 0x7f26880f5290 2026-02-13T02:22:46.820 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:46.815+0000 7f268dd136c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f2688115410 0x7f2688175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:22:46.820 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:46.815+0000 7f268dd136c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f2688115410 0x7f2688175cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:42098/0 (socket says 10.20.193.11:42098) 2026-02-13T02:22:46.820 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:46.815+0000 7f268dd136c0 1 -- 10.20.193.11:0/3745297018 learned_addr learned my addr 10.20.193.11:0/3745297018 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:22:46.820 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:46.815+0000 7f268e5146c0 1 --2- 10.20.193.11:0/3745297018 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f268810f200 0x7f26880f4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:22:46.820 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:46.815+0000 7f268ed156c0 1 --2- 10.20.193.11:0/3745297018 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f26880f5290 0x7f26880fa510 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:22:46.820 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:46.815+0000 7f268dd136c0 1 -- 10.20.193.11:0/3745297018 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f26880f5290 msgr2=0x7f26880fa510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:22:46.820 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:46.815+0000 7f268dd136c0 1 --2- 10.20.193.11:0/3745297018 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f26880f5290 0x7f26880fa510 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:46.820 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:46.815+0000 7f268dd136c0 1 -- 10.20.193.11:0/3745297018 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f268810f200 msgr2=0x7f26880f4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:22:46.820 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:46.815+0000 7f268dd136c0 1 --2- 10.20.193.11:0/3745297018 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f268810f200 0x7f26880f4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:46.820 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:46.815+0000 7f268dd136c0 1 -- 10.20.193.11:0/3745297018 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f267c009590 con 0x7f2688115410 2026-02-13T02:22:46.821 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:46.815+0000 7f268ed156c0 1 --2- 10.20.193.11:0/3745297018 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f26880f5290 0x7f26880fa510 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:22:46.821 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:46.815+0000 7f268dd136c0 1 --2- 10.20.193.11:0/3745297018 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f2688115410 0x7f2688175cb0 secure :-1 s=READY pgs=420 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f267c031f90 tx=0x7f267c0047f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:22:46.821 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:46.815+0000 7f266f7fe6c0 1 -- 10.20.193.11:0/3745297018 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f267c002ae0 con 0x7f2688115410 2026-02-13T02:22:46.821 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:46.815+0000 7f266f7fe6c0 1 -- 10.20.193.11:0/3745297018 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f267c002c40 con 0x7f2688115410 2026-02-13T02:22:46.821 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:46.815+0000 7f266f7fe6c0 1 -- 10.20.193.11:0/3745297018 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f267c0312b0 con 0x7f2688115410 2026-02-13T02:22:46.821 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:46.815+0000 7f26907a36c0 1 -- 10.20.193.11:0/3745297018 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26880fae90 con 0x7f2688115410 2026-02-13T02:22:46.821 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:46.815+0000 7f26907a36c0 1 -- 10.20.193.11:0/3745297018 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26880fb360 con 0x7f2688115410 2026-02-13T02:22:46.821 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:46.815+0000 7f26907a36c0 1 -- 10.20.193.11:0/3745297018 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26881104d0 con 0x7f2688115410 2026-02-13T02:22:46.822 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:46.817+0000 7f266f7fe6c0 1 -- 10.20.193.11:0/3745297018 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7f267c007260 con 0x7f2688115410 2026-02-13T02:22:46.822 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:46.817+0000 7f266f7fe6c0 1 --2- 10.20.193.11:0/3745297018 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f26640b5680 0x7f26640d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:22:46.822 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:46.817+0000 7f266f7fe6c0 1 -- 10.20.193.11:0/3745297018 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7965+0+0 (secure 0 0 0) 0x7f267c107bb0 con 0x7f2688115410 2026-02-13T02:22:46.822 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:46.817+0000 7f268e5146c0 1 --2- 10.20.193.11:0/3745297018 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f26640b5680 0x7f26640d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:22:46.823 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:46.818+0000 7f268e5146c0 1 --2- 10.20.193.11:0/3745297018 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f26640b5680 0x7f26640d5b30 secure :-1 s=READY pgs=272 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2678005980 tx=0x7f2678005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:22:46.823 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:46.818+0000 7f266f7fe6c0 1 -- 10.20.193.11:0/3745297018 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f267c0ca670 con 0x7f2688115410 2026-02-13T02:22:46.936 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:46.934+0000 7f26907a36c0 1 -- 10.20.193.11:0/3745297018 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f268810f5d0 con 0x7f2688115410 2026-02-13T02:22:46.936 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:46.934+0000 7f266f7fe6c0 1 -- 10.20.193.11:0/3745297018 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f267c0077d0 con 0x7f2688115410 2026-02-13T02:22:46.936 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:22:46.937 INFO:teuthology.orchestra.run.trial011.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:22:46.938 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:46.935+0000 7f26907a36c0 1 -- 10.20.193.11:0/3745297018 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f26640b5680 msgr2=0x7f26640d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:22:46.938 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:46.935+0000 7f26907a36c0 1 --2- 10.20.193.11:0/3745297018 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f26640b5680 0x7f26640d5b30 secure :-1 s=READY pgs=272 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2678005980 tx=0x7f2678005910 comp rx=0 tx=0).stop 2026-02-13T02:22:46.938 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:46.935+0000 7f26907a36c0 1 -- 10.20.193.11:0/3745297018 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f2688115410 msgr2=0x7f2688175cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:22:46.938 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:46.935+0000 7f26907a36c0 1 --2- 10.20.193.11:0/3745297018 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f2688115410 0x7f2688175cb0 secure :-1 s=READY pgs=420 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f267c031f90 tx=0x7f267c0047f0 comp rx=0 tx=0).stop 2026-02-13T02:22:46.938 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:46.935+0000 7f26907a36c0 1 -- 10.20.193.11:0/3745297018 shutdown_connections 2026-02-13T02:22:46.938 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:46.935+0000 7f26907a36c0 1 --2- 10.20.193.11:0/3745297018 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f26640b5680 0x7f26640d5b30 unknown :-1 s=CLOSED pgs=272 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:46.938 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:46.935+0000 7f26907a36c0 1 --2- 10.20.193.11:0/3745297018 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f26880f5290 0x7f26880fa510 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:46.938 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:46.935+0000 7f26907a36c0 1 --2- 10.20.193.11:0/3745297018 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f2688115410 0x7f2688175cb0 unknown :-1 s=CLOSED pgs=420 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:46.938 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:46.935+0000 7f26907a36c0 1 --2- 10.20.193.11:0/3745297018 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f268810f200 0x7f26880f4c60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:46.938 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:46.935+0000 7f26907a36c0 1 -- 10.20.193.11:0/3745297018 >> 10.20.193.11:0/3745297018 conn(0x7f26880ecb00 msgr2=0x7f268810d860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:22:46.938 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:46.935+0000 7f26907a36c0 1 -- 10.20.193.11:0/3745297018 shutdown_connections 2026-02-13T02:22:46.939 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:46.935+0000 7f26907a36c0 1 -- 10.20.193.11:0/3745297018 wait complete. 2026-02-13T02:22:47.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:22:47 trial011 ceph-mon[11956]: pgmap v304: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:22:47.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:22:47 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/3745297018' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:22:48.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:22:47 trial060 ceph-mon[14797]: pgmap v304: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:22:48.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:22:47 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/3745297018' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:22:48.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:22:47 trial078 ceph-mon[14969]: pgmap v304: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:22:48.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:22:47 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/3745297018' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:22:49.951 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:22:49 trial011 ceph-mon[11956]: pgmap v305: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:22:49.976 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:22:50.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:22:49 trial060 ceph-mon[14797]: pgmap v305: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:22:50.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:22:49 trial078 ceph-mon[14969]: pgmap v305: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:22:50.101 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:22:50.224 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:50.222+0000 7fa5281606c0 1 -- 10.20.193.11:0/2183205272 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fa52010f200 msgr2=0x7fa52010f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:22:50.224 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:50.222+0000 7fa5281606c0 1 --2- 10.20.193.11:0/2183205272 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fa52010f200 0x7fa52010f5d0 secure :-1 s=READY pgs=421 gs=1 cs=0 l=1 c_cookie=1704789543165186972 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa5100099a0 tx=0x7fa51002ed20 comp rx=0 tx=0).stop 2026-02-13T02:22:50.224 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:50.222+0000 7fa5281606c0 1 -- 10.20.193.11:0/2183205272 shutdown_connections 2026-02-13T02:22:50.224 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:50.222+0000 7fa5281606c0 1 --2- 10.20.193.11:0/2183205272 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fa52010fbf0 0x7fa520114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:50.224 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:50.222+0000 7fa5281606c0 1 --2- 10.20.193.11:0/2183205272 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa520115410 0x7fa520175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:50.224 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:50.222+0000 7fa5281606c0 1 --2- 10.20.193.11:0/2183205272 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fa52010f200 0x7fa52010f5d0 unknown :-1 s=CLOSED pgs=421 gs=1 cs=0 l=1 c_cookie=1704789543165186972 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:50.224 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:50.222+0000 7fa5281606c0 1 -- 10.20.193.11:0/2183205272 >> 10.20.193.11:0/2183205272 conn(0x7fa5200ecb00 msgr2=0x7fa52010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:22:50.224 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:50.222+0000 7fa5281606c0 1 -- 10.20.193.11:0/2183205272 shutdown_connections 2026-02-13T02:22:50.224 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:50.222+0000 7fa5281606c0 1 -- 10.20.193.11:0/2183205272 wait complete. 2026-02-13T02:22:50.225 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:50.223+0000 7fa5281606c0 1 Processor -- start 2026-02-13T02:22:50.225 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:50.223+0000 7fa5281606c0 1 -- start start 2026-02-13T02:22:50.225 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:50.223+0000 7fa5281606c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fa52010f200 0x7fa52011d1b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:22:50.225 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:50.223+0000 7fa5281606c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa520115410 0x7fa52011d6f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:22:50.225 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:50.223+0000 7fa5281606c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fa520122ab0 0x7fa520122f50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:22:50.225 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:50.223+0000 7fa5281606c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7fa520123490 con 0x7fa52010f200 2026-02-13T02:22:50.225 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:50.223+0000 7fa5281606c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa520123600 con 0x7fa520122ab0 2026-02-13T02:22:50.225 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:50.223+0000 7fa5281606c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa5201237c0 con 0x7fa520115410 2026-02-13T02:22:50.225 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:50.223+0000 7fa525ed16c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fa52010f200 0x7fa52011d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:22:50.225 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:50.223+0000 7fa525ed16c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fa52010f200 0x7fa52011d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:42124/0 (socket says 10.20.193.11:42124) 2026-02-13T02:22:50.225 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:50.223+0000 7fa525ed16c0 1 -- 10.20.193.11:0/3603945500 learned_addr learned my addr 10.20.193.11:0/3603945500 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:22:50.225 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:50.223+0000 7fa525ed16c0 1 -- 10.20.193.11:0/3603945500 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa520115410 msgr2=0x7fa52011d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:22:50.225 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:50.223+0000 7fa525ed16c0 1 --2- 10.20.193.11:0/3603945500 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa520115410 0x7fa52011d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:50.225 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:50.223+0000 7fa525ed16c0 1 -- 10.20.193.11:0/3603945500 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fa520122ab0 msgr2=0x7fa520122f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:22:50.225 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:50.223+0000 7fa525ed16c0 1 --2- 10.20.193.11:0/3603945500 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fa520122ab0 0x7fa520122f50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:50.225 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:50.223+0000 7fa525ed16c0 1 -- 10.20.193.11:0/3603945500 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa510009590 con 0x7fa52010f200 2026-02-13T02:22:50.225 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:50.223+0000 7fa525ed16c0 1 --2- 10.20.193.11:0/3603945500 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fa52010f200 0x7fa52011d1b0 secure :-1 s=READY pgs=422 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa510031fd0 tx=0x7fa5100047f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:22:50.225 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:50.223+0000 7fa50effd6c0 1 -- 10.20.193.11:0/3603945500 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa510002ae0 con 0x7fa52010f200 2026-02-13T02:22:50.225 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:50.223+0000 7fa50effd6c0 1 -- 10.20.193.11:0/3603945500 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa510002c40 con 0x7fa52010f200 2026-02-13T02:22:50.225 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:50.223+0000 7fa5281606c0 1 -- 10.20.193.11:0/3603945500 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa520163c40 con 0x7fa52010f200 2026-02-13T02:22:50.225 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:50.223+0000 7fa50effd6c0 1 -- 10.20.193.11:0/3603945500 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa5100372f0 con 0x7fa52010f200 2026-02-13T02:22:50.225 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:50.223+0000 7fa5281606c0 1 -- 10.20.193.11:0/3603945500 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa520164110 con 0x7fa52010f200 2026-02-13T02:22:50.225 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:50.224+0000 7fa5281606c0 1 -- 10.20.193.11:0/3603945500 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5201104d0 con 0x7fa52010f200 2026-02-13T02:22:50.227 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:50.225+0000 7fa50effd6c0 1 -- 10.20.193.11:0/3603945500 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7fa5100077d0 con 0x7fa52010f200 2026-02-13T02:22:50.227 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:50.226+0000 7fa50effd6c0 1 --2- 10.20.193.11:0/3603945500 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fa4fc0b5680 0x7fa4fc0d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:22:50.228 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:50.226+0000 7fa50effd6c0 1 -- 10.20.193.11:0/3603945500 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7965+0+0 (secure 0 0 0) 0x7fa510107bd0 con 0x7fa52010f200 2026-02-13T02:22:50.228 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:50.226+0000 7fa5256d06c0 1 --2- 10.20.193.11:0/3603945500 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fa4fc0b5680 0x7fa4fc0d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:22:50.228 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:50.226+0000 7fa50effd6c0 1 -- 10.20.193.11:0/3603945500 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fa5101406a0 con 0x7fa52010f200 2026-02-13T02:22:50.228 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:50.226+0000 7fa5256d06c0 1 --2- 10.20.193.11:0/3603945500 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fa4fc0b5680 0x7fa4fc0d5b30 secure :-1 s=READY pgs=273 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa520123b40 tx=0x7fa514005d30 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:22:50.343 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:50.342+0000 7fa5281606c0 1 -- 10.20.193.11:0/3603945500 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fa52010f5d0 con 0x7fa52010f200 2026-02-13T02:22:50.343 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:50.342+0000 7fa50effd6c0 1 -- 10.20.193.11:0/3603945500 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fa5100ca6d0 con 0x7fa52010f200 2026-02-13T02:22:50.344 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:22:50.344 INFO:teuthology.orchestra.run.trial011.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:22:50.344 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:50.343+0000 7fa5281606c0 1 -- 10.20.193.11:0/3603945500 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fa4fc0b5680 msgr2=0x7fa4fc0d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:22:50.344 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:50.343+0000 7fa5281606c0 1 --2- 10.20.193.11:0/3603945500 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fa4fc0b5680 0x7fa4fc0d5b30 secure :-1 s=READY pgs=273 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa520123b40 tx=0x7fa514005d30 comp rx=0 tx=0).stop 2026-02-13T02:22:50.344 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:50.343+0000 7fa5281606c0 1 -- 10.20.193.11:0/3603945500 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fa52010f200 msgr2=0x7fa52011d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:22:50.344 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:50.343+0000 7fa5281606c0 1 --2- 10.20.193.11:0/3603945500 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fa52010f200 0x7fa52011d1b0 secure :-1 s=READY pgs=422 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa510031fd0 tx=0x7fa5100047f0 comp rx=0 tx=0).stop 2026-02-13T02:22:50.344 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:50.343+0000 7fa5281606c0 1 -- 10.20.193.11:0/3603945500 shutdown_connections 2026-02-13T02:22:50.344 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:50.343+0000 7fa5281606c0 1 --2- 10.20.193.11:0/3603945500 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fa4fc0b5680 0x7fa4fc0d5b30 unknown :-1 s=CLOSED pgs=273 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:50.345 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:50.343+0000 7fa5281606c0 1 --2- 10.20.193.11:0/3603945500 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fa520122ab0 0x7fa520122f50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:50.345 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:50.343+0000 7fa5281606c0 1 --2- 10.20.193.11:0/3603945500 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa520115410 0x7fa52011d6f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:50.345 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:50.343+0000 7fa5281606c0 1 --2- 10.20.193.11:0/3603945500 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fa52010f200 0x7fa52011d1b0 unknown :-1 s=CLOSED pgs=422 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:50.345 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:50.343+0000 7fa5281606c0 1 -- 10.20.193.11:0/3603945500 >> 10.20.193.11:0/3603945500 conn(0x7fa5200ecb00 msgr2=0x7fa52010cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:22:50.345 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:50.343+0000 7fa5281606c0 1 -- 10.20.193.11:0/3603945500 shutdown_connections 2026-02-13T02:22:50.345 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:50.343+0000 7fa5281606c0 1 -- 10.20.193.11:0/3603945500 wait complete. 2026-02-13T02:22:50.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:22:50 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/3603945500' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:22:51.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:22:50 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/3603945500' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:22:51.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:22:50 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/3603945500' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:22:51.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:22:51 trial011 ceph-mon[11956]: pgmap v306: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:22:52.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:22:51 trial060 ceph-mon[14797]: pgmap v306: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:22:52.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:22:51 trial078 ceph-mon[14969]: pgmap v306: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:22:53.382 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:22:53.505 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:22:53.616 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:53.614+0000 7f177fa2d6c0 1 -- 10.20.193.11:0/3568059772 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f177810fc20 msgr2=0x7f1778114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:22:53.616 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:53.614+0000 7f177fa2d6c0 1 --2- 10.20.193.11:0/3568059772 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f177810fc20 0x7f1778114c60 secure :-1 s=READY pgs=423 gs=1 cs=0 l=1 c_cookie=11952572281442527701 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f176c0099a0 tx=0x7f176c02ed20 comp rx=0 tx=0).stop 2026-02-13T02:22:53.616 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:53.614+0000 7f177fa2d6c0 1 -- 10.20.193.11:0/3568059772 shutdown_connections 2026-02-13T02:22:53.616 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:53.614+0000 7f177fa2d6c0 1 --2- 10.20.193.11:0/3568059772 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f1778115440 0x7f1778175de0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:53.616 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:53.614+0000 7f177fa2d6c0 1 --2- 10.20.193.11:0/3568059772 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f177810fc20 0x7f1778114c60 unknown :-1 s=CLOSED pgs=423 gs=1 cs=0 l=1 c_cookie=11952572281442527701 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:53.616 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:53.614+0000 7f177fa2d6c0 1 --2- 10.20.193.11:0/3568059772 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f177810f230 0x7f177810f600 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:53.616 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:53.615+0000 7f177fa2d6c0 1 -- 10.20.193.11:0/3568059772 >> 10.20.193.11:0/3568059772 conn(0x7f17780ecb30 msgr2=0x7f177810cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:22:53.616 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:53.615+0000 7f177fa2d6c0 1 -- 10.20.193.11:0/3568059772 shutdown_connections 2026-02-13T02:22:53.616 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:53.615+0000 7f177fa2d6c0 1 -- 10.20.193.11:0/3568059772 wait complete. 2026-02-13T02:22:53.617 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:53.615+0000 7f177fa2d6c0 1 Processor -- start 2026-02-13T02:22:53.617 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:53.615+0000 7f177fa2d6c0 1 -- start start 2026-02-13T02:22:53.617 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:53.615+0000 7f177fa2d6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f177810f230 0x7f17780f4be0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:22:53.617 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:53.615+0000 7f177fa2d6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1778115440 0x7f1778175ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:22:53.617 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:53.615+0000 7f177fa2d6c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f17780f5210 0x7f17780fa490 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:22:53.617 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:53.615+0000 7f177fa2d6c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f17780f5900 con 0x7f177810f230 2026-02-13T02:22:53.617 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:53.615+0000 7f177fa2d6c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f17780fa9d0 con 0x7f17780f5210 2026-02-13T02:22:53.617 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:53.615+0000 7f177fa2d6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f17780fab90 con 0x7f1778115440 2026-02-13T02:22:53.617 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:53.615+0000 7f177d79e6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f177810f230 0x7f17780f4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:22:53.617 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:53.615+0000 7f177d79e6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f177810f230 0x7f17780f4be0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:41596/0 (socket says 10.20.193.11:41596) 2026-02-13T02:22:53.617 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:53.615+0000 7f177d79e6c0 1 -- 10.20.193.11:0/1167182363 learned_addr learned my addr 10.20.193.11:0/1167182363 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:22:53.617 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:53.615+0000 7f177cf9d6c0 1 --2- 10.20.193.11:0/1167182363 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1778115440 0x7f1778175ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:22:53.617 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:53.615+0000 7f177df9f6c0 1 --2- 10.20.193.11:0/1167182363 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f17780f5210 0x7f17780fa490 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:22:53.617 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:53.615+0000 7f177d79e6c0 1 -- 10.20.193.11:0/1167182363 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1778115440 msgr2=0x7f1778175ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:22:53.617 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:53.615+0000 7f177d79e6c0 1 --2- 10.20.193.11:0/1167182363 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1778115440 0x7f1778175ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:53.617 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:53.615+0000 7f177d79e6c0 1 -- 10.20.193.11:0/1167182363 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f17780f5210 msgr2=0x7f17780fa490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:22:53.617 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:53.615+0000 7f177d79e6c0 1 --2- 10.20.193.11:0/1167182363 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f17780f5210 0x7f17780fa490 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:53.617 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:53.615+0000 7f177d79e6c0 1 -- 10.20.193.11:0/1167182363 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f176c009590 con 0x7f177810f230 2026-02-13T02:22:53.617 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:53.615+0000 7f177cf9d6c0 1 --2- 10.20.193.11:0/1167182363 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1778115440 0x7f1778175ce0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T02:22:53.617 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:53.615+0000 7f177d79e6c0 1 --2- 10.20.193.11:0/1167182363 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f177810f230 0x7f17780f4be0 secure :-1 s=READY pgs=424 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1768005dc0 tx=0x7f176800bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:22:53.618 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:53.615+0000 7f17667fc6c0 1 -- 10.20.193.11:0/1167182363 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1768004250 con 0x7f177810f230 2026-02-13T02:22:53.618 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:53.615+0000 7f17667fc6c0 1 -- 10.20.193.11:0/1167182363 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f1768009070 con 0x7f177810f230 2026-02-13T02:22:53.618 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:53.615+0000 7f177fa2d6c0 1 -- 10.20.193.11:0/1167182363 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17780fae70 con 0x7f177810f230 2026-02-13T02:22:53.618 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:53.615+0000 7f17667fc6c0 1 -- 10.20.193.11:0/1167182363 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f176800ce10 con 0x7f177810f230 2026-02-13T02:22:53.618 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:53.615+0000 7f177fa2d6c0 1 -- 10.20.193.11:0/1167182363 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17780fb600 con 0x7f177810f230 2026-02-13T02:22:53.618 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:53.616+0000 7f177fa2d6c0 1 -- 10.20.193.11:0/1167182363 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1778110500 con 0x7f177810f230 2026-02-13T02:22:53.619 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:53.617+0000 7f17667fc6c0 1 -- 10.20.193.11:0/1167182363 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7f17680028c0 con 0x7f177810f230 2026-02-13T02:22:53.619 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:53.618+0000 7f17667fc6c0 1 --2- 10.20.193.11:0/1167182363 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f17540b5680 0x7f17540d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:22:53.620 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:53.618+0000 7f17667fc6c0 1 -- 10.20.193.11:0/1167182363 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7965+0+0 (secure 0 0 0) 0x7f17680e3950 con 0x7f177810f230 2026-02-13T02:22:53.620 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:53.618+0000 7f177cf9d6c0 1 --2- 10.20.193.11:0/1167182363 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f17540b5680 0x7f17540d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:22:53.620 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:53.618+0000 7f177cf9d6c0 1 --2- 10.20.193.11:0/1167182363 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f17540b5680 0x7f17540d5b30 secure :-1 s=READY pgs=274 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f176c0023e0 tx=0x7f176c031f90 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:22:53.620 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:53.619+0000 7f17667fc6c0 1 -- 10.20.193.11:0/1167182363 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f17680a6450 con 0x7f177810f230 2026-02-13T02:22:53.701 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:22:53 trial011 ceph-mon[11956]: pgmap v307: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T02:22:53.735 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:53.733+0000 7f177fa2d6c0 1 -- 10.20.193.11:0/1167182363 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f17780f5ce0 con 0x7f177810f230 2026-02-13T02:22:53.735 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:53.733+0000 7f17667fc6c0 1 -- 10.20.193.11:0/1167182363 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f17680a9600 con 0x7f177810f230 2026-02-13T02:22:53.735 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:22:53.735 INFO:teuthology.orchestra.run.trial011.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:22:53.736 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:53.734+0000 7f177fa2d6c0 1 -- 10.20.193.11:0/1167182363 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f17540b5680 msgr2=0x7f17540d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:22:53.736 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:53.734+0000 7f177fa2d6c0 1 --2- 10.20.193.11:0/1167182363 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f17540b5680 0x7f17540d5b30 secure :-1 s=READY pgs=274 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f176c0023e0 tx=0x7f176c031f90 comp rx=0 tx=0).stop 2026-02-13T02:22:53.736 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:53.734+0000 7f177fa2d6c0 1 -- 10.20.193.11:0/1167182363 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f177810f230 msgr2=0x7f17780f4be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:22:53.736 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:53.734+0000 7f177fa2d6c0 1 --2- 10.20.193.11:0/1167182363 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f177810f230 0x7f17780f4be0 secure :-1 s=READY pgs=424 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1768005dc0 tx=0x7f176800bbb0 comp rx=0 tx=0).stop 2026-02-13T02:22:53.736 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:53.734+0000 7f177fa2d6c0 1 -- 10.20.193.11:0/1167182363 shutdown_connections 2026-02-13T02:22:53.736 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:53.734+0000 7f177fa2d6c0 1 --2- 10.20.193.11:0/1167182363 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f17540b5680 0x7f17540d5b30 unknown :-1 s=CLOSED pgs=274 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:53.736 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:53.734+0000 7f177fa2d6c0 1 --2- 10.20.193.11:0/1167182363 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f17780f5210 0x7f17780fa490 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:53.736 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:53.734+0000 7f177fa2d6c0 1 --2- 10.20.193.11:0/1167182363 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f1778115440 0x7f1778175ce0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:53.736 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:53.734+0000 7f177fa2d6c0 1 --2- 10.20.193.11:0/1167182363 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f177810f230 0x7f17780f4be0 unknown :-1 s=CLOSED pgs=424 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:53.736 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:53.734+0000 7f177fa2d6c0 1 -- 10.20.193.11:0/1167182363 >> 10.20.193.11:0/1167182363 conn(0x7f17780ecb30 msgr2=0x7f1778113c60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:22:53.736 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:53.734+0000 7f177fa2d6c0 1 -- 10.20.193.11:0/1167182363 shutdown_connections 2026-02-13T02:22:53.736 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:53.734+0000 7f177fa2d6c0 1 -- 10.20.193.11:0/1167182363 wait complete. 2026-02-13T02:22:53.999 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:22:53 trial060 ceph-mon[14797]: pgmap v307: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T02:22:54.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:22:53 trial078 ceph-mon[14969]: pgmap v307: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T02:22:54.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:22:54 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/1167182363' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:22:55.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:22:54 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/1167182363' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:22:55.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:22:54 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/1167182363' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:22:55.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:22:55 trial011 ceph-mon[11956]: pgmap v308: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:22:56.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:22:55 trial060 ceph-mon[14797]: pgmap v308: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:22:56.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:22:55 trial078 ceph-mon[14969]: pgmap v308: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:22:56.773 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:22:56.898 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:22:57.015 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:57.011+0000 7f28b2ab16c0 1 -- 10.20.193.11:0/851121927 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f28ac117c00 msgr2=0x7f28ac117fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:22:57.015 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:57.011+0000 7f28b2ab16c0 1 --2- 10.20.193.11:0/851121927 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f28ac117c00 0x7f28ac117fd0 secure :-1 s=READY pgs=425 gs=1 cs=0 l=1 c_cookie=16959275194030197577 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f289c0099a0 tx=0x7f289c02ed20 comp rx=0 tx=0).stop 2026-02-13T02:22:57.015 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:57.011+0000 7f28b2ab16c0 1 -- 10.20.193.11:0/851121927 shutdown_connections 2026-02-13T02:22:57.015 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:57.011+0000 7f28b2ab16c0 1 --2- 10.20.193.11:0/851121927 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f28ac11de10 0x7f28ac17e7b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:57.015 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:57.011+0000 7f28b2ab16c0 1 --2- 10.20.193.11:0/851121927 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f28ac1185f0 0x7f28ac11d630 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:57.015 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:57.011+0000 7f28b2ab16c0 1 --2- 10.20.193.11:0/851121927 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f28ac117c00 0x7f28ac117fd0 unknown :-1 s=CLOSED pgs=425 gs=1 cs=0 l=1 c_cookie=16959275194030197577 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:57.016 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:57.011+0000 7f28b2ab16c0 1 -- 10.20.193.11:0/851121927 >> 10.20.193.11:0/851121927 conn(0x7f28ac0f54a0 msgr2=0x7f28ac1158b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:22:57.016 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:57.011+0000 7f28b2ab16c0 1 -- 10.20.193.11:0/851121927 shutdown_connections 2026-02-13T02:22:57.016 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:57.011+0000 7f28b2ab16c0 1 -- 10.20.193.11:0/851121927 wait complete. 2026-02-13T02:22:57.016 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:57.011+0000 7f28b2ab16c0 1 Processor -- start 2026-02-13T02:22:57.016 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:57.011+0000 7f28b2ab16c0 1 -- start start 2026-02-13T02:22:57.016 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:57.011+0000 7f28b2ab16c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f28ac117c00 0x7f28ac125bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:22:57.016 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:57.011+0000 7f28b2ab16c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f28ac11de10 0x7f28ac126100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:22:57.016 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:57.011+0000 7f28b2ab16c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f28ac12b4c0 0x7f28ac12b960 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:22:57.016 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:57.011+0000 7f28b2ab16c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f28ac12bed0 con 0x7f28ac12b4c0 2026-02-13T02:22:57.016 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:57.011+0000 7f28b2ab16c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f28ac12c040 con 0x7f28ac117c00 2026-02-13T02:22:57.016 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:57.011+0000 7f28b2ab16c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f28ac12c200 con 0x7f28ac11de10 2026-02-13T02:22:57.017 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:57.012+0000 7f28b10236c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f28ac12b4c0 0x7f28ac12b960 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:22:57.017 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:57.012+0000 7f28b10236c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f28ac12b4c0 0x7f28ac12b960 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:41604/0 (socket says 10.20.193.11:41604) 2026-02-13T02:22:57.017 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:57.012+0000 7f28b10236c0 1 -- 10.20.193.11:0/787872895 learned_addr learned my addr 10.20.193.11:0/787872895 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:22:57.017 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:57.012+0000 7f28b08226c0 1 --2- 10.20.193.11:0/787872895 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f28ac117c00 0x7f28ac125bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:22:57.017 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:57.012+0000 7f28a3fff6c0 1 --2- 10.20.193.11:0/787872895 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f28ac11de10 0x7f28ac126100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:22:57.017 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:57.012+0000 7f28b10236c0 1 -- 10.20.193.11:0/787872895 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f28ac11de10 msgr2=0x7f28ac126100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:22:57.017 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:57.012+0000 7f28b10236c0 1 --2- 10.20.193.11:0/787872895 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f28ac11de10 0x7f28ac126100 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:57.017 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:57.012+0000 7f28b10236c0 1 -- 10.20.193.11:0/787872895 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f28ac117c00 msgr2=0x7f28ac125bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:22:57.017 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:57.012+0000 7f28b10236c0 1 --2- 10.20.193.11:0/787872895 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f28ac117c00 0x7f28ac125bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:57.017 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:57.012+0000 7f28b10236c0 1 -- 10.20.193.11:0/787872895 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f289c009590 con 0x7f28ac12b4c0 2026-02-13T02:22:57.017 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:57.012+0000 7f28b10236c0 1 --2- 10.20.193.11:0/787872895 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f28ac12b4c0 0x7f28ac12b960 secure :-1 s=READY pgs=426 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f28a8006ea0 tx=0x7f28a800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:22:57.017 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:57.012+0000 7f28a1ffb6c0 1 -- 10.20.193.11:0/787872895 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f28a8003a30 con 0x7f28ac12b4c0 2026-02-13T02:22:57.018 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:57.012+0000 7f28a1ffb6c0 1 -- 10.20.193.11:0/787872895 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f28a8005510 con 0x7f28ac12b4c0 2026-02-13T02:22:57.018 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:57.012+0000 7f28a1ffb6c0 1 -- 10.20.193.11:0/787872895 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f28a800dd70 con 0x7f28ac12b4c0 2026-02-13T02:22:57.018 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:57.012+0000 7f28b2ab16c0 1 -- 10.20.193.11:0/787872895 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28ac16c6b0 con 0x7f28ac12b4c0 2026-02-13T02:22:57.018 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:57.012+0000 7f28b2ab16c0 1 -- 10.20.193.11:0/787872895 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28ac16cb40 con 0x7f28ac12b4c0 2026-02-13T02:22:57.018 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:57.012+0000 7f28b2ab16c0 1 -- 10.20.193.11:0/787872895 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28ac118ed0 con 0x7f28ac12b4c0 2026-02-13T02:22:57.019 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:57.014+0000 7f28a1ffb6c0 1 -- 10.20.193.11:0/787872895 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7f28a8003b90 con 0x7f28ac12b4c0 2026-02-13T02:22:57.019 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:57.014+0000 7f28a1ffb6c0 1 --2- 10.20.193.11:0/787872895 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f28880b5680 0x7f28880d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:22:57.019 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:57.014+0000 7f28a1ffb6c0 1 -- 10.20.193.11:0/787872895 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7965+0+0 (secure 0 0 0) 0x7f28a80e4b10 con 0x7f28ac12b4c0 2026-02-13T02:22:57.019 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:57.014+0000 7f28b08226c0 1 --2- 10.20.193.11:0/787872895 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f28880b5680 0x7f28880d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:22:57.019 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:57.014+0000 7f28b08226c0 1 --2- 10.20.193.11:0/787872895 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f28880b5680 0x7f28880d5b30 secure :-1 s=READY pgs=275 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f289c0023e0 tx=0x7f289c031f90 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:22:57.019 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:57.015+0000 7f28a1ffb6c0 1 -- 10.20.193.11:0/787872895 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f28a80a75d0 con 0x7f28ac12b4c0 2026-02-13T02:22:57.133 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:57.131+0000 7f28b2ab16c0 1 -- 10.20.193.11:0/787872895 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f28ac117fd0 con 0x7f28ac12b4c0 2026-02-13T02:22:57.133 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:57.131+0000 7f28a1ffb6c0 1 -- 10.20.193.11:0/787872895 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f28a80aa780 con 0x7f28ac12b4c0 2026-02-13T02:22:57.134 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:22:57.134 INFO:teuthology.orchestra.run.trial011.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:22:57.135 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:57.133+0000 7f28b2ab16c0 1 -- 10.20.193.11:0/787872895 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f28880b5680 msgr2=0x7f28880d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:22:57.135 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:57.133+0000 7f28b2ab16c0 1 --2- 10.20.193.11:0/787872895 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f28880b5680 0x7f28880d5b30 secure :-1 s=READY pgs=275 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f289c0023e0 tx=0x7f289c031f90 comp rx=0 tx=0).stop 2026-02-13T02:22:57.135 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:57.133+0000 7f28b2ab16c0 1 -- 10.20.193.11:0/787872895 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f28ac12b4c0 msgr2=0x7f28ac12b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:22:57.135 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:57.133+0000 7f28b2ab16c0 1 --2- 10.20.193.11:0/787872895 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f28ac12b4c0 0x7f28ac12b960 secure :-1 s=READY pgs=426 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f28a8006ea0 tx=0x7f28a800cca0 comp rx=0 tx=0).stop 2026-02-13T02:22:57.135 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:57.133+0000 7f28b2ab16c0 1 -- 10.20.193.11:0/787872895 shutdown_connections 2026-02-13T02:22:57.135 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:57.133+0000 7f28b2ab16c0 1 --2- 10.20.193.11:0/787872895 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f28880b5680 0x7f28880d5b30 unknown :-1 s=CLOSED pgs=275 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:57.135 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:57.133+0000 7f28b2ab16c0 1 --2- 10.20.193.11:0/787872895 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f28ac12b4c0 0x7f28ac12b960 unknown :-1 s=CLOSED pgs=426 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:57.136 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:57.133+0000 7f28b2ab16c0 1 --2- 10.20.193.11:0/787872895 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f28ac11de10 0x7f28ac126100 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:57.136 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:57.133+0000 7f28b2ab16c0 1 --2- 10.20.193.11:0/787872895 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f28ac117c00 0x7f28ac125bc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:22:57.136 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:57.133+0000 7f28b2ab16c0 1 -- 10.20.193.11:0/787872895 >> 10.20.193.11:0/787872895 conn(0x7f28ac0f54a0 msgr2=0x7f28ac115880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:22:57.136 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:57.133+0000 7f28b2ab16c0 1 -- 10.20.193.11:0/787872895 shutdown_connections 2026-02-13T02:22:57.136 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:22:57.133+0000 7f28b2ab16c0 1 -- 10.20.193.11:0/787872895 wait complete. 2026-02-13T02:22:57.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:22:57 trial011 ceph-mon[11956]: pgmap v309: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:22:57.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:22:57 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/787872895' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:22:58.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:22:57 trial060 ceph-mon[14797]: pgmap v309: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:22:58.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:22:57 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/787872895' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:22:58.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:22:57 trial078 ceph-mon[14969]: pgmap v309: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:22:58.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:22:57 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/787872895' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:22:59.951 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:22:59 trial011 ceph-mon[11956]: pgmap v310: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:23:00.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:22:59 trial060 ceph-mon[14797]: pgmap v310: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:23:00.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:22:59 trial078 ceph-mon[14969]: pgmap v310: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:23:00.193 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:23:00.316 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:23:00.444 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:00.442+0000 7f45ce2956c0 1 -- 10.20.193.11:0/1768564185 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f45c810f200 msgr2=0x7f45c810f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:23:00.444 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:00.442+0000 7f45ce2956c0 1 --2- 10.20.193.11:0/1768564185 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f45c810f200 0x7f45c810f5d0 secure :-1 s=READY pgs=427 gs=1 cs=0 l=1 c_cookie=9927948649561010770 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f45b40099a0 tx=0x7f45b402ed20 comp rx=0 tx=0).stop 2026-02-13T02:23:00.444 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:00.442+0000 7f45ce2956c0 1 -- 10.20.193.11:0/1768564185 shutdown_connections 2026-02-13T02:23:00.444 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:00.442+0000 7f45ce2956c0 1 --2- 10.20.193.11:0/1768564185 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f45c8115410 0x7f45c8175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:00.444 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:00.442+0000 7f45ce2956c0 1 --2- 10.20.193.11:0/1768564185 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f45c810fbf0 0x7f45c8114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:00.444 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:00.442+0000 7f45ce2956c0 1 --2- 10.20.193.11:0/1768564185 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f45c810f200 0x7f45c810f5d0 unknown :-1 s=CLOSED pgs=427 gs=1 cs=0 l=1 c_cookie=9927948649561010770 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:00.444 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:00.442+0000 7f45ce2956c0 1 -- 10.20.193.11:0/1768564185 >> 10.20.193.11:0/1768564185 conn(0x7f45c80ecb00 msgr2=0x7f45c810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:23:00.444 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:00.442+0000 7f45ce2956c0 1 -- 10.20.193.11:0/1768564185 shutdown_connections 2026-02-13T02:23:00.444 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:00.442+0000 7f45ce2956c0 1 -- 10.20.193.11:0/1768564185 wait complete. 2026-02-13T02:23:00.444 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:00.442+0000 7f45ce2956c0 1 Processor -- start 2026-02-13T02:23:00.444 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:00.442+0000 7f45ce2956c0 1 -- start start 2026-02-13T02:23:00.444 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:00.442+0000 7f45ce2956c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f45c810f200 0x7f45c811d1c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:23:00.444 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:00.442+0000 7f45ce2956c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f45c8115410 0x7f45c811d700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:23:00.444 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:00.442+0000 7f45ce2956c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f45c8122ac0 0x7f45c8122f60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:23:00.444 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:00.442+0000 7f45ce2956c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f45c81234d0 con 0x7f45c810f200 2026-02-13T02:23:00.444 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:00.442+0000 7f45ce2956c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f45c8123640 con 0x7f45c8122ac0 2026-02-13T02:23:00.444 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:00.443+0000 7f45ce2956c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f45c8123800 con 0x7f45c8115410 2026-02-13T02:23:00.445 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:00.443+0000 7f45c7fff6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f45c810f200 0x7f45c811d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:23:00.445 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:00.443+0000 7f45c7fff6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f45c810f200 0x7f45c811d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:41624/0 (socket says 10.20.193.11:41624) 2026-02-13T02:23:00.445 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:00.443+0000 7f45c7fff6c0 1 -- 10.20.193.11:0/923960976 learned_addr learned my addr 10.20.193.11:0/923960976 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:23:00.445 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:00.443+0000 7f45c77fe6c0 1 --2- 10.20.193.11:0/923960976 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f45c8115410 0x7f45c811d700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:23:00.445 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:00.443+0000 7f45cc8076c0 1 --2- 10.20.193.11:0/923960976 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f45c8122ac0 0x7f45c8122f60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:23:00.445 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:00.443+0000 7f45c7fff6c0 1 -- 10.20.193.11:0/923960976 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f45c8115410 msgr2=0x7f45c811d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:23:00.445 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:00.443+0000 7f45c7fff6c0 1 --2- 10.20.193.11:0/923960976 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f45c8115410 0x7f45c811d700 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:00.445 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:00.443+0000 7f45c7fff6c0 1 -- 10.20.193.11:0/923960976 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f45c8122ac0 msgr2=0x7f45c8122f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:23:00.445 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:00.443+0000 7f45c7fff6c0 1 --2- 10.20.193.11:0/923960976 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f45c8122ac0 0x7f45c8122f60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:00.445 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:00.443+0000 7f45c7fff6c0 1 -- 10.20.193.11:0/923960976 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45b4009590 con 0x7f45c810f200 2026-02-13T02:23:00.445 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:00.443+0000 7f45cc8076c0 1 --2- 10.20.193.11:0/923960976 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f45c8122ac0 0x7f45c8122f60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:23:00.445 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:00.443+0000 7f45c7fff6c0 1 --2- 10.20.193.11:0/923960976 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f45c810f200 0x7f45c811d1c0 secure :-1 s=READY pgs=428 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f45b4031fd0 tx=0x7f45b402fc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:23:00.445 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:00.443+0000 7f45c57fa6c0 1 -- 10.20.193.11:0/923960976 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f45b4002ae0 con 0x7f45c810f200 2026-02-13T02:23:00.445 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:00.443+0000 7f45c57fa6c0 1 -- 10.20.193.11:0/923960976 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f45b40046b0 con 0x7f45c810f200 2026-02-13T02:23:00.445 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:00.443+0000 7f45ce2956c0 1 -- 10.20.193.11:0/923960976 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45c8163c50 con 0x7f45c810f200 2026-02-13T02:23:00.445 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:00.443+0000 7f45c57fa6c0 1 -- 10.20.193.11:0/923960976 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f45b40372f0 con 0x7f45c810f200 2026-02-13T02:23:00.445 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:00.443+0000 7f45ce2956c0 1 -- 10.20.193.11:0/923960976 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45c81640d0 con 0x7f45c810f200 2026-02-13T02:23:00.445 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:00.443+0000 7f45ce2956c0 1 -- 10.20.193.11:0/923960976 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45c81104d0 con 0x7f45c810f200 2026-02-13T02:23:00.446 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:00.445+0000 7f45c57fa6c0 1 -- 10.20.193.11:0/923960976 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7f45b4002c40 con 0x7f45c810f200 2026-02-13T02:23:00.447 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:00.445+0000 7f45c57fa6c0 1 --2- 10.20.193.11:0/923960976 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f459c0b5680 0x7f459c0d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:23:00.447 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:00.446+0000 7f45c77fe6c0 1 --2- 10.20.193.11:0/923960976 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f459c0b5680 0x7f459c0d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:23:00.447 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:00.446+0000 7f45c57fa6c0 1 -- 10.20.193.11:0/923960976 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7965+0+0 (secure 0 0 0) 0x7f45b4107b30 con 0x7f45c810f200 2026-02-13T02:23:00.447 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:00.446+0000 7f45c57fa6c0 1 -- 10.20.193.11:0/923960976 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f45b40ce090 con 0x7f45c810f200 2026-02-13T02:23:00.447 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:00.446+0000 7f45c77fe6c0 1 --2- 10.20.193.11:0/923960976 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f459c0b5680 0x7f459c0d5b30 secure :-1 s=READY pgs=276 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f45c8123b50 tx=0x7f45b8009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:23:00.562 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:00.560+0000 7f45ce2956c0 1 -- 10.20.193.11:0/923960976 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f45c810f5d0 con 0x7f45c810f200 2026-02-13T02:23:00.562 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:00.560+0000 7f45c57fa6c0 1 -- 10.20.193.11:0/923960976 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f45b40d0100 con 0x7f45c810f200 2026-02-13T02:23:00.562 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:23:00.562 INFO:teuthology.orchestra.run.trial011.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:23:00.563 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:00.561+0000 7f45ce2956c0 1 -- 10.20.193.11:0/923960976 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f459c0b5680 msgr2=0x7f459c0d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:23:00.563 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:00.562+0000 7f45ce2956c0 1 --2- 10.20.193.11:0/923960976 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f459c0b5680 0x7f459c0d5b30 secure :-1 s=READY pgs=276 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f45c8123b50 tx=0x7f45b8009260 comp rx=0 tx=0).stop 2026-02-13T02:23:00.563 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:00.562+0000 7f45ce2956c0 1 -- 10.20.193.11:0/923960976 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f45c810f200 msgr2=0x7f45c811d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:23:00.563 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:00.562+0000 7f45ce2956c0 1 --2- 10.20.193.11:0/923960976 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f45c810f200 0x7f45c811d1c0 secure :-1 s=READY pgs=428 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f45b4031fd0 tx=0x7f45b402fc80 comp rx=0 tx=0).stop 2026-02-13T02:23:00.563 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:00.562+0000 7f45ce2956c0 1 -- 10.20.193.11:0/923960976 shutdown_connections 2026-02-13T02:23:00.563 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:00.562+0000 7f45ce2956c0 1 --2- 10.20.193.11:0/923960976 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f459c0b5680 0x7f459c0d5b30 unknown :-1 s=CLOSED pgs=276 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:00.563 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:00.562+0000 7f45ce2956c0 1 --2- 10.20.193.11:0/923960976 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f45c8122ac0 0x7f45c8122f60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:00.563 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:00.562+0000 7f45ce2956c0 1 --2- 10.20.193.11:0/923960976 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f45c8115410 0x7f45c811d700 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:00.563 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:00.562+0000 7f45ce2956c0 1 --2- 10.20.193.11:0/923960976 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f45c810f200 0x7f45c811d1c0 unknown :-1 s=CLOSED pgs=428 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:00.563 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:00.562+0000 7f45ce2956c0 1 -- 10.20.193.11:0/923960976 >> 10.20.193.11:0/923960976 conn(0x7f45c80ecb00 msgr2=0x7f45c810cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:23:00.563 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:00.562+0000 7f45ce2956c0 1 -- 10.20.193.11:0/923960976 shutdown_connections 2026-02-13T02:23:00.563 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:00.562+0000 7f45ce2956c0 1 -- 10.20.193.11:0/923960976 wait complete. 2026-02-13T02:23:00.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:23:00 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:23:00.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:23:00 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/923960976' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:23:00.987 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:23:00 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:23:00.987 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:23:00 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/923960976' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:23:01.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:23:00 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:23:01.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:23:00 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/923960976' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:23:01.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:23:01 trial011 ceph-mon[11956]: pgmap v311: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:23:01.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:23:01 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:23:01.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:23:01 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:23:01.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:23:01 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:23:01.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:23:01 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:23:01.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:23:01 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:23:01.953 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:23:01 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:23:02.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:23:01 trial060 ceph-mon[14797]: pgmap v311: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:23:02.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:23:01 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:23:02.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:23:01 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:23:02.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:23:01 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:23:02.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:23:01 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:23:02.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:23:01 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:23:02.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:23:01 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:23:02.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:23:01 trial078 ceph-mon[14969]: pgmap v311: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:23:02.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:23:01 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:23:02.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:23:01 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:23:02.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:23:01 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:23:02.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:23:01 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:23:02.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:23:01 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:23:02.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:23:01 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:23:02.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:23:02 trial011 ceph-mon[11956]: pgmap v312: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 9 op/s 2026-02-13T02:23:02.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:23:02 trial011 ceph-mon[11956]: pgmap v313: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.1 KiB/s rd, 10 op/s 2026-02-13T02:23:03.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:23:02 trial060 ceph-mon[14797]: pgmap v312: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 9 op/s 2026-02-13T02:23:03.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:23:02 trial060 ceph-mon[14797]: pgmap v313: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.1 KiB/s rd, 10 op/s 2026-02-13T02:23:03.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:23:02 trial078 ceph-mon[14969]: pgmap v312: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 9 op/s 2026-02-13T02:23:03.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:23:02 trial078 ceph-mon[14969]: pgmap v313: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.1 KiB/s rd, 10 op/s 2026-02-13T02:23:03.603 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:23:03.726 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:23:03.845 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:03.842+0000 7f37bdf7b6c0 1 -- 10.20.193.11:0/1838377250 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f37b810f230 msgr2=0x7f37b810f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:23:03.846 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:03.842+0000 7f37bdf7b6c0 1 --2- 10.20.193.11:0/1838377250 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f37b810f230 0x7f37b810f600 secure :-1 s=READY pgs=429 gs=1 cs=0 l=1 c_cookie=14545863269712731824 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f37a40099a0 tx=0x7f37a402ed20 comp rx=0 tx=0).stop 2026-02-13T02:23:03.846 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:03.842+0000 7f37bdf7b6c0 1 -- 10.20.193.11:0/1838377250 shutdown_connections 2026-02-13T02:23:03.846 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:03.842+0000 7f37bdf7b6c0 1 --2- 10.20.193.11:0/1838377250 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f37b8115440 0x7f37b8175de0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:03.846 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:03.842+0000 7f37bdf7b6c0 1 --2- 10.20.193.11:0/1838377250 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f37b810fc20 0x7f37b8114c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:03.846 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:03.842+0000 7f37bdf7b6c0 1 --2- 10.20.193.11:0/1838377250 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f37b810f230 0x7f37b810f600 unknown :-1 s=CLOSED pgs=429 gs=1 cs=0 l=1 c_cookie=14545863269712731824 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:03.846 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:03.842+0000 7f37bdf7b6c0 1 -- 10.20.193.11:0/1838377250 >> 10.20.193.11:0/1838377250 conn(0x7f37b80ecb30 msgr2=0x7f37b810cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:23:03.846 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:03.842+0000 7f37bdf7b6c0 1 -- 10.20.193.11:0/1838377250 shutdown_connections 2026-02-13T02:23:03.846 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:03.842+0000 7f37bdf7b6c0 1 -- 10.20.193.11:0/1838377250 wait complete. 2026-02-13T02:23:03.846 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:03.842+0000 7f37bdf7b6c0 1 Processor -- start 2026-02-13T02:23:03.846 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:03.842+0000 7f37bdf7b6c0 1 -- start start 2026-02-13T02:23:03.846 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:03.842+0000 7f37bdf7b6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f37b810f230 0x7f37b811d1e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:23:03.847 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:03.842+0000 7f37bdf7b6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f37b8115440 0x7f37b811d720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:23:03.847 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:03.842+0000 7f37bdf7b6c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f37b8122ae0 0x7f37b8122f80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:23:03.847 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:03.842+0000 7f37bdf7b6c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f37b81234f0 con 0x7f37b810f230 2026-02-13T02:23:03.847 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:03.842+0000 7f37bdf7b6c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f37b8123660 con 0x7f37b8122ae0 2026-02-13T02:23:03.847 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:03.842+0000 7f37bdf7b6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f37b8123820 con 0x7f37b8115440 2026-02-13T02:23:03.847 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:03.842+0000 7f37b77fe6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f37b810f230 0x7f37b811d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:23:03.847 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:03.842+0000 7f37b77fe6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f37b810f230 0x7f37b811d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:50442/0 (socket says 10.20.193.11:50442) 2026-02-13T02:23:03.847 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:03.842+0000 7f37b77fe6c0 1 -- 10.20.193.11:0/3451601828 learned_addr learned my addr 10.20.193.11:0/3451601828 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:23:03.847 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:03.843+0000 7f37b7fff6c0 1 --2- 10.20.193.11:0/3451601828 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f37b8122ae0 0x7f37b8122f80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:23:03.847 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:03.843+0000 7f37b77fe6c0 1 -- 10.20.193.11:0/3451601828 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f37b8115440 msgr2=0x7f37b811d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:23:03.847 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:03.843+0000 7f37b77fe6c0 1 --2- 10.20.193.11:0/3451601828 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f37b8115440 0x7f37b811d720 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:03.848 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:03.843+0000 7f37b77fe6c0 1 -- 10.20.193.11:0/3451601828 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f37b8122ae0 msgr2=0x7f37b8122f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:23:03.848 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:03.843+0000 7f37b77fe6c0 1 --2- 10.20.193.11:0/3451601828 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f37b8122ae0 0x7f37b8122f80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:03.848 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:03.843+0000 7f37b77fe6c0 1 -- 10.20.193.11:0/3451601828 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37a4009590 con 0x7f37b810f230 2026-02-13T02:23:03.848 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:03.843+0000 7f37b77fe6c0 1 --2- 10.20.193.11:0/3451601828 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f37b810f230 0x7f37b811d1e0 secure :-1 s=READY pgs=430 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f37a4031fd0 tx=0x7f37a40047f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:23:03.848 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:03.843+0000 7f37b4ff96c0 1 -- 10.20.193.11:0/3451601828 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f37a4002ae0 con 0x7f37b810f230 2026-02-13T02:23:03.848 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:03.843+0000 7f37b4ff96c0 1 -- 10.20.193.11:0/3451601828 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f37a4002c40 con 0x7f37b810f230 2026-02-13T02:23:03.848 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:03.843+0000 7f37b4ff96c0 1 -- 10.20.193.11:0/3451601828 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f37a40372f0 con 0x7f37b810f230 2026-02-13T02:23:03.848 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:03.843+0000 7f37bdf7b6c0 1 -- 10.20.193.11:0/3451601828 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37b8163c70 con 0x7f37b810f230 2026-02-13T02:23:03.848 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:03.843+0000 7f37bdf7b6c0 1 -- 10.20.193.11:0/3451601828 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37b81640a0 con 0x7f37b810f230 2026-02-13T02:23:03.848 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:03.843+0000 7f37bdf7b6c0 1 -- 10.20.193.11:0/3451601828 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37b8110500 con 0x7f37b810f230 2026-02-13T02:23:03.849 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:03.844+0000 7f37b4ff96c0 1 -- 10.20.193.11:0/3451601828 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7f37a40077d0 con 0x7f37b810f230 2026-02-13T02:23:03.850 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:03.845+0000 7f37b4ff96c0 1 --2- 10.20.193.11:0/3451601828 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f378c0b5600 0x7f378c0d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:23:03.850 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:03.845+0000 7f37b6ffd6c0 1 --2- 10.20.193.11:0/3451601828 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f378c0b5600 0x7f378c0d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:23:03.850 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:03.845+0000 7f37b4ff96c0 1 -- 10.20.193.11:0/3451601828 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7965+0+0 (secure 0 0 0) 0x7f37a4107d20 con 0x7f37b810f230 2026-02-13T02:23:03.850 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:03.845+0000 7f37b6ffd6c0 1 --2- 10.20.193.11:0/3451601828 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f378c0b5600 0x7f378c0d5ab0 secure :-1 s=READY pgs=277 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f37a8005dc0 tx=0x7f37a8005d30 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:23:03.850 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:03.846+0000 7f37b4ff96c0 1 -- 10.20.193.11:0/3451601828 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f37a40ce240 con 0x7f37b810f230 2026-02-13T02:23:03.964 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:03.962+0000 7f37bdf7b6c0 1 -- 10.20.193.11:0/3451601828 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f37b810fc20 con 0x7f37b810f230 2026-02-13T02:23:03.964 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:03.962+0000 7f37b4ff96c0 1 -- 10.20.193.11:0/3451601828 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f37a4094810 con 0x7f37b810f230 2026-02-13T02:23:03.964 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:23:03.964 INFO:teuthology.orchestra.run.trial011.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:23:03.965 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:03.963+0000 7f37bdf7b6c0 1 -- 10.20.193.11:0/3451601828 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f378c0b5600 msgr2=0x7f378c0d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:23:03.965 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:03.963+0000 7f37bdf7b6c0 1 --2- 10.20.193.11:0/3451601828 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f378c0b5600 0x7f378c0d5ab0 secure :-1 s=READY pgs=277 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f37a8005dc0 tx=0x7f37a8005d30 comp rx=0 tx=0).stop 2026-02-13T02:23:03.965 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:03.963+0000 7f37bdf7b6c0 1 -- 10.20.193.11:0/3451601828 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f37b810f230 msgr2=0x7f37b811d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:23:03.966 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:03.963+0000 7f37bdf7b6c0 1 --2- 10.20.193.11:0/3451601828 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f37b810f230 0x7f37b811d1e0 secure :-1 s=READY pgs=430 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f37a4031fd0 tx=0x7f37a40047f0 comp rx=0 tx=0).stop 2026-02-13T02:23:03.966 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:03.963+0000 7f37bdf7b6c0 1 -- 10.20.193.11:0/3451601828 shutdown_connections 2026-02-13T02:23:03.966 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:03.963+0000 7f37bdf7b6c0 1 --2- 10.20.193.11:0/3451601828 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f378c0b5600 0x7f378c0d5ab0 unknown :-1 s=CLOSED pgs=277 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:03.966 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:03.963+0000 7f37bdf7b6c0 1 --2- 10.20.193.11:0/3451601828 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f37b8122ae0 0x7f37b8122f80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:03.966 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:03.963+0000 7f37bdf7b6c0 1 --2- 10.20.193.11:0/3451601828 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f37b8115440 0x7f37b811d720 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:03.966 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:03.963+0000 7f37bdf7b6c0 1 --2- 10.20.193.11:0/3451601828 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f37b810f230 0x7f37b811d1e0 unknown :-1 s=CLOSED pgs=430 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:03.966 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:03.963+0000 7f37bdf7b6c0 1 -- 10.20.193.11:0/3451601828 >> 10.20.193.11:0/3451601828 conn(0x7f37b80ecb30 msgr2=0x7f37b810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:23:03.966 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:03.963+0000 7f37bdf7b6c0 1 -- 10.20.193.11:0/3451601828 shutdown_connections 2026-02-13T02:23:03.966 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:03.963+0000 7f37bdf7b6c0 1 -- 10.20.193.11:0/3451601828 wait complete. 2026-02-13T02:23:04.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:23:04 trial011 ceph-mon[11956]: pgmap v314: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.1 KiB/s rd, 10 op/s 2026-02-13T02:23:04.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:23:04 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/3451601828' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:23:05.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:23:04 trial060 ceph-mon[14797]: pgmap v314: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.1 KiB/s rd, 10 op/s 2026-02-13T02:23:05.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:23:04 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/3451601828' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:23:05.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:23:04 trial078 ceph-mon[14969]: pgmap v314: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.1 KiB/s rd, 10 op/s 2026-02-13T02:23:05.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:23:04 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/3451601828' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:23:06.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:23:06 trial011 ceph-mon[11956]: pgmap v315: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.0 KiB/s rd, 9 op/s 2026-02-13T02:23:07.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:23:06 trial060 ceph-mon[14797]: pgmap v315: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.0 KiB/s rd, 9 op/s 2026-02-13T02:23:07.004 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:23:07.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:23:06 trial078 ceph-mon[14969]: pgmap v315: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.0 KiB/s rd, 9 op/s 2026-02-13T02:23:07.131 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:23:07.253 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:07.248+0000 7fb4672856c0 1 -- 10.20.193.11:0/1410831567 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fb460159b20 msgr2=0x7fb460179f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:23:07.253 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:07.248+0000 7fb4672856c0 1 --2- 10.20.193.11:0/1410831567 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fb460159b20 0x7fb460179f00 secure :-1 s=READY pgs=431 gs=1 cs=0 l=1 c_cookie=16604102737659821450 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb45c00aa40 tx=0x7fb45c02fde0 comp rx=0 tx=0).stop 2026-02-13T02:23:07.253 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:07.248+0000 7fb4672856c0 1 -- 10.20.193.11:0/1410831567 shutdown_connections 2026-02-13T02:23:07.253 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:07.248+0000 7fb4672856c0 1 --2- 10.20.193.11:0/1410831567 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fb460159b20 0x7fb460179f00 unknown :-1 s=CLOSED pgs=431 gs=1 cs=0 l=1 c_cookie=16604102737659821450 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:07.253 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:07.248+0000 7fb4672856c0 1 --2- 10.20.193.11:0/1410831567 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb4600675f0 0x7fb4601595e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:07.253 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:07.248+0000 7fb4672856c0 1 --2- 10.20.193.11:0/1410831567 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fb460066ce0 0x7fb4600670b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:07.253 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:07.248+0000 7fb4672856c0 1 -- 10.20.193.11:0/1410831567 >> 10.20.193.11:0/1410831567 conn(0x7fb460064810 msgr2=0x7fb460064c10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:23:07.253 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:07.248+0000 7fb4672856c0 1 -- 10.20.193.11:0/1410831567 shutdown_connections 2026-02-13T02:23:07.253 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:07.248+0000 7fb4672856c0 1 -- 10.20.193.11:0/1410831567 wait complete. 2026-02-13T02:23:07.254 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:07.249+0000 7fb4672856c0 1 Processor -- start 2026-02-13T02:23:07.254 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:07.249+0000 7fb4672856c0 1 -- start start 2026-02-13T02:23:07.254 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:07.249+0000 7fb4672856c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb460066ce0 0x7fb4601657e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:23:07.254 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:07.249+0000 7fb4672856c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fb4600675f0 0x7fb460165d20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:23:07.254 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:07.249+0000 7fb4672856c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fb460159b20 0x7fb46016b0e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:23:07.254 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:07.249+0000 7fb4672856c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7fb46016b730 con 0x7fb460159b20 2026-02-13T02:23:07.254 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:07.249+0000 7fb4672856c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb46016b8a0 con 0x7fb4600675f0 2026-02-13T02:23:07.254 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:07.249+0000 7fb4672856c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fb46016ba60 con 0x7fb460066ce0 2026-02-13T02:23:07.254 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:07.249+0000 7fb4657f76c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fb460159b20 0x7fb46016b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:23:07.254 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:07.249+0000 7fb4657f76c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fb460159b20 0x7fb46016b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:50460/0 (socket says 10.20.193.11:50460) 2026-02-13T02:23:07.254 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:07.249+0000 7fb4657f76c0 1 -- 10.20.193.11:0/3176434636 learned_addr learned my addr 10.20.193.11:0/3176434636 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:23:07.254 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:07.249+0000 7fb464ff66c0 1 --2- 10.20.193.11:0/3176434636 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb460066ce0 0x7fb4601657e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:23:07.255 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:07.249+0000 7fb457fff6c0 1 --2- 10.20.193.11:0/3176434636 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fb4600675f0 0x7fb460165d20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:23:07.255 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:07.249+0000 7fb4657f76c0 1 -- 10.20.193.11:0/3176434636 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb460066ce0 msgr2=0x7fb4601657e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:23:07.255 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:07.249+0000 7fb4657f76c0 1 --2- 10.20.193.11:0/3176434636 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb460066ce0 0x7fb4601657e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:07.255 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:07.249+0000 7fb4657f76c0 1 -- 10.20.193.11:0/3176434636 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fb4600675f0 msgr2=0x7fb460165d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:23:07.255 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:07.249+0000 7fb4657f76c0 1 --2- 10.20.193.11:0/3176434636 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fb4600675f0 0x7fb460165d20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:07.255 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:07.249+0000 7fb4657f76c0 1 -- 10.20.193.11:0/3176434636 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb45c00a660 con 0x7fb460159b20 2026-02-13T02:23:07.255 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:07.249+0000 7fb457fff6c0 1 --2- 10.20.193.11:0/3176434636 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fb4600675f0 0x7fb460165d20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:23:07.255 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:07.249+0000 7fb4657f76c0 1 --2- 10.20.193.11:0/3176434636 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fb460159b20 0x7fb46016b0e0 secure :-1 s=READY pgs=432 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb45c0054b0 tx=0x7fb45c0054e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:23:07.255 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:07.249+0000 7fb455ffb6c0 1 -- 10.20.193.11:0/3176434636 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb45c003a30 con 0x7fb460159b20 2026-02-13T02:23:07.255 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:07.249+0000 7fb4672856c0 1 -- 10.20.193.11:0/3176434636 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb46016bce0 con 0x7fb460159b20 2026-02-13T02:23:07.255 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:07.249+0000 7fb455ffb6c0 1 -- 10.20.193.11:0/3176434636 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb45c030990 con 0x7fb460159b20 2026-02-13T02:23:07.255 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:07.249+0000 7fb455ffb6c0 1 -- 10.20.193.11:0/3176434636 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb45c0382f0 con 0x7fb460159b20 2026-02-13T02:23:07.256 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:07.249+0000 7fb4672856c0 1 -- 10.20.193.11:0/3176434636 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb460155750 con 0x7fb460159b20 2026-02-13T02:23:07.256 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:07.250+0000 7fb4672856c0 1 -- 10.20.193.11:0/3176434636 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4600681f0 con 0x7fb460159b20 2026-02-13T02:23:07.257 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:07.251+0000 7fb455ffb6c0 1 -- 10.20.193.11:0/3176434636 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7fb45c003b90 con 0x7fb460159b20 2026-02-13T02:23:07.257 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:07.252+0000 7fb455ffb6c0 1 --2- 10.20.193.11:0/3176434636 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fb43c0b5600 0x7fb43c0d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:23:07.257 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:07.252+0000 7fb455ffb6c0 1 -- 10.20.193.11:0/3176434636 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7965+0+0 (secure 0 0 0) 0x7fb45c108d40 con 0x7fb460159b20 2026-02-13T02:23:07.257 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:07.252+0000 7fb464ff66c0 1 --2- 10.20.193.11:0/3176434636 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fb43c0b5600 0x7fb43c0d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:23:07.257 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:07.252+0000 7fb464ff66c0 1 --2- 10.20.193.11:0/3176434636 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fb43c0b5600 0x7fb43c0d5ab0 secure :-1 s=READY pgs=278 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb450004750 tx=0x7fb450009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:23:07.257 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:07.252+0000 7fb455ffb6c0 1 -- 10.20.193.11:0/3176434636 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fb45c0cb840 con 0x7fb460159b20 2026-02-13T02:23:07.368 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:07.366+0000 7fb4672856c0 1 -- 10.20.193.11:0/3176434636 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fb4600670b0 con 0x7fb460159b20 2026-02-13T02:23:07.369 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:07.367+0000 7fb455ffb6c0 1 -- 10.20.193.11:0/3176434636 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fb45c0ce9f0 con 0x7fb460159b20 2026-02-13T02:23:07.369 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:23:07.369 INFO:teuthology.orchestra.run.trial011.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:23:07.370 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:07.368+0000 7fb4672856c0 1 -- 10.20.193.11:0/3176434636 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fb43c0b5600 msgr2=0x7fb43c0d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:23:07.370 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:07.368+0000 7fb4672856c0 1 --2- 10.20.193.11:0/3176434636 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fb43c0b5600 0x7fb43c0d5ab0 secure :-1 s=READY pgs=278 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb450004750 tx=0x7fb450009260 comp rx=0 tx=0).stop 2026-02-13T02:23:07.370 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:07.368+0000 7fb4672856c0 1 -- 10.20.193.11:0/3176434636 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fb460159b20 msgr2=0x7fb46016b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:23:07.370 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:07.368+0000 7fb4672856c0 1 --2- 10.20.193.11:0/3176434636 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fb460159b20 0x7fb46016b0e0 secure :-1 s=READY pgs=432 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb45c0054b0 tx=0x7fb45c0054e0 comp rx=0 tx=0).stop 2026-02-13T02:23:07.370 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:07.368+0000 7fb4672856c0 1 -- 10.20.193.11:0/3176434636 shutdown_connections 2026-02-13T02:23:07.370 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:07.368+0000 7fb4672856c0 1 --2- 10.20.193.11:0/3176434636 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fb43c0b5600 0x7fb43c0d5ab0 unknown :-1 s=CLOSED pgs=278 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:07.370 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:07.368+0000 7fb4672856c0 1 --2- 10.20.193.11:0/3176434636 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fb4600675f0 0x7fb460165d20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:07.371 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:07.368+0000 7fb4672856c0 1 --2- 10.20.193.11:0/3176434636 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fb460159b20 0x7fb46016b0e0 unknown :-1 s=CLOSED pgs=432 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:07.371 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:07.368+0000 7fb4672856c0 1 --2- 10.20.193.11:0/3176434636 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb460066ce0 0x7fb4601657e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:07.371 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:07.368+0000 7fb4672856c0 1 -- 10.20.193.11:0/3176434636 >> 10.20.193.11:0/3176434636 conn(0x7fb460064810 msgr2=0x7fb46015b7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:23:07.371 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:07.368+0000 7fb4672856c0 1 -- 10.20.193.11:0/3176434636 shutdown_connections 2026-02-13T02:23:07.371 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:07.368+0000 7fb4672856c0 1 -- 10.20.193.11:0/3176434636 wait complete. 2026-02-13T02:23:07.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:23:07 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/3176434636' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:23:08.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:23:07 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/3176434636' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:23:08.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:23:07 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/3176434636' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:23:08.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:23:08 trial011 ceph-mon[11956]: pgmap v316: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 10 op/s 2026-02-13T02:23:09.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:23:08 trial060 ceph-mon[14797]: pgmap v316: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 10 op/s 2026-02-13T02:23:09.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:23:08 trial078 ceph-mon[14969]: pgmap v316: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 10 op/s 2026-02-13T02:23:10.407 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:23:10.533 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:23:10.659 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:10.656+0000 7efdd9dcc6c0 1 -- 10.20.193.11:0/2383584035 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7efdd4115440 msgr2=0x7efdd4175de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:23:10.660 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:10.656+0000 7efdd9dcc6c0 1 --2- 10.20.193.11:0/2383584035 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7efdd4115440 0x7efdd4175de0 secure :-1 s=READY pgs=433 gs=1 cs=0 l=1 c_cookie=12376420816601337401 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efdc800aa70 tx=0x7efdc802fde0 comp rx=0 tx=0).stop 2026-02-13T02:23:10.660 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:10.656+0000 7efdd9dcc6c0 1 -- 10.20.193.11:0/2383584035 shutdown_connections 2026-02-13T02:23:10.660 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:10.656+0000 7efdd9dcc6c0 1 --2- 10.20.193.11:0/2383584035 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7efdd410fc20 0x7efdd4114c60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:10.660 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:10.656+0000 7efdd9dcc6c0 1 --2- 10.20.193.11:0/2383584035 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7efdd4115440 0x7efdd4175de0 unknown :-1 s=CLOSED pgs=433 gs=1 cs=0 l=1 c_cookie=12376420816601337401 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:10.660 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:10.656+0000 7efdd9dcc6c0 1 --2- 10.20.193.11:0/2383584035 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7efdd410f230 0x7efdd410f600 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:10.660 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:10.656+0000 7efdd9dcc6c0 1 -- 10.20.193.11:0/2383584035 >> 10.20.193.11:0/2383584035 conn(0x7efdd40ecb30 msgr2=0x7efdd410cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:23:10.660 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:10.656+0000 7efdd9dcc6c0 1 -- 10.20.193.11:0/2383584035 shutdown_connections 2026-02-13T02:23:10.660 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:10.656+0000 7efdd9dcc6c0 1 -- 10.20.193.11:0/2383584035 wait complete. 2026-02-13T02:23:10.660 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:10.656+0000 7efdd9dcc6c0 1 Processor -- start 2026-02-13T02:23:10.661 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:10.656+0000 7efdd9dcc6c0 1 -- start start 2026-02-13T02:23:10.661 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:10.656+0000 7efdd9dcc6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7efdd410f230 0x7efdd411d130 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:23:10.661 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:10.656+0000 7efdd9dcc6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7efdd4115440 0x7efdd411d670 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:23:10.661 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:10.656+0000 7efdd9dcc6c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7efdd4122a30 0x7efdd4122ed0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:23:10.661 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:10.656+0000 7efdd9dcc6c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7efdd4123440 con 0x7efdd4115440 2026-02-13T02:23:10.661 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:10.656+0000 7efdd9dcc6c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7efdd41235b0 con 0x7efdd4122a30 2026-02-13T02:23:10.661 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:10.656+0000 7efdd9dcc6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7efdd4123770 con 0x7efdd410f230 2026-02-13T02:23:10.661 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:10.656+0000 7efdd2ffd6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7efdd4115440 0x7efdd411d670 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:23:10.661 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:10.656+0000 7efdd2ffd6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7efdd4115440 0x7efdd411d670 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:50474/0 (socket says 10.20.193.11:50474) 2026-02-13T02:23:10.661 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:10.656+0000 7efdd2ffd6c0 1 -- 10.20.193.11:0/3126467983 learned_addr learned my addr 10.20.193.11:0/3126467983 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:23:10.661 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:10.657+0000 7efdd3fff6c0 1 --2- 10.20.193.11:0/3126467983 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7efdd4122a30 0x7efdd4122ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:23:10.662 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:10.657+0000 7efdd2ffd6c0 1 -- 10.20.193.11:0/3126467983 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7efdd410f230 msgr2=0x7efdd411d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:23:10.662 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:10.657+0000 7efdd2ffd6c0 1 --2- 10.20.193.11:0/3126467983 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7efdd410f230 0x7efdd411d130 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:10.662 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:10.657+0000 7efdd2ffd6c0 1 -- 10.20.193.11:0/3126467983 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7efdd4122a30 msgr2=0x7efdd4122ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:23:10.662 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:10.657+0000 7efdd2ffd6c0 1 --2- 10.20.193.11:0/3126467983 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7efdd4122a30 0x7efdd4122ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:10.662 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:10.657+0000 7efdd2ffd6c0 1 -- 10.20.193.11:0/3126467983 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdc800a660 con 0x7efdd4115440 2026-02-13T02:23:10.662 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:10.657+0000 7efdd2ffd6c0 1 --2- 10.20.193.11:0/3126467983 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7efdd4115440 0x7efdd411d670 secure :-1 s=READY pgs=434 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efdc4005dc0 tx=0x7efdc400bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:23:10.662 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:10.657+0000 7efdd0ff96c0 1 -- 10.20.193.11:0/3126467983 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efdc4004250 con 0x7efdd4115440 2026-02-13T02:23:10.662 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:10.657+0000 7efdd0ff96c0 1 -- 10.20.193.11:0/3126467983 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7efdc4009070 con 0x7efdd4115440 2026-02-13T02:23:10.662 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:10.657+0000 7efdd9dcc6c0 1 -- 10.20.193.11:0/3126467983 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdd4163c20 con 0x7efdd4115440 2026-02-13T02:23:10.662 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:10.657+0000 7efdd0ff96c0 1 -- 10.20.193.11:0/3126467983 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efdc400cdc0 con 0x7efdd4115440 2026-02-13T02:23:10.662 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:10.657+0000 7efdd9dcc6c0 1 -- 10.20.193.11:0/3126467983 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdd4164100 con 0x7efdd4115440 2026-02-13T02:23:10.662 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:10.657+0000 7efdd9dcc6c0 1 -- 10.20.193.11:0/3126467983 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdd4110500 con 0x7efdd4115440 2026-02-13T02:23:10.663 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:10.658+0000 7efdd0ff96c0 1 -- 10.20.193.11:0/3126467983 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7efdc40028c0 con 0x7efdd4115440 2026-02-13T02:23:10.664 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:10.659+0000 7efdd0ff96c0 1 --2- 10.20.193.11:0/3126467983 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7efda80b5680 0x7efda80d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:23:10.664 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:10.659+0000 7efdd37fe6c0 1 --2- 10.20.193.11:0/3126467983 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7efda80b5680 0x7efda80d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:23:10.664 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:10.659+0000 7efdd0ff96c0 1 -- 10.20.193.11:0/3126467983 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7965+0+0 (secure 0 0 0) 0x7efdc40e3970 con 0x7efdd4115440 2026-02-13T02:23:10.664 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:10.659+0000 7efdd37fe6c0 1 --2- 10.20.193.11:0/3126467983 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7efda80b5680 0x7efda80d5b30 secure :-1 s=READY pgs=279 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efdc0005980 tx=0x7efdc0005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:23:10.664 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:10.660+0000 7efdd0ff96c0 1 -- 10.20.193.11:0/3126467983 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7efdc40a6470 con 0x7efdd4115440 2026-02-13T02:23:10.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:23:10 trial011 ceph-mon[11956]: pgmap v317: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 10 op/s 2026-02-13T02:23:10.778 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:10.776+0000 7efdd9dcc6c0 1 -- 10.20.193.11:0/3126467983 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7efdd410fc20 con 0x7efdd4115440 2026-02-13T02:23:10.778 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:10.776+0000 7efdd0ff96c0 1 -- 10.20.193.11:0/3126467983 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7efdc40a9620 con 0x7efdd4115440 2026-02-13T02:23:10.779 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:23:10.779 INFO:teuthology.orchestra.run.trial011.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:23:10.780 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:10.777+0000 7efdd9dcc6c0 1 -- 10.20.193.11:0/3126467983 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7efda80b5680 msgr2=0x7efda80d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:23:10.780 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:10.777+0000 7efdd9dcc6c0 1 --2- 10.20.193.11:0/3126467983 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7efda80b5680 0x7efda80d5b30 secure :-1 s=READY pgs=279 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efdc0005980 tx=0x7efdc0005910 comp rx=0 tx=0).stop 2026-02-13T02:23:10.780 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:10.777+0000 7efdd9dcc6c0 1 -- 10.20.193.11:0/3126467983 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7efdd4115440 msgr2=0x7efdd411d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:23:10.780 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:10.777+0000 7efdd9dcc6c0 1 --2- 10.20.193.11:0/3126467983 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7efdd4115440 0x7efdd411d670 secure :-1 s=READY pgs=434 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efdc4005dc0 tx=0x7efdc400bbb0 comp rx=0 tx=0).stop 2026-02-13T02:23:10.780 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:10.777+0000 7efdd9dcc6c0 1 -- 10.20.193.11:0/3126467983 shutdown_connections 2026-02-13T02:23:10.780 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:10.777+0000 7efdd9dcc6c0 1 --2- 10.20.193.11:0/3126467983 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7efda80b5680 0x7efda80d5b30 unknown :-1 s=CLOSED pgs=279 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:10.781 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:10.777+0000 7efdd9dcc6c0 1 --2- 10.20.193.11:0/3126467983 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7efdd4122a30 0x7efdd4122ed0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:10.781 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:10.777+0000 7efdd9dcc6c0 1 --2- 10.20.193.11:0/3126467983 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7efdd4115440 0x7efdd411d670 unknown :-1 s=CLOSED pgs=434 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:10.781 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:10.777+0000 7efdd9dcc6c0 1 --2- 10.20.193.11:0/3126467983 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7efdd410f230 0x7efdd411d130 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:10.781 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:10.777+0000 7efdd9dcc6c0 1 -- 10.20.193.11:0/3126467983 >> 10.20.193.11:0/3126467983 conn(0x7efdd40ecb30 msgr2=0x7efdd410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:23:10.781 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:10.777+0000 7efdd9dcc6c0 1 -- 10.20.193.11:0/3126467983 shutdown_connections 2026-02-13T02:23:10.781 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:10.777+0000 7efdd9dcc6c0 1 -- 10.20.193.11:0/3126467983 wait complete. 2026-02-13T02:23:11.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:23:10 trial060 ceph-mon[14797]: pgmap v317: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 10 op/s 2026-02-13T02:23:11.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:23:10 trial078 ceph-mon[14969]: pgmap v317: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 10 op/s 2026-02-13T02:23:11.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:23:11 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/3126467983' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:23:12.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:23:11 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/3126467983' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:23:12.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:23:11 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/3126467983' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:23:12.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:23:12 trial011 ceph-mon[11956]: pgmap v318: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 6.2 KiB/s rd, 11 op/s 2026-02-13T02:23:13.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:23:12 trial060 ceph-mon[14797]: pgmap v318: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 6.2 KiB/s rd, 11 op/s 2026-02-13T02:23:13.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:23:12 trial078 ceph-mon[14969]: pgmap v318: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 6.2 KiB/s rd, 11 op/s 2026-02-13T02:23:13.819 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:23:13.945 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:23:14.065 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:14.060+0000 7f301603b6c0 1 -- 10.20.193.11:0/1374767599 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f301010f200 msgr2=0x7f301010f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:23:14.065 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:14.060+0000 7f301603b6c0 1 --2- 10.20.193.11:0/1374767599 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f301010f200 0x7f301010f5d0 secure :-1 s=READY pgs=435 gs=1 cs=0 l=1 c_cookie=13683206788548606401 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2ffc0099a0 tx=0x7f2ffc02ed20 comp rx=0 tx=0).stop 2026-02-13T02:23:14.066 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:14.060+0000 7f301603b6c0 1 -- 10.20.193.11:0/1374767599 shutdown_connections 2026-02-13T02:23:14.066 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:14.060+0000 7f301603b6c0 1 --2- 10.20.193.11:0/1374767599 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f3010115410 0x7f3010175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:14.066 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:14.060+0000 7f301603b6c0 1 --2- 10.20.193.11:0/1374767599 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f301010fbf0 0x7f3010114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:14.066 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:14.060+0000 7f301603b6c0 1 --2- 10.20.193.11:0/1374767599 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f301010f200 0x7f301010f5d0 unknown :-1 s=CLOSED pgs=435 gs=1 cs=0 l=1 c_cookie=13683206788548606401 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:14.066 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:14.060+0000 7f301603b6c0 1 -- 10.20.193.11:0/1374767599 >> 10.20.193.11:0/1374767599 conn(0x7f30100ecb00 msgr2=0x7f301010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:23:14.066 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:14.060+0000 7f301603b6c0 1 -- 10.20.193.11:0/1374767599 shutdown_connections 2026-02-13T02:23:14.066 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:14.060+0000 7f301603b6c0 1 -- 10.20.193.11:0/1374767599 wait complete. 2026-02-13T02:23:14.066 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:14.061+0000 7f301603b6c0 1 Processor -- start 2026-02-13T02:23:14.066 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:14.061+0000 7f301603b6c0 1 -- start start 2026-02-13T02:23:14.066 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:14.061+0000 7f301603b6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f301010f200 0x7f301011d1e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:23:14.066 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:14.061+0000 7f301603b6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f3010115410 0x7f301011d720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:23:14.067 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:14.061+0000 7f301603b6c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f3010122ae0 0x7f3010122f80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:23:14.067 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:14.061+0000 7f301603b6c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f30101234f0 con 0x7f3010115410 2026-02-13T02:23:14.067 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:14.061+0000 7f301603b6c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f3010123660 con 0x7f3010122ae0 2026-02-13T02:23:14.067 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:14.061+0000 7f301603b6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f3010123820 con 0x7f301010f200 2026-02-13T02:23:14.067 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:14.061+0000 7f300effd6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f3010115410 0x7f301011d720 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:23:14.067 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:14.061+0000 7f300effd6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f3010115410 0x7f301011d720 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:50110/0 (socket says 10.20.193.11:50110) 2026-02-13T02:23:14.067 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:14.061+0000 7f300effd6c0 1 -- 10.20.193.11:0/159937276 learned_addr learned my addr 10.20.193.11:0/159937276 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:23:14.067 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:14.061+0000 7f300f7fe6c0 1 --2- 10.20.193.11:0/159937276 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f301010f200 0x7f301011d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:23:14.067 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:14.061+0000 7f300effd6c0 1 -- 10.20.193.11:0/159937276 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f301010f200 msgr2=0x7f301011d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:23:14.067 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:14.061+0000 7f300effd6c0 1 --2- 10.20.193.11:0/159937276 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f301010f200 0x7f301011d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:14.067 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:14.061+0000 7f300effd6c0 1 -- 10.20.193.11:0/159937276 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f3010122ae0 msgr2=0x7f3010122f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:23:14.067 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:14.061+0000 7f300effd6c0 1 --2- 10.20.193.11:0/159937276 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f3010122ae0 0x7f3010122f80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:14.067 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:14.061+0000 7f300effd6c0 1 -- 10.20.193.11:0/159937276 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ffc009590 con 0x7f3010115410 2026-02-13T02:23:14.068 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:14.061+0000 7f300f7fe6c0 1 --2- 10.20.193.11:0/159937276 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f301010f200 0x7f301011d1e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:23:14.068 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:14.061+0000 7f300effd6c0 1 --2- 10.20.193.11:0/159937276 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f3010115410 0x7f301011d720 secure :-1 s=READY pgs=436 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3000005dc0 tx=0x7f300000bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:23:14.068 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:14.061+0000 7f300cff96c0 1 -- 10.20.193.11:0/159937276 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3000004250 con 0x7f3010115410 2026-02-13T02:23:14.068 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:14.061+0000 7f300cff96c0 1 -- 10.20.193.11:0/159937276 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f3000009070 con 0x7f3010115410 2026-02-13T02:23:14.068 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:14.061+0000 7f301603b6c0 1 -- 10.20.193.11:0/159937276 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3010163cd0 con 0x7f3010115410 2026-02-13T02:23:14.068 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:14.061+0000 7f300cff96c0 1 -- 10.20.193.11:0/159937276 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f300000cdc0 con 0x7f3010115410 2026-02-13T02:23:14.068 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:14.061+0000 7f301603b6c0 1 -- 10.20.193.11:0/159937276 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30101641b0 con 0x7f3010115410 2026-02-13T02:23:14.068 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:14.062+0000 7f301603b6c0 1 -- 10.20.193.11:0/159937276 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30101104d0 con 0x7f3010115410 2026-02-13T02:23:14.069 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:14.063+0000 7f300cff96c0 1 -- 10.20.193.11:0/159937276 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7f30000028c0 con 0x7f3010115410 2026-02-13T02:23:14.069 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:14.064+0000 7f300cff96c0 1 --2- 10.20.193.11:0/159937276 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f2fe40b5680 0x7f2fe40d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:23:14.069 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:14.064+0000 7f300f7fe6c0 1 --2- 10.20.193.11:0/159937276 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f2fe40b5680 0x7f2fe40d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:23:14.069 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:14.064+0000 7f300cff96c0 1 -- 10.20.193.11:0/159937276 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7965+0+0 (secure 0 0 0) 0x7f30000e3a30 con 0x7f3010115410 2026-02-13T02:23:14.070 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:14.064+0000 7f300cff96c0 1 -- 10.20.193.11:0/159937276 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f30000a64f0 con 0x7f3010115410 2026-02-13T02:23:14.070 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:14.064+0000 7f300f7fe6c0 1 --2- 10.20.193.11:0/159937276 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f2fe40b5680 0x7f2fe40d5b30 secure :-1 s=READY pgs=280 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2ffc0098c0 tx=0x7f2ffc005c80 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:23:14.183 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:14.180+0000 7f301603b6c0 1 -- 10.20.193.11:0/159937276 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f301010f5d0 con 0x7f3010115410 2026-02-13T02:23:14.184 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:14.180+0000 7f300cff96c0 1 -- 10.20.193.11:0/159937276 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f30000a96a0 con 0x7f3010115410 2026-02-13T02:23:14.184 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:23:14.184 INFO:teuthology.orchestra.run.trial011.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:23:14.185 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:14.181+0000 7f301603b6c0 1 -- 10.20.193.11:0/159937276 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f2fe40b5680 msgr2=0x7f2fe40d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:23:14.185 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:14.181+0000 7f301603b6c0 1 --2- 10.20.193.11:0/159937276 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f2fe40b5680 0x7f2fe40d5b30 secure :-1 s=READY pgs=280 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2ffc0098c0 tx=0x7f2ffc005c80 comp rx=0 tx=0).stop 2026-02-13T02:23:14.185 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:14.181+0000 7f301603b6c0 1 -- 10.20.193.11:0/159937276 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f3010115410 msgr2=0x7f301011d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:23:14.185 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:14.181+0000 7f301603b6c0 1 --2- 10.20.193.11:0/159937276 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f3010115410 0x7f301011d720 secure :-1 s=READY pgs=436 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3000005dc0 tx=0x7f300000bbb0 comp rx=0 tx=0).stop 2026-02-13T02:23:14.185 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:14.181+0000 7f301603b6c0 1 -- 10.20.193.11:0/159937276 shutdown_connections 2026-02-13T02:23:14.186 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:14.181+0000 7f301603b6c0 1 --2- 10.20.193.11:0/159937276 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f2fe40b5680 0x7f2fe40d5b30 unknown :-1 s=CLOSED pgs=280 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:14.186 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:14.181+0000 7f301603b6c0 1 --2- 10.20.193.11:0/159937276 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f3010122ae0 0x7f3010122f80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:14.186 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:14.181+0000 7f301603b6c0 1 --2- 10.20.193.11:0/159937276 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f3010115410 0x7f301011d720 unknown :-1 s=CLOSED pgs=436 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:14.186 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:14.181+0000 7f301603b6c0 1 --2- 10.20.193.11:0/159937276 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f301010f200 0x7f301011d1e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:14.186 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:14.181+0000 7f301603b6c0 1 -- 10.20.193.11:0/159937276 >> 10.20.193.11:0/159937276 conn(0x7f30100ecb00 msgr2=0x7f301010cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:23:14.186 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:14.181+0000 7f301603b6c0 1 -- 10.20.193.11:0/159937276 shutdown_connections 2026-02-13T02:23:14.186 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:14.181+0000 7f301603b6c0 1 -- 10.20.193.11:0/159937276 wait complete. 2026-02-13T02:23:14.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:23:14 trial011 ceph-mon[11956]: pgmap v319: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:23:14.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:23:14 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/159937276' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:23:15.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:23:14 trial060 ceph-mon[14797]: pgmap v319: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:23:15.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:23:14 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/159937276' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:23:15.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:23:14 trial078 ceph-mon[14969]: pgmap v319: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:23:15.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:23:14 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/159937276' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:23:16.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:23:16 trial011 ceph-mon[11956]: pgmap v320: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:23:17.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:23:16 trial060 ceph-mon[14797]: pgmap v320: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:23:17.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:23:16 trial078 ceph-mon[14969]: pgmap v320: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:23:17.223 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:23:17.349 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:23:17.464 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:17.460+0000 7fdcf63046c0 1 -- 10.20.193.11:0/1819964525 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fdcf01131b0 msgr2=0x7fdcf0173b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:23:17.464 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:17.460+0000 7fdcf63046c0 1 --2- 10.20.193.11:0/1819964525 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fdcf01131b0 0x7fdcf0173b50 secure :-1 s=READY pgs=437 gs=1 cs=0 l=1 c_cookie=3982501912436974400 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdce400aa70 tx=0x7fdce402fde0 comp rx=0 tx=0).stop 2026-02-13T02:23:17.464 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:17.460+0000 7fdcf63046c0 1 -- 10.20.193.11:0/1819964525 shutdown_connections 2026-02-13T02:23:17.464 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:17.460+0000 7fdcf63046c0 1 --2- 10.20.193.11:0/1819964525 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fdcf010d990 0x7fdcf01129d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:17.464 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:17.460+0000 7fdcf63046c0 1 --2- 10.20.193.11:0/1819964525 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fdcf01131b0 0x7fdcf0173b50 unknown :-1 s=CLOSED pgs=437 gs=1 cs=0 l=1 c_cookie=3982501912436974400 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:17.464 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:17.460+0000 7fdcf63046c0 1 --2- 10.20.193.11:0/1819964525 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fdcf010cfa0 0x7fdcf010d370 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:17.465 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:17.460+0000 7fdcf63046c0 1 -- 10.20.193.11:0/1819964525 >> 10.20.193.11:0/1819964525 conn(0x7fdcf00ea8e0 msgr2=0x7fdcf010acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:23:17.465 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:17.460+0000 7fdcf63046c0 1 -- 10.20.193.11:0/1819964525 shutdown_connections 2026-02-13T02:23:17.465 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:17.460+0000 7fdcf63046c0 1 -- 10.20.193.11:0/1819964525 wait complete. 2026-02-13T02:23:17.465 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:17.460+0000 7fdcf63046c0 1 Processor -- start 2026-02-13T02:23:17.465 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:17.460+0000 7fdcf63046c0 1 -- start start 2026-02-13T02:23:17.465 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:17.460+0000 7fdcf63046c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fdcf010cfa0 0x7fdcf00f4bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:23:17.465 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:17.460+0000 7fdcf63046c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fdcf01131b0 0x7fdcf0173a50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:23:17.465 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:17.460+0000 7fdcf63046c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fdcf00f51f0 0x7fdcf00fa4c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:23:17.465 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:17.460+0000 7fdcf63046c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7fdcf00f58e0 con 0x7fdcf010cfa0 2026-02-13T02:23:17.465 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:17.460+0000 7fdcf63046c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7fdcf00faa00 con 0x7fdcf00f51f0 2026-02-13T02:23:17.465 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:17.460+0000 7fdcf63046c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fdcf00fabc0 con 0x7fdcf01131b0 2026-02-13T02:23:17.466 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:17.460+0000 7fdceffff6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fdcf010cfa0 0x7fdcf00f4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:23:17.466 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:17.460+0000 7fdceffff6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fdcf010cfa0 0x7fdcf00f4bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:50134/0 (socket says 10.20.193.11:50134) 2026-02-13T02:23:17.466 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:17.460+0000 7fdceffff6c0 1 -- 10.20.193.11:0/1685656477 learned_addr learned my addr 10.20.193.11:0/1685656477 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:23:17.466 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:17.460+0000 7fdcf487a6c0 1 --2- 10.20.193.11:0/1685656477 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fdcf00f51f0 0x7fdcf00fa4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:23:17.466 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:17.460+0000 7fdcef7fe6c0 1 --2- 10.20.193.11:0/1685656477 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fdcf01131b0 0x7fdcf0173a50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:23:17.466 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:17.460+0000 7fdceffff6c0 1 -- 10.20.193.11:0/1685656477 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fdcf01131b0 msgr2=0x7fdcf0173a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:23:17.466 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:17.460+0000 7fdceffff6c0 1 --2- 10.20.193.11:0/1685656477 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fdcf01131b0 0x7fdcf0173a50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:17.466 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:17.460+0000 7fdceffff6c0 1 -- 10.20.193.11:0/1685656477 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fdcf00f51f0 msgr2=0x7fdcf00fa4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:23:17.466 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:17.460+0000 7fdceffff6c0 1 --2- 10.20.193.11:0/1685656477 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fdcf00f51f0 0x7fdcf00fa4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:17.466 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:17.460+0000 7fdceffff6c0 1 -- 10.20.193.11:0/1685656477 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdce400a660 con 0x7fdcf010cfa0 2026-02-13T02:23:17.466 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:17.461+0000 7fdceffff6c0 1 --2- 10.20.193.11:0/1685656477 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fdcf010cfa0 0x7fdcf00f4bc0 secure :-1 s=READY pgs=438 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdcdc005dc0 tx=0x7fdcdc00bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:23:17.466 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:17.461+0000 7fdced7fa6c0 1 -- 10.20.193.11:0/1685656477 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdcdc004250 con 0x7fdcf010cfa0 2026-02-13T02:23:17.467 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:17.461+0000 7fdced7fa6c0 1 -- 10.20.193.11:0/1685656477 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fdcdc009070 con 0x7fdcf010cfa0 2026-02-13T02:23:17.467 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:17.461+0000 7fdced7fa6c0 1 -- 10.20.193.11:0/1685656477 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdcdc00ce10 con 0x7fdcf010cfa0 2026-02-13T02:23:17.467 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:17.461+0000 7fdcf63046c0 1 -- 10.20.193.11:0/1685656477 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcf00faea0 con 0x7fdcf010cfa0 2026-02-13T02:23:17.467 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:17.461+0000 7fdcf63046c0 1 -- 10.20.193.11:0/1685656477 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcf00fb630 con 0x7fdcf010cfa0 2026-02-13T02:23:17.467 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:17.461+0000 7fdcf63046c0 1 -- 10.20.193.11:0/1685656477 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdcf010e270 con 0x7fdcf010cfa0 2026-02-13T02:23:17.468 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:17.462+0000 7fdced7fa6c0 1 -- 10.20.193.11:0/1685656477 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7fdcdc0028c0 con 0x7fdcf010cfa0 2026-02-13T02:23:17.468 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:17.463+0000 7fdced7fa6c0 1 --2- 10.20.193.11:0/1685656477 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fdcc40b5680 0x7fdcc40d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:23:17.468 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:17.463+0000 7fdced7fa6c0 1 -- 10.20.193.11:0/1685656477 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7965+0+0 (secure 0 0 0) 0x7fdcdc0e3950 con 0x7fdcf010cfa0 2026-02-13T02:23:17.468 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:17.463+0000 7fdcef7fe6c0 1 --2- 10.20.193.11:0/1685656477 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fdcc40b5680 0x7fdcc40d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:23:17.468 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:17.463+0000 7fdced7fa6c0 1 -- 10.20.193.11:0/1685656477 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fdcdc0a6450 con 0x7fdcf010cfa0 2026-02-13T02:23:17.468 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:17.463+0000 7fdcef7fe6c0 1 --2- 10.20.193.11:0/1685656477 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fdcc40b5680 0x7fdcc40d5b30 secure :-1 s=READY pgs=281 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdce0005980 tx=0x7fdce0005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:23:17.580 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:17.577+0000 7fdcf63046c0 1 -- 10.20.193.11:0/1685656477 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fdcf00f5d10 con 0x7fdcf010cfa0 2026-02-13T02:23:17.580 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:17.578+0000 7fdced7fa6c0 1 -- 10.20.193.11:0/1685656477 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fdcdc0a9600 con 0x7fdcf010cfa0 2026-02-13T02:23:17.580 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:23:17.580 INFO:teuthology.orchestra.run.trial011.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:23:17.581 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:17.579+0000 7fdcf63046c0 1 -- 10.20.193.11:0/1685656477 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fdcc40b5680 msgr2=0x7fdcc40d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:23:17.581 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:17.579+0000 7fdcf63046c0 1 --2- 10.20.193.11:0/1685656477 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fdcc40b5680 0x7fdcc40d5b30 secure :-1 s=READY pgs=281 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdce0005980 tx=0x7fdce0005910 comp rx=0 tx=0).stop 2026-02-13T02:23:17.582 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:17.579+0000 7fdcf63046c0 1 -- 10.20.193.11:0/1685656477 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fdcf010cfa0 msgr2=0x7fdcf00f4bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:23:17.582 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:17.579+0000 7fdcf63046c0 1 --2- 10.20.193.11:0/1685656477 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fdcf010cfa0 0x7fdcf00f4bc0 secure :-1 s=READY pgs=438 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdcdc005dc0 tx=0x7fdcdc00bbb0 comp rx=0 tx=0).stop 2026-02-13T02:23:17.582 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:17.579+0000 7fdcf63046c0 1 -- 10.20.193.11:0/1685656477 shutdown_connections 2026-02-13T02:23:17.582 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:17.579+0000 7fdcf63046c0 1 --2- 10.20.193.11:0/1685656477 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fdcc40b5680 0x7fdcc40d5b30 unknown :-1 s=CLOSED pgs=281 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:17.582 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:17.579+0000 7fdcf63046c0 1 --2- 10.20.193.11:0/1685656477 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fdcf00f51f0 0x7fdcf00fa4c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:17.582 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:17.579+0000 7fdcf63046c0 1 --2- 10.20.193.11:0/1685656477 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fdcf01131b0 0x7fdcf0173a50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:17.582 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:17.579+0000 7fdcf63046c0 1 --2- 10.20.193.11:0/1685656477 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fdcf010cfa0 0x7fdcf00f4bc0 unknown :-1 s=CLOSED pgs=438 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:17.582 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:17.579+0000 7fdcf63046c0 1 -- 10.20.193.11:0/1685656477 >> 10.20.193.11:0/1685656477 conn(0x7fdcf00ea8e0 msgr2=0x7fdcf0110ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:23:17.582 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:17.579+0000 7fdcf63046c0 1 -- 10.20.193.11:0/1685656477 shutdown_connections 2026-02-13T02:23:17.583 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:17.579+0000 7fdcf63046c0 1 -- 10.20.193.11:0/1685656477 wait complete. 2026-02-13T02:23:17.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:23:17 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/1685656477' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:23:18.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:23:17 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/1685656477' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:23:18.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:23:17 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/1685656477' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:23:18.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:23:18 trial011 ceph-mon[11956]: pgmap v321: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T02:23:19.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:23:18 trial060 ceph-mon[14797]: pgmap v321: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T02:23:19.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:23:18 trial078 ceph-mon[14969]: pgmap v321: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T02:23:20.619 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:23:20.744 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:23:20.866 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:20.863+0000 7f79e31496c0 1 -- 10.20.193.11:0/1492216861 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f79dc10fc20 msgr2=0x7f79dc114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:23:20.867 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:20.863+0000 7f79e31496c0 1 --2- 10.20.193.11:0/1492216861 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f79dc10fc20 0x7f79dc114c60 secure :-1 s=READY pgs=439 gs=1 cs=0 l=1 c_cookie=2770378565776413345 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f79c40099a0 tx=0x7f79c402ed20 comp rx=0 tx=0).stop 2026-02-13T02:23:20.867 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:20.863+0000 7f79e31496c0 1 -- 10.20.193.11:0/1492216861 shutdown_connections 2026-02-13T02:23:20.867 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:20.863+0000 7f79e31496c0 1 --2- 10.20.193.11:0/1492216861 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f79dc115440 0x7f79dc175de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:20.867 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:20.863+0000 7f79e31496c0 1 --2- 10.20.193.11:0/1492216861 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f79dc10fc20 0x7f79dc114c60 unknown :-1 s=CLOSED pgs=439 gs=1 cs=0 l=1 c_cookie=2770378565776413345 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:20.867 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:20.863+0000 7f79e31496c0 1 --2- 10.20.193.11:0/1492216861 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f79dc10f230 0x7f79dc10f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:20.867 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:20.863+0000 7f79e31496c0 1 -- 10.20.193.11:0/1492216861 >> 10.20.193.11:0/1492216861 conn(0x7f79dc0ecb30 msgr2=0x7f79dc10cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:23:20.867 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:20.863+0000 7f79e31496c0 1 -- 10.20.193.11:0/1492216861 shutdown_connections 2026-02-13T02:23:20.867 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:20.863+0000 7f79e31496c0 1 -- 10.20.193.11:0/1492216861 wait complete. 2026-02-13T02:23:20.867 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:20.863+0000 7f79e31496c0 1 Processor -- start 2026-02-13T02:23:20.867 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:20.863+0000 7f79e31496c0 1 -- start start 2026-02-13T02:23:20.867 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:20.863+0000 7f79e31496c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f79dc10f230 0x7f79dc0f4be0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:23:20.867 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:20.863+0000 7f79e31496c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f79dc115440 0x7f79dc175ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:23:20.867 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:20.863+0000 7f79e31496c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f79dc0f5210 0x7f79dc0fa490 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:23:20.868 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:20.863+0000 7f79e31496c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f79dc0f5900 con 0x7f79dc115440 2026-02-13T02:23:20.868 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:20.863+0000 7f79e31496c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f79dc0fa9d0 con 0x7f79dc0f5210 2026-02-13T02:23:20.868 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:20.863+0000 7f79e31496c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f79dc0fab90 con 0x7f79dc10f230 2026-02-13T02:23:20.868 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:20.863+0000 7f79d3fff6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f79dc115440 0x7f79dc175ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:23:20.868 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:20.863+0000 7f79d3fff6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f79dc115440 0x7f79dc175ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:36660/0 (socket says 10.20.193.11:36660) 2026-02-13T02:23:20.868 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:20.863+0000 7f79d3fff6c0 1 -- 10.20.193.11:0/1137211713 learned_addr learned my addr 10.20.193.11:0/1137211713 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:23:20.868 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:20.863+0000 7f79e0eba6c0 1 --2- 10.20.193.11:0/1137211713 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f79dc10f230 0x7f79dc0f4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:23:20.868 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:20.863+0000 7f79e16bb6c0 1 --2- 10.20.193.11:0/1137211713 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f79dc0f5210 0x7f79dc0fa490 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:23:20.868 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:20.863+0000 7f79d3fff6c0 1 -- 10.20.193.11:0/1137211713 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f79dc10f230 msgr2=0x7f79dc0f4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:23:20.868 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:20.863+0000 7f79d3fff6c0 1 --2- 10.20.193.11:0/1137211713 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f79dc10f230 0x7f79dc0f4be0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:20.868 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:20.864+0000 7f79d3fff6c0 1 -- 10.20.193.11:0/1137211713 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f79dc0f5210 msgr2=0x7f79dc0fa490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:23:20.868 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:20.864+0000 7f79d3fff6c0 1 --2- 10.20.193.11:0/1137211713 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f79dc0f5210 0x7f79dc0fa490 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:20.868 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:20.864+0000 7f79d3fff6c0 1 -- 10.20.193.11:0/1137211713 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79c4009590 con 0x7f79dc115440 2026-02-13T02:23:20.868 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:20.864+0000 7f79d3fff6c0 1 --2- 10.20.193.11:0/1137211713 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f79dc115440 0x7f79dc175ce0 secure :-1 s=READY pgs=440 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f79c4031f90 tx=0x7f79c40047f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:23:20.868 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:20.864+0000 7f79d1ffb6c0 1 -- 10.20.193.11:0/1137211713 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f79c4002ae0 con 0x7f79dc115440 2026-02-13T02:23:20.868 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:20.864+0000 7f79d1ffb6c0 1 -- 10.20.193.11:0/1137211713 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f79c4002c40 con 0x7f79dc115440 2026-02-13T02:23:20.869 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:20.864+0000 7f79e31496c0 1 -- 10.20.193.11:0/1137211713 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79dc0fae10 con 0x7f79dc115440 2026-02-13T02:23:20.869 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:20.864+0000 7f79d1ffb6c0 1 -- 10.20.193.11:0/1137211713 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f79c40312b0 con 0x7f79dc115440 2026-02-13T02:23:20.869 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:20.864+0000 7f79e31496c0 1 -- 10.20.193.11:0/1137211713 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79dc0fb2e0 con 0x7f79dc115440 2026-02-13T02:23:20.869 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:20.864+0000 7f79e31496c0 1 -- 10.20.193.11:0/1137211713 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79dc110500 con 0x7f79dc115440 2026-02-13T02:23:20.869 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:20.866+0000 7f79d1ffb6c0 1 -- 10.20.193.11:0/1137211713 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7f79c4007260 con 0x7f79dc115440 2026-02-13T02:23:20.870 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:20.866+0000 7f79d1ffb6c0 1 --2- 10.20.193.11:0/1137211713 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f79b80b5680 0x7f79b80d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:23:20.870 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:20.866+0000 7f79e0eba6c0 1 --2- 10.20.193.11:0/1137211713 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f79b80b5680 0x7f79b80d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:23:20.870 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:20.867+0000 7f79d1ffb6c0 1 -- 10.20.193.11:0/1137211713 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7965+0+0 (secure 0 0 0) 0x7f79c4107b70 con 0x7f79dc115440 2026-02-13T02:23:20.870 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:20.867+0000 7f79e0eba6c0 1 --2- 10.20.193.11:0/1137211713 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f79b80b5680 0x7f79b80d5b30 secure :-1 s=READY pgs=282 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f79cc005980 tx=0x7f79cc005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:23:20.870 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:20.867+0000 7f79d1ffb6c0 1 -- 10.20.193.11:0/1137211713 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f79c40ca670 con 0x7f79dc115440 2026-02-13T02:23:20.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:23:20 trial011 ceph-mon[11956]: pgmap v322: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:23:20.982 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:20.980+0000 7f79e31496c0 1 -- 10.20.193.11:0/1137211713 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f79dc10f600 con 0x7f79dc115440 2026-02-13T02:23:20.983 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:20.981+0000 7f79d1ffb6c0 1 -- 10.20.193.11:0/1137211713 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f79c40077d0 con 0x7f79dc115440 2026-02-13T02:23:20.983 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:23:20.983 INFO:teuthology.orchestra.run.trial011.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:23:20.984 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:20.982+0000 7f79e31496c0 1 -- 10.20.193.11:0/1137211713 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f79b80b5680 msgr2=0x7f79b80d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:23:20.984 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:20.982+0000 7f79e31496c0 1 --2- 10.20.193.11:0/1137211713 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f79b80b5680 0x7f79b80d5b30 secure :-1 s=READY pgs=282 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f79cc005980 tx=0x7f79cc005910 comp rx=0 tx=0).stop 2026-02-13T02:23:20.984 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:20.982+0000 7f79e31496c0 1 -- 10.20.193.11:0/1137211713 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f79dc115440 msgr2=0x7f79dc175ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:23:20.984 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:20.982+0000 7f79e31496c0 1 --2- 10.20.193.11:0/1137211713 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f79dc115440 0x7f79dc175ce0 secure :-1 s=READY pgs=440 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f79c4031f90 tx=0x7f79c40047f0 comp rx=0 tx=0).stop 2026-02-13T02:23:20.984 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:20.982+0000 7f79e31496c0 1 -- 10.20.193.11:0/1137211713 shutdown_connections 2026-02-13T02:23:20.984 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:20.982+0000 7f79e31496c0 1 --2- 10.20.193.11:0/1137211713 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f79b80b5680 0x7f79b80d5b30 unknown :-1 s=CLOSED pgs=282 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:20.984 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:20.982+0000 7f79e31496c0 1 --2- 10.20.193.11:0/1137211713 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f79dc0f5210 0x7f79dc0fa490 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:20.984 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:20.982+0000 7f79e31496c0 1 --2- 10.20.193.11:0/1137211713 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f79dc115440 0x7f79dc175ce0 unknown :-1 s=CLOSED pgs=440 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:20.985 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:20.982+0000 7f79e31496c0 1 --2- 10.20.193.11:0/1137211713 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f79dc10f230 0x7f79dc0f4be0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:20.985 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:20.982+0000 7f79e31496c0 1 -- 10.20.193.11:0/1137211713 >> 10.20.193.11:0/1137211713 conn(0x7f79dc0ecb30 msgr2=0x7f79dc113c60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:23:20.985 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:20.982+0000 7f79e31496c0 1 -- 10.20.193.11:0/1137211713 shutdown_connections 2026-02-13T02:23:20.985 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:20.982+0000 7f79e31496c0 1 -- 10.20.193.11:0/1137211713 wait complete. 2026-02-13T02:23:21.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:23:20 trial060 ceph-mon[14797]: pgmap v322: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:23:21.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:23:20 trial078 ceph-mon[14969]: pgmap v322: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:23:21.951 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:23:21 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/1137211713' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:23:21.999 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:23:21 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/1137211713' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:23:22.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:23:21 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/1137211713' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:23:22.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:23:22 trial011 ceph-mon[11956]: pgmap v323: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:23:23.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:23:22 trial060 ceph-mon[14797]: pgmap v323: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:23:23.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:23:22 trial078 ceph-mon[14969]: pgmap v323: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:23:24.024 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:23:24.151 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:23:24.264 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:24.262+0000 7fd916fb86c0 1 -- 10.20.193.11:0/3920634686 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fd910115440 msgr2=0x7fd910175de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:23:24.264 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:24.262+0000 7fd916fb86c0 1 --2- 10.20.193.11:0/3920634686 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fd910115440 0x7fd910175de0 secure :-1 s=READY pgs=441 gs=1 cs=0 l=1 c_cookie=9558300227646158399 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd90c00aa70 tx=0x7fd90c02fde0 comp rx=0 tx=0).stop 2026-02-13T02:23:24.264 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:24.262+0000 7fd916fb86c0 1 -- 10.20.193.11:0/3920634686 shutdown_connections 2026-02-13T02:23:24.265 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:24.262+0000 7fd916fb86c0 1 --2- 10.20.193.11:0/3920634686 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fd910115440 0x7fd910175de0 unknown :-1 s=CLOSED pgs=441 gs=1 cs=0 l=1 c_cookie=9558300227646158399 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:24.265 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:24.262+0000 7fd916fb86c0 1 --2- 10.20.193.11:0/3920634686 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd91010fc20 0x7fd910114c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:24.265 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:24.262+0000 7fd916fb86c0 1 --2- 10.20.193.11:0/3920634686 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fd91010f230 0x7fd91010f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:24.265 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:24.262+0000 7fd916fb86c0 1 -- 10.20.193.11:0/3920634686 >> 10.20.193.11:0/3920634686 conn(0x7fd9100ecb30 msgr2=0x7fd91010cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:23:24.265 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:24.262+0000 7fd916fb86c0 1 -- 10.20.193.11:0/3920634686 shutdown_connections 2026-02-13T02:23:24.265 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:24.262+0000 7fd916fb86c0 1 -- 10.20.193.11:0/3920634686 wait complete. 2026-02-13T02:23:24.267 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:24.263+0000 7fd916fb86c0 1 Processor -- start 2026-02-13T02:23:24.267 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:24.263+0000 7fd916fb86c0 1 -- start start 2026-02-13T02:23:24.267 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:24.263+0000 7fd916fb86c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd91010f230 0x7fd91011d1a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:23:24.267 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:24.263+0000 7fd916fb86c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fd910115440 0x7fd91011d6e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:23:24.267 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:24.263+0000 7fd916fb86c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fd910122aa0 0x7fd910122f40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:23:24.267 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:24.263+0000 7fd916fb86c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7fd910123480 con 0x7fd910122aa0 2026-02-13T02:23:24.268 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:24.263+0000 7fd916fb86c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd9101235f0 con 0x7fd910115440 2026-02-13T02:23:24.268 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:24.263+0000 7fd916fb86c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fd9101237b0 con 0x7fd91010f230 2026-02-13T02:23:24.268 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:24.263+0000 7fd91552a6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fd910122aa0 0x7fd910122f40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:23:24.268 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:24.263+0000 7fd91552a6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fd910122aa0 0x7fd910122f40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:36678/0 (socket says 10.20.193.11:36678) 2026-02-13T02:23:24.268 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:24.263+0000 7fd91552a6c0 1 -- 10.20.193.11:0/3892087315 learned_addr learned my addr 10.20.193.11:0/3892087315 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:23:24.268 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:24.263+0000 7fd914d296c0 1 --2- 10.20.193.11:0/3892087315 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd91010f230 0x7fd91011d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:23:24.268 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:24.263+0000 7fd907fff6c0 1 --2- 10.20.193.11:0/3892087315 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fd910115440 0x7fd91011d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:23:24.268 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:24.263+0000 7fd91552a6c0 1 -- 10.20.193.11:0/3892087315 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd91010f230 msgr2=0x7fd91011d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:23:24.268 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:24.263+0000 7fd91552a6c0 1 --2- 10.20.193.11:0/3892087315 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd91010f230 0x7fd91011d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:24.268 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:24.263+0000 7fd91552a6c0 1 -- 10.20.193.11:0/3892087315 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fd910115440 msgr2=0x7fd91011d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:23:24.268 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:24.263+0000 7fd91552a6c0 1 --2- 10.20.193.11:0/3892087315 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fd910115440 0x7fd91011d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:24.268 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:24.263+0000 7fd91552a6c0 1 -- 10.20.193.11:0/3892087315 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd90c00a660 con 0x7fd910122aa0 2026-02-13T02:23:24.269 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:24.263+0000 7fd91552a6c0 1 --2- 10.20.193.11:0/3892087315 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fd910122aa0 0x7fd910122f40 secure :-1 s=READY pgs=442 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd90c0054b0 tx=0x7fd90c0054e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:23:24.269 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:24.263+0000 7fd905ffb6c0 1 -- 10.20.193.11:0/3892087315 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd90c003a30 con 0x7fd910122aa0 2026-02-13T02:23:24.269 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:24.263+0000 7fd905ffb6c0 1 -- 10.20.193.11:0/3892087315 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd90c003b90 con 0x7fd910122aa0 2026-02-13T02:23:24.269 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:24.263+0000 7fd916fb86c0 1 -- 10.20.193.11:0/3892087315 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd910163c30 con 0x7fd910122aa0 2026-02-13T02:23:24.269 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:24.263+0000 7fd905ffb6c0 1 -- 10.20.193.11:0/3892087315 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd90c0382d0 con 0x7fd910122aa0 2026-02-13T02:23:24.269 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:24.263+0000 7fd916fb86c0 1 -- 10.20.193.11:0/3892087315 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9101640b0 con 0x7fd910122aa0 2026-02-13T02:23:24.269 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:24.264+0000 7fd916fb86c0 1 -- 10.20.193.11:0/3892087315 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd910110500 con 0x7fd910122aa0 2026-02-13T02:23:24.269 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:24.265+0000 7fd905ffb6c0 1 -- 10.20.193.11:0/3892087315 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7fd90c003d00 con 0x7fd910122aa0 2026-02-13T02:23:24.270 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:24.266+0000 7fd905ffb6c0 1 --2- 10.20.193.11:0/3892087315 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fd8ec0b5680 0x7fd8ec0d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:23:24.270 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:24.266+0000 7fd914d296c0 1 --2- 10.20.193.11:0/3892087315 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fd8ec0b5680 0x7fd8ec0d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:23:24.270 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:24.266+0000 7fd905ffb6c0 1 -- 10.20.193.11:0/3892087315 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7965+0+0 (secure 0 0 0) 0x7fd90c108dc0 con 0x7fd910122aa0 2026-02-13T02:23:24.270 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:24.266+0000 7fd914d296c0 1 --2- 10.20.193.11:0/3892087315 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fd8ec0b5680 0x7fd8ec0d5b30 secure :-1 s=READY pgs=283 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd900005980 tx=0x7fd900005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:23:24.270 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:24.266+0000 7fd905ffb6c0 1 -- 10.20.193.11:0/3892087315 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fd90c0ce890 con 0x7fd910122aa0 2026-02-13T02:23:24.384 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:24.382+0000 7fd916fb86c0 1 -- 10.20.193.11:0/3892087315 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fd91010f600 con 0x7fd910122aa0 2026-02-13T02:23:24.385 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:24.383+0000 7fd905ffb6c0 1 -- 10.20.193.11:0/3892087315 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fd90c0cea70 con 0x7fd910122aa0 2026-02-13T02:23:24.385 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:23:24.385 INFO:teuthology.orchestra.run.trial011.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:23:24.386 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:24.384+0000 7fd916fb86c0 1 -- 10.20.193.11:0/3892087315 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fd8ec0b5680 msgr2=0x7fd8ec0d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:23:24.387 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:24.384+0000 7fd916fb86c0 1 --2- 10.20.193.11:0/3892087315 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fd8ec0b5680 0x7fd8ec0d5b30 secure :-1 s=READY pgs=283 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd900005980 tx=0x7fd900005910 comp rx=0 tx=0).stop 2026-02-13T02:23:24.387 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:24.384+0000 7fd916fb86c0 1 -- 10.20.193.11:0/3892087315 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fd910122aa0 msgr2=0x7fd910122f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:23:24.387 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:24.384+0000 7fd916fb86c0 1 --2- 10.20.193.11:0/3892087315 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fd910122aa0 0x7fd910122f40 secure :-1 s=READY pgs=442 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd90c0054b0 tx=0x7fd90c0054e0 comp rx=0 tx=0).stop 2026-02-13T02:23:24.387 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:24.385+0000 7fd916fb86c0 1 -- 10.20.193.11:0/3892087315 shutdown_connections 2026-02-13T02:23:24.387 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:24.385+0000 7fd916fb86c0 1 --2- 10.20.193.11:0/3892087315 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fd8ec0b5680 0x7fd8ec0d5b30 unknown :-1 s=CLOSED pgs=283 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:24.387 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:24.385+0000 7fd916fb86c0 1 --2- 10.20.193.11:0/3892087315 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fd910115440 0x7fd91011d6e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:24.387 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:24.385+0000 7fd916fb86c0 1 --2- 10.20.193.11:0/3892087315 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fd910122aa0 0x7fd910122f40 unknown :-1 s=CLOSED pgs=442 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:24.387 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:24.385+0000 7fd916fb86c0 1 --2- 10.20.193.11:0/3892087315 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd91010f230 0x7fd91011d1a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:24.387 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:24.385+0000 7fd916fb86c0 1 -- 10.20.193.11:0/3892087315 >> 10.20.193.11:0/3892087315 conn(0x7fd9100ecb30 msgr2=0x7fd91010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:23:24.387 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:24.385+0000 7fd916fb86c0 1 -- 10.20.193.11:0/3892087315 shutdown_connections 2026-02-13T02:23:24.388 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:24.385+0000 7fd916fb86c0 1 -- 10.20.193.11:0/3892087315 wait complete. 2026-02-13T02:23:24.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:23:24 trial011 ceph-mon[11956]: pgmap v324: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:23:24.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:23:24 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/3892087315' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:23:25.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:23:24 trial060 ceph-mon[14797]: pgmap v324: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:23:25.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:23:24 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/3892087315' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:23:25.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:23:24 trial078 ceph-mon[14969]: pgmap v324: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:23:25.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:23:24 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/3892087315' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:23:26.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:23:26 trial011 ceph-mon[11956]: pgmap v325: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:23:27.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:23:26 trial060 ceph-mon[14797]: pgmap v325: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:23:27.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:23:26 trial078 ceph-mon[14969]: pgmap v325: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:23:27.426 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:23:27.551 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:23:27.670 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:27.666+0000 7f0a0201f6c0 1 -- 10.20.193.11:0/528788940 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f09fc10f230 msgr2=0x7f09fc10f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:23:27.670 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:27.666+0000 7f0a0201f6c0 1 --2- 10.20.193.11:0/528788940 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f09fc10f230 0x7f09fc10f600 secure :-1 s=READY pgs=443 gs=1 cs=0 l=1 c_cookie=12367958485838247718 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f09e80099a0 tx=0x7f09e802ed20 comp rx=0 tx=0).stop 2026-02-13T02:23:27.671 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:27.666+0000 7f0a0201f6c0 1 -- 10.20.193.11:0/528788940 shutdown_connections 2026-02-13T02:23:27.671 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:27.666+0000 7f0a0201f6c0 1 --2- 10.20.193.11:0/528788940 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f09fc115440 0x7f09fc175de0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:27.671 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:27.666+0000 7f0a0201f6c0 1 --2- 10.20.193.11:0/528788940 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f09fc10fc20 0x7f09fc114c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:27.671 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:27.666+0000 7f0a0201f6c0 1 --2- 10.20.193.11:0/528788940 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f09fc10f230 0x7f09fc10f600 unknown :-1 s=CLOSED pgs=443 gs=1 cs=0 l=1 c_cookie=12367958485838247718 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:27.671 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:27.666+0000 7f0a0201f6c0 1 -- 10.20.193.11:0/528788940 >> 10.20.193.11:0/528788940 conn(0x7f09fc0ecb30 msgr2=0x7f09fc10cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:23:27.671 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:27.666+0000 7f0a0201f6c0 1 -- 10.20.193.11:0/528788940 shutdown_connections 2026-02-13T02:23:27.671 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:27.666+0000 7f0a0201f6c0 1 -- 10.20.193.11:0/528788940 wait complete. 2026-02-13T02:23:27.671 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:27.667+0000 7f0a0201f6c0 1 Processor -- start 2026-02-13T02:23:27.671 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:27.667+0000 7f0a0201f6c0 1 -- start start 2026-02-13T02:23:27.671 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:27.667+0000 7f0a0201f6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f09fc10f230 0x7f09fc11d130 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:23:27.671 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:27.667+0000 7f0a0201f6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f09fc115440 0x7f09fc11d670 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:23:27.672 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:27.667+0000 7f0a0201f6c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f09fc122a30 0x7f09fc122ed0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:23:27.672 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:27.667+0000 7f0a0201f6c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f09fc123440 con 0x7f09fc115440 2026-02-13T02:23:27.672 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:27.667+0000 7f0a0201f6c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f09fc1235b0 con 0x7f09fc122a30 2026-02-13T02:23:27.672 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:27.667+0000 7f0a0201f6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f09fc123770 con 0x7f09fc10f230 2026-02-13T02:23:27.672 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:27.667+0000 7f09faffd6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f09fc115440 0x7f09fc11d670 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:23:27.672 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:27.667+0000 7f09faffd6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f09fc115440 0x7f09fc11d670 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:36702/0 (socket says 10.20.193.11:36702) 2026-02-13T02:23:27.672 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:27.667+0000 7f09faffd6c0 1 -- 10.20.193.11:0/3396078303 learned_addr learned my addr 10.20.193.11:0/3396078303 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:23:27.672 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:27.667+0000 7f09fb7fe6c0 1 --2- 10.20.193.11:0/3396078303 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f09fc10f230 0x7f09fc11d130 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:23:27.672 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:27.667+0000 7f09fbfff6c0 1 --2- 10.20.193.11:0/3396078303 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f09fc122a30 0x7f09fc122ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:23:27.672 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:27.667+0000 7f09faffd6c0 1 -- 10.20.193.11:0/3396078303 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f09fc10f230 msgr2=0x7f09fc11d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:23:27.672 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:27.667+0000 7f09faffd6c0 1 --2- 10.20.193.11:0/3396078303 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f09fc10f230 0x7f09fc11d130 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:27.672 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:27.667+0000 7f09faffd6c0 1 -- 10.20.193.11:0/3396078303 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f09fc122a30 msgr2=0x7f09fc122ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:23:27.673 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:27.667+0000 7f09faffd6c0 1 --2- 10.20.193.11:0/3396078303 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f09fc122a30 0x7f09fc122ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:27.673 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:27.667+0000 7f09faffd6c0 1 -- 10.20.193.11:0/3396078303 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09e8009590 con 0x7f09fc115440 2026-02-13T02:23:27.673 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:27.667+0000 7f09fb7fe6c0 1 --2- 10.20.193.11:0/3396078303 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f09fc10f230 0x7f09fc11d130 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:23:27.673 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:27.667+0000 7f09fbfff6c0 1 --2- 10.20.193.11:0/3396078303 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f09fc122a30 0x7f09fc122ed0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:23:27.673 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:27.667+0000 7f09faffd6c0 1 --2- 10.20.193.11:0/3396078303 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f09fc115440 0x7f09fc11d670 secure :-1 s=READY pgs=444 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f09ec00b6c0 tx=0x7f09ec00bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:23:27.673 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:27.667+0000 7f09f8ff96c0 1 -- 10.20.193.11:0/3396078303 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f09ec0044a0 con 0x7f09fc115440 2026-02-13T02:23:27.673 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:27.667+0000 7f09f8ff96c0 1 -- 10.20.193.11:0/3396078303 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f09ec00be50 con 0x7f09fc115440 2026-02-13T02:23:27.673 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:27.667+0000 7f0a0201f6c0 1 -- 10.20.193.11:0/3396078303 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09fc163c20 con 0x7f09fc115440 2026-02-13T02:23:27.673 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:27.667+0000 7f09f8ff96c0 1 -- 10.20.193.11:0/3396078303 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f09ec00cd50 con 0x7f09fc115440 2026-02-13T02:23:27.673 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:27.667+0000 7f0a0201f6c0 1 -- 10.20.193.11:0/3396078303 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09fc1640b0 con 0x7f09fc115440 2026-02-13T02:23:27.673 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:27.668+0000 7f0a0201f6c0 1 -- 10.20.193.11:0/3396078303 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09fc110500 con 0x7f09fc115440 2026-02-13T02:23:27.674 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:27.669+0000 7f09f8ff96c0 1 -- 10.20.193.11:0/3396078303 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7f09ec0026b0 con 0x7f09fc115440 2026-02-13T02:23:27.675 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:27.670+0000 7f09f8ff96c0 1 --2- 10.20.193.11:0/3396078303 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f09d00b5680 0x7f09d00d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:23:27.675 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:27.670+0000 7f09fb7fe6c0 1 --2- 10.20.193.11:0/3396078303 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f09d00b5680 0x7f09d00d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:23:27.675 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:27.670+0000 7f09f8ff96c0 1 -- 10.20.193.11:0/3396078303 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7965+0+0 (secure 0 0 0) 0x7f09ec0e3810 con 0x7f09fc115440 2026-02-13T02:23:27.675 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:27.670+0000 7f09f8ff96c0 1 -- 10.20.193.11:0/3396078303 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f09ec0a62d0 con 0x7f09fc115440 2026-02-13T02:23:27.675 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:27.670+0000 7f09fb7fe6c0 1 --2- 10.20.193.11:0/3396078303 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f09d00b5680 0x7f09d00d5b30 secure :-1 s=READY pgs=284 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f09e8009970 tx=0x7f09e80023a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:23:27.789 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:27.787+0000 7f0a0201f6c0 1 -- 10.20.193.11:0/3396078303 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f09fc10f600 con 0x7f09fc115440 2026-02-13T02:23:27.790 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:27.787+0000 7f09f8ff96c0 1 -- 10.20.193.11:0/3396078303 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f09ec0a9480 con 0x7f09fc115440 2026-02-13T02:23:27.790 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:23:27.790 INFO:teuthology.orchestra.run.trial011.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:23:27.791 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:27.788+0000 7f0a0201f6c0 1 -- 10.20.193.11:0/3396078303 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f09d00b5680 msgr2=0x7f09d00d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:23:27.791 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:27.788+0000 7f0a0201f6c0 1 --2- 10.20.193.11:0/3396078303 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f09d00b5680 0x7f09d00d5b30 secure :-1 s=READY pgs=284 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f09e8009970 tx=0x7f09e80023a0 comp rx=0 tx=0).stop 2026-02-13T02:23:27.791 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:27.788+0000 7f0a0201f6c0 1 -- 10.20.193.11:0/3396078303 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f09fc115440 msgr2=0x7f09fc11d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:23:27.791 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:27.788+0000 7f0a0201f6c0 1 --2- 10.20.193.11:0/3396078303 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f09fc115440 0x7f09fc11d670 secure :-1 s=READY pgs=444 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f09ec00b6c0 tx=0x7f09ec00bb90 comp rx=0 tx=0).stop 2026-02-13T02:23:27.791 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:27.788+0000 7f0a0201f6c0 1 -- 10.20.193.11:0/3396078303 shutdown_connections 2026-02-13T02:23:27.791 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:27.788+0000 7f0a0201f6c0 1 --2- 10.20.193.11:0/3396078303 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f09d00b5680 0x7f09d00d5b30 unknown :-1 s=CLOSED pgs=284 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:27.792 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:27.788+0000 7f0a0201f6c0 1 --2- 10.20.193.11:0/3396078303 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f09fc122a30 0x7f09fc122ed0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:27.792 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:27.788+0000 7f0a0201f6c0 1 --2- 10.20.193.11:0/3396078303 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f09fc115440 0x7f09fc11d670 unknown :-1 s=CLOSED pgs=444 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:27.792 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:27.788+0000 7f0a0201f6c0 1 --2- 10.20.193.11:0/3396078303 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f09fc10f230 0x7f09fc11d130 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:27.792 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:27.788+0000 7f0a0201f6c0 1 -- 10.20.193.11:0/3396078303 >> 10.20.193.11:0/3396078303 conn(0x7f09fc0ecb30 msgr2=0x7f09fc10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:23:27.792 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:27.788+0000 7f0a0201f6c0 1 -- 10.20.193.11:0/3396078303 shutdown_connections 2026-02-13T02:23:27.792 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:27.789+0000 7f0a0201f6c0 1 -- 10.20.193.11:0/3396078303 wait complete. 2026-02-13T02:23:28.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:23:28 trial011 ceph-mon[11956]: pgmap v326: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T02:23:28.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:23:28 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/3396078303' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:23:29.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:23:28 trial060 ceph-mon[14797]: pgmap v326: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T02:23:29.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:23:28 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/3396078303' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:23:29.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:23:28 trial078 ceph-mon[14969]: pgmap v326: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T02:23:29.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:23:28 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/3396078303' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:23:30.830 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:23:30.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:23:30 trial011 ceph-mon[11956]: pgmap v327: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:23:30.957 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:23:31.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:23:30 trial060 ceph-mon[14797]: pgmap v327: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:23:31.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:23:30 trial078 ceph-mon[14969]: pgmap v327: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:23:31.076 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:31.072+0000 7fd9c11c06c0 1 -- 10.20.193.11:0/1029686937 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fd9bc10d9a0 msgr2=0x7fd9bc1129e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:23:31.077 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:31.072+0000 7fd9c11c06c0 1 --2- 10.20.193.11:0/1029686937 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fd9bc10d9a0 0x7fd9bc1129e0 secure :-1 s=READY pgs=445 gs=1 cs=0 l=1 c_cookie=11133615529666739428 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd9a40099a0 tx=0x7fd9a402ed20 comp rx=0 tx=0).stop 2026-02-13T02:23:31.077 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:31.072+0000 7fd9c11c06c0 1 -- 10.20.193.11:0/1029686937 shutdown_connections 2026-02-13T02:23:31.077 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:31.072+0000 7fd9c11c06c0 1 --2- 10.20.193.11:0/1029686937 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fd9bc1131c0 0x7fd9bc173b60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:31.077 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:31.072+0000 7fd9c11c06c0 1 --2- 10.20.193.11:0/1029686937 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fd9bc10d9a0 0x7fd9bc1129e0 unknown :-1 s=CLOSED pgs=445 gs=1 cs=0 l=1 c_cookie=11133615529666739428 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:31.077 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:31.072+0000 7fd9c11c06c0 1 --2- 10.20.193.11:0/1029686937 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd9bc10cfb0 0x7fd9bc10d380 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:31.077 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:31.072+0000 7fd9c11c06c0 1 -- 10.20.193.11:0/1029686937 >> 10.20.193.11:0/1029686937 conn(0x7fd9bc0ea8b0 msgr2=0x7fd9bc10acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:23:31.077 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:31.072+0000 7fd9c11c06c0 1 -- 10.20.193.11:0/1029686937 shutdown_connections 2026-02-13T02:23:31.077 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:31.072+0000 7fd9c11c06c0 1 -- 10.20.193.11:0/1029686937 wait complete. 2026-02-13T02:23:31.077 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:31.073+0000 7fd9c11c06c0 1 Processor -- start 2026-02-13T02:23:31.078 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:31.073+0000 7fd9c11c06c0 1 -- start start 2026-02-13T02:23:31.078 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:31.073+0000 7fd9c11c06c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd9bc10cfb0 0x7fd9bc11af80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:23:31.078 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:31.073+0000 7fd9c11c06c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fd9bc1131c0 0x7fd9bc11b4c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:23:31.078 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:31.073+0000 7fd9c11c06c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fd9bc120880 0x7fd9bc120d20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:23:31.078 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:31.073+0000 7fd9c11c06c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7fd9bc121290 con 0x7fd9bc1131c0 2026-02-13T02:23:31.078 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:31.073+0000 7fd9c11c06c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd9bc121400 con 0x7fd9bc120880 2026-02-13T02:23:31.078 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:31.073+0000 7fd9c11c06c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fd9bc1215c0 con 0x7fd9bc10cfb0 2026-02-13T02:23:31.078 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:31.073+0000 7fd9ba5756c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fd9bc1131c0 0x7fd9bc11b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:23:31.078 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:31.073+0000 7fd9ba5756c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fd9bc1131c0 0x7fd9bc11b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:50736/0 (socket says 10.20.193.11:50736) 2026-02-13T02:23:31.078 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:31.073+0000 7fd9ba5756c0 1 -- 10.20.193.11:0/77946271 learned_addr learned my addr 10.20.193.11:0/77946271 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:23:31.078 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:31.073+0000 7fd9bad766c0 1 --2- 10.20.193.11:0/77946271 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd9bc10cfb0 0x7fd9bc11af80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:23:31.078 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:31.073+0000 7fd9bb5776c0 1 --2- 10.20.193.11:0/77946271 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fd9bc120880 0x7fd9bc120d20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:23:31.079 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:31.073+0000 7fd9ba5756c0 1 -- 10.20.193.11:0/77946271 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd9bc10cfb0 msgr2=0x7fd9bc11af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:23:31.079 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:31.073+0000 7fd9ba5756c0 1 --2- 10.20.193.11:0/77946271 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd9bc10cfb0 0x7fd9bc11af80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:31.079 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:31.073+0000 7fd9ba5756c0 1 -- 10.20.193.11:0/77946271 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fd9bc120880 msgr2=0x7fd9bc120d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:23:31.079 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:31.073+0000 7fd9ba5756c0 1 --2- 10.20.193.11:0/77946271 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fd9bc120880 0x7fd9bc120d20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:31.079 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:31.073+0000 7fd9ba5756c0 1 -- 10.20.193.11:0/77946271 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9a4009590 con 0x7fd9bc1131c0 2026-02-13T02:23:31.079 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:31.073+0000 7fd9bb5776c0 1 --2- 10.20.193.11:0/77946271 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fd9bc120880 0x7fd9bc120d20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T02:23:31.079 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:31.073+0000 7fd9ba5756c0 1 --2- 10.20.193.11:0/77946271 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fd9bc1131c0 0x7fd9bc11b4c0 secure :-1 s=READY pgs=446 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd9a4031f90 tx=0x7fd9a40047f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:23:31.079 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:31.073+0000 7fd99bfff6c0 1 -- 10.20.193.11:0/77946271 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd9a4002ae0 con 0x7fd9bc1131c0 2026-02-13T02:23:31.079 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:31.073+0000 7fd99bfff6c0 1 -- 10.20.193.11:0/77946271 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd9a4002c40 con 0x7fd9bc1131c0 2026-02-13T02:23:31.079 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:31.073+0000 7fd99bfff6c0 1 -- 10.20.193.11:0/77946271 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd9a40312b0 con 0x7fd9bc1131c0 2026-02-13T02:23:31.079 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:31.073+0000 7fd9c11c06c0 1 -- 10.20.193.11:0/77946271 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9bc161a10 con 0x7fd9bc1131c0 2026-02-13T02:23:31.079 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:31.073+0000 7fd9c11c06c0 1 -- 10.20.193.11:0/77946271 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9bc161e90 con 0x7fd9bc1131c0 2026-02-13T02:23:31.079 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:31.074+0000 7fd9c11c06c0 1 -- 10.20.193.11:0/77946271 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9bc10e280 con 0x7fd9bc1131c0 2026-02-13T02:23:31.080 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:31.075+0000 7fd99bfff6c0 1 -- 10.20.193.11:0/77946271 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7fd9a4007260 con 0x7fd9bc1131c0 2026-02-13T02:23:31.081 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:31.076+0000 7fd99bfff6c0 1 --2- 10.20.193.11:0/77946271 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fd9900b5680 0x7fd9900d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:23:31.081 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:31.076+0000 7fd99bfff6c0 1 -- 10.20.193.11:0/77946271 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7965+0+0 (secure 0 0 0) 0x7fd9a4107c70 con 0x7fd9bc1131c0 2026-02-13T02:23:31.081 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:31.076+0000 7fd9bad766c0 1 --2- 10.20.193.11:0/77946271 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fd9900b5680 0x7fd9900d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:23:31.081 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:31.076+0000 7fd9bad766c0 1 --2- 10.20.193.11:0/77946271 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fd9900b5680 0x7fd9900d5b30 secure :-1 s=READY pgs=285 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd9b0005980 tx=0x7fd9b0005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:23:31.081 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:31.076+0000 7fd99bfff6c0 1 -- 10.20.193.11:0/77946271 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fd9a40ca730 con 0x7fd9bc1131c0 2026-02-13T02:23:31.192 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:31.190+0000 7fd9c11c06c0 1 -- 10.20.193.11:0/77946271 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fd9bc10d380 con 0x7fd9bc1131c0 2026-02-13T02:23:31.192 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:31.190+0000 7fd99bfff6c0 1 -- 10.20.193.11:0/77946271 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fd9a40cd8e0 con 0x7fd9bc1131c0 2026-02-13T02:23:31.193 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:23:31.193 INFO:teuthology.orchestra.run.trial011.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:23:31.193 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:31.191+0000 7fd9c11c06c0 1 -- 10.20.193.11:0/77946271 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fd9900b5680 msgr2=0x7fd9900d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:23:31.194 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:31.191+0000 7fd9c11c06c0 1 --2- 10.20.193.11:0/77946271 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fd9900b5680 0x7fd9900d5b30 secure :-1 s=READY pgs=285 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd9b0005980 tx=0x7fd9b0005910 comp rx=0 tx=0).stop 2026-02-13T02:23:31.194 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:31.191+0000 7fd9c11c06c0 1 -- 10.20.193.11:0/77946271 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fd9bc1131c0 msgr2=0x7fd9bc11b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:23:31.194 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:31.191+0000 7fd9c11c06c0 1 --2- 10.20.193.11:0/77946271 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fd9bc1131c0 0x7fd9bc11b4c0 secure :-1 s=READY pgs=446 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd9a4031f90 tx=0x7fd9a40047f0 comp rx=0 tx=0).stop 2026-02-13T02:23:31.194 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:31.191+0000 7fd9c11c06c0 1 -- 10.20.193.11:0/77946271 shutdown_connections 2026-02-13T02:23:31.194 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:31.191+0000 7fd9c11c06c0 1 --2- 10.20.193.11:0/77946271 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fd9900b5680 0x7fd9900d5b30 unknown :-1 s=CLOSED pgs=285 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:31.194 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:31.191+0000 7fd9c11c06c0 1 --2- 10.20.193.11:0/77946271 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fd9bc120880 0x7fd9bc120d20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:31.194 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:31.191+0000 7fd9c11c06c0 1 --2- 10.20.193.11:0/77946271 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fd9bc1131c0 0x7fd9bc11b4c0 unknown :-1 s=CLOSED pgs=446 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:31.194 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:31.191+0000 7fd9c11c06c0 1 --2- 10.20.193.11:0/77946271 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd9bc10cfb0 0x7fd9bc11af80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:31.194 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:31.191+0000 7fd9c11c06c0 1 -- 10.20.193.11:0/77946271 >> 10.20.193.11:0/77946271 conn(0x7fd9bc0ea8b0 msgr2=0x7fd9bc10ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:23:31.194 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:31.191+0000 7fd9c11c06c0 1 -- 10.20.193.11:0/77946271 shutdown_connections 2026-02-13T02:23:31.195 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:31.191+0000 7fd9c11c06c0 1 -- 10.20.193.11:0/77946271 wait complete. 2026-02-13T02:23:31.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:23:31 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/77946271' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:23:32.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:23:31 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/77946271' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:23:32.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:23:31 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/77946271' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:23:32.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:23:32 trial011 ceph-mon[11956]: pgmap v328: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:23:33.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:23:32 trial060 ceph-mon[14797]: pgmap v328: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:23:33.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:23:32 trial078 ceph-mon[14969]: pgmap v328: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:23:34.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:23:33 trial060 ceph-mon[14797]: pgmap v329: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:23:34.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:23:33 trial078 ceph-mon[14969]: pgmap v329: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:23:34.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:23:33 trial011 ceph-mon[11956]: pgmap v329: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:23:34.232 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:23:34.356 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:23:34.477 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:34.473+0000 7f236b7cc6c0 1 -- 10.20.193.11:0/238273045 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f236410f230 msgr2=0x7f236410f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:23:34.478 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:34.473+0000 7f236b7cc6c0 1 --2- 10.20.193.11:0/238273045 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f236410f230 0x7f236410f600 secure :-1 s=READY pgs=447 gs=1 cs=0 l=1 c_cookie=9981131401645295749 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f23540099a0 tx=0x7f235402ed20 comp rx=0 tx=0).stop 2026-02-13T02:23:34.478 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:34.473+0000 7f236b7cc6c0 1 -- 10.20.193.11:0/238273045 shutdown_connections 2026-02-13T02:23:34.478 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:34.473+0000 7f236b7cc6c0 1 --2- 10.20.193.11:0/238273045 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f236410fc20 0x7f2364114c60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:34.478 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:34.473+0000 7f236b7cc6c0 1 --2- 10.20.193.11:0/238273045 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f2364115440 0x7f2364175de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:34.478 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:34.473+0000 7f236b7cc6c0 1 --2- 10.20.193.11:0/238273045 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f236410f230 0x7f236410f600 unknown :-1 s=CLOSED pgs=447 gs=1 cs=0 l=1 c_cookie=9981131401645295749 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:34.478 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:34.473+0000 7f236b7cc6c0 1 -- 10.20.193.11:0/238273045 >> 10.20.193.11:0/238273045 conn(0x7f23640ecb30 msgr2=0x7f236410cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:23:34.478 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:34.473+0000 7f236b7cc6c0 1 -- 10.20.193.11:0/238273045 shutdown_connections 2026-02-13T02:23:34.478 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:34.474+0000 7f236b7cc6c0 1 -- 10.20.193.11:0/238273045 wait complete. 2026-02-13T02:23:34.478 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:34.474+0000 7f236b7cc6c0 1 Processor -- start 2026-02-13T02:23:34.479 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:34.474+0000 7f236b7cc6c0 1 -- start start 2026-02-13T02:23:34.479 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:34.474+0000 7f236b7cc6c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f236410f230 0x7f236411d1e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:23:34.479 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:34.474+0000 7f236b7cc6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f2364115440 0x7f236411d720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:23:34.479 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:34.474+0000 7f236b7cc6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f2364122ae0 0x7f2364122f80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:23:34.479 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:34.474+0000 7f236b7cc6c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f23641234f0 con 0x7f2364122ae0 2026-02-13T02:23:34.479 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:34.474+0000 7f236b7cc6c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f2364123660 con 0x7f236410f230 2026-02-13T02:23:34.479 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:34.474+0000 7f236b7cc6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f2364123820 con 0x7f2364115440 2026-02-13T02:23:34.479 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:34.474+0000 7f2369d426c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f2364122ae0 0x7f2364122f80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:23:34.479 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:34.474+0000 7f2369d426c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f2364122ae0 0x7f2364122f80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:50744/0 (socket says 10.20.193.11:50744) 2026-02-13T02:23:34.479 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:34.474+0000 7f2369d426c0 1 -- 10.20.193.11:0/3015034225 learned_addr learned my addr 10.20.193.11:0/3015034225 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:23:34.479 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:34.474+0000 7f2368d406c0 1 --2- 10.20.193.11:0/3015034225 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f2364115440 0x7f236411d720 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:23:34.479 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:34.474+0000 7f23695416c0 1 --2- 10.20.193.11:0/3015034225 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f236410f230 0x7f236411d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:23:34.480 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:34.474+0000 7f2369d426c0 1 -- 10.20.193.11:0/3015034225 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f2364115440 msgr2=0x7f236411d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:23:34.480 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:34.474+0000 7f2369d426c0 1 --2- 10.20.193.11:0/3015034225 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f2364115440 0x7f236411d720 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:34.480 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:34.474+0000 7f2369d426c0 1 -- 10.20.193.11:0/3015034225 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f236410f230 msgr2=0x7f236411d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:23:34.480 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:34.474+0000 7f2369d426c0 1 --2- 10.20.193.11:0/3015034225 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f236410f230 0x7f236411d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:34.480 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:34.474+0000 7f2369d426c0 1 -- 10.20.193.11:0/3015034225 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2354009590 con 0x7f2364122ae0 2026-02-13T02:23:34.480 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:34.474+0000 7f23695416c0 1 --2- 10.20.193.11:0/3015034225 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f236410f230 0x7f236411d1e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T02:23:34.480 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:34.474+0000 7f2369d426c0 1 --2- 10.20.193.11:0/3015034225 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f2364122ae0 0x7f2364122f80 secure :-1 s=READY pgs=448 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2360006ea0 tx=0x7f236000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:23:34.480 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:34.475+0000 7f23527fc6c0 1 -- 10.20.193.11:0/3015034225 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2360003a30 con 0x7f2364122ae0 2026-02-13T02:23:34.480 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:34.475+0000 7f236b7cc6c0 1 -- 10.20.193.11:0/3015034225 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2364163cd0 con 0x7f2364122ae0 2026-02-13T02:23:34.480 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:34.475+0000 7f23527fc6c0 1 -- 10.20.193.11:0/3015034225 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f2360005510 con 0x7f2364122ae0 2026-02-13T02:23:34.480 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:34.475+0000 7f23527fc6c0 1 -- 10.20.193.11:0/3015034225 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f236000dd70 con 0x7f2364122ae0 2026-02-13T02:23:34.480 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:34.475+0000 7f236b7cc6c0 1 -- 10.20.193.11:0/3015034225 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23641641b0 con 0x7f2364122ae0 2026-02-13T02:23:34.481 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:34.475+0000 7f236b7cc6c0 1 -- 10.20.193.11:0/3015034225 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2364110500 con 0x7f2364122ae0 2026-02-13T02:23:34.482 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:34.476+0000 7f23527fc6c0 1 -- 10.20.193.11:0/3015034225 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7f2360003b90 con 0x7f2364122ae0 2026-02-13T02:23:34.482 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:34.477+0000 7f23527fc6c0 1 --2- 10.20.193.11:0/3015034225 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f23400b5600 0x7f23400d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:23:34.482 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:34.477+0000 7f23695416c0 1 --2- 10.20.193.11:0/3015034225 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f23400b5600 0x7f23400d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:23:34.482 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:34.477+0000 7f23527fc6c0 1 -- 10.20.193.11:0/3015034225 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7965+0+0 (secure 0 0 0) 0x7f23600e4a80 con 0x7f2364122ae0 2026-02-13T02:23:34.482 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:34.477+0000 7f23527fc6c0 1 -- 10.20.193.11:0/3015034225 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f23600aafa0 con 0x7f2364122ae0 2026-02-13T02:23:34.482 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:34.477+0000 7f23695416c0 1 --2- 10.20.193.11:0/3015034225 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f23400b5600 0x7f23400d5ab0 secure :-1 s=READY pgs=286 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f23540023e0 tx=0x7f2354031f90 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:23:34.594 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:34.592+0000 7f236b7cc6c0 1 -- 10.20.193.11:0/3015034225 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f236410f600 con 0x7f2364122ae0 2026-02-13T02:23:34.594 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:34.592+0000 7f23527fc6c0 1 -- 10.20.193.11:0/3015034225 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f23600ad010 con 0x7f2364122ae0 2026-02-13T02:23:34.595 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:23:34.595 INFO:teuthology.orchestra.run.trial011.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:23:34.596 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:34.593+0000 7f236b7cc6c0 1 -- 10.20.193.11:0/3015034225 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f23400b5600 msgr2=0x7f23400d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:23:34.596 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:34.593+0000 7f236b7cc6c0 1 --2- 10.20.193.11:0/3015034225 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f23400b5600 0x7f23400d5ab0 secure :-1 s=READY pgs=286 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f23540023e0 tx=0x7f2354031f90 comp rx=0 tx=0).stop 2026-02-13T02:23:34.596 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:34.593+0000 7f236b7cc6c0 1 -- 10.20.193.11:0/3015034225 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f2364122ae0 msgr2=0x7f2364122f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:23:34.596 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:34.593+0000 7f236b7cc6c0 1 --2- 10.20.193.11:0/3015034225 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f2364122ae0 0x7f2364122f80 secure :-1 s=READY pgs=448 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2360006ea0 tx=0x7f236000cca0 comp rx=0 tx=0).stop 2026-02-13T02:23:34.596 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:34.593+0000 7f236b7cc6c0 1 -- 10.20.193.11:0/3015034225 shutdown_connections 2026-02-13T02:23:34.596 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:34.593+0000 7f236b7cc6c0 1 --2- 10.20.193.11:0/3015034225 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f23400b5600 0x7f23400d5ab0 unknown :-1 s=CLOSED pgs=286 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:34.597 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:34.593+0000 7f236b7cc6c0 1 --2- 10.20.193.11:0/3015034225 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f2364122ae0 0x7f2364122f80 unknown :-1 s=CLOSED pgs=448 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:34.597 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:34.593+0000 7f236b7cc6c0 1 --2- 10.20.193.11:0/3015034225 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f2364115440 0x7f236411d720 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:34.597 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:34.593+0000 7f236b7cc6c0 1 --2- 10.20.193.11:0/3015034225 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f236410f230 0x7f236411d1e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:34.597 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:34.593+0000 7f236b7cc6c0 1 -- 10.20.193.11:0/3015034225 >> 10.20.193.11:0/3015034225 conn(0x7f23640ecb30 msgr2=0x7f236410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:23:34.597 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:34.593+0000 7f236b7cc6c0 1 -- 10.20.193.11:0/3015034225 shutdown_connections 2026-02-13T02:23:34.597 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:34.593+0000 7f236b7cc6c0 1 -- 10.20.193.11:0/3015034225 wait complete. 2026-02-13T02:23:34.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:23:34 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/3015034225' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:23:35.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:23:34 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/3015034225' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:23:35.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:23:34 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/3015034225' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:23:36.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:23:35 trial060 ceph-mon[14797]: pgmap v330: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:23:36.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:23:35 trial078 ceph-mon[14969]: pgmap v330: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:23:36.202 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:23:35 trial011 ceph-mon[11956]: pgmap v330: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:23:37.635 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:23:37.761 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:23:37.881 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:37.877+0000 7fb9b857c6c0 1 -- 10.20.193.11:0/2862296523 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fb9b0115440 msgr2=0x7fb9b0175de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:23:37.882 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:37.877+0000 7fb9b857c6c0 1 --2- 10.20.193.11:0/2862296523 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fb9b0115440 0x7fb9b0175de0 secure :-1 s=READY pgs=449 gs=1 cs=0 l=1 c_cookie=12440281005363590598 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb9ac00aa70 tx=0x7fb9ac02fde0 comp rx=0 tx=0).stop 2026-02-13T02:23:37.882 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:37.877+0000 7fb9b857c6c0 1 -- 10.20.193.11:0/2862296523 shutdown_connections 2026-02-13T02:23:37.882 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:37.877+0000 7fb9b857c6c0 1 --2- 10.20.193.11:0/2862296523 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fb9b0115440 0x7fb9b0175de0 unknown :-1 s=CLOSED pgs=449 gs=1 cs=0 l=1 c_cookie=12440281005363590598 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:37.882 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:37.877+0000 7fb9b857c6c0 1 --2- 10.20.193.11:0/2862296523 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb9b010fc20 0x7fb9b0114c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:37.882 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:37.877+0000 7fb9b857c6c0 1 --2- 10.20.193.11:0/2862296523 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fb9b010f230 0x7fb9b010f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:37.882 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:37.877+0000 7fb9b857c6c0 1 -- 10.20.193.11:0/2862296523 >> 10.20.193.11:0/2862296523 conn(0x7fb9b00ecb30 msgr2=0x7fb9b010cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:23:37.882 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:37.877+0000 7fb9b857c6c0 1 -- 10.20.193.11:0/2862296523 shutdown_connections 2026-02-13T02:23:37.882 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:37.877+0000 7fb9b857c6c0 1 -- 10.20.193.11:0/2862296523 wait complete. 2026-02-13T02:23:37.882 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:37.878+0000 7fb9b857c6c0 1 Processor -- start 2026-02-13T02:23:37.882 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:37.878+0000 7fb9b857c6c0 1 -- start start 2026-02-13T02:23:37.883 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:37.878+0000 7fb9b857c6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb9b010f230 0x7fb9b011d1a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:23:37.883 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:37.878+0000 7fb9b857c6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fb9b0115440 0x7fb9b011d6e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:23:37.883 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:37.878+0000 7fb9b857c6c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fb9b0122aa0 0x7fb9b0122f40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:23:37.883 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:37.878+0000 7fb9b857c6c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7fb9b01234b0 con 0x7fb9b0115440 2026-02-13T02:23:37.883 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:37.878+0000 7fb9b857c6c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb9b0123620 con 0x7fb9b0122aa0 2026-02-13T02:23:37.883 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:37.878+0000 7fb9b857c6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fb9b01237e0 con 0x7fb9b010f230 2026-02-13T02:23:37.883 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:37.878+0000 7fb9b5af06c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fb9b0115440 0x7fb9b011d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:23:37.883 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:37.878+0000 7fb9b5af06c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fb9b0115440 0x7fb9b011d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:50768/0 (socket says 10.20.193.11:50768) 2026-02-13T02:23:37.883 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:37.878+0000 7fb9b5af06c0 1 -- 10.20.193.11:0/455958826 learned_addr learned my addr 10.20.193.11:0/455958826 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:23:37.883 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:37.878+0000 7fb9b62f16c0 1 --2- 10.20.193.11:0/455958826 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb9b010f230 0x7fb9b011d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:23:37.883 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:37.878+0000 7fb9b6af26c0 1 --2- 10.20.193.11:0/455958826 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fb9b0122aa0 0x7fb9b0122f40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:23:37.883 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:37.878+0000 7fb9b5af06c0 1 -- 10.20.193.11:0/455958826 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb9b010f230 msgr2=0x7fb9b011d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:23:37.884 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:37.878+0000 7fb9b5af06c0 1 --2- 10.20.193.11:0/455958826 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb9b010f230 0x7fb9b011d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:37.884 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:37.878+0000 7fb9b5af06c0 1 -- 10.20.193.11:0/455958826 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fb9b0122aa0 msgr2=0x7fb9b0122f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:23:37.884 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:37.878+0000 7fb9b5af06c0 1 --2- 10.20.193.11:0/455958826 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fb9b0122aa0 0x7fb9b0122f40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:37.884 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:37.878+0000 7fb9b5af06c0 1 -- 10.20.193.11:0/455958826 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9ac00a660 con 0x7fb9b0115440 2026-02-13T02:23:37.884 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:37.878+0000 7fb9b5af06c0 1 --2- 10.20.193.11:0/455958826 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fb9b0115440 0x7fb9b011d6e0 secure :-1 s=READY pgs=450 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb9a400b750 tx=0x7fb9a400bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:23:37.884 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:37.878+0000 7fb9977fe6c0 1 -- 10.20.193.11:0/455958826 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb9a4004a80 con 0x7fb9b0115440 2026-02-13T02:23:37.884 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:37.878+0000 7fb9977fe6c0 1 -- 10.20.193.11:0/455958826 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb9a4009030 con 0x7fb9b0115440 2026-02-13T02:23:37.884 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:37.878+0000 7fb9b857c6c0 1 -- 10.20.193.11:0/455958826 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9b0163c90 con 0x7fb9b0115440 2026-02-13T02:23:37.884 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:37.878+0000 7fb9977fe6c0 1 -- 10.20.193.11:0/455958826 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb9a400cdd0 con 0x7fb9b0115440 2026-02-13T02:23:37.884 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:37.878+0000 7fb9b857c6c0 1 -- 10.20.193.11:0/455958826 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9b0164120 con 0x7fb9b0115440 2026-02-13T02:23:37.884 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:37.879+0000 7fb9b857c6c0 1 -- 10.20.193.11:0/455958826 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9b0110500 con 0x7fb9b0115440 2026-02-13T02:23:37.885 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:37.880+0000 7fb9977fe6c0 1 -- 10.20.193.11:0/455958826 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7fb9a4005020 con 0x7fb9b0115440 2026-02-13T02:23:37.885 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:37.881+0000 7fb9977fe6c0 1 --2- 10.20.193.11:0/455958826 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fb98c0b5680 0x7fb98c0d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:23:37.886 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:37.881+0000 7fb9977fe6c0 1 -- 10.20.193.11:0/455958826 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7965+0+0 (secure 0 0 0) 0x7fb9a40e39d0 con 0x7fb9b0115440 2026-02-13T02:23:37.886 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:37.881+0000 7fb9b62f16c0 1 --2- 10.20.193.11:0/455958826 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fb98c0b5680 0x7fb98c0d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:23:37.886 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:37.881+0000 7fb9b62f16c0 1 --2- 10.20.193.11:0/455958826 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fb98c0b5680 0x7fb98c0d5b30 secure :-1 s=READY pgs=287 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb9a0004750 tx=0x7fb9a0009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:23:37.886 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:37.881+0000 7fb9977fe6c0 1 -- 10.20.193.11:0/455958826 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fb9a40a6490 con 0x7fb9b0115440 2026-02-13T02:23:38.007 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:38.005+0000 7fb9b857c6c0 1 -- 10.20.193.11:0/455958826 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fb9b010fc20 con 0x7fb9b0115440 2026-02-13T02:23:38.007 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:38.005+0000 7fb9977fe6c0 1 -- 10.20.193.11:0/455958826 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fb9a4004d00 con 0x7fb9b0115440 2026-02-13T02:23:38.007 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:23:38.008 INFO:teuthology.orchestra.run.trial011.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:23:38.009 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:38.006+0000 7fb9b857c6c0 1 -- 10.20.193.11:0/455958826 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fb98c0b5680 msgr2=0x7fb98c0d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:23:38.009 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:38.006+0000 7fb9b857c6c0 1 --2- 10.20.193.11:0/455958826 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fb98c0b5680 0x7fb98c0d5b30 secure :-1 s=READY pgs=287 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb9a0004750 tx=0x7fb9a0009260 comp rx=0 tx=0).stop 2026-02-13T02:23:38.009 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:38.006+0000 7fb9b857c6c0 1 -- 10.20.193.11:0/455958826 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fb9b0115440 msgr2=0x7fb9b011d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:23:38.009 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:38.006+0000 7fb9b857c6c0 1 --2- 10.20.193.11:0/455958826 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fb9b0115440 0x7fb9b011d6e0 secure :-1 s=READY pgs=450 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb9a400b750 tx=0x7fb9a400bc20 comp rx=0 tx=0).stop 2026-02-13T02:23:38.009 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:38.006+0000 7fb9b857c6c0 1 -- 10.20.193.11:0/455958826 shutdown_connections 2026-02-13T02:23:38.009 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:38.006+0000 7fb9b857c6c0 1 --2- 10.20.193.11:0/455958826 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fb98c0b5680 0x7fb98c0d5b30 unknown :-1 s=CLOSED pgs=287 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:38.009 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:38.006+0000 7fb9b857c6c0 1 --2- 10.20.193.11:0/455958826 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fb9b0122aa0 0x7fb9b0122f40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:38.009 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:38.006+0000 7fb9b857c6c0 1 --2- 10.20.193.11:0/455958826 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fb9b0115440 0x7fb9b011d6e0 unknown :-1 s=CLOSED pgs=450 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:38.009 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:38.006+0000 7fb9b857c6c0 1 --2- 10.20.193.11:0/455958826 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb9b010f230 0x7fb9b011d1a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:38.009 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:38.006+0000 7fb9b857c6c0 1 -- 10.20.193.11:0/455958826 >> 10.20.193.11:0/455958826 conn(0x7fb9b00ecb30 msgr2=0x7fb9b010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:23:38.010 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:38.006+0000 7fb9b857c6c0 1 -- 10.20.193.11:0/455958826 shutdown_connections 2026-02-13T02:23:38.010 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:38.006+0000 7fb9b857c6c0 1 -- 10.20.193.11:0/455958826 wait complete. 2026-02-13T02:23:38.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:23:38 trial011 ceph-mon[11956]: pgmap v331: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T02:23:38.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:23:38 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/455958826' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:23:38.744 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:23:38 trial078 ceph-mon[14969]: pgmap v331: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T02:23:38.744 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:23:38 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/455958826' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:23:38.750 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:23:38 trial060 ceph-mon[14797]: pgmap v331: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T02:23:38.750 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:23:38 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/455958826' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:23:40.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:23:40 trial011 ceph-mon[11956]: pgmap v332: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:23:40.750 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:23:40 trial060 ceph-mon[14797]: pgmap v332: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:23:40.791 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:23:40 trial078 ceph-mon[14969]: pgmap v332: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:23:41.047 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:23:41.173 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:23:41.289 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:41.285+0000 7fa0bc41c6c0 1 -- 10.20.193.11:0/2845337286 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fa0b410f230 msgr2=0x7fa0b410f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:23:41.289 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:41.285+0000 7fa0bc41c6c0 1 --2- 10.20.193.11:0/2845337286 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fa0b410f230 0x7fa0b410f600 secure :-1 s=READY pgs=451 gs=1 cs=0 l=1 c_cookie=9405602141353735220 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa0a40099a0 tx=0x7fa0a402ed20 comp rx=0 tx=0).stop 2026-02-13T02:23:41.289 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:41.285+0000 7fa0bc41c6c0 1 -- 10.20.193.11:0/2845337286 shutdown_connections 2026-02-13T02:23:41.289 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:41.285+0000 7fa0bc41c6c0 1 --2- 10.20.193.11:0/2845337286 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fa0b410fc20 0x7fa0b4114c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:41.290 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:41.285+0000 7fa0bc41c6c0 1 --2- 10.20.193.11:0/2845337286 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa0b4115440 0x7fa0b4175de0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:41.290 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:41.285+0000 7fa0bc41c6c0 1 --2- 10.20.193.11:0/2845337286 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fa0b410f230 0x7fa0b410f600 unknown :-1 s=CLOSED pgs=451 gs=1 cs=0 l=1 c_cookie=9405602141353735220 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:41.290 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:41.285+0000 7fa0bc41c6c0 1 -- 10.20.193.11:0/2845337286 >> 10.20.193.11:0/2845337286 conn(0x7fa0b40ecb30 msgr2=0x7fa0b410cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:23:41.290 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:41.285+0000 7fa0bc41c6c0 1 -- 10.20.193.11:0/2845337286 shutdown_connections 2026-02-13T02:23:41.290 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:41.285+0000 7fa0bc41c6c0 1 -- 10.20.193.11:0/2845337286 wait complete. 2026-02-13T02:23:41.290 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:41.285+0000 7fa0bc41c6c0 1 Processor -- start 2026-02-13T02:23:41.290 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:41.285+0000 7fa0bc41c6c0 1 -- start start 2026-02-13T02:23:41.290 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:41.285+0000 7fa0bc41c6c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fa0b410f230 0x7fa0b411d1c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:23:41.290 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:41.285+0000 7fa0bc41c6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fa0b4115440 0x7fa0b411d700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:23:41.290 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:41.285+0000 7fa0bc41c6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa0b4122ac0 0x7fa0b4122f60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:23:41.290 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:41.285+0000 7fa0bc41c6c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7fa0b41234d0 con 0x7fa0b4115440 2026-02-13T02:23:41.291 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:41.285+0000 7fa0bc41c6c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa0b4123640 con 0x7fa0b410f230 2026-02-13T02:23:41.291 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:41.285+0000 7fa0bc41c6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa0b4123800 con 0x7fa0b4122ac0 2026-02-13T02:23:41.291 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:41.286+0000 7fa0b99906c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fa0b4115440 0x7fa0b411d700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:23:41.291 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:41.286+0000 7fa0b99906c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fa0b4115440 0x7fa0b411d700 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:36652/0 (socket says 10.20.193.11:36652) 2026-02-13T02:23:41.291 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:41.286+0000 7fa0b99906c0 1 -- 10.20.193.11:0/2497731571 learned_addr learned my addr 10.20.193.11:0/2497731571 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:23:41.291 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:41.286+0000 7fa0ba9926c0 1 --2- 10.20.193.11:0/2497731571 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa0b4122ac0 0x7fa0b4122f60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:23:41.291 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:41.286+0000 7fa0ba1916c0 1 --2- 10.20.193.11:0/2497731571 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fa0b410f230 0x7fa0b411d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:23:41.291 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:41.286+0000 7fa0b99906c0 1 -- 10.20.193.11:0/2497731571 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa0b4122ac0 msgr2=0x7fa0b4122f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:23:41.291 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:41.286+0000 7fa0b99906c0 1 --2- 10.20.193.11:0/2497731571 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa0b4122ac0 0x7fa0b4122f60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:41.291 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:41.286+0000 7fa0b99906c0 1 -- 10.20.193.11:0/2497731571 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fa0b410f230 msgr2=0x7fa0b411d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:23:41.291 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:41.286+0000 7fa0b99906c0 1 --2- 10.20.193.11:0/2497731571 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fa0b410f230 0x7fa0b411d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:41.291 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:41.286+0000 7fa0b99906c0 1 -- 10.20.193.11:0/2497731571 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0a4009590 con 0x7fa0b4115440 2026-02-13T02:23:41.292 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:41.286+0000 7fa0b99906c0 1 --2- 10.20.193.11:0/2497731571 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fa0b4115440 0x7fa0b411d700 secure :-1 s=READY pgs=452 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa0a8005dc0 tx=0x7fa0a800bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:23:41.292 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:41.286+0000 7fa09b7fe6c0 1 -- 10.20.193.11:0/2497731571 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa0a8004250 con 0x7fa0b4115440 2026-02-13T02:23:41.292 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:41.286+0000 7fa09b7fe6c0 1 -- 10.20.193.11:0/2497731571 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fa0a8009070 con 0x7fa0b4115440 2026-02-13T02:23:41.292 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:41.286+0000 7fa09b7fe6c0 1 -- 10.20.193.11:0/2497731571 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa0a800cdc0 con 0x7fa0b4115440 2026-02-13T02:23:41.292 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:41.286+0000 7fa0bc41c6c0 1 -- 10.20.193.11:0/2497731571 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0b4163cb0 con 0x7fa0b4115440 2026-02-13T02:23:41.292 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:41.286+0000 7fa0bc41c6c0 1 -- 10.20.193.11:0/2497731571 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0b4164140 con 0x7fa0b4115440 2026-02-13T02:23:41.292 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:41.286+0000 7fa0bc41c6c0 1 -- 10.20.193.11:0/2497731571 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0b4110500 con 0x7fa0b4115440 2026-02-13T02:23:41.293 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:41.288+0000 7fa09b7fe6c0 1 -- 10.20.193.11:0/2497731571 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7fa0a80028c0 con 0x7fa0b4115440 2026-02-13T02:23:41.293 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:41.288+0000 7fa09b7fe6c0 1 --2- 10.20.193.11:0/2497731571 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fa0900b5680 0x7fa0900d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:23:41.293 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:41.288+0000 7fa0ba1916c0 1 --2- 10.20.193.11:0/2497731571 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fa0900b5680 0x7fa0900d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:23:41.293 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:41.288+0000 7fa09b7fe6c0 1 -- 10.20.193.11:0/2497731571 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7965+0+0 (secure 0 0 0) 0x7fa0a80e3990 con 0x7fa0b4115440 2026-02-13T02:23:41.293 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:41.289+0000 7fa0ba1916c0 1 --2- 10.20.193.11:0/2497731571 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fa0900b5680 0x7fa0900d5b30 secure :-1 s=READY pgs=288 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa0a40023e0 tx=0x7fa0a4031f90 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:23:41.294 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:41.289+0000 7fa09b7fe6c0 1 -- 10.20.193.11:0/2497731571 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fa0a80a6450 con 0x7fa0b4115440 2026-02-13T02:23:41.407 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:41.405+0000 7fa0bc41c6c0 1 -- 10.20.193.11:0/2497731571 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fa0b410f600 con 0x7fa0b4115440 2026-02-13T02:23:41.408 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:41.406+0000 7fa09b7fe6c0 1 -- 10.20.193.11:0/2497731571 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fa0a80a9600 con 0x7fa0b4115440 2026-02-13T02:23:41.408 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:23:41.408 INFO:teuthology.orchestra.run.trial011.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:23:41.409 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:41.407+0000 7fa0bc41c6c0 1 -- 10.20.193.11:0/2497731571 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fa0900b5680 msgr2=0x7fa0900d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:23:41.409 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:41.407+0000 7fa0bc41c6c0 1 --2- 10.20.193.11:0/2497731571 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fa0900b5680 0x7fa0900d5b30 secure :-1 s=READY pgs=288 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa0a40023e0 tx=0x7fa0a4031f90 comp rx=0 tx=0).stop 2026-02-13T02:23:41.409 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:41.407+0000 7fa0bc41c6c0 1 -- 10.20.193.11:0/2497731571 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fa0b4115440 msgr2=0x7fa0b411d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:23:41.409 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:41.407+0000 7fa0bc41c6c0 1 --2- 10.20.193.11:0/2497731571 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fa0b4115440 0x7fa0b411d700 secure :-1 s=READY pgs=452 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa0a8005dc0 tx=0x7fa0a800bbb0 comp rx=0 tx=0).stop 2026-02-13T02:23:41.409 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:41.407+0000 7fa0bc41c6c0 1 -- 10.20.193.11:0/2497731571 shutdown_connections 2026-02-13T02:23:41.410 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:41.407+0000 7fa0bc41c6c0 1 --2- 10.20.193.11:0/2497731571 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fa0900b5680 0x7fa0900d5b30 unknown :-1 s=CLOSED pgs=288 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:41.410 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:41.407+0000 7fa0bc41c6c0 1 --2- 10.20.193.11:0/2497731571 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fa0b4122ac0 0x7fa0b4122f60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:41.410 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:41.407+0000 7fa0bc41c6c0 1 --2- 10.20.193.11:0/2497731571 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fa0b4115440 0x7fa0b411d700 unknown :-1 s=CLOSED pgs=452 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:41.410 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:41.407+0000 7fa0bc41c6c0 1 --2- 10.20.193.11:0/2497731571 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fa0b410f230 0x7fa0b411d1c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:41.410 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:41.407+0000 7fa0bc41c6c0 1 -- 10.20.193.11:0/2497731571 >> 10.20.193.11:0/2497731571 conn(0x7fa0b40ecb30 msgr2=0x7fa0b410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:23:41.410 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:41.407+0000 7fa0bc41c6c0 1 -- 10.20.193.11:0/2497731571 shutdown_connections 2026-02-13T02:23:41.410 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:41.407+0000 7fa0bc41c6c0 1 -- 10.20.193.11:0/2497731571 wait complete. 2026-02-13T02:23:42.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:23:42 trial011 ceph-mon[11956]: pgmap v333: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:23:42.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:23:42 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/2497731571' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:23:42.750 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:23:42 trial060 ceph-mon[14797]: pgmap v333: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:23:42.750 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:23:42 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/2497731571' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:23:42.791 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:23:42 trial078 ceph-mon[14969]: pgmap v333: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:23:42.791 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:23:42 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/2497731571' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:23:44.450 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:23:44.577 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:23:44.625 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:23:44 trial011 ceph-mon[11956]: pgmap v334: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:23:44.699 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:44.695+0000 7fb58ed4d6c0 1 -- 10.20.193.11:0/1485593317 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fb588115410 msgr2=0x7fb588175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:23:44.699 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:44.695+0000 7fb58ed4d6c0 1 --2- 10.20.193.11:0/1485593317 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fb588115410 0x7fb588175db0 secure :-1 s=READY pgs=453 gs=1 cs=0 l=1 c_cookie=15377124604227324080 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb58400aa70 tx=0x7fb58402fde0 comp rx=0 tx=0).stop 2026-02-13T02:23:44.699 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:44.695+0000 7fb58ed4d6c0 1 -- 10.20.193.11:0/1485593317 shutdown_connections 2026-02-13T02:23:44.699 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:44.695+0000 7fb58ed4d6c0 1 --2- 10.20.193.11:0/1485593317 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fb588115410 0x7fb588175db0 unknown :-1 s=CLOSED pgs=453 gs=1 cs=0 l=1 c_cookie=15377124604227324080 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:44.699 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:44.695+0000 7fb58ed4d6c0 1 --2- 10.20.193.11:0/1485593317 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb58810fbf0 0x7fb588114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:44.700 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:44.695+0000 7fb58ed4d6c0 1 --2- 10.20.193.11:0/1485593317 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fb58810f200 0x7fb58810f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:44.700 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:44.695+0000 7fb58ed4d6c0 1 -- 10.20.193.11:0/1485593317 >> 10.20.193.11:0/1485593317 conn(0x7fb5880ecb00 msgr2=0x7fb58810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:23:44.700 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:44.695+0000 7fb58ed4d6c0 1 -- 10.20.193.11:0/1485593317 shutdown_connections 2026-02-13T02:23:44.700 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:44.695+0000 7fb58ed4d6c0 1 -- 10.20.193.11:0/1485593317 wait complete. 2026-02-13T02:23:44.700 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:44.695+0000 7fb58ed4d6c0 1 Processor -- start 2026-02-13T02:23:44.700 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:44.695+0000 7fb58ed4d6c0 1 -- start start 2026-02-13T02:23:44.700 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:44.695+0000 7fb58ed4d6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb58810f200 0x7fb58811d180 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:23:44.700 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:44.695+0000 7fb58ed4d6c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fb588115410 0x7fb58811d6c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:23:44.700 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:44.695+0000 7fb58ed4d6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fb588122a80 0x7fb588122f20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:23:44.700 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:44.695+0000 7fb58ed4d6c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7fb588123490 con 0x7fb588122a80 2026-02-13T02:23:44.700 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:44.695+0000 7fb58ed4d6c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb588123600 con 0x7fb588115410 2026-02-13T02:23:44.701 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:44.695+0000 7fb58ed4d6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fb5881237c0 con 0x7fb58810f200 2026-02-13T02:23:44.701 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:44.695+0000 7fb58d2bf6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fb588122a80 0x7fb588122f20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:23:44.701 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:44.695+0000 7fb58d2bf6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fb588122a80 0x7fb588122f20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:36676/0 (socket says 10.20.193.11:36676) 2026-02-13T02:23:44.701 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:44.695+0000 7fb58d2bf6c0 1 -- 10.20.193.11:0/3073827549 learned_addr learned my addr 10.20.193.11:0/3073827549 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:23:44.701 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:44.695+0000 7fb58cabe6c0 1 --2- 10.20.193.11:0/3073827549 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb58810f200 0x7fb58811d180 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:23:44.701 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:44.695+0000 7fb58d2bf6c0 1 -- 10.20.193.11:0/3073827549 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb58810f200 msgr2=0x7fb58811d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:23:44.701 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:44.695+0000 7fb57ffff6c0 1 --2- 10.20.193.11:0/3073827549 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fb588115410 0x7fb58811d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:23:44.701 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:44.695+0000 7fb58d2bf6c0 1 --2- 10.20.193.11:0/3073827549 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb58810f200 0x7fb58811d180 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:44.701 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:44.695+0000 7fb58d2bf6c0 1 -- 10.20.193.11:0/3073827549 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fb588115410 msgr2=0x7fb58811d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:23:44.701 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:44.695+0000 7fb58d2bf6c0 1 --2- 10.20.193.11:0/3073827549 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fb588115410 0x7fb58811d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:44.701 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:44.695+0000 7fb58d2bf6c0 1 -- 10.20.193.11:0/3073827549 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb58400a660 con 0x7fb588122a80 2026-02-13T02:23:44.701 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:44.695+0000 7fb58cabe6c0 1 --2- 10.20.193.11:0/3073827549 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb58810f200 0x7fb58811d180 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:23:44.702 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:44.696+0000 7fb57ffff6c0 1 --2- 10.20.193.11:0/3073827549 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fb588115410 0x7fb58811d6c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:23:44.702 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:44.696+0000 7fb58d2bf6c0 1 --2- 10.20.193.11:0/3073827549 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fb588122a80 0x7fb588122f20 secure :-1 s=READY pgs=454 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb5840054b0 tx=0x7fb5840054e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:23:44.702 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:44.696+0000 7fb57dffb6c0 1 -- 10.20.193.11:0/3073827549 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb584003a30 con 0x7fb588122a80 2026-02-13T02:23:44.702 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:44.696+0000 7fb57dffb6c0 1 -- 10.20.193.11:0/3073827549 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fb584003b90 con 0x7fb588122a80 2026-02-13T02:23:44.702 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:44.696+0000 7fb58ed4d6c0 1 -- 10.20.193.11:0/3073827549 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb588163c10 con 0x7fb588122a80 2026-02-13T02:23:44.702 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:44.696+0000 7fb57dffb6c0 1 -- 10.20.193.11:0/3073827549 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb5840382d0 con 0x7fb588122a80 2026-02-13T02:23:44.702 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:44.696+0000 7fb58ed4d6c0 1 -- 10.20.193.11:0/3073827549 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb588164040 con 0x7fb588122a80 2026-02-13T02:23:44.702 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:44.696+0000 7fb58ed4d6c0 1 -- 10.20.193.11:0/3073827549 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5881104d0 con 0x7fb588122a80 2026-02-13T02:23:44.702 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:44.697+0000 7fb57dffb6c0 1 -- 10.20.193.11:0/3073827549 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7fb584008350 con 0x7fb588122a80 2026-02-13T02:23:44.703 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:44.698+0000 7fb57dffb6c0 1 --2- 10.20.193.11:0/3073827549 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fb5640b5600 0x7fb5640d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:23:44.703 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:44.698+0000 7fb58cabe6c0 1 --2- 10.20.193.11:0/3073827549 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fb5640b5600 0x7fb5640d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:23:44.703 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:44.698+0000 7fb57dffb6c0 1 -- 10.20.193.11:0/3073827549 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7965+0+0 (secure 0 0 0) 0x7fb584108f50 con 0x7fb588122a80 2026-02-13T02:23:44.703 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:44.698+0000 7fb57dffb6c0 1 -- 10.20.193.11:0/3073827549 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fb5840cf470 con 0x7fb588122a80 2026-02-13T02:23:44.704 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:44.698+0000 7fb58cabe6c0 1 --2- 10.20.193.11:0/3073827549 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fb5640b5600 0x7fb5640d5ab0 secure :-1 s=READY pgs=289 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb578004750 tx=0x7fb578005f10 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:23:44.750 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:23:44 trial060 ceph-mon[14797]: pgmap v334: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:23:44.791 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:23:44 trial078 ceph-mon[14969]: pgmap v334: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:23:44.816 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:44.814+0000 7fb58ed4d6c0 1 -- 10.20.193.11:0/3073827549 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fb58810f5d0 con 0x7fb588122a80 2026-02-13T02:23:44.816 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:44.814+0000 7fb57dffb6c0 1 -- 10.20.193.11:0/3073827549 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fb5840cebc0 con 0x7fb588122a80 2026-02-13T02:23:44.817 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:23:44.817 INFO:teuthology.orchestra.run.trial011.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:23:44.818 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:44.815+0000 7fb58ed4d6c0 1 -- 10.20.193.11:0/3073827549 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fb5640b5600 msgr2=0x7fb5640d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:23:44.818 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:44.815+0000 7fb58ed4d6c0 1 --2- 10.20.193.11:0/3073827549 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fb5640b5600 0x7fb5640d5ab0 secure :-1 s=READY pgs=289 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb578004750 tx=0x7fb578005f10 comp rx=0 tx=0).stop 2026-02-13T02:23:44.818 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:44.815+0000 7fb58ed4d6c0 1 -- 10.20.193.11:0/3073827549 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fb588122a80 msgr2=0x7fb588122f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:23:44.818 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:44.815+0000 7fb58ed4d6c0 1 --2- 10.20.193.11:0/3073827549 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fb588122a80 0x7fb588122f20 secure :-1 s=READY pgs=454 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb5840054b0 tx=0x7fb5840054e0 comp rx=0 tx=0).stop 2026-02-13T02:23:44.818 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:44.815+0000 7fb58ed4d6c0 1 -- 10.20.193.11:0/3073827549 shutdown_connections 2026-02-13T02:23:44.818 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:44.815+0000 7fb58ed4d6c0 1 --2- 10.20.193.11:0/3073827549 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fb5640b5600 0x7fb5640d5ab0 unknown :-1 s=CLOSED pgs=289 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:44.818 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:44.815+0000 7fb58ed4d6c0 1 --2- 10.20.193.11:0/3073827549 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fb588115410 0x7fb58811d6c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:44.819 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:44.815+0000 7fb58ed4d6c0 1 --2- 10.20.193.11:0/3073827549 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fb588122a80 0x7fb588122f20 unknown :-1 s=CLOSED pgs=454 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:44.819 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:44.815+0000 7fb58ed4d6c0 1 --2- 10.20.193.11:0/3073827549 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fb58810f200 0x7fb58811d180 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:44.819 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:44.815+0000 7fb58ed4d6c0 1 -- 10.20.193.11:0/3073827549 >> 10.20.193.11:0/3073827549 conn(0x7fb5880ecb00 msgr2=0x7fb58810cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:23:44.819 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:44.815+0000 7fb58ed4d6c0 1 -- 10.20.193.11:0/3073827549 shutdown_connections 2026-02-13T02:23:44.819 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:44.815+0000 7fb58ed4d6c0 1 -- 10.20.193.11:0/3073827549 wait complete. 2026-02-13T02:23:45.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:23:45 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/3073827549' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:23:45.750 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:23:45 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/3073827549' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:23:45.791 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:23:45 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/3073827549' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:23:46.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:23:46 trial011 ceph-mon[11956]: pgmap v335: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:23:46.750 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:23:46 trial060 ceph-mon[14797]: pgmap v335: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:23:46.791 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:23:46 trial078 ceph-mon[14969]: pgmap v335: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:23:47.856 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:23:47.982 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:23:48.094 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:48.090+0000 7fd8b5f496c0 1 -- 10.20.193.11:0/2712059378 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fd8b0115410 msgr2=0x7fd8b0175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:23:48.094 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:48.090+0000 7fd8b5f496c0 1 --2- 10.20.193.11:0/2712059378 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fd8b0115410 0x7fd8b0175db0 secure :-1 s=READY pgs=455 gs=1 cs=0 l=1 c_cookie=13998905884469953655 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd8a400aa70 tx=0x7fd8a402fde0 comp rx=0 tx=0).stop 2026-02-13T02:23:48.094 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:48.090+0000 7fd8b5f496c0 1 -- 10.20.193.11:0/2712059378 shutdown_connections 2026-02-13T02:23:48.094 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:48.090+0000 7fd8b5f496c0 1 --2- 10.20.193.11:0/2712059378 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fd8b010fbf0 0x7fd8b0114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:48.094 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:48.090+0000 7fd8b5f496c0 1 --2- 10.20.193.11:0/2712059378 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fd8b0115410 0x7fd8b0175db0 unknown :-1 s=CLOSED pgs=455 gs=1 cs=0 l=1 c_cookie=13998905884469953655 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:48.094 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:48.090+0000 7fd8b5f496c0 1 --2- 10.20.193.11:0/2712059378 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd8b010f200 0x7fd8b010f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:48.094 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:48.090+0000 7fd8b5f496c0 1 -- 10.20.193.11:0/2712059378 >> 10.20.193.11:0/2712059378 conn(0x7fd8b00ecb00 msgr2=0x7fd8b010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:23:48.094 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:48.090+0000 7fd8b5f496c0 1 -- 10.20.193.11:0/2712059378 shutdown_connections 2026-02-13T02:23:48.094 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:48.090+0000 7fd8b5f496c0 1 -- 10.20.193.11:0/2712059378 wait complete. 2026-02-13T02:23:48.095 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:48.090+0000 7fd8b5f496c0 1 Processor -- start 2026-02-13T02:23:48.095 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:48.090+0000 7fd8b5f496c0 1 -- start start 2026-02-13T02:23:48.095 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:48.090+0000 7fd8b5f496c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fd8b010f200 0x7fd8b011d170 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:23:48.095 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:48.090+0000 7fd8b5f496c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fd8b0115410 0x7fd8b011d6b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:23:48.095 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:48.090+0000 7fd8b5f496c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd8b0122a70 0x7fd8b0122f10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:23:48.095 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:48.090+0000 7fd8b5f496c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7fd8b0123480 con 0x7fd8b010f200 2026-02-13T02:23:48.095 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:48.090+0000 7fd8b5f496c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd8b01235f0 con 0x7fd8b0115410 2026-02-13T02:23:48.095 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:48.090+0000 7fd8b5f496c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fd8b01237b0 con 0x7fd8b0122a70 2026-02-13T02:23:48.095 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:48.090+0000 7fd8af7fe6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fd8b010f200 0x7fd8b011d170 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:23:48.095 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:48.090+0000 7fd8af7fe6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fd8b010f200 0x7fd8b011d170 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:36684/0 (socket says 10.20.193.11:36684) 2026-02-13T02:23:48.095 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:48.090+0000 7fd8af7fe6c0 1 -- 10.20.193.11:0/2408658767 learned_addr learned my addr 10.20.193.11:0/2408658767 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:23:48.095 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:48.090+0000 7fd8affff6c0 1 --2- 10.20.193.11:0/2408658767 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd8b0122a70 0x7fd8b0122f10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:23:48.096 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:48.090+0000 7fd8aeffd6c0 1 --2- 10.20.193.11:0/2408658767 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fd8b0115410 0x7fd8b011d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:23:48.096 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:48.091+0000 7fd8af7fe6c0 1 -- 10.20.193.11:0/2408658767 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd8b0122a70 msgr2=0x7fd8b0122f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:23:48.096 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:48.091+0000 7fd8af7fe6c0 1 --2- 10.20.193.11:0/2408658767 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd8b0122a70 0x7fd8b0122f10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:48.096 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:48.091+0000 7fd8af7fe6c0 1 -- 10.20.193.11:0/2408658767 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fd8b0115410 msgr2=0x7fd8b011d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:23:48.096 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:48.091+0000 7fd8af7fe6c0 1 --2- 10.20.193.11:0/2408658767 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fd8b0115410 0x7fd8b011d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:48.096 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:48.091+0000 7fd8af7fe6c0 1 -- 10.20.193.11:0/2408658767 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8a400a660 con 0x7fd8b010f200 2026-02-13T02:23:48.096 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:48.091+0000 7fd8af7fe6c0 1 --2- 10.20.193.11:0/2408658767 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fd8b010f200 0x7fd8b011d170 secure :-1 s=READY pgs=456 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd89c00b710 tx=0x7fd89c00bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:23:48.096 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:48.091+0000 7fd8acff96c0 1 -- 10.20.193.11:0/2408658767 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd89c004250 con 0x7fd8b010f200 2026-02-13T02:23:48.096 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:48.091+0000 7fd8acff96c0 1 -- 10.20.193.11:0/2408658767 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fd89c002da0 con 0x7fd8b010f200 2026-02-13T02:23:48.096 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:48.091+0000 7fd8b5f496c0 1 -- 10.20.193.11:0/2408658767 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8b0163c60 con 0x7fd8b010f200 2026-02-13T02:23:48.096 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:48.091+0000 7fd8acff96c0 1 -- 10.20.193.11:0/2408658767 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd89c00ce40 con 0x7fd8b010f200 2026-02-13T02:23:48.096 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:48.091+0000 7fd8b5f496c0 1 -- 10.20.193.11:0/2408658767 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8b0164140 con 0x7fd8b010f200 2026-02-13T02:23:48.097 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:48.091+0000 7fd8b5f496c0 1 -- 10.20.193.11:0/2408658767 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8b01104d0 con 0x7fd8b010f200 2026-02-13T02:23:48.098 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:48.092+0000 7fd8acff96c0 1 -- 10.20.193.11:0/2408658767 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7fd89c00c410 con 0x7fd8b010f200 2026-02-13T02:23:48.098 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:48.093+0000 7fd8acff96c0 1 --2- 10.20.193.11:0/2408658767 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fd8840b5680 0x7fd8840d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:23:48.098 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:48.093+0000 7fd8acff96c0 1 -- 10.20.193.11:0/2408658767 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7965+0+0 (secure 0 0 0) 0x7fd89c0e3c20 con 0x7fd8b010f200 2026-02-13T02:23:48.098 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:48.093+0000 7fd8aeffd6c0 1 --2- 10.20.193.11:0/2408658767 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fd8840b5680 0x7fd8840d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:23:48.098 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:48.093+0000 7fd8aeffd6c0 1 --2- 10.20.193.11:0/2408658767 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fd8840b5680 0x7fd8840d5b30 secure :-1 s=READY pgs=290 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd8a0005980 tx=0x7fd8a0005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:23:48.098 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:48.093+0000 7fd8acff96c0 1 -- 10.20.193.11:0/2408658767 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fd89c0a66e0 con 0x7fd8b010f200 2026-02-13T02:23:48.212 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:48.210+0000 7fd8b5f496c0 1 -- 10.20.193.11:0/2408658767 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fd8b010f5d0 con 0x7fd8b010f200 2026-02-13T02:23:48.212 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:48.210+0000 7fd8acff96c0 1 -- 10.20.193.11:0/2408658767 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fd89c0a9890 con 0x7fd8b010f200 2026-02-13T02:23:48.212 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:23:48.212 INFO:teuthology.orchestra.run.trial011.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:23:48.213 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:48.211+0000 7fd8b5f496c0 1 -- 10.20.193.11:0/2408658767 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fd8840b5680 msgr2=0x7fd8840d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:23:48.213 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:48.211+0000 7fd8b5f496c0 1 --2- 10.20.193.11:0/2408658767 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fd8840b5680 0x7fd8840d5b30 secure :-1 s=READY pgs=290 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd8a0005980 tx=0x7fd8a0005910 comp rx=0 tx=0).stop 2026-02-13T02:23:48.213 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:48.211+0000 7fd8b5f496c0 1 -- 10.20.193.11:0/2408658767 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fd8b010f200 msgr2=0x7fd8b011d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:23:48.213 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:48.211+0000 7fd8b5f496c0 1 --2- 10.20.193.11:0/2408658767 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fd8b010f200 0x7fd8b011d170 secure :-1 s=READY pgs=456 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd89c00b710 tx=0x7fd89c00bbe0 comp rx=0 tx=0).stop 2026-02-13T02:23:48.213 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:48.211+0000 7fd8b5f496c0 1 -- 10.20.193.11:0/2408658767 shutdown_connections 2026-02-13T02:23:48.213 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:48.211+0000 7fd8b5f496c0 1 --2- 10.20.193.11:0/2408658767 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fd8840b5680 0x7fd8840d5b30 unknown :-1 s=CLOSED pgs=290 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:48.213 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:48.211+0000 7fd8b5f496c0 1 --2- 10.20.193.11:0/2408658767 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fd8b0115410 0x7fd8b011d6b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:48.213 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:48.211+0000 7fd8b5f496c0 1 --2- 10.20.193.11:0/2408658767 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fd8b0122a70 0x7fd8b0122f10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:48.213 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:48.211+0000 7fd8b5f496c0 1 --2- 10.20.193.11:0/2408658767 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fd8b010f200 0x7fd8b011d170 unknown :-1 s=CLOSED pgs=456 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:48.213 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:48.211+0000 7fd8b5f496c0 1 -- 10.20.193.11:0/2408658767 >> 10.20.193.11:0/2408658767 conn(0x7fd8b00ecb00 msgr2=0x7fd8b010cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:23:48.213 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:48.211+0000 7fd8b5f496c0 1 -- 10.20.193.11:0/2408658767 shutdown_connections 2026-02-13T02:23:48.213 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:48.212+0000 7fd8b5f496c0 1 -- 10.20.193.11:0/2408658767 wait complete. 2026-02-13T02:23:48.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:23:48 trial011 ceph-mon[11956]: pgmap v336: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T02:23:48.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:23:48 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/2408658767' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:23:48.750 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:23:48 trial060 ceph-mon[14797]: pgmap v336: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T02:23:48.750 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:23:48 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/2408658767' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:23:48.791 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:23:48 trial078 ceph-mon[14969]: pgmap v336: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T02:23:48.791 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:23:48 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/2408658767' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:23:50.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:23:50 trial011 ceph-mon[11956]: pgmap v337: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:23:50.750 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:23:50 trial060 ceph-mon[14797]: pgmap v337: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:23:50.791 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:23:50 trial078 ceph-mon[14969]: pgmap v337: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:23:51.252 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:23:51.379 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:23:51.500 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:51.496+0000 7f8a05ac86c0 1 -- 10.20.193.11:0/445976944 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f8a0010fc20 msgr2=0x7f8a00114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:23:51.501 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:51.496+0000 7f8a05ac86c0 1 --2- 10.20.193.11:0/445976944 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f8a0010fc20 0x7f8a00114c60 secure :-1 s=READY pgs=457 gs=1 cs=0 l=1 c_cookie=16196664413113637730 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f89f00099a0 tx=0x7f89f002ed00 comp rx=0 tx=0).stop 2026-02-13T02:23:51.501 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:51.496+0000 7f8a05ac86c0 1 -- 10.20.193.11:0/445976944 shutdown_connections 2026-02-13T02:23:51.501 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:51.496+0000 7f8a05ac86c0 1 --2- 10.20.193.11:0/445976944 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f8a00115440 0x7f8a00175de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:51.501 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:51.496+0000 7f8a05ac86c0 1 --2- 10.20.193.11:0/445976944 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f8a0010fc20 0x7f8a00114c60 unknown :-1 s=CLOSED pgs=457 gs=1 cs=0 l=1 c_cookie=16196664413113637730 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:51.501 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:51.496+0000 7f8a05ac86c0 1 --2- 10.20.193.11:0/445976944 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f8a0010f230 0x7f8a0010f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:51.501 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:51.496+0000 7f8a05ac86c0 1 -- 10.20.193.11:0/445976944 >> 10.20.193.11:0/445976944 conn(0x7f8a000ecb30 msgr2=0x7f8a0010cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:23:51.501 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:51.496+0000 7f8a05ac86c0 1 -- 10.20.193.11:0/445976944 shutdown_connections 2026-02-13T02:23:51.501 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:51.497+0000 7f8a05ac86c0 1 -- 10.20.193.11:0/445976944 wait complete. 2026-02-13T02:23:51.501 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:51.497+0000 7f8a05ac86c0 1 Processor -- start 2026-02-13T02:23:51.501 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:51.497+0000 7f8a05ac86c0 1 -- start start 2026-02-13T02:23:51.502 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:51.497+0000 7f8a05ac86c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f8a0010f230 0x7f8a000f4c50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:23:51.502 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:51.497+0000 7f8a05ac86c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f8a00115440 0x7f8a00175ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:23:51.502 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:51.497+0000 7f8a05ac86c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f8a000f5280 0x7f8a000fa550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:23:51.502 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:51.497+0000 7f8a05ac86c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f8a000f58e0 con 0x7f8a0010f230 2026-02-13T02:23:51.502 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:51.497+0000 7f8a05ac86c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f8a000faa90 con 0x7f8a000f5280 2026-02-13T02:23:51.502 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:51.497+0000 7f8a05ac86c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f8a000fac50 con 0x7f8a00115440 2026-02-13T02:23:51.502 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:51.497+0000 7f89ff7fe6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f8a0010f230 0x7f8a000f4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:23:51.502 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:51.497+0000 7f89ff7fe6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f8a0010f230 0x7f8a000f4c50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:56984/0 (socket says 10.20.193.11:56984) 2026-02-13T02:23:51.502 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:51.497+0000 7f89ff7fe6c0 1 -- 10.20.193.11:0/2519941153 learned_addr learned my addr 10.20.193.11:0/2519941153 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:23:51.502 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:51.497+0000 7f89feffd6c0 1 --2- 10.20.193.11:0/2519941153 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f8a00115440 0x7f8a00175ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:23:51.502 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:51.497+0000 7f89fffff6c0 1 --2- 10.20.193.11:0/2519941153 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f8a000f5280 0x7f8a000fa550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:23:51.502 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:51.497+0000 7f89ff7fe6c0 1 -- 10.20.193.11:0/2519941153 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f8a00115440 msgr2=0x7f8a00175ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:23:51.503 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:51.497+0000 7f89ff7fe6c0 1 --2- 10.20.193.11:0/2519941153 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f8a00115440 0x7f8a00175ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:51.503 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:51.497+0000 7f89ff7fe6c0 1 -- 10.20.193.11:0/2519941153 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f8a000f5280 msgr2=0x7f8a000fa550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:23:51.503 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:51.497+0000 7f89ff7fe6c0 1 --2- 10.20.193.11:0/2519941153 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f8a000f5280 0x7f8a000fa550 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:51.503 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:51.497+0000 7f89ff7fe6c0 1 -- 10.20.193.11:0/2519941153 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89f0009590 con 0x7f8a0010f230 2026-02-13T02:23:51.503 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:51.497+0000 7f89ff7fe6c0 1 --2- 10.20.193.11:0/2519941153 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f8a0010f230 0x7f8a000f4c50 secure :-1 s=READY pgs=458 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f89ec00b6c0 tx=0x7f89ec00bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:23:51.503 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:51.497+0000 7f89fcff96c0 1 -- 10.20.193.11:0/2519941153 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f89ec004560 con 0x7f8a0010f230 2026-02-13T02:23:51.503 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:51.497+0000 7f89fcff96c0 1 -- 10.20.193.11:0/2519941153 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f89ec009030 con 0x7f8a0010f230 2026-02-13T02:23:51.503 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:51.497+0000 7f8a05ac86c0 1 -- 10.20.193.11:0/2519941153 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a000faed0 con 0x7f8a0010f230 2026-02-13T02:23:51.503 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:51.497+0000 7f89fcff96c0 1 -- 10.20.193.11:0/2519941153 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f89ec00ce30 con 0x7f8a0010f230 2026-02-13T02:23:51.503 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:51.497+0000 7f8a05ac86c0 1 -- 10.20.193.11:0/2519941153 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a000fb6c0 con 0x7f8a0010f230 2026-02-13T02:23:51.503 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:51.498+0000 7f8a05ac86c0 1 -- 10.20.193.11:0/2519941153 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a00110500 con 0x7f8a0010f230 2026-02-13T02:23:51.504 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:51.499+0000 7f89fcff96c0 1 -- 10.20.193.11:0/2519941153 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7f89ec00c410 con 0x7f8a0010f230 2026-02-13T02:23:51.504 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:51.500+0000 7f89fcff96c0 1 --2- 10.20.193.11:0/2519941153 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f89d40b5680 0x7f89d40d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:23:51.505 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:51.500+0000 7f89fcff96c0 1 -- 10.20.193.11:0/2519941153 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7965+0+0 (secure 0 0 0) 0x7f89ec0e38f0 con 0x7f8a0010f230 2026-02-13T02:23:51.505 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:51.500+0000 7f89feffd6c0 1 --2- 10.20.193.11:0/2519941153 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f89d40b5680 0x7f89d40d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:23:51.505 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:51.500+0000 7f89feffd6c0 1 --2- 10.20.193.11:0/2519941153 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f89d40b5680 0x7f89d40d5b30 secure :-1 s=READY pgs=291 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f89f00023e0 tx=0x7f89f0009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:23:51.505 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:51.500+0000 7f89fcff96c0 1 -- 10.20.193.11:0/2519941153 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f89ec0a63b0 con 0x7f8a0010f230 2026-02-13T02:23:51.615 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:51.613+0000 7f8a05ac86c0 1 -- 10.20.193.11:0/2519941153 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f8a000f5da0 con 0x7f8a0010f230 2026-02-13T02:23:51.615 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:51.613+0000 7f89fcff96c0 1 -- 10.20.193.11:0/2519941153 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f89ec0a9560 con 0x7f8a0010f230 2026-02-13T02:23:51.616 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:23:51.616 INFO:teuthology.orchestra.run.trial011.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:23:51.617 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:51.615+0000 7f8a05ac86c0 1 -- 10.20.193.11:0/2519941153 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f89d40b5680 msgr2=0x7f89d40d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:23:51.617 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:51.615+0000 7f8a05ac86c0 1 --2- 10.20.193.11:0/2519941153 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f89d40b5680 0x7f89d40d5b30 secure :-1 s=READY pgs=291 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f89f00023e0 tx=0x7f89f0009260 comp rx=0 tx=0).stop 2026-02-13T02:23:51.617 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:51.615+0000 7f8a05ac86c0 1 -- 10.20.193.11:0/2519941153 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f8a0010f230 msgr2=0x7f8a000f4c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:23:51.617 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:51.615+0000 7f8a05ac86c0 1 --2- 10.20.193.11:0/2519941153 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f8a0010f230 0x7f8a000f4c50 secure :-1 s=READY pgs=458 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f89ec00b6c0 tx=0x7f89ec00bb90 comp rx=0 tx=0).stop 2026-02-13T02:23:51.617 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:51.615+0000 7f8a05ac86c0 1 -- 10.20.193.11:0/2519941153 shutdown_connections 2026-02-13T02:23:51.617 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:51.615+0000 7f8a05ac86c0 1 --2- 10.20.193.11:0/2519941153 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f89d40b5680 0x7f89d40d5b30 unknown :-1 s=CLOSED pgs=291 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:51.617 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:51.615+0000 7f8a05ac86c0 1 --2- 10.20.193.11:0/2519941153 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f8a000f5280 0x7f8a000fa550 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:51.618 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:51.615+0000 7f8a05ac86c0 1 --2- 10.20.193.11:0/2519941153 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f8a00115440 0x7f8a00175ce0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:51.618 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:51.615+0000 7f8a05ac86c0 1 --2- 10.20.193.11:0/2519941153 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f8a0010f230 0x7f8a000f4c50 unknown :-1 s=CLOSED pgs=458 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:51.618 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:51.615+0000 7f8a05ac86c0 1 -- 10.20.193.11:0/2519941153 >> 10.20.193.11:0/2519941153 conn(0x7f8a000ecb30 msgr2=0x7f8a00111c00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:23:51.618 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:51.615+0000 7f8a05ac86c0 1 -- 10.20.193.11:0/2519941153 shutdown_connections 2026-02-13T02:23:51.618 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:51.615+0000 7f8a05ac86c0 1 -- 10.20.193.11:0/2519941153 wait complete. 2026-02-13T02:23:52.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:23:52 trial011 ceph-mon[11956]: pgmap v338: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:23:52.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:23:52 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/2519941153' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:23:52.750 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:23:52 trial060 ceph-mon[14797]: pgmap v338: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:23:52.750 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:23:52 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/2519941153' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:23:52.791 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:23:52 trial078 ceph-mon[14969]: pgmap v338: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:23:52.791 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:23:52 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/2519941153' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:23:54.656 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:23:54.684 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:23:54 trial011 ceph-mon[11956]: pgmap v339: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:23:54.750 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:23:54 trial060 ceph-mon[14797]: pgmap v339: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:23:54.784 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:23:54.791 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:23:54 trial078 ceph-mon[14969]: pgmap v339: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:23:54.905 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:54.900+0000 7f32f1e696c0 1 -- 10.20.193.11:0/4228079356 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f32ec10fc20 msgr2=0x7f32ec114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:23:54.905 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:54.900+0000 7f32f1e696c0 1 --2- 10.20.193.11:0/4228079356 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f32ec10fc20 0x7f32ec114c60 secure :-1 s=READY pgs=459 gs=1 cs=0 l=1 c_cookie=16568632120485378184 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f32dc0099a0 tx=0x7f32dc02ed50 comp rx=0 tx=0).stop 2026-02-13T02:23:54.905 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:54.900+0000 7f32f1e696c0 1 -- 10.20.193.11:0/4228079356 shutdown_connections 2026-02-13T02:23:54.905 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:54.900+0000 7f32f1e696c0 1 --2- 10.20.193.11:0/4228079356 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f32ec115440 0x7f32ec175de0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:54.905 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:54.900+0000 7f32f1e696c0 1 --2- 10.20.193.11:0/4228079356 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f32ec10fc20 0x7f32ec114c60 unknown :-1 s=CLOSED pgs=459 gs=1 cs=0 l=1 c_cookie=16568632120485378184 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:54.906 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:54.900+0000 7f32f1e696c0 1 --2- 10.20.193.11:0/4228079356 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f32ec10f230 0x7f32ec10f600 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:54.906 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:54.900+0000 7f32f1e696c0 1 -- 10.20.193.11:0/4228079356 >> 10.20.193.11:0/4228079356 conn(0x7f32ec0ecb30 msgr2=0x7f32ec10cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:23:54.906 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:54.900+0000 7f32f1e696c0 1 -- 10.20.193.11:0/4228079356 shutdown_connections 2026-02-13T02:23:54.906 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:54.900+0000 7f32f1e696c0 1 -- 10.20.193.11:0/4228079356 wait complete. 2026-02-13T02:23:54.906 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:54.901+0000 7f32f1e696c0 1 Processor -- start 2026-02-13T02:23:54.906 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:54.901+0000 7f32f1e696c0 1 -- start start 2026-02-13T02:23:54.906 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:54.901+0000 7f32f1e696c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f32ec10f230 0x7f32ec0f4b20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:23:54.906 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:54.901+0000 7f32f1e696c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f32ec115440 0x7f32ec175ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:23:54.906 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:54.901+0000 7f32f1e696c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f32ec0f5150 0x7f32ec0fa420 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:23:54.906 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:54.901+0000 7f32f1e696c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f32ec0f57b0 con 0x7f32ec115440 2026-02-13T02:23:54.906 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:54.901+0000 7f32f1e696c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f32ec0fa960 con 0x7f32ec10f230 2026-02-13T02:23:54.906 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:54.901+0000 7f32f1e696c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f32ec0fab20 con 0x7f32ec0f5150 2026-02-13T02:23:54.907 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:54.901+0000 7f32eaffd6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f32ec115440 0x7f32ec175ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:23:54.907 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:54.901+0000 7f32eaffd6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f32ec115440 0x7f32ec175ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:57002/0 (socket says 10.20.193.11:57002) 2026-02-13T02:23:54.907 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:54.901+0000 7f32eaffd6c0 1 -- 10.20.193.11:0/3843421552 learned_addr learned my addr 10.20.193.11:0/3843421552 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:23:54.907 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:54.901+0000 7f32eb7fe6c0 1 --2- 10.20.193.11:0/3843421552 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f32ec10f230 0x7f32ec0f4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:23:54.907 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:54.901+0000 7f32eaffd6c0 1 -- 10.20.193.11:0/3843421552 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f32ec0f5150 msgr2=0x7f32ec0fa420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:23:54.907 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:54.901+0000 7f32eaffd6c0 1 --2- 10.20.193.11:0/3843421552 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f32ec0f5150 0x7f32ec0fa420 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:54.907 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:54.901+0000 7f32eaffd6c0 1 -- 10.20.193.11:0/3843421552 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f32ec10f230 msgr2=0x7f32ec0f4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:23:54.907 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:54.901+0000 7f32eaffd6c0 1 --2- 10.20.193.11:0/3843421552 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f32ec10f230 0x7f32ec0f4b20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:54.907 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:54.901+0000 7f32eaffd6c0 1 -- 10.20.193.11:0/3843421552 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32dc009590 con 0x7f32ec115440 2026-02-13T02:23:54.907 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:54.901+0000 7f32eb7fe6c0 1 --2- 10.20.193.11:0/3843421552 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f32ec10f230 0x7f32ec0f4b20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T02:23:54.907 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:54.901+0000 7f32eaffd6c0 1 --2- 10.20.193.11:0/3843421552 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f32ec115440 0x7f32ec175ce0 secure :-1 s=READY pgs=460 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f32dc005b40 tx=0x7f32dc02fbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:23:54.907 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:54.901+0000 7f32e8ff96c0 1 -- 10.20.193.11:0/3843421552 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f32dc002ae0 con 0x7f32ec115440 2026-02-13T02:23:54.908 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:54.901+0000 7f32e8ff96c0 1 -- 10.20.193.11:0/3843421552 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f32dc002c40 con 0x7f32ec115440 2026-02-13T02:23:54.908 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:54.901+0000 7f32e8ff96c0 1 -- 10.20.193.11:0/3843421552 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f32dc0312b0 con 0x7f32ec115440 2026-02-13T02:23:54.908 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:54.901+0000 7f32f1e696c0 1 -- 10.20.193.11:0/3843421552 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32ec0fad40 con 0x7f32ec115440 2026-02-13T02:23:54.908 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:54.901+0000 7f32f1e696c0 1 -- 10.20.193.11:0/3843421552 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32ec0fb170 con 0x7f32ec115440 2026-02-13T02:23:54.908 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:54.902+0000 7f32f1e696c0 1 -- 10.20.193.11:0/3843421552 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32ec110500 con 0x7f32ec115440 2026-02-13T02:23:54.909 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:54.903+0000 7f32e8ff96c0 1 -- 10.20.193.11:0/3843421552 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7f32dc0077d0 con 0x7f32ec115440 2026-02-13T02:23:54.909 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:54.904+0000 7f32e8ff96c0 1 --2- 10.20.193.11:0/3843421552 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f32c00b5680 0x7f32c00d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:23:54.909 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:54.904+0000 7f32eb7fe6c0 1 --2- 10.20.193.11:0/3843421552 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f32c00b5680 0x7f32c00d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:23:54.909 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:54.904+0000 7f32e8ff96c0 1 -- 10.20.193.11:0/3843421552 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7965+0+0 (secure 0 0 0) 0x7f32dc107b60 con 0x7f32ec115440 2026-02-13T02:23:54.909 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:54.904+0000 7f32e8ff96c0 1 -- 10.20.193.11:0/3843421552 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f32dc0cd300 con 0x7f32ec115440 2026-02-13T02:23:54.909 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:54.904+0000 7f32eb7fe6c0 1 --2- 10.20.193.11:0/3843421552 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f32c00b5680 0x7f32c00d5b30 secure :-1 s=READY pgs=292 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f32d8004750 tx=0x7f32d8009260 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:23:55.022 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:55.019+0000 7f32f1e696c0 1 -- 10.20.193.11:0/3843421552 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f32ec10f600 con 0x7f32ec115440 2026-02-13T02:23:55.022 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:55.019+0000 7f32e8ff96c0 1 -- 10.20.193.11:0/3843421552 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f32dc0cd630 con 0x7f32ec115440 2026-02-13T02:23:55.022 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:23:55.023 INFO:teuthology.orchestra.run.trial011.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:23:55.024 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:55.020+0000 7f32f1e696c0 1 -- 10.20.193.11:0/3843421552 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f32c00b5680 msgr2=0x7f32c00d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:23:55.024 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:55.020+0000 7f32f1e696c0 1 --2- 10.20.193.11:0/3843421552 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f32c00b5680 0x7f32c00d5b30 secure :-1 s=READY pgs=292 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f32d8004750 tx=0x7f32d8009260 comp rx=0 tx=0).stop 2026-02-13T02:23:55.024 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:55.020+0000 7f32f1e696c0 1 -- 10.20.193.11:0/3843421552 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f32ec115440 msgr2=0x7f32ec175ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:23:55.024 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:55.020+0000 7f32f1e696c0 1 --2- 10.20.193.11:0/3843421552 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f32ec115440 0x7f32ec175ce0 secure :-1 s=READY pgs=460 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f32dc005b40 tx=0x7f32dc02fbf0 comp rx=0 tx=0).stop 2026-02-13T02:23:55.024 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:55.020+0000 7f32f1e696c0 1 -- 10.20.193.11:0/3843421552 shutdown_connections 2026-02-13T02:23:55.024 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:55.020+0000 7f32f1e696c0 1 --2- 10.20.193.11:0/3843421552 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f32c00b5680 0x7f32c00d5b30 unknown :-1 s=CLOSED pgs=292 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:55.024 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:55.020+0000 7f32f1e696c0 1 --2- 10.20.193.11:0/3843421552 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f32ec0f5150 0x7f32ec0fa420 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:55.024 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:55.020+0000 7f32f1e696c0 1 --2- 10.20.193.11:0/3843421552 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f32ec115440 0x7f32ec175ce0 unknown :-1 s=CLOSED pgs=460 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:55.024 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:55.020+0000 7f32f1e696c0 1 --2- 10.20.193.11:0/3843421552 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f32ec10f230 0x7f32ec0f4b20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:55.024 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:55.020+0000 7f32f1e696c0 1 -- 10.20.193.11:0/3843421552 >> 10.20.193.11:0/3843421552 conn(0x7f32ec0ecb30 msgr2=0x7f32ec10d750 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:23:55.025 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:55.020+0000 7f32f1e696c0 1 -- 10.20.193.11:0/3843421552 shutdown_connections 2026-02-13T02:23:55.025 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:55.020+0000 7f32f1e696c0 1 -- 10.20.193.11:0/3843421552 wait complete. 2026-02-13T02:23:55.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:23:55 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/3843421552' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:23:55.750 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:23:55 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/3843421552' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:23:55.791 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:23:55 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/3843421552' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:23:56.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:23:56 trial011 ceph-mon[11956]: pgmap v340: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:23:56.750 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:23:56 trial060 ceph-mon[14797]: pgmap v340: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:23:56.791 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:23:56 trial078 ceph-mon[14969]: pgmap v340: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:23:58.062 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:23:58.189 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:23:58.300 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:58.295+0000 7fed4eafd6c0 1 -- 10.20.193.11:0/15441348 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fed4810f200 msgr2=0x7fed4810f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:23:58.301 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:58.295+0000 7fed4eafd6c0 1 --2- 10.20.193.11:0/15441348 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fed4810f200 0x7fed4810f5d0 secure :-1 s=READY pgs=461 gs=1 cs=0 l=1 c_cookie=11701229180598087697 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fed380099a0 tx=0x7fed3802ed20 comp rx=0 tx=0).stop 2026-02-13T02:23:58.301 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:58.295+0000 7fed4eafd6c0 1 -- 10.20.193.11:0/15441348 shutdown_connections 2026-02-13T02:23:58.301 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:58.295+0000 7fed4eafd6c0 1 --2- 10.20.193.11:0/15441348 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fed48115410 0x7fed48175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:58.301 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:58.295+0000 7fed4eafd6c0 1 --2- 10.20.193.11:0/15441348 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fed4810fbf0 0x7fed48114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:58.301 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:58.295+0000 7fed4eafd6c0 1 --2- 10.20.193.11:0/15441348 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fed4810f200 0x7fed4810f5d0 unknown :-1 s=CLOSED pgs=461 gs=1 cs=0 l=1 c_cookie=11701229180598087697 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:58.301 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:58.295+0000 7fed4eafd6c0 1 -- 10.20.193.11:0/15441348 >> 10.20.193.11:0/15441348 conn(0x7fed480ecb00 msgr2=0x7fed4810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:23:58.301 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:58.295+0000 7fed4eafd6c0 1 -- 10.20.193.11:0/15441348 shutdown_connections 2026-02-13T02:23:58.301 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:58.296+0000 7fed4eafd6c0 1 -- 10.20.193.11:0/15441348 wait complete. 2026-02-13T02:23:58.301 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:58.296+0000 7fed4eafd6c0 1 Processor -- start 2026-02-13T02:23:58.301 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:58.296+0000 7fed4eafd6c0 1 -- start start 2026-02-13T02:23:58.301 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:58.296+0000 7fed4eafd6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fed4810f200 0x7fed4811d200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:23:58.302 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:58.296+0000 7fed4eafd6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fed48115410 0x7fed4811d740 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:23:58.302 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:58.296+0000 7fed4eafd6c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fed48122b00 0x7fed48122fa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:23:58.302 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:58.296+0000 7fed4eafd6c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7fed48123510 con 0x7fed4810f200 2026-02-13T02:23:58.302 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:58.296+0000 7fed4eafd6c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7fed48123680 con 0x7fed48122b00 2026-02-13T02:23:58.302 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:58.296+0000 7fed4eafd6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fed48123840 con 0x7fed48115410 2026-02-13T02:23:58.302 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:58.296+0000 7fed4c86e6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fed4810f200 0x7fed4811d200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:23:58.302 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:58.296+0000 7fed4c86e6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fed4810f200 0x7fed4811d200 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:57028/0 (socket says 10.20.193.11:57028) 2026-02-13T02:23:58.302 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:58.296+0000 7fed4c86e6c0 1 -- 10.20.193.11:0/423126659 learned_addr learned my addr 10.20.193.11:0/423126659 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:23:58.302 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:58.296+0000 7fed3ffff6c0 1 --2- 10.20.193.11:0/423126659 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fed48115410 0x7fed4811d740 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:23:58.302 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:58.296+0000 7fed4d06f6c0 1 --2- 10.20.193.11:0/423126659 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fed48122b00 0x7fed48122fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:23:58.302 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:58.296+0000 7fed4c86e6c0 1 -- 10.20.193.11:0/423126659 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fed48115410 msgr2=0x7fed4811d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:23:58.302 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:58.296+0000 7fed4c86e6c0 1 --2- 10.20.193.11:0/423126659 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fed48115410 0x7fed4811d740 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:58.303 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:58.296+0000 7fed4c86e6c0 1 -- 10.20.193.11:0/423126659 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fed48122b00 msgr2=0x7fed48122fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:23:58.303 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:58.296+0000 7fed4c86e6c0 1 --2- 10.20.193.11:0/423126659 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fed48122b00 0x7fed48122fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:58.303 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:58.296+0000 7fed4c86e6c0 1 -- 10.20.193.11:0/423126659 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed38009590 con 0x7fed4810f200 2026-02-13T02:23:58.303 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:58.296+0000 7fed4c86e6c0 1 --2- 10.20.193.11:0/423126659 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fed4810f200 0x7fed4811d200 secure :-1 s=READY pgs=462 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fed38031fd0 tx=0x7fed380047f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:23:58.303 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:58.296+0000 7fed3dffb6c0 1 -- 10.20.193.11:0/423126659 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fed38002ae0 con 0x7fed4810f200 2026-02-13T02:23:58.303 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:58.296+0000 7fed3dffb6c0 1 -- 10.20.193.11:0/423126659 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fed38002c40 con 0x7fed4810f200 2026-02-13T02:23:58.303 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:58.296+0000 7fed4eafd6c0 1 -- 10.20.193.11:0/423126659 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed48163c90 con 0x7fed4810f200 2026-02-13T02:23:58.303 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:58.296+0000 7fed3dffb6c0 1 -- 10.20.193.11:0/423126659 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fed380372f0 con 0x7fed4810f200 2026-02-13T02:23:58.303 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:58.297+0000 7fed4eafd6c0 1 -- 10.20.193.11:0/423126659 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed48164110 con 0x7fed4810f200 2026-02-13T02:23:58.303 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:58.297+0000 7fed4eafd6c0 1 -- 10.20.193.11:0/423126659 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed481104d0 con 0x7fed4810f200 2026-02-13T02:23:58.304 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:58.298+0000 7fed3dffb6c0 1 -- 10.20.193.11:0/423126659 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7fed380077d0 con 0x7fed4810f200 2026-02-13T02:23:58.305 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:58.299+0000 7fed3dffb6c0 1 --2- 10.20.193.11:0/423126659 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fed240b5680 0x7fed240d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:23:58.305 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:58.299+0000 7fed3dffb6c0 1 -- 10.20.193.11:0/423126659 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7965+0+0 (secure 0 0 0) 0x7fed38107d30 con 0x7fed4810f200 2026-02-13T02:23:58.305 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:58.299+0000 7fed3ffff6c0 1 --2- 10.20.193.11:0/423126659 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fed240b5680 0x7fed240d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:23:58.305 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:58.299+0000 7fed3ffff6c0 1 --2- 10.20.193.11:0/423126659 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fed240b5680 0x7fed240d5b30 secure :-1 s=READY pgs=293 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fed30005980 tx=0x7fed30005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:23:58.305 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:58.299+0000 7fed3dffb6c0 1 -- 10.20.193.11:0/423126659 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fed380ca7f0 con 0x7fed4810f200 2026-02-13T02:23:58.419 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:58.417+0000 7fed4eafd6c0 1 -- 10.20.193.11:0/423126659 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fed4810f5d0 con 0x7fed4810f200 2026-02-13T02:23:58.419 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:58.417+0000 7fed3dffb6c0 1 -- 10.20.193.11:0/423126659 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fed380cd9a0 con 0x7fed4810f200 2026-02-13T02:23:58.420 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:23:58.420 INFO:teuthology.orchestra.run.trial011.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:23:58.421 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:58.419+0000 7fed4eafd6c0 1 -- 10.20.193.11:0/423126659 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fed240b5680 msgr2=0x7fed240d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:23:58.421 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:58.419+0000 7fed4eafd6c0 1 --2- 10.20.193.11:0/423126659 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fed240b5680 0x7fed240d5b30 secure :-1 s=READY pgs=293 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fed30005980 tx=0x7fed30005910 comp rx=0 tx=0).stop 2026-02-13T02:23:58.421 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:58.419+0000 7fed4eafd6c0 1 -- 10.20.193.11:0/423126659 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fed4810f200 msgr2=0x7fed4811d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:23:58.421 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:58.419+0000 7fed4eafd6c0 1 --2- 10.20.193.11:0/423126659 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fed4810f200 0x7fed4811d200 secure :-1 s=READY pgs=462 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fed38031fd0 tx=0x7fed380047f0 comp rx=0 tx=0).stop 2026-02-13T02:23:58.421 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:58.419+0000 7fed4eafd6c0 1 -- 10.20.193.11:0/423126659 shutdown_connections 2026-02-13T02:23:58.421 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:58.419+0000 7fed4eafd6c0 1 --2- 10.20.193.11:0/423126659 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fed240b5680 0x7fed240d5b30 unknown :-1 s=CLOSED pgs=293 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:58.421 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:58.419+0000 7fed4eafd6c0 1 --2- 10.20.193.11:0/423126659 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fed48122b00 0x7fed48122fa0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:58.421 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:58.419+0000 7fed4eafd6c0 1 --2- 10.20.193.11:0/423126659 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fed48115410 0x7fed4811d740 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:58.421 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:58.419+0000 7fed4eafd6c0 1 --2- 10.20.193.11:0/423126659 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fed4810f200 0x7fed4811d200 unknown :-1 s=CLOSED pgs=462 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:23:58.422 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:58.419+0000 7fed4eafd6c0 1 -- 10.20.193.11:0/423126659 >> 10.20.193.11:0/423126659 conn(0x7fed480ecb00 msgr2=0x7fed4810cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:23:58.422 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:58.419+0000 7fed4eafd6c0 1 -- 10.20.193.11:0/423126659 shutdown_connections 2026-02-13T02:23:58.422 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:23:58.419+0000 7fed4eafd6c0 1 -- 10.20.193.11:0/423126659 wait complete. 2026-02-13T02:23:58.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:23:58 trial011 ceph-mon[11956]: pgmap v341: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T02:23:58.750 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:23:58 trial060 ceph-mon[14797]: pgmap v341: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T02:23:58.791 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:23:58 trial078 ceph-mon[14969]: pgmap v341: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T02:23:59.701 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:23:59 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/423126659' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:23:59.750 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:23:59 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/423126659' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:23:59.791 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:23:59 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/423126659' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:24:00.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:24:00 trial011 ceph-mon[11956]: pgmap v342: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:24:00.750 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:24:00 trial060 ceph-mon[14797]: pgmap v342: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:24:00.791 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:24:00 trial078 ceph-mon[14969]: pgmap v342: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:24:01.459 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:24:01.582 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:24:01.645 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:24:01 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:24:01.705 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:01.701+0000 7f05a351f6c0 1 -- 10.20.193.11:0/1074523498 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f059c10bd00 msgr2=0x7f059c175a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:24:01.705 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:01.701+0000 7f05a351f6c0 1 --2- 10.20.193.11:0/1074523498 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f059c10bd00 0x7f059c175a70 secure :-1 s=READY pgs=463 gs=1 cs=0 l=1 c_cookie=4702715034292460442 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f059800aa40 tx=0x7f059802fde0 comp rx=0 tx=0).stop 2026-02-13T02:24:01.706 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:01.701+0000 7f05a351f6c0 1 -- 10.20.193.11:0/1074523498 shutdown_connections 2026-02-13T02:24:01.706 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:01.701+0000 7f05a351f6c0 1 --2- 10.20.193.11:0/1074523498 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f059c10b120 0x7f059c10b550 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:24:01.706 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:01.701+0000 7f05a351f6c0 1 --2- 10.20.193.11:0/1074523498 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f059c10bd00 0x7f059c175a70 unknown :-1 s=CLOSED pgs=463 gs=1 cs=0 l=1 c_cookie=4702715034292460442 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:24:01.706 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:01.701+0000 7f05a351f6c0 1 --2- 10.20.193.11:0/1074523498 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f059c10dad0 0x7f059c10dea0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:24:01.706 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:01.701+0000 7f05a351f6c0 1 -- 10.20.193.11:0/1074523498 >> 10.20.193.11:0/1074523498 conn(0x7f059c062e00 msgr2=0x7f059c109660 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:24:01.706 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:01.701+0000 7f05a351f6c0 1 -- 10.20.193.11:0/1074523498 shutdown_connections 2026-02-13T02:24:01.706 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:01.701+0000 7f05a351f6c0 1 -- 10.20.193.11:0/1074523498 wait complete. 2026-02-13T02:24:01.706 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:01.702+0000 7f05a351f6c0 1 Processor -- start 2026-02-13T02:24:01.706 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:01.702+0000 7f05a351f6c0 1 -- start start 2026-02-13T02:24:01.706 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:01.702+0000 7f05a351f6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f059c10b120 0x7f059c0f50f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:24:01.706 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:01.702+0000 7f05a351f6c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f059c10bd00 0x7f059c0f5630 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:24:01.707 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:01.702+0000 7f05a351f6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f059c10dad0 0x7f059c0fa9f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:24:01.707 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:01.702+0000 7f05a351f6c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7f059c0fb040 con 0x7f059c10b120 2026-02-13T02:24:01.707 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:01.702+0000 7f05a351f6c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7f059c0fb1b0 con 0x7f059c10bd00 2026-02-13T02:24:01.707 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:01.702+0000 7f05a351f6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7f059c0fb370 con 0x7f059c10dad0 2026-02-13T02:24:01.707 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:01.702+0000 7f05a12906c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f059c10b120 0x7f059c0f50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:24:01.707 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:01.702+0000 7f05a12906c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f059c10b120 0x7f059c0f50f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:50348/0 (socket says 10.20.193.11:50348) 2026-02-13T02:24:01.707 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:01.702+0000 7f05a12906c0 1 -- 10.20.193.11:0/1870861787 learned_addr learned my addr 10.20.193.11:0/1870861787 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:24:01.707 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:01.702+0000 7f05a1a916c0 1 --2- 10.20.193.11:0/1870861787 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f059c10dad0 0x7f059c0fa9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:24:01.707 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:01.702+0000 7f05a0a8f6c0 1 --2- 10.20.193.11:0/1870861787 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f059c10bd00 0x7f059c0f5630 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:24:01.707 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:01.702+0000 7f05a12906c0 1 -- 10.20.193.11:0/1870861787 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f059c10dad0 msgr2=0x7f059c0fa9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:24:01.707 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:01.702+0000 7f05a12906c0 1 --2- 10.20.193.11:0/1870861787 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f059c10dad0 0x7f059c0fa9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:24:01.707 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:01.702+0000 7f05a12906c0 1 -- 10.20.193.11:0/1870861787 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f059c10bd00 msgr2=0x7f059c0f5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:24:01.708 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:01.702+0000 7f05a12906c0 1 --2- 10.20.193.11:0/1870861787 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f059c10bd00 0x7f059c0f5630 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:24:01.708 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:01.702+0000 7f05a12906c0 1 -- 10.20.193.11:0/1870861787 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f059800a660 con 0x7f059c10b120 2026-02-13T02:24:01.708 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:01.702+0000 7f05a12906c0 1 --2- 10.20.193.11:0/1870861787 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f059c10b120 0x7f059c0f50f0 secure :-1 s=READY pgs=464 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f058c005dc0 tx=0x7f058c00bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:24:01.708 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:01.702+0000 7f058a7fc6c0 1 -- 10.20.193.11:0/1870861787 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f058c004250 con 0x7f059c10b120 2026-02-13T02:24:01.708 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:01.702+0000 7f058a7fc6c0 1 -- 10.20.193.11:0/1870861787 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7f058c009070 con 0x7f059c10b120 2026-02-13T02:24:01.708 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:01.702+0000 7f05a351f6c0 1 -- 10.20.193.11:0/1870861787 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f059c0fb650 con 0x7f059c10b120 2026-02-13T02:24:01.708 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:01.702+0000 7f058a7fc6c0 1 -- 10.20.193.11:0/1870861787 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f058c00cde0 con 0x7f059c10b120 2026-02-13T02:24:01.708 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:01.702+0000 7f05a351f6c0 1 -- 10.20.193.11:0/1870861787 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f059c172bf0 con 0x7f059c10b120 2026-02-13T02:24:01.708 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:01.703+0000 7f05a351f6c0 1 -- 10.20.193.11:0/1870861787 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f059c0fb870 con 0x7f059c10b120 2026-02-13T02:24:01.709 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:01.704+0000 7f058a7fc6c0 1 -- 10.20.193.11:0/1870861787 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7f058c0028c0 con 0x7f059c10b120 2026-02-13T02:24:01.709 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:01.705+0000 7f058a7fc6c0 1 --2- 10.20.193.11:0/1870861787 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f05780b5600 0x7f05780d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:24:01.709 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:01.705+0000 7f058a7fc6c0 1 -- 10.20.193.11:0/1870861787 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7965+0+0 (secure 0 0 0) 0x7f058c0e3a40 con 0x7f059c10b120 2026-02-13T02:24:01.710 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:01.705+0000 7f05a0a8f6c0 1 --2- 10.20.193.11:0/1870861787 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f05780b5600 0x7f05780d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:24:01.710 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:01.705+0000 7f05a0a8f6c0 1 --2- 10.20.193.11:0/1870861787 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f05780b5600 0x7f05780d5ab0 secure :-1 s=READY pgs=294 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0590005980 tx=0x7f0590005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:24:01.710 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:01.705+0000 7f058a7fc6c0 1 -- 10.20.193.11:0/1870861787 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f058c0a6500 con 0x7f059c10b120 2026-02-13T02:24:01.750 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:24:01 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:24:01.788 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:24:01 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T02:24:01.823 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:01.821+0000 7f05a351f6c0 1 -- 10.20.193.11:0/1870861787 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f059c10c130 con 0x7f059c10b120 2026-02-13T02:24:01.823 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:01.821+0000 7f058a7fc6c0 1 -- 10.20.193.11:0/1870861787 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f058c0a96b0 con 0x7f059c10b120 2026-02-13T02:24:01.823 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:24:01.823 INFO:teuthology.orchestra.run.trial011.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:24:01.824 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:01.822+0000 7f05a351f6c0 1 -- 10.20.193.11:0/1870861787 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f05780b5600 msgr2=0x7f05780d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:24:01.824 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:01.822+0000 7f05a351f6c0 1 --2- 10.20.193.11:0/1870861787 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f05780b5600 0x7f05780d5ab0 secure :-1 s=READY pgs=294 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0590005980 tx=0x7f0590005910 comp rx=0 tx=0).stop 2026-02-13T02:24:01.824 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:01.822+0000 7f05a351f6c0 1 -- 10.20.193.11:0/1870861787 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f059c10b120 msgr2=0x7f059c0f50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:24:01.824 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:01.822+0000 7f05a351f6c0 1 --2- 10.20.193.11:0/1870861787 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f059c10b120 0x7f059c0f50f0 secure :-1 s=READY pgs=464 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f058c005dc0 tx=0x7f058c00bbb0 comp rx=0 tx=0).stop 2026-02-13T02:24:01.824 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:01.822+0000 7f05a351f6c0 1 -- 10.20.193.11:0/1870861787 shutdown_connections 2026-02-13T02:24:01.825 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:01.822+0000 7f05a351f6c0 1 --2- 10.20.193.11:0/1870861787 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7f05780b5600 0x7f05780d5ab0 unknown :-1 s=CLOSED pgs=294 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:24:01.825 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:01.822+0000 7f05a351f6c0 1 --2- 10.20.193.11:0/1870861787 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7f059c10bd00 0x7f059c0f5630 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:24:01.825 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:01.822+0000 7f05a351f6c0 1 --2- 10.20.193.11:0/1870861787 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7f059c10dad0 0x7f059c0fa9f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:24:01.825 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:01.822+0000 7f05a351f6c0 1 --2- 10.20.193.11:0/1870861787 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7f059c10b120 0x7f059c0f50f0 unknown :-1 s=CLOSED pgs=464 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:24:01.825 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:01.822+0000 7f05a351f6c0 1 -- 10.20.193.11:0/1870861787 >> 10.20.193.11:0/1870861787 conn(0x7f059c062e00 msgr2=0x7f059c0eb910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:24:01.825 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:01.822+0000 7f05a351f6c0 1 -- 10.20.193.11:0/1870861787 shutdown_connections 2026-02-13T02:24:01.825 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:01.822+0000 7f05a351f6c0 1 -- 10.20.193.11:0/1870861787 wait complete. 2026-02-13T02:24:02.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:24:02 trial011 ceph-mon[11956]: pgmap v343: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:24:02.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:24:02 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:24:02.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:24:02 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:24:02.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:24:02 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:24:02.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:24:02 trial011 ceph-mon[11956]: pgmap v344: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 9 op/s 2026-02-13T02:24:02.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:24:02 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:24:02.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:24:02 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:24:02.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:24:02 trial011 ceph-mon[11956]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:24:02.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:24:02 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/1870861787' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:24:02.750 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:24:02 trial060 ceph-mon[14797]: pgmap v343: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:24:02.750 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:24:02 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:24:02.750 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:24:02 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:24:02.751 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:24:02 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:24:02.751 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:24:02 trial060 ceph-mon[14797]: pgmap v344: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 9 op/s 2026-02-13T02:24:02.751 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:24:02 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:24:02.751 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:24:02 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:24:02.751 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:24:02 trial060 ceph-mon[14797]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:24:02.751 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:24:02 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/1870861787' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:24:02.791 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:24:02 trial078 ceph-mon[14969]: pgmap v343: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T02:24:02.791 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:24:02 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:24:02.791 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:24:02 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T02:24:02.792 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:24:02 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' 2026-02-13T02:24:02.792 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:24:02 trial078 ceph-mon[14969]: pgmap v344: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 9 op/s 2026-02-13T02:24:02.792 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:24:02 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T02:24:02.792 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:24:02 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T02:24:02.792 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:24:02 trial078 ceph-mon[14969]: from='mgr.14116 10.20.193.11:0/3113752810' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T02:24:02.792 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:24:02 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/1870861787' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:24:03.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:24:03 trial011 ceph-mon[11956]: pgmap v345: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 10 op/s 2026-02-13T02:24:04.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:24:03 trial060 ceph-mon[14797]: pgmap v345: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 10 op/s 2026-02-13T02:24:04.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:24:03 trial078 ceph-mon[14969]: pgmap v345: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 10 op/s 2026-02-13T02:24:04.863 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:24:04.987 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:24:05.106 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:05.102+0000 7facf9d656c0 1 -- 10.20.193.11:0/1149938244 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7facf4115440 msgr2=0x7facf4175de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:24:05.107 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:05.102+0000 7facf9d656c0 1 --2- 10.20.193.11:0/1149938244 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7facf4115440 0x7facf4175de0 secure :-1 s=READY pgs=465 gs=1 cs=0 l=1 c_cookie=6081473000003631397 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7face800aa70 tx=0x7face802fde0 comp rx=0 tx=0).stop 2026-02-13T02:24:05.107 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:05.102+0000 7facf9d656c0 1 -- 10.20.193.11:0/1149938244 shutdown_connections 2026-02-13T02:24:05.107 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:05.102+0000 7facf9d656c0 1 --2- 10.20.193.11:0/1149938244 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7facf410fc20 0x7facf4114c60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:24:05.107 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:05.102+0000 7facf9d656c0 1 --2- 10.20.193.11:0/1149938244 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7facf4115440 0x7facf4175de0 unknown :-1 s=CLOSED pgs=465 gs=1 cs=0 l=1 c_cookie=6081473000003631397 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:24:05.107 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:05.102+0000 7facf9d656c0 1 --2- 10.20.193.11:0/1149938244 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7facf410f230 0x7facf410f600 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:24:05.107 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:05.102+0000 7facf9d656c0 1 -- 10.20.193.11:0/1149938244 >> 10.20.193.11:0/1149938244 conn(0x7facf40ecb30 msgr2=0x7facf410cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:24:05.107 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:05.102+0000 7facf9d656c0 1 -- 10.20.193.11:0/1149938244 shutdown_connections 2026-02-13T02:24:05.107 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:05.102+0000 7facf9d656c0 1 -- 10.20.193.11:0/1149938244 wait complete. 2026-02-13T02:24:05.108 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:05.103+0000 7facf9d656c0 1 Processor -- start 2026-02-13T02:24:05.108 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:05.103+0000 7facf9d656c0 1 -- start start 2026-02-13T02:24:05.108 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:05.103+0000 7facf9d656c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7facf410f230 0x7facf411d130 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:24:05.108 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:05.103+0000 7facf9d656c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7facf4115440 0x7facf411d670 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:24:05.108 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:05.103+0000 7facf9d656c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7facf4122a30 0x7facf4122ed0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:24:05.108 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:05.103+0000 7facf9d656c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7facf4123440 con 0x7facf4115440 2026-02-13T02:24:05.108 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:05.103+0000 7facf9d656c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7facf41235b0 con 0x7facf4122a30 2026-02-13T02:24:05.108 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:05.103+0000 7facf9d656c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7facf4123770 con 0x7facf410f230 2026-02-13T02:24:05.108 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:05.103+0000 7facf2ffd6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7facf4115440 0x7facf411d670 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:24:05.108 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:05.103+0000 7facf2ffd6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7facf4115440 0x7facf411d670 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:50352/0 (socket says 10.20.193.11:50352) 2026-02-13T02:24:05.109 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:05.103+0000 7facf2ffd6c0 1 -- 10.20.193.11:0/1827079288 learned_addr learned my addr 10.20.193.11:0/1827079288 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:24:05.109 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:05.103+0000 7facf37fe6c0 1 --2- 10.20.193.11:0/1827079288 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7facf410f230 0x7facf411d130 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:24:05.109 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:05.103+0000 7facf3fff6c0 1 --2- 10.20.193.11:0/1827079288 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7facf4122a30 0x7facf4122ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:24:05.109 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:05.103+0000 7facf2ffd6c0 1 -- 10.20.193.11:0/1827079288 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7facf410f230 msgr2=0x7facf411d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:24:05.109 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:05.103+0000 7facf2ffd6c0 1 --2- 10.20.193.11:0/1827079288 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7facf410f230 0x7facf411d130 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:24:05.109 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:05.103+0000 7facf2ffd6c0 1 -- 10.20.193.11:0/1827079288 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7facf4122a30 msgr2=0x7facf4122ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:24:05.109 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:05.103+0000 7facf2ffd6c0 1 --2- 10.20.193.11:0/1827079288 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7facf4122a30 0x7facf4122ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:24:05.109 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:05.103+0000 7facf2ffd6c0 1 -- 10.20.193.11:0/1827079288 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7face800a660 con 0x7facf4115440 2026-02-13T02:24:05.109 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:05.103+0000 7facf2ffd6c0 1 --2- 10.20.193.11:0/1827079288 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7facf4115440 0x7facf411d670 secure :-1 s=READY pgs=466 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7face4005dc0 tx=0x7face400bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:24:05.109 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:05.103+0000 7facf0ff96c0 1 -- 10.20.193.11:0/1827079288 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7face4004250 con 0x7facf4115440 2026-02-13T02:24:05.109 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:05.103+0000 7facf0ff96c0 1 -- 10.20.193.11:0/1827079288 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7face4009070 con 0x7facf4115440 2026-02-13T02:24:05.110 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:05.103+0000 7facf9d656c0 1 -- 10.20.193.11:0/1827079288 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facf4163c20 con 0x7facf4115440 2026-02-13T02:24:05.110 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:05.103+0000 7facf0ff96c0 1 -- 10.20.193.11:0/1827079288 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7face400cdc0 con 0x7facf4115440 2026-02-13T02:24:05.110 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:05.103+0000 7facf9d656c0 1 -- 10.20.193.11:0/1827079288 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facf41640b0 con 0x7facf4115440 2026-02-13T02:24:05.110 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:05.103+0000 7facf9d656c0 1 -- 10.20.193.11:0/1827079288 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facf4110500 con 0x7facf4115440 2026-02-13T02:24:05.110 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:05.105+0000 7facf0ff96c0 1 -- 10.20.193.11:0/1827079288 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7face40028c0 con 0x7facf4115440 2026-02-13T02:24:05.111 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:05.105+0000 7facf0ff96c0 1 --2- 10.20.193.11:0/1827079288 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7facc80b5600 0x7facc80d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:24:05.111 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:05.105+0000 7facf0ff96c0 1 -- 10.20.193.11:0/1827079288 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7965+0+0 (secure 0 0 0) 0x7face40e3a30 con 0x7facf4115440 2026-02-13T02:24:05.111 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:05.105+0000 7facf37fe6c0 1 --2- 10.20.193.11:0/1827079288 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7facc80b5600 0x7facc80d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:24:05.112 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:05.106+0000 7facf37fe6c0 1 --2- 10.20.193.11:0/1827079288 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7facc80b5600 0x7facc80d5ab0 secure :-1 s=READY pgs=295 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7face0005980 tx=0x7face0005910 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:24:05.112 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:05.106+0000 7facf0ff96c0 1 -- 10.20.193.11:0/1827079288 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7face40a64f0 con 0x7facf4115440 2026-02-13T02:24:05.221 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:05.218+0000 7facf9d656c0 1 -- 10.20.193.11:0/1827079288 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7facf410f600 con 0x7facf4115440 2026-02-13T02:24:05.221 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:05.219+0000 7facf0ff96c0 1 -- 10.20.193.11:0/1827079288 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7face40a96a0 con 0x7facf4115440 2026-02-13T02:24:05.221 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:24:05.221 INFO:teuthology.orchestra.run.trial011.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:24:05.222 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:05.219+0000 7facf9d656c0 1 -- 10.20.193.11:0/1827079288 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7facc80b5600 msgr2=0x7facc80d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:24:05.222 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:05.219+0000 7facf9d656c0 1 --2- 10.20.193.11:0/1827079288 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7facc80b5600 0x7facc80d5ab0 secure :-1 s=READY pgs=295 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7face0005980 tx=0x7face0005910 comp rx=0 tx=0).stop 2026-02-13T02:24:05.222 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:05.219+0000 7facf9d656c0 1 -- 10.20.193.11:0/1827079288 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7facf4115440 msgr2=0x7facf411d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:24:05.223 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:05.219+0000 7facf9d656c0 1 --2- 10.20.193.11:0/1827079288 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7facf4115440 0x7facf411d670 secure :-1 s=READY pgs=466 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7face4005dc0 tx=0x7face400bbb0 comp rx=0 tx=0).stop 2026-02-13T02:24:05.223 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:05.219+0000 7facf9d656c0 1 -- 10.20.193.11:0/1827079288 shutdown_connections 2026-02-13T02:24:05.223 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:05.219+0000 7facf9d656c0 1 --2- 10.20.193.11:0/1827079288 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7facc80b5600 0x7facc80d5ab0 unknown :-1 s=CLOSED pgs=295 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:24:05.223 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:05.219+0000 7facf9d656c0 1 --2- 10.20.193.11:0/1827079288 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7facf4122a30 0x7facf4122ed0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:24:05.223 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:05.219+0000 7facf9d656c0 1 --2- 10.20.193.11:0/1827079288 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7facf4115440 0x7facf411d670 unknown :-1 s=CLOSED pgs=466 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:24:05.223 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:05.219+0000 7facf9d656c0 1 --2- 10.20.193.11:0/1827079288 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7facf410f230 0x7facf411d130 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:24:05.223 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:05.219+0000 7facf9d656c0 1 -- 10.20.193.11:0/1827079288 >> 10.20.193.11:0/1827079288 conn(0x7facf40ecb30 msgr2=0x7facf410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:24:05.223 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:05.220+0000 7facf9d656c0 1 -- 10.20.193.11:0/1827079288 shutdown_connections 2026-02-13T02:24:05.223 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:05.220+0000 7facf9d656c0 1 -- 10.20.193.11:0/1827079288 wait complete. 2026-02-13T02:24:05.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:24:05 trial011 ceph-mon[11956]: pgmap v346: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 10 op/s 2026-02-13T02:24:05.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:24:05 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/1827079288' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:24:06.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:24:05 trial060 ceph-mon[14797]: pgmap v346: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 10 op/s 2026-02-13T02:24:06.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:24:05 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/1827079288' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:24:06.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:24:05 trial078 ceph-mon[14969]: pgmap v346: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 10 op/s 2026-02-13T02:24:06.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:24:05 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/1827079288' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:24:07.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:24:07 trial011 ceph-mon[11956]: pgmap v347: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.1 KiB/s rd, 10 op/s 2026-02-13T02:24:08.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:24:07 trial060 ceph-mon[14797]: pgmap v347: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.1 KiB/s rd, 10 op/s 2026-02-13T02:24:08.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:24:07 trial078 ceph-mon[14969]: pgmap v347: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.1 KiB/s rd, 10 op/s 2026-02-13T02:24:08.261 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:24:08.386 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:24:08.512 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:08.508+0000 7efee2dcb6c0 1 -- 10.20.193.11:0/1444787188 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7efedc10cf80 msgr2=0x7efedc10d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:24:08.512 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:08.508+0000 7efee2dcb6c0 1 --2- 10.20.193.11:0/1444787188 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7efedc10cf80 0x7efedc10d350 secure :-1 s=READY pgs=467 gs=1 cs=0 l=1 c_cookie=6543067160629415686 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efecc0099a0 tx=0x7efecc02ed20 comp rx=0 tx=0).stop 2026-02-13T02:24:08.512 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:08.508+0000 7efee2dcb6c0 1 -- 10.20.193.11:0/1444787188 shutdown_connections 2026-02-13T02:24:08.512 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:08.508+0000 7efee2dcb6c0 1 --2- 10.20.193.11:0/1444787188 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7efedc10d970 0x7efedc1129b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:24:08.512 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:08.508+0000 7efee2dcb6c0 1 --2- 10.20.193.11:0/1444787188 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7efedc113190 0x7efedc173b30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:24:08.512 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:08.508+0000 7efee2dcb6c0 1 --2- 10.20.193.11:0/1444787188 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7efedc10cf80 0x7efedc10d350 unknown :-1 s=CLOSED pgs=467 gs=1 cs=0 l=1 c_cookie=6543067160629415686 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:24:08.512 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:08.508+0000 7efee2dcb6c0 1 -- 10.20.193.11:0/1444787188 >> 10.20.193.11:0/1444787188 conn(0x7efedc0ea880 msgr2=0x7efedc10ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:24:08.512 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:08.508+0000 7efee2dcb6c0 1 -- 10.20.193.11:0/1444787188 shutdown_connections 2026-02-13T02:24:08.512 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:08.508+0000 7efee2dcb6c0 1 -- 10.20.193.11:0/1444787188 wait complete. 2026-02-13T02:24:08.512 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:08.508+0000 7efee2dcb6c0 1 Processor -- start 2026-02-13T02:24:08.513 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:08.508+0000 7efee2dcb6c0 1 -- start start 2026-02-13T02:24:08.513 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:08.508+0000 7efee2dcb6c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7efedc10cf80 0x7efedc0f4b60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:24:08.513 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:08.508+0000 7efee2dcb6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7efedc113190 0x7efedc173a30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:24:08.513 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:08.508+0000 7efee2dcb6c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7efedc0f5190 0x7efedc0fa410 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:24:08.513 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:08.508+0000 7efee2dcb6c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7efedc0f57f0 con 0x7efedc113190 2026-02-13T02:24:08.513 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:08.508+0000 7efee2dcb6c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7efedc0fa950 con 0x7efedc10cf80 2026-02-13T02:24:08.513 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:08.508+0000 7efee2dcb6c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7efedc0fab10 con 0x7efedc0f5190 2026-02-13T02:24:08.513 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:08.508+0000 7efed3fff6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7efedc113190 0x7efedc173a30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:24:08.513 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:08.508+0000 7efed3fff6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7efedc113190 0x7efedc173a30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:50376/0 (socket says 10.20.193.11:50376) 2026-02-13T02:24:08.513 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:08.508+0000 7efed3fff6c0 1 -- 10.20.193.11:0/4013919364 learned_addr learned my addr 10.20.193.11:0/4013919364 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:24:08.513 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:08.508+0000 7efee0b3c6c0 1 --2- 10.20.193.11:0/4013919364 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7efedc10cf80 0x7efedc0f4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:24:08.514 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:08.508+0000 7efee133d6c0 1 --2- 10.20.193.11:0/4013919364 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7efedc0f5190 0x7efedc0fa410 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:24:08.514 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:08.508+0000 7efed3fff6c0 1 -- 10.20.193.11:0/4013919364 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7efedc0f5190 msgr2=0x7efedc0fa410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:24:08.514 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:08.508+0000 7efed3fff6c0 1 --2- 10.20.193.11:0/4013919364 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7efedc0f5190 0x7efedc0fa410 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:24:08.514 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:08.508+0000 7efed3fff6c0 1 -- 10.20.193.11:0/4013919364 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7efedc10cf80 msgr2=0x7efedc0f4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:24:08.514 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:08.508+0000 7efed3fff6c0 1 --2- 10.20.193.11:0/4013919364 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7efedc10cf80 0x7efedc0f4b60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:24:08.514 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:08.508+0000 7efed3fff6c0 1 -- 10.20.193.11:0/4013919364 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efecc009590 con 0x7efedc113190 2026-02-13T02:24:08.514 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:08.508+0000 7efed3fff6c0 1 --2- 10.20.193.11:0/4013919364 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7efedc113190 0x7efedc173a30 secure :-1 s=READY pgs=468 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efec4005dc0 tx=0x7efec400bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:24:08.514 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:08.509+0000 7efed1ffb6c0 1 -- 10.20.193.11:0/4013919364 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efec4004250 con 0x7efedc113190 2026-02-13T02:24:08.514 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:08.509+0000 7efee2dcb6c0 1 -- 10.20.193.11:0/4013919364 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efedc0fad90 con 0x7efedc113190 2026-02-13T02:24:08.514 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:08.509+0000 7efed1ffb6c0 1 -- 10.20.193.11:0/4013919364 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7efec4009070 con 0x7efedc113190 2026-02-13T02:24:08.514 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:08.509+0000 7efed1ffb6c0 1 -- 10.20.193.11:0/4013919364 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efec400cdc0 con 0x7efedc113190 2026-02-13T02:24:08.514 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:08.509+0000 7efee2dcb6c0 1 -- 10.20.193.11:0/4013919364 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efedc0fb580 con 0x7efedc113190 2026-02-13T02:24:08.514 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:08.509+0000 7efee2dcb6c0 1 -- 10.20.193.11:0/4013919364 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efedc10e250 con 0x7efedc113190 2026-02-13T02:24:08.515 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:08.510+0000 7efed1ffb6c0 1 -- 10.20.193.11:0/4013919364 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7efec40028c0 con 0x7efedc113190 2026-02-13T02:24:08.516 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:08.511+0000 7efed1ffb6c0 1 --2- 10.20.193.11:0/4013919364 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7efeb80b5600 0x7efeb80d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:24:08.516 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:08.511+0000 7efed1ffb6c0 1 -- 10.20.193.11:0/4013919364 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7965+0+0 (secure 0 0 0) 0x7efec40e3a20 con 0x7efedc113190 2026-02-13T02:24:08.516 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:08.511+0000 7efee0b3c6c0 1 --2- 10.20.193.11:0/4013919364 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7efeb80b5600 0x7efeb80d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:24:08.516 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:08.511+0000 7efee0b3c6c0 1 --2- 10.20.193.11:0/4013919364 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7efeb80b5600 0x7efeb80d5ab0 secure :-1 s=READY pgs=296 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efecc0023e0 tx=0x7efecc031f90 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:24:08.516 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:08.512+0000 7efed1ffb6c0 1 -- 10.20.193.11:0/4013919364 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7efec40a64e0 con 0x7efedc113190 2026-02-13T02:24:08.628 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:08.626+0000 7efee2dcb6c0 1 -- 10.20.193.11:0/4013919364 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7efedc10d3b0 con 0x7efedc113190 2026-02-13T02:24:08.628 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:08.626+0000 7efed1ffb6c0 1 -- 10.20.193.11:0/4013919364 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7efec40a9690 con 0x7efedc113190 2026-02-13T02:24:08.628 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:24:08.628 INFO:teuthology.orchestra.run.trial011.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:24:08.629 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:08.627+0000 7efee2dcb6c0 1 -- 10.20.193.11:0/4013919364 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7efeb80b5600 msgr2=0x7efeb80d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:24:08.629 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:08.627+0000 7efee2dcb6c0 1 --2- 10.20.193.11:0/4013919364 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7efeb80b5600 0x7efeb80d5ab0 secure :-1 s=READY pgs=296 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efecc0023e0 tx=0x7efecc031f90 comp rx=0 tx=0).stop 2026-02-13T02:24:08.630 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:08.627+0000 7efee2dcb6c0 1 -- 10.20.193.11:0/4013919364 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7efedc113190 msgr2=0x7efedc173a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:24:08.630 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:08.627+0000 7efee2dcb6c0 1 --2- 10.20.193.11:0/4013919364 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7efedc113190 0x7efedc173a30 secure :-1 s=READY pgs=468 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efec4005dc0 tx=0x7efec400bbb0 comp rx=0 tx=0).stop 2026-02-13T02:24:08.630 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:08.627+0000 7efee2dcb6c0 1 -- 10.20.193.11:0/4013919364 shutdown_connections 2026-02-13T02:24:08.630 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:08.627+0000 7efee2dcb6c0 1 --2- 10.20.193.11:0/4013919364 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7efeb80b5600 0x7efeb80d5ab0 unknown :-1 s=CLOSED pgs=296 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:24:08.630 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:08.627+0000 7efee2dcb6c0 1 --2- 10.20.193.11:0/4013919364 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7efedc0f5190 0x7efedc0fa410 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:24:08.630 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:08.627+0000 7efee2dcb6c0 1 --2- 10.20.193.11:0/4013919364 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7efedc113190 0x7efedc173a30 unknown :-1 s=CLOSED pgs=468 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:24:08.630 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:08.627+0000 7efee2dcb6c0 1 --2- 10.20.193.11:0/4013919364 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7efedc10cf80 0x7efedc0f4b60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:24:08.630 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:08.627+0000 7efee2dcb6c0 1 -- 10.20.193.11:0/4013919364 >> 10.20.193.11:0/4013919364 conn(0x7efedc0ea880 msgr2=0x7efedc0605e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:24:08.630 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:08.627+0000 7efee2dcb6c0 1 -- 10.20.193.11:0/4013919364 shutdown_connections 2026-02-13T02:24:08.630 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:08.627+0000 7efee2dcb6c0 1 -- 10.20.193.11:0/4013919364 wait complete. 2026-02-13T02:24:08.942 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:24:08 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/4013919364' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:24:08.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:24:08 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/4013919364' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:24:09.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:24:08 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/4013919364' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:24:09.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:24:09 trial011 ceph-mon[11956]: pgmap v348: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.1 KiB/s rd, 9 op/s 2026-02-13T02:24:10.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:24:09 trial060 ceph-mon[14797]: pgmap v348: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.1 KiB/s rd, 9 op/s 2026-02-13T02:24:10.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:24:09 trial078 ceph-mon[14969]: pgmap v348: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.1 KiB/s rd, 9 op/s 2026-02-13T02:24:11.683 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:24:11.811 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:24:11.924 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:24:11 trial011 ceph-mon[11956]: pgmap v349: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.0 KiB/s rd, 9 op/s 2026-02-13T02:24:11.928 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:11.924+0000 7fc8360806c0 1 -- 10.20.193.11:0/3215971034 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fc83010cfb0 msgr2=0x7fc83010d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:24:11.929 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:11.924+0000 7fc8360806c0 1 --2- 10.20.193.11:0/3215971034 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fc83010cfb0 0x7fc83010d380 secure :-1 s=READY pgs=469 gs=1 cs=0 l=1 c_cookie=2838576784911529005 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc81c0099a0 tx=0x7fc81c02ed20 comp rx=0 tx=0).stop 2026-02-13T02:24:11.929 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:11.924+0000 7fc8360806c0 1 -- 10.20.193.11:0/3215971034 shutdown_connections 2026-02-13T02:24:11.929 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:11.924+0000 7fc8360806c0 1 --2- 10.20.193.11:0/3215971034 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fc83010d9a0 0x7fc8301129e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:24:11.929 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:11.924+0000 7fc8360806c0 1 --2- 10.20.193.11:0/3215971034 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fc8301131c0 0x7fc830173b60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:24:11.929 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:11.924+0000 7fc8360806c0 1 --2- 10.20.193.11:0/3215971034 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fc83010cfb0 0x7fc83010d380 unknown :-1 s=CLOSED pgs=469 gs=1 cs=0 l=1 c_cookie=2838576784911529005 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:24:11.929 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:11.924+0000 7fc8360806c0 1 -- 10.20.193.11:0/3215971034 >> 10.20.193.11:0/3215971034 conn(0x7fc8300ea8b0 msgr2=0x7fc83010acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:24:11.929 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:11.924+0000 7fc8360806c0 1 -- 10.20.193.11:0/3215971034 shutdown_connections 2026-02-13T02:24:11.929 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:11.924+0000 7fc8360806c0 1 -- 10.20.193.11:0/3215971034 wait complete. 2026-02-13T02:24:11.929 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:11.925+0000 7fc8360806c0 1 Processor -- start 2026-02-13T02:24:11.929 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:11.925+0000 7fc8360806c0 1 -- start start 2026-02-13T02:24:11.930 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:11.925+0000 7fc8360806c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fc83010cfb0 0x7fc830060700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:24:11.930 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:11.925+0000 7fc8360806c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fc8301131c0 0x7fc830060c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:24:11.930 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:11.925+0000 7fc8360806c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fc830061180 0x7fc830163200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:24:11.930 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:11.925+0000 7fc8360806c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7fc830163740 con 0x7fc830061180 2026-02-13T02:24:11.930 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:11.925+0000 7fc8360806c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc8301638b0 con 0x7fc8301131c0 2026-02-13T02:24:11.930 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:11.925+0000 7fc8360806c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc830163a70 con 0x7fc83010cfb0 2026-02-13T02:24:11.930 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:11.925+0000 7fc82ffff6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fc830061180 0x7fc830163200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:24:11.930 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:11.925+0000 7fc82ffff6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fc830061180 0x7fc830163200 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:60112/0 (socket says 10.20.193.11:60112) 2026-02-13T02:24:11.930 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:11.925+0000 7fc82ffff6c0 1 -- 10.20.193.11:0/1727121269 learned_addr learned my addr 10.20.193.11:0/1727121269 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:24:11.930 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:11.925+0000 7fc82effd6c0 1 --2- 10.20.193.11:0/1727121269 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fc8301131c0 0x7fc830060c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:24:11.930 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:11.925+0000 7fc82f7fe6c0 1 --2- 10.20.193.11:0/1727121269 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fc83010cfb0 0x7fc830060700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:24:11.930 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:11.925+0000 7fc82ffff6c0 1 -- 10.20.193.11:0/1727121269 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fc83010cfb0 msgr2=0x7fc830060700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:24:11.931 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:11.925+0000 7fc82ffff6c0 1 --2- 10.20.193.11:0/1727121269 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fc83010cfb0 0x7fc830060700 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:24:11.931 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:11.925+0000 7fc82ffff6c0 1 -- 10.20.193.11:0/1727121269 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fc8301131c0 msgr2=0x7fc830060c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:24:11.931 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:11.925+0000 7fc82ffff6c0 1 --2- 10.20.193.11:0/1727121269 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fc8301131c0 0x7fc830060c40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:24:11.931 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:11.925+0000 7fc82ffff6c0 1 -- 10.20.193.11:0/1727121269 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc81c009590 con 0x7fc830061180 2026-02-13T02:24:11.931 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:11.925+0000 7fc82ffff6c0 1 --2- 10.20.193.11:0/1727121269 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fc830061180 0x7fc830163200 secure :-1 s=READY pgs=470 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc824006ea0 tx=0x7fc82400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:24:11.931 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:11.925+0000 7fc82cff96c0 1 -- 10.20.193.11:0/1727121269 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc824003a30 con 0x7fc830061180 2026-02-13T02:24:11.931 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:11.925+0000 7fc82cff96c0 1 -- 10.20.193.11:0/1727121269 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fc824005510 con 0x7fc830061180 2026-02-13T02:24:11.931 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:11.925+0000 7fc82cff96c0 1 -- 10.20.193.11:0/1727121269 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc82400dd70 con 0x7fc830061180 2026-02-13T02:24:11.931 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:11.925+0000 7fc8360806c0 1 -- 10.20.193.11:0/1727121269 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc830163d50 con 0x7fc830061180 2026-02-13T02:24:11.931 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:11.925+0000 7fc8360806c0 1 -- 10.20.193.11:0/1727121269 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc830164230 con 0x7fc830061180 2026-02-13T02:24:11.931 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:11.926+0000 7fc8360806c0 1 -- 10.20.193.11:0/1727121269 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc83010e280 con 0x7fc830061180 2026-02-13T02:24:11.932 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:11.928+0000 7fc82cff96c0 1 -- 10.20.193.11:0/1727121269 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7fc824003b90 con 0x7fc830061180 2026-02-13T02:24:11.933 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:11.928+0000 7fc82cff96c0 1 --2- 10.20.193.11:0/1727121269 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fc8040b5680 0x7fc8040d5b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:24:11.933 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:11.928+0000 7fc82f7fe6c0 1 --2- 10.20.193.11:0/1727121269 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fc8040b5680 0x7fc8040d5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:24:11.933 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:11.929+0000 7fc82cff96c0 1 -- 10.20.193.11:0/1727121269 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7965+0+0 (secure 0 0 0) 0x7fc8240e4900 con 0x7fc830061180 2026-02-13T02:24:11.933 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:11.929+0000 7fc82cff96c0 1 -- 10.20.193.11:0/1727121269 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fc8240aae20 con 0x7fc830061180 2026-02-13T02:24:11.933 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:11.929+0000 7fc82f7fe6c0 1 --2- 10.20.193.11:0/1727121269 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fc8040b5680 0x7fc8040d5b30 secure :-1 s=READY pgs=297 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc81c0098c0 tx=0x7fc81c0023a0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:24:12.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:24:11 trial060 ceph-mon[14797]: pgmap v349: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.0 KiB/s rd, 9 op/s 2026-02-13T02:24:12.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:24:11 trial078 ceph-mon[14969]: pgmap v349: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.0 KiB/s rd, 9 op/s 2026-02-13T02:24:12.046 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:12.044+0000 7fc8360806c0 1 -- 10.20.193.11:0/1727121269 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fc83010d380 con 0x7fc830061180 2026-02-13T02:24:12.046 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:12.044+0000 7fc82cff96c0 1 -- 10.20.193.11:0/1727121269 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fc824071480 con 0x7fc830061180 2026-02-13T02:24:12.046 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:24:12.047 INFO:teuthology.orchestra.run.trial011.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:24:12.048 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:12.045+0000 7fc8360806c0 1 -- 10.20.193.11:0/1727121269 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fc8040b5680 msgr2=0x7fc8040d5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:24:12.048 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:12.045+0000 7fc8360806c0 1 --2- 10.20.193.11:0/1727121269 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fc8040b5680 0x7fc8040d5b30 secure :-1 s=READY pgs=297 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc81c0098c0 tx=0x7fc81c0023a0 comp rx=0 tx=0).stop 2026-02-13T02:24:12.048 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:12.045+0000 7fc8360806c0 1 -- 10.20.193.11:0/1727121269 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fc830061180 msgr2=0x7fc830163200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:24:12.048 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:12.045+0000 7fc8360806c0 1 --2- 10.20.193.11:0/1727121269 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fc830061180 0x7fc830163200 secure :-1 s=READY pgs=470 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc824006ea0 tx=0x7fc82400cca0 comp rx=0 tx=0).stop 2026-02-13T02:24:12.048 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:12.045+0000 7fc8360806c0 1 -- 10.20.193.11:0/1727121269 shutdown_connections 2026-02-13T02:24:12.048 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:12.045+0000 7fc8360806c0 1 --2- 10.20.193.11:0/1727121269 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fc8040b5680 0x7fc8040d5b30 unknown :-1 s=CLOSED pgs=297 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:24:12.048 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:12.045+0000 7fc8360806c0 1 --2- 10.20.193.11:0/1727121269 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fc8301131c0 0x7fc830060c40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:24:12.048 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:12.045+0000 7fc8360806c0 1 --2- 10.20.193.11:0/1727121269 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fc830061180 0x7fc830163200 unknown :-1 s=CLOSED pgs=470 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:24:12.049 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:12.045+0000 7fc8360806c0 1 --2- 10.20.193.11:0/1727121269 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fc83010cfb0 0x7fc830060700 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:24:12.049 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:12.045+0000 7fc8360806c0 1 -- 10.20.193.11:0/1727121269 >> 10.20.193.11:0/1727121269 conn(0x7fc8300ea8b0 msgr2=0x7fc83010ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:24:12.049 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:12.045+0000 7fc8360806c0 1 -- 10.20.193.11:0/1727121269 shutdown_connections 2026-02-13T02:24:12.049 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:12.046+0000 7fc8360806c0 1 -- 10.20.193.11:0/1727121269 wait complete. 2026-02-13T02:24:12.901 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:24:12 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/1727121269' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:24:12.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:24:12 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/1727121269' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:24:13.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:24:12 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/1727121269' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:24:13.952 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:24:13 trial011 ceph-mon[11956]: pgmap v350: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 10 op/s 2026-02-13T02:24:14.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:24:13 trial060 ceph-mon[14797]: pgmap v350: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 10 op/s 2026-02-13T02:24:14.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:24:13 trial078 ceph-mon[14969]: pgmap v350: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 10 op/s 2026-02-13T02:24:15.086 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph health --format=json 2026-02-13T02:24:15.214 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:24:15.331 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:15.327+0000 7fc8c1ee16c0 1 -- 10.20.193.11:0/620950201 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fc8bc10fbf0 msgr2=0x7fc8bc114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:24:15.331 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:15.327+0000 7fc8c1ee16c0 1 --2- 10.20.193.11:0/620950201 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fc8bc10fbf0 0x7fc8bc114c30 secure :-1 s=READY pgs=471 gs=1 cs=0 l=1 c_cookie=18154431036530541916 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc8ac0099a0 tx=0x7fc8ac02ed20 comp rx=0 tx=0).stop 2026-02-13T02:24:15.331 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:15.327+0000 7fc8c1ee16c0 1 -- 10.20.193.11:0/620950201 shutdown_connections 2026-02-13T02:24:15.331 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:15.327+0000 7fc8c1ee16c0 1 --2- 10.20.193.11:0/620950201 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fc8bc115410 0x7fc8bc175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:24:15.332 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:15.327+0000 7fc8c1ee16c0 1 --2- 10.20.193.11:0/620950201 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fc8bc10fbf0 0x7fc8bc114c30 unknown :-1 s=CLOSED pgs=471 gs=1 cs=0 l=1 c_cookie=18154431036530541916 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:24:15.332 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:15.327+0000 7fc8c1ee16c0 1 --2- 10.20.193.11:0/620950201 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fc8bc10f200 0x7fc8bc10f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:24:15.332 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:15.327+0000 7fc8c1ee16c0 1 -- 10.20.193.11:0/620950201 >> 10.20.193.11:0/620950201 conn(0x7fc8bc0ecb00 msgr2=0x7fc8bc10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:24:15.332 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:15.327+0000 7fc8c1ee16c0 1 -- 10.20.193.11:0/620950201 shutdown_connections 2026-02-13T02:24:15.332 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:15.327+0000 7fc8c1ee16c0 1 -- 10.20.193.11:0/620950201 wait complete. 2026-02-13T02:24:15.332 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:15.327+0000 7fc8c1ee16c0 1 Processor -- start 2026-02-13T02:24:15.333 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:15.327+0000 7fc8c1ee16c0 1 -- start start 2026-02-13T02:24:15.333 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:15.327+0000 7fc8c1ee16c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fc8bc10f200 0x7fc8bc0f4ba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:24:15.333 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:15.327+0000 7fc8c1ee16c0 1 --2- >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fc8bc115410 0x7fc8bc175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:24:15.333 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:15.327+0000 7fc8c1ee16c0 1 --2- >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fc8bc0f51d0 0x7fc8bc0fa4a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:24:15.333 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:15.327+0000 7fc8c1ee16c0 1 -- --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_getmap magic: 0 -- 0x7fc8bc0f58c0 con 0x7fc8bc10f200 2026-02-13T02:24:15.334 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:15.327+0000 7fc8c1ee16c0 1 -- --> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc8bc0fa9e0 con 0x7fc8bc115410 2026-02-13T02:24:15.334 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:15.327+0000 7fc8c1ee16c0 1 -- --> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc8bc0faba0 con 0x7fc8bc0f51d0 2026-02-13T02:24:15.334 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:15.328+0000 7fc8bb7fe6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fc8bc10f200 0x7fc8bc0f4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:24:15.334 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:15.328+0000 7fc8bb7fe6c0 1 --2- >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fc8bc10f200 0x7fc8bc0f4ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.11:3300/0 says I am v2:10.20.193.11:60142/0 (socket says 10.20.193.11:60142) 2026-02-13T02:24:15.334 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:15.328+0000 7fc8bb7fe6c0 1 -- 10.20.193.11:0/4161974330 learned_addr learned my addr 10.20.193.11:0/4161974330 (peer_addr_for_me v2:10.20.193.11:0/0) 2026-02-13T02:24:15.334 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:15.328+0000 7fc8bbfff6c0 1 --2- 10.20.193.11:0/4161974330 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fc8bc0f51d0 0x7fc8bc0fa4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:24:15.335 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:15.328+0000 7fc8baffd6c0 1 --2- 10.20.193.11:0/4161974330 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fc8bc115410 0x7fc8bc175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:24:15.335 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:15.328+0000 7fc8bb7fe6c0 1 -- 10.20.193.11:0/4161974330 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fc8bc0f51d0 msgr2=0x7fc8bc0fa4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:24:15.335 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:15.328+0000 7fc8bb7fe6c0 1 --2- 10.20.193.11:0/4161974330 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fc8bc0f51d0 0x7fc8bc0fa4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:24:15.335 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:15.328+0000 7fc8bb7fe6c0 1 -- 10.20.193.11:0/4161974330 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fc8bc115410 msgr2=0x7fc8bc175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:24:15.335 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:15.328+0000 7fc8bb7fe6c0 1 --2- 10.20.193.11:0/4161974330 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fc8bc115410 0x7fc8bc175cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:24:15.335 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:15.328+0000 7fc8bb7fe6c0 1 -- 10.20.193.11:0/4161974330 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8ac009590 con 0x7fc8bc10f200 2026-02-13T02:24:15.336 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:15.328+0000 7fc8bb7fe6c0 1 --2- 10.20.193.11:0/4161974330 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fc8bc10f200 0x7fc8bc0f4ba0 secure :-1 s=READY pgs=472 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc8a8005dc0 tx=0x7fc8a800bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:24:15.336 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:15.328+0000 7fc8b8ff96c0 1 -- 10.20.193.11:0/4161974330 <== mon.0 v2:10.20.193.11:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc8a8004250 con 0x7fc8bc10f200 2026-02-13T02:24:15.336 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:15.328+0000 7fc8c1ee16c0 1 -- 10.20.193.11:0/4161974330 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8bc0fae80 con 0x7fc8bc10f200 2026-02-13T02:24:15.336 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:15.328+0000 7fc8b8ff96c0 1 -- 10.20.193.11:0/4161974330 <== mon.0 v2:10.20.193.11:3300/0 2 ==== config(28 keys) ==== 1150+0+0 (secure 0 0 0) 0x7fc8a8009070 con 0x7fc8bc10f200 2026-02-13T02:24:15.336 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:15.328+0000 7fc8b8ff96c0 1 -- 10.20.193.11:0/4161974330 <== mon.0 v2:10.20.193.11:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc8a800ce10 con 0x7fc8bc10f200 2026-02-13T02:24:15.336 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:15.328+0000 7fc8c1ee16c0 1 -- 10.20.193.11:0/4161974330 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8bc0fb310 con 0x7fc8bc10f200 2026-02-13T02:24:15.337 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:15.328+0000 7fc8c1ee16c0 1 -- 10.20.193.11:0/4161974330 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8bc1104d0 con 0x7fc8bc10f200 2026-02-13T02:24:15.338 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:15.330+0000 7fc8b8ff96c0 1 -- 10.20.193.11:0/4161974330 <== mon.0 v2:10.20.193.11:3300/0 4 ==== mgrmap(e 12) ==== 157066+0+0 (secure 0 0 0) 0x7fc8a80028c0 con 0x7fc8bc10f200 2026-02-13T02:24:15.339 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:15.330+0000 7fc8b8ff96c0 1 --2- 10.20.193.11:0/4161974330 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fc8900b5600 0x7fc8900d5ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T02:24:15.339 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:15.330+0000 7fc8b8ff96c0 1 -- 10.20.193.11:0/4161974330 <== mon.0 v2:10.20.193.11:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7965+0+0 (secure 0 0 0) 0x7fc8a80e38a0 con 0x7fc8bc10f200 2026-02-13T02:24:15.339 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:15.330+0000 7fc8baffd6c0 1 --2- 10.20.193.11:0/4161974330 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fc8900b5600 0x7fc8900d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T02:24:15.339 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:15.331+0000 7fc8baffd6c0 1 --2- 10.20.193.11:0/4161974330 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fc8900b5600 0x7fc8900d5ab0 secure :-1 s=READY pgs=298 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc8ac0023e0 tx=0x7fc8ac031f90 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T02:24:15.339 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:15.331+0000 7fc8b8ff96c0 1 -- 10.20.193.11:0/4161974330 <== mon.0 v2:10.20.193.11:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fc8a80a6360 con 0x7fc8bc10f200 2026-02-13T02:24:15.449 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:15.447+0000 7fc8c1ee16c0 1 -- 10.20.193.11:0/4161974330 --> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fc8bc0fb310 con 0x7fc8bc10f200 2026-02-13T02:24:15.449 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:15.447+0000 7fc8b8ff96c0 1 -- 10.20.193.11:0/4161974330 <== mon.0 v2:10.20.193.11:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fc8bc0fb310 con 0x7fc8bc10f200 2026-02-13T02:24:15.449 INFO:teuthology.orchestra.run.trial011.stdout: 2026-02-13T02:24:15.449 INFO:teuthology.orchestra.run.trial011.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T02:24:15.450 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:15.448+0000 7fc8c1ee16c0 1 -- 10.20.193.11:0/4161974330 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fc8900b5600 msgr2=0x7fc8900d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:24:15.450 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:15.448+0000 7fc8c1ee16c0 1 --2- 10.20.193.11:0/4161974330 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fc8900b5600 0x7fc8900d5ab0 secure :-1 s=READY pgs=298 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc8ac0023e0 tx=0x7fc8ac031f90 comp rx=0 tx=0).stop 2026-02-13T02:24:15.451 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:15.448+0000 7fc8c1ee16c0 1 -- 10.20.193.11:0/4161974330 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fc8bc10f200 msgr2=0x7fc8bc0f4ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T02:24:15.451 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:15.448+0000 7fc8c1ee16c0 1 --2- 10.20.193.11:0/4161974330 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fc8bc10f200 0x7fc8bc0f4ba0 secure :-1 s=READY pgs=472 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc8a8005dc0 tx=0x7fc8a800bbb0 comp rx=0 tx=0).stop 2026-02-13T02:24:15.451 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:15.448+0000 7fc8c1ee16c0 1 -- 10.20.193.11:0/4161974330 shutdown_connections 2026-02-13T02:24:15.451 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:15.448+0000 7fc8c1ee16c0 1 --2- 10.20.193.11:0/4161974330 >> [v2:10.20.193.11:6800/861334768,v1:10.20.193.11:6801/861334768] conn(0x7fc8900b5600 0x7fc8900d5ab0 unknown :-1 s=CLOSED pgs=298 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:24:15.451 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:15.448+0000 7fc8c1ee16c0 1 --2- 10.20.193.11:0/4161974330 >> [v2:10.20.193.60:3300/0,v1:10.20.193.60:6789/0] conn(0x7fc8bc115410 0x7fc8bc175cb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:24:15.451 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:15.448+0000 7fc8c1ee16c0 1 --2- 10.20.193.11:0/4161974330 >> [v2:10.20.193.78:3300/0,v1:10.20.193.78:6789/0] conn(0x7fc8bc0f51d0 0x7fc8bc0fa4a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:24:15.451 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:15.448+0000 7fc8c1ee16c0 1 --2- 10.20.193.11:0/4161974330 >> [v2:10.20.193.11:3300/0,v1:10.20.193.11:6789/0] conn(0x7fc8bc10f200 0x7fc8bc0f4ba0 unknown :-1 s=CLOSED pgs=472 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T02:24:15.451 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:15.448+0000 7fc8c1ee16c0 1 -- 10.20.193.11:0/4161974330 >> 10.20.193.11:0/4161974330 conn(0x7fc8bc0ecb00 msgr2=0x7fc8bc10d7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T02:24:15.451 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:15.448+0000 7fc8c1ee16c0 1 -- 10.20.193.11:0/4161974330 shutdown_connections 2026-02-13T02:24:15.451 INFO:teuthology.orchestra.run.trial011.stderr:2026-02-13T02:24:15.448+0000 7fc8c1ee16c0 1 -- 10.20.193.11:0/4161974330 wait complete. 2026-02-13T02:24:15.488 INFO:tasks.cephadm:Teardown begin 2026-02-13T02:24:15.488 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_batrick_ceph_cfcf307502511ba51c39a8b9085c2fcde505d421/qa/tasks/cephadm.py", line 2025, in task healthy(ctx=ctx, config=config) File "/home/teuthworker/src/github.com_batrick_ceph_cfcf307502511ba51c39a8b9085c2fcde505d421/qa/tasks/ceph.py", line 1557, in healthy manager.wait_until_healthy(timeout=300) File "/home/teuthworker/src/github.com_batrick_ceph_cfcf307502511ba51c39a8b9085c2fcde505d421/qa/tasks/ceph_manager.py", line 3393, in wait_until_healthy assert time.time() - start < timeout, \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: timeout expired in wait_until_healthy 2026-02-13T02:24:15.492 DEBUG:teuthology.orchestra.run.trial011:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-13T02:24:15.521 DEBUG:teuthology.orchestra.run.trial060:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-13T02:24:15.555 DEBUG:teuthology.orchestra.run.trial078:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-13T02:24:15.588 INFO:tasks.cephadm:Disabling cephadm mgr module 2026-02-13T02:24:15.588 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fc631695-0881-11f1-899c-d404e6e7d460 -- ceph mgr module disable cephadm 2026-02-13T02:24:15.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:24:15 trial011 ceph-mon[11956]: pgmap v351: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:24:15.702 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:24:15 trial011 ceph-mon[11956]: from='client.? 10.20.193.11:0/4161974330' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:24:15.711 INFO:teuthology.orchestra.run.trial011.stderr:Inferring config /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/mon.a/config 2026-02-13T02:24:15.726 INFO:teuthology.orchestra.run.trial011.stderr:Error: statfs /etc/ceph/ceph.client.admin.keyring: no such file or directory 2026-02-13T02:24:15.742 DEBUG:teuthology.orchestra.run:got remote process result: 125 2026-02-13T02:24:15.743 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2026-02-13T02:24:15.743 DEBUG:teuthology.orchestra.run.trial011:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2026-02-13T02:24:15.761 DEBUG:teuthology.orchestra.run.trial060:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2026-02-13T02:24:15.781 DEBUG:teuthology.orchestra.run.trial078:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2026-02-13T02:24:15.799 INFO:tasks.cephadm:Stopping all daemons... 2026-02-13T02:24:15.799 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2026-02-13T02:24:15.800 DEBUG:teuthology.orchestra.run.trial011:> sudo systemctl stop ceph-fc631695-0881-11f1-899c-d404e6e7d460@mon.a 2026-02-13T02:24:16.000 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:24:15 trial060 ceph-mon[14797]: pgmap v351: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:24:16.001 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:24:15 trial060 ceph-mon[14797]: from='client.? 10.20.193.11:0/4161974330' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:24:16.041 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:24:15 trial078 ceph-mon[14969]: pgmap v351: 97 pgs: 97 active+clean; 653 KiB data, 327 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T02:24:16.042 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:24:15 trial078 ceph-mon[14969]: from='client.? 10.20.193.11:0/4161974330' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T02:24:16.172 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:24:15 trial011 systemd[1]: Stopping ceph-fc631695-0881-11f1-899c-d404e6e7d460@mon.a.service - Ceph mon.a for fc631695-0881-11f1-899c-d404e6e7d460... 2026-02-13T02:24:16.172 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:24:15 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mon-a[11952]: 2026-02-13T02:24:15.907+0000 7f43deea86c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T02:24:16.172 INFO:journalctl@ceph.mon.a.trial011.stdout:Feb 13 02:24:15 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mon-a[11952]: 2026-02-13T02:24:15.907+0000 7f43deea86c0 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2026-02-13T02:24:16.256 DEBUG:teuthology.orchestra.run.trial011:> sudo pkill -f 'journalctl -f -n 0 -u ceph-fc631695-0881-11f1-899c-d404e6e7d460@mon.a.service' 2026-02-13T02:24:16.306 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T02:24:16.307 INFO:tasks.cephadm.mon.a:Stopped mon.a 2026-02-13T02:24:16.307 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2026-02-13T02:24:16.307 DEBUG:teuthology.orchestra.run.trial060:> sudo systemctl stop ceph-fc631695-0881-11f1-899c-d404e6e7d460@mon.b 2026-02-13T02:24:16.628 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:24:16 trial060 systemd[1]: Stopping ceph-fc631695-0881-11f1-899c-d404e6e7d460@mon.b.service - Ceph mon.b for fc631695-0881-11f1-899c-d404e6e7d460... 2026-02-13T02:24:16.628 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:24:16 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mon-b[14792]: 2026-02-13T02:24:16.415+0000 7febde7606c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T02:24:16.628 INFO:journalctl@ceph.mon.b.trial060.stdout:Feb 13 02:24:16 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mon-b[14792]: 2026-02-13T02:24:16.415+0000 7febde7606c0 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2026-02-13T02:24:16.723 DEBUG:teuthology.orchestra.run.trial060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-fc631695-0881-11f1-899c-d404e6e7d460@mon.b.service' 2026-02-13T02:24:16.772 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T02:24:16.772 INFO:tasks.cephadm.mon.c:Stopped mon.b 2026-02-13T02:24:16.773 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2026-02-13T02:24:16.773 DEBUG:teuthology.orchestra.run.trial078:> sudo systemctl stop ceph-fc631695-0881-11f1-899c-d404e6e7d460@mon.c 2026-02-13T02:24:17.087 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:24:16 trial078 systemd[1]: Stopping ceph-fc631695-0881-11f1-899c-d404e6e7d460@mon.c.service - Ceph mon.c for fc631695-0881-11f1-899c-d404e6e7d460... 2026-02-13T02:24:17.087 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:24:16 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mon-c[14954]: 2026-02-13T02:24:16.881+0000 7f2a469426c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T02:24:17.087 INFO:journalctl@ceph.mon.c.trial078.stdout:Feb 13 02:24:16 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mon-c[14954]: 2026-02-13T02:24:16.881+0000 7f2a469426c0 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2026-02-13T02:24:17.189 DEBUG:teuthology.orchestra.run.trial078:> sudo pkill -f 'journalctl -f -n 0 -u ceph-fc631695-0881-11f1-899c-d404e6e7d460@mon.c.service' 2026-02-13T02:24:17.238 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T02:24:17.239 INFO:tasks.cephadm.mon.c:Stopped mon.c 2026-02-13T02:24:17.239 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2026-02-13T02:24:17.239 DEBUG:teuthology.orchestra.run.trial011:> sudo systemctl stop ceph-fc631695-0881-11f1-899c-d404e6e7d460@mgr.x 2026-02-13T02:24:17.478 DEBUG:teuthology.orchestra.run.trial011:> sudo pkill -f 'journalctl -f -n 0 -u ceph-fc631695-0881-11f1-899c-d404e6e7d460@mgr.x.service' 2026-02-13T02:24:17.524 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T02:24:17.524 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2026-02-13T02:24:17.524 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2026-02-13T02:24:17.525 DEBUG:teuthology.orchestra.run.trial060:> sudo systemctl stop ceph-fc631695-0881-11f1-899c-d404e6e7d460@mgr.y 2026-02-13T02:24:17.650 INFO:journalctl@ceph.mgr.y.trial060.stdout:Feb 13 02:24:17 trial060 systemd[1]: Stopping ceph-fc631695-0881-11f1-899c-d404e6e7d460@mgr.y.service - Ceph mgr.y for fc631695-0881-11f1-899c-d404e6e7d460... 2026-02-13T02:24:17.741 DEBUG:teuthology.orchestra.run.trial060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-fc631695-0881-11f1-899c-d404e6e7d460@mgr.y.service' 2026-02-13T02:24:17.785 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T02:24:17.785 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2026-02-13T02:24:17.786 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2026-02-13T02:24:17.786 DEBUG:teuthology.orchestra.run.trial078:> sudo systemctl stop ceph-fc631695-0881-11f1-899c-d404e6e7d460@mgr.z 2026-02-13T02:24:18.009 DEBUG:teuthology.orchestra.run.trial078:> sudo pkill -f 'journalctl -f -n 0 -u ceph-fc631695-0881-11f1-899c-d404e6e7d460@mgr.z.service' 2026-02-13T02:24:18.054 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T02:24:18.054 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2026-02-13T02:24:18.054 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2026-02-13T02:24:18.055 DEBUG:teuthology.orchestra.run.trial011:> sudo systemctl stop ceph-fc631695-0881-11f1-899c-d404e6e7d460@osd.0 2026-02-13T02:24:18.452 INFO:journalctl@ceph.osd.0.trial011.stdout:Feb 13 02:24:18 trial011 systemd[1]: Stopping ceph-fc631695-0881-11f1-899c-d404e6e7d460@osd.0.service - Ceph osd.0 for fc631695-0881-11f1-899c-d404e6e7d460... 2026-02-13T02:24:18.452 INFO:journalctl@ceph.osd.0.trial011.stdout:Feb 13 02:24:18 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-0[24273]: 2026-02-13T02:24:18.158+0000 7f79b21326c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T02:24:18.452 INFO:journalctl@ceph.osd.0.trial011.stdout:Feb 13 02:24:18 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-0[24273]: 2026-02-13T02:24:18.158+0000 7f79b21326c0 -1 osd.0 73 *** Got signal Terminated *** 2026-02-13T02:24:18.452 INFO:journalctl@ceph.osd.0.trial011.stdout:Feb 13 02:24:18 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-0[24273]: 2026-02-13T02:24:18.159+0000 7f79b21326c0 -1 osd.0 73 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T02:24:23.544 INFO:journalctl@ceph.osd.0.trial011.stdout:Feb 13 02:24:23 trial011 podman[66451]: 2026-02-13 02:24:23.238664171 +0000 UTC m=+5.090701922 container died 2d63970325fe4484ae5e3a8bc91c4a4ce5e599ab4b920aaae505946bd1f74286 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, license=BSD-3-Clause, ceph=True, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.licenses=BSD-3-Clause, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, summary=Rocky Linux Base image, vendor=Rocky Enterprise Software Foundation, version=10, OSD_FLAVOR=default, org.opencontainers.image.title=rockylinux, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, io.buildah.version=1.33.7, name=rockylinux) 2026-02-13T02:24:23.545 INFO:journalctl@ceph.osd.0.trial011.stdout:Feb 13 02:24:23 trial011 podman[66451]: 2026-02-13 02:24:23.247152812 +0000 UTC m=+5.099190573 container remove 2d63970325fe4484ae5e3a8bc91c4a4ce5e599ab4b920aaae505946bd1f74286 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-0, license=BSD-3-Clause, io.buildah.version=1.33.7, summary=Rocky Linux Base image, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.title=rockylinux, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, ceph=True, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, version=10, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.version=10, name=rockylinux, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-13T02:24:23.545 INFO:journalctl@ceph.osd.0.trial011.stdout:Feb 13 02:24:23 trial011 bash[66451]: ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-0 2026-02-13T02:24:23.545 INFO:journalctl@ceph.osd.0.trial011.stdout:Feb 13 02:24:23 trial011 podman[66578]: 2026-02-13 02:24:23.384282582 +0000 UTC m=+0.016324649 container create 9c75196c6d67c1b8d3d323e3da71e7ceb1f05d55c95aa2e56181715744998317 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-0-deactivate, io.buildah.version=1.33.7, org.opencontainers.image.title=rockylinux, name=rockylinux, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_REF=wip-pdonnell-testing-20260210.171210, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team , vendor=Rocky Enterprise Software Foundation, summary=Rocky Linux Base image, license=BSD-3-Clause, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.licenses=BSD-3-Clause, version=10) 2026-02-13T02:24:23.545 INFO:journalctl@ceph.osd.0.trial011.stdout:Feb 13 02:24:23 trial011 podman[66578]: 2026-02-13 02:24:23.420575948 +0000 UTC m=+0.052618025 container init 9c75196c6d67c1b8d3d323e3da71e7ceb1f05d55c95aa2e56181715744998317 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-0-deactivate, org.opencontainers.image.title=rockylinux, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.documentation=https://docs.ceph.com/, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.version=10, license=BSD-3-Clause, vendor=Rocky Enterprise Software Foundation, ceph=True, io.buildah.version=1.33.7, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.authors=Ceph Release Team , summary=Rocky Linux Base image, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.licenses=BSD-3-Clause, version=10, OSD_FLAVOR=default, name=rockylinux) 2026-02-13T02:24:23.545 INFO:journalctl@ceph.osd.0.trial011.stdout:Feb 13 02:24:23 trial011 podman[66578]: 2026-02-13 02:24:23.422284392 +0000 UTC m=+0.054326459 container start 9c75196c6d67c1b8d3d323e3da71e7ceb1f05d55c95aa2e56181715744998317 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-0-deactivate, version=10, OSD_FLAVOR=default, org.opencontainers.image.version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.authors=Ceph Release Team , vendor=Rocky Enterprise Software Foundation, summary=Rocky Linux Base image, ceph=True, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.licenses=BSD-3-Clause, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.33.7, org.opencontainers.image.title=rockylinux, license=BSD-3-Clause, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, name=rockylinux) 2026-02-13T02:24:23.545 INFO:journalctl@ceph.osd.0.trial011.stdout:Feb 13 02:24:23 trial011 podman[66578]: 2026-02-13 02:24:23.422739728 +0000 UTC m=+0.054781805 container attach 9c75196c6d67c1b8d3d323e3da71e7ceb1f05d55c95aa2e56181715744998317 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-0-deactivate, vendor=Rocky Enterprise Software Foundation, summary=Rocky Linux Base image, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, name=rockylinux, version=10, ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.title=rockylinux, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.documentation=https://docs.ceph.com/, io.buildah.version=1.33.7, license=BSD-3-Clause, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default, org.opencontainers.image.licenses=BSD-3-Clause) 2026-02-13T02:24:23.545 INFO:journalctl@ceph.osd.0.trial011.stdout:Feb 13 02:24:23 trial011 podman[66578]: 2026-02-13 02:24:23.378007725 +0000 UTC m=+0.010049792 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T02:24:23.576 DEBUG:teuthology.orchestra.run.trial011:> sudo pkill -f 'journalctl -f -n 0 -u ceph-fc631695-0881-11f1-899c-d404e6e7d460@osd.0.service' 2026-02-13T02:24:23.622 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T02:24:23.622 INFO:tasks.cephadm.osd.0:Stopped osd.0 2026-02-13T02:24:23.622 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2026-02-13T02:24:23.622 DEBUG:teuthology.orchestra.run.trial060:> sudo systemctl stop ceph-fc631695-0881-11f1-899c-d404e6e7d460@osd.1 2026-02-13T02:24:24.000 INFO:journalctl@ceph.osd.1.trial060.stdout:Feb 13 02:24:23 trial060 systemd[1]: Stopping ceph-fc631695-0881-11f1-899c-d404e6e7d460@osd.1.service - Ceph osd.1 for fc631695-0881-11f1-899c-d404e6e7d460... 2026-02-13T02:24:24.001 INFO:journalctl@ceph.osd.1.trial060.stdout:Feb 13 02:24:23 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-1[19684]: 2026-02-13T02:24:23.730+0000 7f1e4ad776c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T02:24:24.001 INFO:journalctl@ceph.osd.1.trial060.stdout:Feb 13 02:24:23 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-1[19684]: 2026-02-13T02:24:23.730+0000 7f1e4ad776c0 -1 osd.1 73 *** Got signal Terminated *** 2026-02-13T02:24:24.001 INFO:journalctl@ceph.osd.1.trial060.stdout:Feb 13 02:24:23 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-1[19684]: 2026-02-13T02:24:23.730+0000 7f1e4ad776c0 -1 osd.1 73 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T02:24:29.135 INFO:journalctl@ceph.osd.1.trial060.stdout:Feb 13 02:24:28 trial060 podman[46283]: 2026-02-13 02:24:28.821302341 +0000 UTC m=+5.101818705 container died 6c6b231ac654f439711e041fa21cdedb1a625057aa17e7385907c09cf8db3080 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-1, org.opencontainers.image.licenses=BSD-3-Clause, summary=Rocky Linux Base image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.version=10, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, license=BSD-3-Clause, org.opencontainers.image.authors=Ceph Release Team , version=10, ceph=True, io.buildah.version=1.33.7, name=rockylinux, vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.title=rockylinux, OSD_FLAVOR=default) 2026-02-13T02:24:29.135 INFO:journalctl@ceph.osd.1.trial060.stdout:Feb 13 02:24:28 trial060 podman[46283]: 2026-02-13 02:24:28.829490571 +0000 UTC m=+5.110006915 container remove 6c6b231ac654f439711e041fa21cdedb1a625057aa17e7385907c09cf8db3080 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-1, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.title=rockylinux, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.licenses=BSD-3-Clause, CEPH_REF=wip-pdonnell-testing-20260210.171210, ceph=True, summary=Rocky Linux Base image, name=rockylinux, org.opencontainers.image.version=10, version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/, license=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, io.buildah.version=1.33.7, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10) 2026-02-13T02:24:29.135 INFO:journalctl@ceph.osd.1.trial060.stdout:Feb 13 02:24:28 trial060 bash[46283]: ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-1 2026-02-13T02:24:29.135 INFO:journalctl@ceph.osd.1.trial060.stdout:Feb 13 02:24:28 trial060 podman[46415]: 2026-02-13 02:24:28.967907804 +0000 UTC m=+0.014534084 container create 28562dee1c368c919e324db9de66b2fd1a4b2050515280ac172c789bf9951f1e (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-1-deactivate, name=rockylinux, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, summary=Rocky Linux Base image, org.opencontainers.image.authors=Ceph Release Team , license=BSD-3-Clause, version=10, ceph=True, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.version=10, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.title=rockylinux, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.33.7, OSD_FLAVOR=default, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, CEPH_REF=wip-pdonnell-testing-20260210.171210, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-13T02:24:29.135 INFO:journalctl@ceph.osd.1.trial060.stdout:Feb 13 02:24:29 trial060 podman[46415]: 2026-02-13 02:24:29.00417484 +0000 UTC m=+0.050801120 container init 28562dee1c368c919e324db9de66b2fd1a4b2050515280ac172c789bf9951f1e (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-1-deactivate, org.opencontainers.image.title=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, ceph=True, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.documentation=https://docs.ceph.com/, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, license=BSD-3-Clause, org.opencontainers.image.version=10, vendor=Rocky Enterprise Software Foundation, io.buildah.version=1.33.7, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, version=10, name=rockylinux, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, summary=Rocky Linux Base image, CEPH_REF=wip-pdonnell-testing-20260210.171210) 2026-02-13T02:24:29.135 INFO:journalctl@ceph.osd.1.trial060.stdout:Feb 13 02:24:29 trial060 podman[46415]: 2026-02-13 02:24:29.00590577 +0000 UTC m=+0.052532040 container start 28562dee1c368c919e324db9de66b2fd1a4b2050515280ac172c789bf9951f1e (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-1-deactivate, summary=Rocky Linux Base image, org.opencontainers.image.version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, license=BSD-3-Clause, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, ceph=True, vendor=Rocky Enterprise Software Foundation, io.buildah.version=1.33.7, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.licenses=BSD-3-Clause, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, version=10, name=rockylinux, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.title=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation) 2026-02-13T02:24:29.135 INFO:journalctl@ceph.osd.1.trial060.stdout:Feb 13 02:24:29 trial060 podman[46415]: 2026-02-13 02:24:29.006340759 +0000 UTC m=+0.052967029 container attach 28562dee1c368c919e324db9de66b2fd1a4b2050515280ac172c789bf9951f1e (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-1-deactivate, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , vendor=Rocky Enterprise Software Foundation, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, version=10, summary=Rocky Linux Base image, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.version=10, OSD_FLAVOR=default, org.opencontainers.image.title=rockylinux, name=rockylinux, license=BSD-3-Clause, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_REF=wip-pdonnell-testing-20260210.171210, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.33.7) 2026-02-13T02:24:29.135 INFO:journalctl@ceph.osd.1.trial060.stdout:Feb 13 02:24:29 trial060 podman[46415]: 2026-02-13 02:24:28.961583892 +0000 UTC m=+0.008210172 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T02:24:29.136 INFO:journalctl@ceph.osd.1.trial060.stdout:Feb 13 02:24:29 trial060 podman[46415]: 2026-02-13 02:24:29.134897592 +0000 UTC m=+0.181523872 container died 28562dee1c368c919e324db9de66b2fd1a4b2050515280ac172c789bf9951f1e (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-1-deactivate, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, vendor=Rocky Enterprise Software Foundation, OSD_FLAVOR=default, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.title=rockylinux, name=rockylinux, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, license=BSD-3-Clause, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, io.buildah.version=1.33.7, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, summary=Rocky Linux Base image, version=10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-13T02:24:29.162 DEBUG:teuthology.orchestra.run.trial060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-fc631695-0881-11f1-899c-d404e6e7d460@osd.1.service' 2026-02-13T02:24:29.209 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T02:24:29.209 INFO:tasks.cephadm.osd.1:Stopped osd.1 2026-02-13T02:24:29.210 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2026-02-13T02:24:29.210 DEBUG:teuthology.orchestra.run.trial078:> sudo systemctl stop ceph-fc631695-0881-11f1-899c-d404e6e7d460@osd.2 2026-02-13T02:24:29.541 INFO:journalctl@ceph.osd.2.trial078.stdout:Feb 13 02:24:29 trial078 systemd[1]: Stopping ceph-fc631695-0881-11f1-899c-d404e6e7d460@osd.2.service - Ceph osd.2 for fc631695-0881-11f1-899c-d404e6e7d460... 2026-02-13T02:24:29.542 INFO:journalctl@ceph.osd.2.trial078.stdout:Feb 13 02:24:29 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-2[20023]: 2026-02-13T02:24:29.321+0000 7f11319e96c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T02:24:29.542 INFO:journalctl@ceph.osd.2.trial078.stdout:Feb 13 02:24:29 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-2[20023]: 2026-02-13T02:24:29.321+0000 7f11319e96c0 -1 osd.2 73 *** Got signal Terminated *** 2026-02-13T02:24:29.542 INFO:journalctl@ceph.osd.2.trial078.stdout:Feb 13 02:24:29 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-2[20023]: 2026-02-13T02:24:29.321+0000 7f11319e96c0 -1 osd.2 73 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T02:24:34.721 INFO:journalctl@ceph.osd.2.trial078.stdout:Feb 13 02:24:34 trial078 podman[47551]: 2026-02-13 02:24:34.401123034 +0000 UTC m=+5.090341943 container died 17447274de02d6a3f7074c27c88eb4639afad4a042d8c8045aa96a778d8551c9 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-2, name=rockylinux, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.version=10, org.opencontainers.image.title=rockylinux, vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-pdonnell-testing-20260210.171210, summary=Rocky Linux Base image, io.buildah.version=1.33.7, license=BSD-3-Clause, ceph=True, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-13T02:24:34.721 INFO:journalctl@ceph.osd.2.trial078.stdout:Feb 13 02:24:34 trial078 podman[47551]: 2026-02-13 02:24:34.410226641 +0000 UTC m=+5.099445560 container remove 17447274de02d6a3f7074c27c88eb4639afad4a042d8c8045aa96a778d8551c9 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-2, license=BSD-3-Clause, name=rockylinux, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.version=10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, ceph=True, io.buildah.version=1.33.7, vendor=Rocky Enterprise Software Foundation, version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.title=rockylinux, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.licenses=BSD-3-Clause, summary=Rocky Linux Base image) 2026-02-13T02:24:34.721 INFO:journalctl@ceph.osd.2.trial078.stdout:Feb 13 02:24:34 trial078 bash[47551]: ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-2 2026-02-13T02:24:34.721 INFO:journalctl@ceph.osd.2.trial078.stdout:Feb 13 02:24:34 trial078 podman[47677]: 2026-02-13 02:24:34.544919787 +0000 UTC m=+0.014926665 container create 0c935fc2bd9891dba2411c4765d6c6ba7415b4a7aa739e093f02ae27c7abb792 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-2-deactivate, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, license=BSD-3-Clause, name=rockylinux, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.version=10, org.opencontainers.image.licenses=BSD-3-Clause, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.title=rockylinux, ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.33.7, summary=Rocky Linux Base image, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_REF=wip-pdonnell-testing-20260210.171210, OSD_FLAVOR=default, version=10) 2026-02-13T02:24:34.722 INFO:journalctl@ceph.osd.2.trial078.stdout:Feb 13 02:24:34 trial078 podman[47677]: 2026-02-13 02:24:34.576953725 +0000 UTC m=+0.046960593 container init 0c935fc2bd9891dba2411c4765d6c6ba7415b4a7aa739e093f02ae27c7abb792 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-2-deactivate, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, vendor=Rocky Enterprise Software Foundation, CEPH_REF=wip-pdonnell-testing-20260210.171210, OSD_FLAVOR=default, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.version=10, name=rockylinux, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.title=rockylinux, io.buildah.version=1.33.7, summary=Rocky Linux Base image, version=10, license=BSD-3-Clause, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=docker.io/rockylinux/rockylinux:10) 2026-02-13T02:24:34.722 INFO:journalctl@ceph.osd.2.trial078.stdout:Feb 13 02:24:34 trial078 podman[47677]: 2026-02-13 02:24:34.579013881 +0000 UTC m=+0.049020749 container start 0c935fc2bd9891dba2411c4765d6c6ba7415b4a7aa739e093f02ae27c7abb792 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-2-deactivate, OSD_FLAVOR=default, ceph=True, summary=Rocky Linux Base image, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.version=10, name=rockylinux, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.33.7, org.opencontainers.image.documentation=https://docs.ceph.com/, license=BSD-3-Clause, vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.title=rockylinux, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, version=10, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_REF=wip-pdonnell-testing-20260210.171210) 2026-02-13T02:24:34.722 INFO:journalctl@ceph.osd.2.trial078.stdout:Feb 13 02:24:34 trial078 podman[47677]: 2026-02-13 02:24:34.579481265 +0000 UTC m=+0.049488153 container attach 0c935fc2bd9891dba2411c4765d6c6ba7415b4a7aa739e093f02ae27c7abb792 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-2-deactivate, license=BSD-3-Clause, name=rockylinux, org.opencontainers.image.title=rockylinux, ceph=True, summary=Rocky Linux Base image, version=10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.33.7, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.version=10, vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10) 2026-02-13T02:24:34.722 INFO:journalctl@ceph.osd.2.trial078.stdout:Feb 13 02:24:34 trial078 podman[47677]: 2026-02-13 02:24:34.538683125 +0000 UTC m=+0.008689993 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T02:24:34.722 INFO:journalctl@ceph.osd.2.trial078.stdout:Feb 13 02:24:34 trial078 podman[47677]: 2026-02-13 02:24:34.718987128 +0000 UTC m=+0.188994006 container died 0c935fc2bd9891dba2411c4765d6c6ba7415b4a7aa739e093f02ae27c7abb792 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-2-deactivate, license=BSD-3-Clause, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.licenses=BSD-3-Clause, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.title=rockylinux, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.33.7, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.version=10, name=rockylinux, OSD_FLAVOR=default, version=10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, summary=Rocky Linux Base image, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-13T02:24:34.756 DEBUG:teuthology.orchestra.run.trial078:> sudo pkill -f 'journalctl -f -n 0 -u ceph-fc631695-0881-11f1-899c-d404e6e7d460@osd.2.service' 2026-02-13T02:24:34.804 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T02:24:34.805 INFO:tasks.cephadm.osd.2:Stopped osd.2 2026-02-13T02:24:34.805 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2026-02-13T02:24:34.805 DEBUG:teuthology.orchestra.run.trial011:> sudo systemctl stop ceph-fc631695-0881-11f1-899c-d404e6e7d460@osd.3 2026-02-13T02:24:35.159 INFO:journalctl@ceph.osd.3.trial011.stdout:Feb 13 02:24:34 trial011 systemd[1]: Stopping ceph-fc631695-0881-11f1-899c-d404e6e7d460@osd.3.service - Ceph osd.3 for fc631695-0881-11f1-899c-d404e6e7d460... 2026-02-13T02:24:35.159 INFO:journalctl@ceph.osd.3.trial011.stdout:Feb 13 02:24:34 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-3[30441]: 2026-02-13T02:24:34.905+0000 7fb656f376c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T02:24:35.160 INFO:journalctl@ceph.osd.3.trial011.stdout:Feb 13 02:24:34 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-3[30441]: 2026-02-13T02:24:34.905+0000 7fb656f376c0 -1 osd.3 73 *** Got signal Terminated *** 2026-02-13T02:24:35.160 INFO:journalctl@ceph.osd.3.trial011.stdout:Feb 13 02:24:34 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-3[30441]: 2026-02-13T02:24:34.905+0000 7fb656f376c0 -1 osd.3 73 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T02:24:40.302 INFO:journalctl@ceph.osd.3.trial011.stdout:Feb 13 02:24:39 trial011 podman[66721]: 2026-02-13 02:24:39.985177246 +0000 UTC m=+5.091082085 container died c45844354fd6229799f9a6049cb1e392e8a52f0fb7eb006353526de36c55368e (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-3, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-pdonnell-testing-20260210.171210, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, license=BSD-3-Clause, OSD_FLAVOR=default, io.buildah.version=1.33.7, ceph=True, org.opencontainers.image.title=rockylinux, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.licenses=BSD-3-Clause, summary=Rocky Linux Base image, name=rockylinux, org.opencontainers.image.version=10, version=10, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, vendor=Rocky Enterprise Software Foundation) 2026-02-13T02:24:40.302 INFO:journalctl@ceph.osd.3.trial011.stdout:Feb 13 02:24:39 trial011 podman[66721]: 2026-02-13 02:24:39.994149842 +0000 UTC m=+5.100054681 container remove c45844354fd6229799f9a6049cb1e392e8a52f0fb7eb006353526de36c55368e (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-3, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, name=rockylinux, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-pdonnell-testing-20260210.171210, ceph=True, version=10, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.title=rockylinux, org.opencontainers.image.licenses=BSD-3-Clause, summary=Rocky Linux Base image, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, io.buildah.version=1.33.7, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, org.opencontainers.image.version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, license=BSD-3-Clause) 2026-02-13T02:24:40.302 INFO:journalctl@ceph.osd.3.trial011.stdout:Feb 13 02:24:39 trial011 bash[66721]: ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-3 2026-02-13T02:24:40.303 INFO:journalctl@ceph.osd.3.trial011.stdout:Feb 13 02:24:40 trial011 podman[66842]: 2026-02-13 02:24:40.132037361 +0000 UTC m=+0.015991244 container create f2661917f8cacf037e46f3e7ef1aa380becbd2a6abbf67ffcd4524780755d859 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-3-deactivate, vendor=Rocky Enterprise Software Foundation, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, summary=Rocky Linux Base image, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, name=rockylinux, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.title=rockylinux, ceph=True, org.opencontainers.image.authors=Ceph Release Team , license=BSD-3-Clause, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.33.7, org.opencontainers.image.version=10, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation) 2026-02-13T02:24:40.303 INFO:journalctl@ceph.osd.3.trial011.stdout:Feb 13 02:24:40 trial011 podman[66842]: 2026-02-13 02:24:40.171917687 +0000 UTC m=+0.055871570 container init f2661917f8cacf037e46f3e7ef1aa380becbd2a6abbf67ffcd4524780755d859 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-3-deactivate, OSD_FLAVOR=default, license=BSD-3-Clause, org.opencontainers.image.version=10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, version=10, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.documentation=https://docs.ceph.com/, name=rockylinux, io.buildah.version=1.33.7, org.opencontainers.image.title=rockylinux, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, summary=Rocky Linux Base image, ceph=True) 2026-02-13T02:24:40.303 INFO:journalctl@ceph.osd.3.trial011.stdout:Feb 13 02:24:40 trial011 podman[66842]: 2026-02-13 02:24:40.174032345 +0000 UTC m=+0.057986228 container start f2661917f8cacf037e46f3e7ef1aa380becbd2a6abbf67ffcd4524780755d859 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-3-deactivate, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, CEPH_REF=wip-pdonnell-testing-20260210.171210, license=BSD-3-Clause, version=10, ceph=True, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.title=rockylinux, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, summary=Rocky Linux Base image, name=rockylinux, io.buildah.version=1.33.7, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, vendor=Rocky Enterprise Software Foundation) 2026-02-13T02:24:40.303 INFO:journalctl@ceph.osd.3.trial011.stdout:Feb 13 02:24:40 trial011 podman[66842]: 2026-02-13 02:24:40.174518868 +0000 UTC m=+0.058472751 container attach f2661917f8cacf037e46f3e7ef1aa380becbd2a6abbf67ffcd4524780755d859 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-3-deactivate, summary=Rocky Linux Base image, ceph=True, license=BSD-3-Clause, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, CEPH_REF=wip-pdonnell-testing-20260210.171210, io.buildah.version=1.33.7, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.version=10, org.opencontainers.image.title=rockylinux, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , name=rockylinux, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, version=10) 2026-02-13T02:24:40.303 INFO:journalctl@ceph.osd.3.trial011.stdout:Feb 13 02:24:40 trial011 podman[66842]: 2026-02-13 02:24:40.125786791 +0000 UTC m=+0.009740674 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T02:24:40.343 DEBUG:teuthology.orchestra.run.trial011:> sudo pkill -f 'journalctl -f -n 0 -u ceph-fc631695-0881-11f1-899c-d404e6e7d460@osd.3.service' 2026-02-13T02:24:40.390 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T02:24:40.390 INFO:tasks.cephadm.osd.3:Stopped osd.3 2026-02-13T02:24:40.390 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2026-02-13T02:24:40.390 DEBUG:teuthology.orchestra.run.trial060:> sudo systemctl stop ceph-fc631695-0881-11f1-899c-d404e6e7d460@osd.4 2026-02-13T02:24:40.750 INFO:journalctl@ceph.osd.4.trial060.stdout:Feb 13 02:24:40 trial060 systemd[1]: Stopping ceph-fc631695-0881-11f1-899c-d404e6e7d460@osd.4.service - Ceph osd.4 for fc631695-0881-11f1-899c-d404e6e7d460... 2026-02-13T02:24:40.750 INFO:journalctl@ceph.osd.4.trial060.stdout:Feb 13 02:24:40 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-4[26005]: 2026-02-13T02:24:40.496+0000 7f0e2d3a06c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T02:24:40.751 INFO:journalctl@ceph.osd.4.trial060.stdout:Feb 13 02:24:40 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-4[26005]: 2026-02-13T02:24:40.496+0000 7f0e2d3a06c0 -1 osd.4 73 *** Got signal Terminated *** 2026-02-13T02:24:40.751 INFO:journalctl@ceph.osd.4.trial060.stdout:Feb 13 02:24:40 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-4[26005]: 2026-02-13T02:24:40.496+0000 7f0e2d3a06c0 -1 osd.4 73 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T02:24:44.702 INFO:journalctl@ceph.osd.6.trial011.stdout:Feb 13 02:24:44 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-6[36692]: 2026-02-13T02:24:44.318+0000 7f2a641056c0 -1 osd.6 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:21.166218+0000 front 2026-02-13T02:24:21.166209+0000 (oldest deadline 2026-02-13T02:24:44.066265+0000) 2026-02-13T02:24:44.702 INFO:journalctl@ceph.osd.9.trial011.stdout:Feb 13 02:24:44 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-9[43169]: 2026-02-13T02:24:44.491+0000 7fb6ba0a26c0 -1 osd.9 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:19.130671+0000 front 2026-02-13T02:24:19.130656+0000 (oldest deadline 2026-02-13T02:24:43.830795+0000) 2026-02-13T02:24:44.750 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:24:44 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:24:44.333+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:21.576733+0000 front 2026-02-13T02:24:21.576946+0000 (oldest deadline 2026-02-13T02:24:43.876770+0000) 2026-02-13T02:24:45.702 INFO:journalctl@ceph.osd.9.trial011.stdout:Feb 13 02:24:45 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-9[43169]: 2026-02-13T02:24:45.541+0000 7fb6ba0a26c0 -1 osd.9 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:19.130671+0000 front 2026-02-13T02:24:19.130656+0000 (oldest deadline 2026-02-13T02:24:43.830795+0000) 2026-02-13T02:24:45.702 INFO:journalctl@ceph.osd.6.trial011.stdout:Feb 13 02:24:45 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-6[36692]: 2026-02-13T02:24:45.337+0000 7f2a641056c0 -1 osd.6 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:21.166218+0000 front 2026-02-13T02:24:21.166209+0000 (oldest deadline 2026-02-13T02:24:44.066265+0000) 2026-02-13T02:24:45.703 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:24:45 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:24:45.352+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:21.576733+0000 front 2026-02-13T02:24:21.576946+0000 (oldest deadline 2026-02-13T02:24:43.876770+0000) 2026-02-13T02:24:45.704 INFO:journalctl@ceph.osd.4.trial060.stdout:Feb 13 02:24:45 trial060 podman[46557]: 2026-02-13 02:24:45.565925235 +0000 UTC m=+5.080019919 container died 0ea34a2ef39ff282bfd86a836265c0d27d7c0a526ab4ce377c6136d8c0947922 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-4, io.buildah.version=1.33.7, org.opencontainers.image.licenses=BSD-3-Clause, summary=Rocky Linux Base image, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, license=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, name=rockylinux, version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.title=rockylinux, org.opencontainers.image.version=10, vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10) 2026-02-13T02:24:45.704 INFO:journalctl@ceph.osd.4.trial060.stdout:Feb 13 02:24:45 trial060 podman[46557]: 2026-02-13 02:24:45.574183566 +0000 UTC m=+5.088278250 container remove 0ea34a2ef39ff282bfd86a836265c0d27d7c0a526ab4ce377c6136d8c0947922 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-4, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, name=rockylinux, version=10, OSD_FLAVOR=default, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, license=BSD-3-Clause, org.opencontainers.image.title=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, vendor=Rocky Enterprise Software Foundation, io.buildah.version=1.33.7, org.opencontainers.image.version=10, summary=Rocky Linux Base image, org.opencontainers.image.licenses=BSD-3-Clause) 2026-02-13T02:24:45.704 INFO:journalctl@ceph.osd.4.trial060.stdout:Feb 13 02:24:45 trial060 bash[46557]: ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-4 2026-02-13T02:24:45.791 INFO:journalctl@ceph.osd.8.trial078.stdout:Feb 13 02:24:45 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-8[32377]: 2026-02-13T02:24:45.377+0000 7f39ad2336c0 -1 osd.8 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:20.388100+0000 front 2026-02-13T02:24:20.388058+0000 (oldest deadline 2026-02-13T02:24:44.488088+0000) 2026-02-13T02:24:45.888 DEBUG:teuthology.orchestra.run.trial060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-fc631695-0881-11f1-899c-d404e6e7d460@osd.4.service' 2026-02-13T02:24:45.934 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T02:24:45.934 INFO:tasks.cephadm.osd.4:Stopped osd.4 2026-02-13T02:24:45.934 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2026-02-13T02:24:45.935 DEBUG:teuthology.orchestra.run.trial078:> sudo systemctl stop ceph-fc631695-0881-11f1-899c-d404e6e7d460@osd.5 2026-02-13T02:24:46.291 INFO:journalctl@ceph.osd.5.trial078.stdout:Feb 13 02:24:45 trial078 systemd[1]: Stopping ceph-fc631695-0881-11f1-899c-d404e6e7d460@osd.5.service - Ceph osd.5 for fc631695-0881-11f1-899c-d404e6e7d460... 2026-02-13T02:24:46.291 INFO:journalctl@ceph.osd.5.trial078.stdout:Feb 13 02:24:46 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-5[26065]: 2026-02-13T02:24:46.033+0000 7f033bce06c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T02:24:46.292 INFO:journalctl@ceph.osd.5.trial078.stdout:Feb 13 02:24:46 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-5[26065]: 2026-02-13T02:24:46.033+0000 7f033bce06c0 -1 osd.5 73 *** Got signal Terminated *** 2026-02-13T02:24:46.292 INFO:journalctl@ceph.osd.5.trial078.stdout:Feb 13 02:24:46 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-5[26065]: 2026-02-13T02:24:46.033+0000 7f033bce06c0 -1 osd.5 73 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T02:24:46.702 INFO:journalctl@ceph.osd.9.trial011.stdout:Feb 13 02:24:46 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-9[43169]: 2026-02-13T02:24:46.507+0000 7fb6ba0a26c0 -1 osd.9 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:19.130671+0000 front 2026-02-13T02:24:19.130656+0000 (oldest deadline 2026-02-13T02:24:43.830795+0000) 2026-02-13T02:24:46.702 INFO:journalctl@ceph.osd.6.trial011.stdout:Feb 13 02:24:46 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-6[36692]: 2026-02-13T02:24:46.302+0000 7f2a641056c0 -1 osd.6 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:21.166218+0000 front 2026-02-13T02:24:21.166209+0000 (oldest deadline 2026-02-13T02:24:44.066265+0000) 2026-02-13T02:24:46.750 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:24:46 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:24:46.344+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:21.576733+0000 front 2026-02-13T02:24:21.576946+0000 (oldest deadline 2026-02-13T02:24:43.876770+0000) 2026-02-13T02:24:46.791 INFO:journalctl@ceph.osd.5.trial078.stdout:Feb 13 02:24:46 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-5[26065]: 2026-02-13T02:24:46.370+0000 7f0333bad6c0 -1 osd.5 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:19.611231+0000 front 2026-02-13T02:24:19.611174+0000 (oldest deadline 2026-02-13T02:24:45.511050+0000) 2026-02-13T02:24:46.792 INFO:journalctl@ceph.osd.8.trial078.stdout:Feb 13 02:24:46 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-8[32377]: 2026-02-13T02:24:46.408+0000 7f39ad2336c0 -1 osd.8 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:20.388100+0000 front 2026-02-13T02:24:20.388058+0000 (oldest deadline 2026-02-13T02:24:44.488088+0000) 2026-02-13T02:24:47.541 INFO:journalctl@ceph.osd.5.trial078.stdout:Feb 13 02:24:47 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-5[26065]: 2026-02-13T02:24:47.387+0000 7f0333bad6c0 -1 osd.5 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:19.611231+0000 front 2026-02-13T02:24:19.611174+0000 (oldest deadline 2026-02-13T02:24:45.511050+0000) 2026-02-13T02:24:47.542 INFO:journalctl@ceph.osd.8.trial078.stdout:Feb 13 02:24:47 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-8[32377]: 2026-02-13T02:24:47.374+0000 7f39ad2336c0 -1 osd.8 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:20.388100+0000 front 2026-02-13T02:24:20.388058+0000 (oldest deadline 2026-02-13T02:24:44.488088+0000) 2026-02-13T02:24:47.542 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:24:47 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:24:47.217+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:23.112468+0000 front 2026-02-13T02:24:23.112473+0000 (oldest deadline 2026-02-13T02:24:47.212522+0000) 2026-02-13T02:24:47.702 INFO:journalctl@ceph.osd.9.trial011.stdout:Feb 13 02:24:47 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-9[43169]: 2026-02-13T02:24:47.500+0000 7fb6ba0a26c0 -1 osd.9 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:19.130671+0000 front 2026-02-13T02:24:19.130656+0000 (oldest deadline 2026-02-13T02:24:43.830795+0000) 2026-02-13T02:24:47.702 INFO:journalctl@ceph.osd.6.trial011.stdout:Feb 13 02:24:47 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-6[36692]: 2026-02-13T02:24:47.271+0000 7f2a641056c0 -1 osd.6 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:21.166218+0000 front 2026-02-13T02:24:21.166209+0000 (oldest deadline 2026-02-13T02:24:44.066265+0000) 2026-02-13T02:24:47.750 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:24:47 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:24:47.353+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:21.576733+0000 front 2026-02-13T02:24:21.576946+0000 (oldest deadline 2026-02-13T02:24:43.876770+0000) 2026-02-13T02:24:48.541 INFO:journalctl@ceph.osd.5.trial078.stdout:Feb 13 02:24:48 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-5[26065]: 2026-02-13T02:24:48.380+0000 7f0333bad6c0 -1 osd.5 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:19.611231+0000 front 2026-02-13T02:24:19.611174+0000 (oldest deadline 2026-02-13T02:24:45.511050+0000) 2026-02-13T02:24:48.542 INFO:journalctl@ceph.osd.8.trial078.stdout:Feb 13 02:24:48 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-8[32377]: 2026-02-13T02:24:48.424+0000 7f39ad2336c0 -1 osd.8 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:20.388100+0000 front 2026-02-13T02:24:20.388058+0000 (oldest deadline 2026-02-13T02:24:44.488088+0000) 2026-02-13T02:24:48.542 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:24:48 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:24:48.182+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:23.112468+0000 front 2026-02-13T02:24:23.112473+0000 (oldest deadline 2026-02-13T02:24:47.212522+0000) 2026-02-13T02:24:48.702 INFO:journalctl@ceph.osd.9.trial011.stdout:Feb 13 02:24:48 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-9[43169]: 2026-02-13T02:24:48.515+0000 7fb6ba0a26c0 -1 osd.9 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:19.130671+0000 front 2026-02-13T02:24:19.130656+0000 (oldest deadline 2026-02-13T02:24:43.830795+0000) 2026-02-13T02:24:48.702 INFO:journalctl@ceph.osd.6.trial011.stdout:Feb 13 02:24:48 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-6[36692]: 2026-02-13T02:24:48.316+0000 7f2a641056c0 -1 osd.6 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:21.166218+0000 front 2026-02-13T02:24:21.166209+0000 (oldest deadline 2026-02-13T02:24:44.066265+0000) 2026-02-13T02:24:48.750 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:24:48 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:24:48.384+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:21.576733+0000 front 2026-02-13T02:24:21.576946+0000 (oldest deadline 2026-02-13T02:24:43.876770+0000) 2026-02-13T02:24:49.450 INFO:journalctl@ceph.osd.5.trial078.stdout:Feb 13 02:24:49 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-5[26065]: 2026-02-13T02:24:49.427+0000 7f0333bad6c0 -1 osd.5 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:19.611231+0000 front 2026-02-13T02:24:19.611174+0000 (oldest deadline 2026-02-13T02:24:45.511050+0000) 2026-02-13T02:24:49.450 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:24:49 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:24:49.180+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:23.112468+0000 front 2026-02-13T02:24:23.112473+0000 (oldest deadline 2026-02-13T02:24:47.212522+0000) 2026-02-13T02:24:49.702 INFO:journalctl@ceph.osd.9.trial011.stdout:Feb 13 02:24:49 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-9[43169]: 2026-02-13T02:24:49.541+0000 7fb6ba0a26c0 -1 osd.9 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:19.130671+0000 front 2026-02-13T02:24:19.130656+0000 (oldest deadline 2026-02-13T02:24:43.830795+0000) 2026-02-13T02:24:49.702 INFO:journalctl@ceph.osd.6.trial011.stdout:Feb 13 02:24:49 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-6[36692]: 2026-02-13T02:24:49.357+0000 7f2a641056c0 -1 osd.6 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:21.166218+0000 front 2026-02-13T02:24:21.166209+0000 (oldest deadline 2026-02-13T02:24:44.066265+0000) 2026-02-13T02:24:49.750 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:24:49 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:24:49.402+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:21.576733+0000 front 2026-02-13T02:24:21.576946+0000 (oldest deadline 2026-02-13T02:24:43.876770+0000) 2026-02-13T02:24:49.791 INFO:journalctl@ceph.osd.8.trial078.stdout:Feb 13 02:24:49 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-8[32377]: 2026-02-13T02:24:49.447+0000 7f39ad2336c0 -1 osd.8 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:20.388100+0000 front 2026-02-13T02:24:20.388058+0000 (oldest deadline 2026-02-13T02:24:44.488088+0000) 2026-02-13T02:24:50.541 INFO:journalctl@ceph.osd.5.trial078.stdout:Feb 13 02:24:50 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-5[26065]: 2026-02-13T02:24:50.446+0000 7f0333bad6c0 -1 osd.5 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:19.611231+0000 front 2026-02-13T02:24:19.611174+0000 (oldest deadline 2026-02-13T02:24:45.511050+0000) 2026-02-13T02:24:50.542 INFO:journalctl@ceph.osd.8.trial078.stdout:Feb 13 02:24:50 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-8[32377]: 2026-02-13T02:24:50.475+0000 7f39ad2336c0 -1 osd.8 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:20.388100+0000 front 2026-02-13T02:24:20.388058+0000 (oldest deadline 2026-02-13T02:24:44.488088+0000) 2026-02-13T02:24:50.542 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:24:50 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:24:50.229+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:23.112468+0000 front 2026-02-13T02:24:23.112473+0000 (oldest deadline 2026-02-13T02:24:47.212522+0000) 2026-02-13T02:24:50.702 INFO:journalctl@ceph.osd.6.trial011.stdout:Feb 13 02:24:50 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-6[36692]: 2026-02-13T02:24:50.392+0000 7f2a641056c0 -1 osd.6 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:21.166218+0000 front 2026-02-13T02:24:21.166209+0000 (oldest deadline 2026-02-13T02:24:44.066265+0000) 2026-02-13T02:24:50.703 INFO:journalctl@ceph.osd.9.trial011.stdout:Feb 13 02:24:50 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-9[43169]: 2026-02-13T02:24:50.522+0000 7fb6ba0a26c0 -1 osd.9 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:19.130671+0000 front 2026-02-13T02:24:19.130656+0000 (oldest deadline 2026-02-13T02:24:43.830795+0000) 2026-02-13T02:24:50.750 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:24:50 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:24:50.432+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:21.576733+0000 front 2026-02-13T02:24:21.576946+0000 (oldest deadline 2026-02-13T02:24:43.876770+0000) 2026-02-13T02:24:50.750 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:24:50 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:24:50.432+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:23.876890+0000 front 2026-02-13T02:24:23.876928+0000 (oldest deadline 2026-02-13T02:24:49.777050+0000) 2026-02-13T02:24:51.414 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:24:51 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:24:51.224+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:23.112468+0000 front 2026-02-13T02:24:23.112473+0000 (oldest deadline 2026-02-13T02:24:47.212522+0000) 2026-02-13T02:24:51.414 INFO:journalctl@ceph.osd.5.trial078.stdout:Feb 13 02:24:51 trial078 podman[47819]: 2026-02-13 02:24:51.103110348 +0000 UTC m=+5.081100398 container died c4a2fe536414ecf24e73f2d3a342a5a8e71cdfc8b8a1e7f7fe78417f6066a690 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-5, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default, license=BSD-3-Clause, version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, summary=Rocky Linux Base image, io.buildah.version=1.33.7, name=rockylinux, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.licenses=BSD-3-Clause, ceph=True, org.opencontainers.image.version=10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.title=rockylinux, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-13T02:24:51.415 INFO:journalctl@ceph.osd.5.trial078.stdout:Feb 13 02:24:51 trial078 podman[47819]: 2026-02-13 02:24:51.111220335 +0000 UTC m=+5.089210395 container remove c4a2fe536414ecf24e73f2d3a342a5a8e71cdfc8b8a1e7f7fe78417f6066a690 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-5, name=rockylinux, org.opencontainers.image.documentation=https://docs.ceph.com/, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.version=10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-pdonnell-testing-20260210.171210, vendor=Rocky Enterprise Software Foundation, version=10, io.buildah.version=1.33.7, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, summary=Rocky Linux Base image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, org.opencontainers.image.title=rockylinux, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, ceph=True, license=BSD-3-Clause) 2026-02-13T02:24:51.415 INFO:journalctl@ceph.osd.5.trial078.stdout:Feb 13 02:24:51 trial078 bash[47819]: ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-5 2026-02-13T02:24:51.415 INFO:journalctl@ceph.osd.5.trial078.stdout:Feb 13 02:24:51 trial078 podman[47945]: 2026-02-13 02:24:51.244228778 +0000 UTC m=+0.013544088 container create b3da03cd7fcaea9e45ad1c019c24fdc3da291c745517873f2a2b18cacfb6529c (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-5-deactivate, ceph=True, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.title=rockylinux, summary=Rocky Linux Base image, license=BSD-3-Clause, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, vendor=Rocky Enterprise Software Foundation, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.version=10, org.opencontainers.image.licenses=BSD-3-Clause, io.buildah.version=1.33.7, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, name=rockylinux, version=10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-13T02:24:51.415 INFO:journalctl@ceph.osd.5.trial078.stdout:Feb 13 02:24:51 trial078 podman[47945]: 2026-02-13 02:24:51.27498779 +0000 UTC m=+0.044303111 container init b3da03cd7fcaea9e45ad1c019c24fdc3da291c745517873f2a2b18cacfb6529c (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-5-deactivate, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.documentation=https://docs.ceph.com/, summary=Rocky Linux Base image, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, OSD_FLAVOR=default, license=BSD-3-Clause, org.opencontainers.image.title=rockylinux, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, name=rockylinux, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.33.7, CEPH_REF=wip-pdonnell-testing-20260210.171210, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.authors=Ceph Release Team , version=10, org.opencontainers.image.version=10) 2026-02-13T02:24:51.415 INFO:journalctl@ceph.osd.5.trial078.stdout:Feb 13 02:24:51 trial078 podman[47945]: 2026-02-13 02:24:51.276705285 +0000 UTC m=+0.046020595 container start b3da03cd7fcaea9e45ad1c019c24fdc3da291c745517873f2a2b18cacfb6529c (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-5-deactivate, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.licenses=BSD-3-Clause, ceph=True, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-pdonnell-testing-20260210.171210, name=rockylinux, org.opencontainers.image.version=10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, io.buildah.version=1.33.7, org.opencontainers.image.title=rockylinux, summary=Rocky Linux Base image, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, OSD_FLAVOR=default, license=BSD-3-Clause, version=10, vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-13T02:24:51.415 INFO:journalctl@ceph.osd.5.trial078.stdout:Feb 13 02:24:51 trial078 podman[47945]: 2026-02-13 02:24:51.277126322 +0000 UTC m=+0.046441622 container attach b3da03cd7fcaea9e45ad1c019c24fdc3da291c745517873f2a2b18cacfb6529c (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-5-deactivate, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.licenses=BSD-3-Clause, io.buildah.version=1.33.7, org.opencontainers.image.title=rockylinux, summary=Rocky Linux Base image, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.authors=Ceph Release Team , version=10, org.opencontainers.image.version=10, CEPH_REF=wip-pdonnell-testing-20260210.171210, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, OSD_FLAVOR=default, license=BSD-3-Clause, name=rockylinux, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-13T02:24:51.415 INFO:journalctl@ceph.osd.5.trial078.stdout:Feb 13 02:24:51 trial078 podman[47945]: 2026-02-13 02:24:51.238644587 +0000 UTC m=+0.007959897 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T02:24:51.415 INFO:journalctl@ceph.osd.5.trial078.stdout:Feb 13 02:24:51 trial078 podman[47945]: 2026-02-13 02:24:51.412151399 +0000 UTC m=+0.181466709 container died b3da03cd7fcaea9e45ad1c019c24fdc3da291c745517873f2a2b18cacfb6529c (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-5-deactivate, org.opencontainers.image.documentation=https://docs.ceph.com/, io.buildah.version=1.33.7, org.opencontainers.image.title=rockylinux, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_REF=wip-pdonnell-testing-20260210.171210, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, name=rockylinux, summary=Rocky Linux Base image, OSD_FLAVOR=default, ceph=True, org.opencontainers.image.version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, vendor=Rocky Enterprise Software Foundation, license=BSD-3-Clause, version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-13T02:24:51.450 DEBUG:teuthology.orchestra.run.trial078:> sudo pkill -f 'journalctl -f -n 0 -u ceph-fc631695-0881-11f1-899c-d404e6e7d460@osd.5.service' 2026-02-13T02:24:51.498 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T02:24:51.498 INFO:tasks.cephadm.osd.5:Stopped osd.5 2026-02-13T02:24:51.498 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2026-02-13T02:24:51.499 DEBUG:teuthology.orchestra.run.trial011:> sudo systemctl stop ceph-fc631695-0881-11f1-899c-d404e6e7d460@osd.6 2026-02-13T02:24:51.702 INFO:journalctl@ceph.osd.9.trial011.stdout:Feb 13 02:24:51 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-9[43169]: 2026-02-13T02:24:51.505+0000 7fb6ba0a26c0 -1 osd.9 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:19.130671+0000 front 2026-02-13T02:24:19.130656+0000 (oldest deadline 2026-02-13T02:24:43.830795+0000) 2026-02-13T02:24:51.702 INFO:journalctl@ceph.osd.9.trial011.stdout:Feb 13 02:24:51 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-9[43169]: 2026-02-13T02:24:51.505+0000 7fb6ba0a26c0 -1 osd.9 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:28.531392+0000 front 2026-02-13T02:24:28.531406+0000 (oldest deadline 2026-02-13T02:24:51.431407+0000) 2026-02-13T02:24:51.702 INFO:journalctl@ceph.osd.6.trial011.stdout:Feb 13 02:24:51 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-6[36692]: 2026-02-13T02:24:51.441+0000 7f2a641056c0 -1 osd.6 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:21.166218+0000 front 2026-02-13T02:24:21.166209+0000 (oldest deadline 2026-02-13T02:24:44.066265+0000) 2026-02-13T02:24:51.703 INFO:journalctl@ceph.osd.6.trial011.stdout:Feb 13 02:24:51 trial011 systemd[1]: Stopping ceph-fc631695-0881-11f1-899c-d404e6e7d460@osd.6.service - Ceph osd.6 for fc631695-0881-11f1-899c-d404e6e7d460... 2026-02-13T02:24:51.703 INFO:journalctl@ceph.osd.6.trial011.stdout:Feb 13 02:24:51 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-6[36692]: 2026-02-13T02:24:51.602+0000 7f2a682306c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T02:24:51.703 INFO:journalctl@ceph.osd.6.trial011.stdout:Feb 13 02:24:51 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-6[36692]: 2026-02-13T02:24:51.602+0000 7f2a682306c0 -1 osd.6 73 *** Got signal Terminated *** 2026-02-13T02:24:51.703 INFO:journalctl@ceph.osd.6.trial011.stdout:Feb 13 02:24:51 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-6[36692]: 2026-02-13T02:24:51.602+0000 7f2a682306c0 -1 osd.6 73 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T02:24:51.750 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:24:51 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:24:51.400+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:21.576733+0000 front 2026-02-13T02:24:21.576946+0000 (oldest deadline 2026-02-13T02:24:43.876770+0000) 2026-02-13T02:24:51.750 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:24:51 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:24:51.400+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:23.876890+0000 front 2026-02-13T02:24:23.876928+0000 (oldest deadline 2026-02-13T02:24:49.777050+0000) 2026-02-13T02:24:51.791 INFO:journalctl@ceph.osd.8.trial078.stdout:Feb 13 02:24:51 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-8[32377]: 2026-02-13T02:24:51.442+0000 7f39ad2336c0 -1 osd.8 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:20.388100+0000 front 2026-02-13T02:24:20.388058+0000 (oldest deadline 2026-02-13T02:24:44.488088+0000) 2026-02-13T02:24:51.791 INFO:journalctl@ceph.osd.8.trial078.stdout:Feb 13 02:24:51 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-8[32377]: 2026-02-13T02:24:51.442+0000 7f39ad2336c0 -1 osd.8 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:27.988606+0000 front 2026-02-13T02:24:27.988677+0000 (oldest deadline 2026-02-13T02:24:50.888692+0000) 2026-02-13T02:24:52.250 INFO:journalctl@ceph.osd.7.trial060.stdout:Feb 13 02:24:51 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-7[32498]: 2026-02-13T02:24:51.910+0000 7feab95646c0 -1 osd.7 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:26.986717+0000 front 2026-02-13T02:24:26.986746+0000 (oldest deadline 2026-02-13T02:24:51.686828+0000) 2026-02-13T02:24:52.541 INFO:journalctl@ceph.osd.8.trial078.stdout:Feb 13 02:24:52 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-8[32377]: 2026-02-13T02:24:52.443+0000 7f39ad2336c0 -1 osd.8 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:20.388100+0000 front 2026-02-13T02:24:20.388058+0000 (oldest deadline 2026-02-13T02:24:44.488088+0000) 2026-02-13T02:24:52.542 INFO:journalctl@ceph.osd.8.trial078.stdout:Feb 13 02:24:52 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-8[32377]: 2026-02-13T02:24:52.443+0000 7f39ad2336c0 -1 osd.8 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:27.988606+0000 front 2026-02-13T02:24:27.988677+0000 (oldest deadline 2026-02-13T02:24:50.888692+0000) 2026-02-13T02:24:52.542 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:24:52 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:24:52.201+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:23.112468+0000 front 2026-02-13T02:24:23.112473+0000 (oldest deadline 2026-02-13T02:24:47.212522+0000) 2026-02-13T02:24:52.750 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:24:52 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:24:52.445+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:21.576733+0000 front 2026-02-13T02:24:21.576946+0000 (oldest deadline 2026-02-13T02:24:43.876770+0000) 2026-02-13T02:24:52.750 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:24:52 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:24:52.445+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:23.876890+0000 front 2026-02-13T02:24:23.876928+0000 (oldest deadline 2026-02-13T02:24:49.777050+0000) 2026-02-13T02:24:52.952 INFO:journalctl@ceph.osd.9.trial011.stdout:Feb 13 02:24:52 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-9[43169]: 2026-02-13T02:24:52.500+0000 7fb6ba0a26c0 -1 osd.9 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:19.130671+0000 front 2026-02-13T02:24:19.130656+0000 (oldest deadline 2026-02-13T02:24:43.830795+0000) 2026-02-13T02:24:52.952 INFO:journalctl@ceph.osd.9.trial011.stdout:Feb 13 02:24:52 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-9[43169]: 2026-02-13T02:24:52.500+0000 7fb6ba0a26c0 -1 osd.9 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:28.531392+0000 front 2026-02-13T02:24:28.531406+0000 (oldest deadline 2026-02-13T02:24:51.431407+0000) 2026-02-13T02:24:52.952 INFO:journalctl@ceph.osd.6.trial011.stdout:Feb 13 02:24:52 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-6[36692]: 2026-02-13T02:24:52.452+0000 7f2a641056c0 -1 osd.6 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:21.166218+0000 front 2026-02-13T02:24:21.166209+0000 (oldest deadline 2026-02-13T02:24:44.066265+0000) 2026-02-13T02:24:52.952 INFO:journalctl@ceph.osd.6.trial011.stdout:Feb 13 02:24:52 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-6[36692]: 2026-02-13T02:24:52.452+0000 7f2a641056c0 -1 osd.6 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:25.766737+0000 front 2026-02-13T02:24:25.766752+0000 (oldest deadline 2026-02-13T02:24:51.666813+0000) 2026-02-13T02:24:53.250 INFO:journalctl@ceph.osd.7.trial060.stdout:Feb 13 02:24:52 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-7[32498]: 2026-02-13T02:24:52.953+0000 7feab95646c0 -1 osd.7 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:26.986717+0000 front 2026-02-13T02:24:26.986746+0000 (oldest deadline 2026-02-13T02:24:51.686828+0000) 2026-02-13T02:24:53.541 INFO:journalctl@ceph.osd.8.trial078.stdout:Feb 13 02:24:53 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-8[32377]: 2026-02-13T02:24:53.398+0000 7f39ad2336c0 -1 osd.8 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:20.388100+0000 front 2026-02-13T02:24:20.388058+0000 (oldest deadline 2026-02-13T02:24:44.488088+0000) 2026-02-13T02:24:53.541 INFO:journalctl@ceph.osd.8.trial078.stdout:Feb 13 02:24:53 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-8[32377]: 2026-02-13T02:24:53.398+0000 7f39ad2336c0 -1 osd.8 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:27.988606+0000 front 2026-02-13T02:24:27.988677+0000 (oldest deadline 2026-02-13T02:24:50.888692+0000) 2026-02-13T02:24:53.542 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:24:53 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:24:53.161+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:23.112468+0000 front 2026-02-13T02:24:23.112473+0000 (oldest deadline 2026-02-13T02:24:47.212522+0000) 2026-02-13T02:24:53.542 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:24:53 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:24:53.161+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:27.212755+0000 front 2026-02-13T02:24:27.212693+0000 (oldest deadline 2026-02-13T02:24:53.112753+0000) 2026-02-13T02:24:53.750 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:24:53 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:24:53.419+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:21.576733+0000 front 2026-02-13T02:24:21.576946+0000 (oldest deadline 2026-02-13T02:24:43.876770+0000) 2026-02-13T02:24:53.750 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:24:53 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:24:53.419+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:23.876890+0000 front 2026-02-13T02:24:23.876928+0000 (oldest deadline 2026-02-13T02:24:49.777050+0000) 2026-02-13T02:24:53.952 INFO:journalctl@ceph.osd.6.trial011.stdout:Feb 13 02:24:53 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-6[36692]: 2026-02-13T02:24:53.454+0000 7f2a641056c0 -1 osd.6 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:21.166218+0000 front 2026-02-13T02:24:21.166209+0000 (oldest deadline 2026-02-13T02:24:44.066265+0000) 2026-02-13T02:24:53.952 INFO:journalctl@ceph.osd.6.trial011.stdout:Feb 13 02:24:53 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-6[36692]: 2026-02-13T02:24:53.454+0000 7f2a641056c0 -1 osd.6 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:25.766737+0000 front 2026-02-13T02:24:25.766752+0000 (oldest deadline 2026-02-13T02:24:51.666813+0000) 2026-02-13T02:24:53.952 INFO:journalctl@ceph.osd.9.trial011.stdout:Feb 13 02:24:53 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-9[43169]: 2026-02-13T02:24:53.530+0000 7fb6ba0a26c0 -1 osd.9 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:19.130671+0000 front 2026-02-13T02:24:19.130656+0000 (oldest deadline 2026-02-13T02:24:43.830795+0000) 2026-02-13T02:24:53.952 INFO:journalctl@ceph.osd.9.trial011.stdout:Feb 13 02:24:53 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-9[43169]: 2026-02-13T02:24:53.530+0000 7fb6ba0a26c0 -1 osd.9 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:28.531392+0000 front 2026-02-13T02:24:28.531406+0000 (oldest deadline 2026-02-13T02:24:51.431407+0000) 2026-02-13T02:24:54.250 INFO:journalctl@ceph.osd.7.trial060.stdout:Feb 13 02:24:53 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-7[32498]: 2026-02-13T02:24:53.913+0000 7feab95646c0 -1 osd.7 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:26.986717+0000 front 2026-02-13T02:24:26.986746+0000 (oldest deadline 2026-02-13T02:24:51.686828+0000) 2026-02-13T02:24:54.541 INFO:journalctl@ceph.osd.8.trial078.stdout:Feb 13 02:24:54 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-8[32377]: 2026-02-13T02:24:54.356+0000 7f39ad2336c0 -1 osd.8 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:20.388100+0000 front 2026-02-13T02:24:20.388058+0000 (oldest deadline 2026-02-13T02:24:44.488088+0000) 2026-02-13T02:24:54.542 INFO:journalctl@ceph.osd.8.trial078.stdout:Feb 13 02:24:54 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-8[32377]: 2026-02-13T02:24:54.356+0000 7f39ad2336c0 -1 osd.8 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:27.988606+0000 front 2026-02-13T02:24:27.988677+0000 (oldest deadline 2026-02-13T02:24:50.888692+0000) 2026-02-13T02:24:54.542 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:24:54 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:24:54.199+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:23.112468+0000 front 2026-02-13T02:24:23.112473+0000 (oldest deadline 2026-02-13T02:24:47.212522+0000) 2026-02-13T02:24:54.542 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:24:54 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:24:54.199+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:27.212755+0000 front 2026-02-13T02:24:27.212693+0000 (oldest deadline 2026-02-13T02:24:53.112753+0000) 2026-02-13T02:24:54.750 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:24:54 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:24:54.412+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:21.576733+0000 front 2026-02-13T02:24:21.576946+0000 (oldest deadline 2026-02-13T02:24:43.876770+0000) 2026-02-13T02:24:54.750 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:24:54 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:24:54.412+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:23.876890+0000 front 2026-02-13T02:24:23.876928+0000 (oldest deadline 2026-02-13T02:24:49.777050+0000) 2026-02-13T02:24:54.952 INFO:journalctl@ceph.osd.9.trial011.stdout:Feb 13 02:24:54 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-9[43169]: 2026-02-13T02:24:54.492+0000 7fb6ba0a26c0 -1 osd.9 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:19.130671+0000 front 2026-02-13T02:24:19.130656+0000 (oldest deadline 2026-02-13T02:24:43.830795+0000) 2026-02-13T02:24:54.952 INFO:journalctl@ceph.osd.9.trial011.stdout:Feb 13 02:24:54 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-9[43169]: 2026-02-13T02:24:54.492+0000 7fb6ba0a26c0 -1 osd.9 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:28.531392+0000 front 2026-02-13T02:24:28.531406+0000 (oldest deadline 2026-02-13T02:24:51.431407+0000) 2026-02-13T02:24:54.952 INFO:journalctl@ceph.osd.6.trial011.stdout:Feb 13 02:24:54 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-6[36692]: 2026-02-13T02:24:54.497+0000 7f2a641056c0 -1 osd.6 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:21.166218+0000 front 2026-02-13T02:24:21.166209+0000 (oldest deadline 2026-02-13T02:24:44.066265+0000) 2026-02-13T02:24:54.952 INFO:journalctl@ceph.osd.6.trial011.stdout:Feb 13 02:24:54 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-6[36692]: 2026-02-13T02:24:54.497+0000 7f2a641056c0 -1 osd.6 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:25.766737+0000 front 2026-02-13T02:24:25.766752+0000 (oldest deadline 2026-02-13T02:24:51.666813+0000) 2026-02-13T02:24:55.250 INFO:journalctl@ceph.osd.7.trial060.stdout:Feb 13 02:24:54 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-7[32498]: 2026-02-13T02:24:54.938+0000 7feab95646c0 -1 osd.7 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:26.986717+0000 front 2026-02-13T02:24:26.986746+0000 (oldest deadline 2026-02-13T02:24:51.686828+0000) 2026-02-13T02:24:55.541 INFO:journalctl@ceph.osd.8.trial078.stdout:Feb 13 02:24:55 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-8[32377]: 2026-02-13T02:24:55.359+0000 7f39ad2336c0 -1 osd.8 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:20.388100+0000 front 2026-02-13T02:24:20.388058+0000 (oldest deadline 2026-02-13T02:24:44.488088+0000) 2026-02-13T02:24:55.542 INFO:journalctl@ceph.osd.8.trial078.stdout:Feb 13 02:24:55 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-8[32377]: 2026-02-13T02:24:55.359+0000 7f39ad2336c0 -1 osd.8 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:27.988606+0000 front 2026-02-13T02:24:27.988677+0000 (oldest deadline 2026-02-13T02:24:50.888692+0000) 2026-02-13T02:24:55.542 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:24:55 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:24:55.181+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:23.112468+0000 front 2026-02-13T02:24:23.112473+0000 (oldest deadline 2026-02-13T02:24:47.212522+0000) 2026-02-13T02:24:55.542 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:24:55 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:24:55.181+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:27.212755+0000 front 2026-02-13T02:24:27.212693+0000 (oldest deadline 2026-02-13T02:24:53.112753+0000) 2026-02-13T02:24:55.542 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:24:55 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:24:55.181+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.78:6804 osd.2 since back 2026-02-13T02:24:34.213127+0000 front 2026-02-13T02:24:34.213138+0000 (oldest deadline 2026-02-13T02:24:54.713206+0000) 2026-02-13T02:24:55.750 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:24:55 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:24:55.398+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:21.576733+0000 front 2026-02-13T02:24:21.576946+0000 (oldest deadline 2026-02-13T02:24:43.876770+0000) 2026-02-13T02:24:55.750 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:24:55 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:24:55.398+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:23.876890+0000 front 2026-02-13T02:24:23.876928+0000 (oldest deadline 2026-02-13T02:24:49.777050+0000) 2026-02-13T02:24:55.952 INFO:journalctl@ceph.osd.9.trial011.stdout:Feb 13 02:24:55 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-9[43169]: 2026-02-13T02:24:55.508+0000 7fb6ba0a26c0 -1 osd.9 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:19.130671+0000 front 2026-02-13T02:24:19.130656+0000 (oldest deadline 2026-02-13T02:24:43.830795+0000) 2026-02-13T02:24:55.952 INFO:journalctl@ceph.osd.9.trial011.stdout:Feb 13 02:24:55 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-9[43169]: 2026-02-13T02:24:55.508+0000 7fb6ba0a26c0 -1 osd.9 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:28.531392+0000 front 2026-02-13T02:24:28.531406+0000 (oldest deadline 2026-02-13T02:24:51.431407+0000) 2026-02-13T02:24:55.952 INFO:journalctl@ceph.osd.6.trial011.stdout:Feb 13 02:24:55 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-6[36692]: 2026-02-13T02:24:55.534+0000 7f2a641056c0 -1 osd.6 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:21.166218+0000 front 2026-02-13T02:24:21.166209+0000 (oldest deadline 2026-02-13T02:24:44.066265+0000) 2026-02-13T02:24:55.952 INFO:journalctl@ceph.osd.6.trial011.stdout:Feb 13 02:24:55 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-6[36692]: 2026-02-13T02:24:55.534+0000 7f2a641056c0 -1 osd.6 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:25.766737+0000 front 2026-02-13T02:24:25.766752+0000 (oldest deadline 2026-02-13T02:24:51.666813+0000) 2026-02-13T02:24:56.250 INFO:journalctl@ceph.osd.7.trial060.stdout:Feb 13 02:24:55 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-7[32498]: 2026-02-13T02:24:55.987+0000 7feab95646c0 -1 osd.7 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:26.986717+0000 front 2026-02-13T02:24:26.986746+0000 (oldest deadline 2026-02-13T02:24:51.686828+0000) 2026-02-13T02:24:56.541 INFO:journalctl@ceph.osd.8.trial078.stdout:Feb 13 02:24:56 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-8[32377]: 2026-02-13T02:24:56.329+0000 7f39ad2336c0 -1 osd.8 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:20.388100+0000 front 2026-02-13T02:24:20.388058+0000 (oldest deadline 2026-02-13T02:24:44.488088+0000) 2026-02-13T02:24:56.542 INFO:journalctl@ceph.osd.8.trial078.stdout:Feb 13 02:24:56 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-8[32377]: 2026-02-13T02:24:56.329+0000 7f39ad2336c0 -1 osd.8 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:27.988606+0000 front 2026-02-13T02:24:27.988677+0000 (oldest deadline 2026-02-13T02:24:50.888692+0000) 2026-02-13T02:24:56.542 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:24:56 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:24:56.167+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:23.112468+0000 front 2026-02-13T02:24:23.112473+0000 (oldest deadline 2026-02-13T02:24:47.212522+0000) 2026-02-13T02:24:56.542 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:24:56 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:24:56.167+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:27.212755+0000 front 2026-02-13T02:24:27.212693+0000 (oldest deadline 2026-02-13T02:24:53.112753+0000) 2026-02-13T02:24:56.542 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:24:56 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:24:56.167+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.78:6804 osd.2 since back 2026-02-13T02:24:34.213127+0000 front 2026-02-13T02:24:34.213138+0000 (oldest deadline 2026-02-13T02:24:54.713206+0000) 2026-02-13T02:24:56.750 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:24:56 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:24:56.377+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:21.576733+0000 front 2026-02-13T02:24:21.576946+0000 (oldest deadline 2026-02-13T02:24:43.876770+0000) 2026-02-13T02:24:56.750 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:24:56 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:24:56.377+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:23.876890+0000 front 2026-02-13T02:24:23.876928+0000 (oldest deadline 2026-02-13T02:24:49.777050+0000) 2026-02-13T02:24:56.838 INFO:journalctl@ceph.osd.9.trial011.stdout:Feb 13 02:24:56 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-9[43169]: 2026-02-13T02:24:56.540+0000 7fb6ba0a26c0 -1 osd.9 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:19.130671+0000 front 2026-02-13T02:24:19.130656+0000 (oldest deadline 2026-02-13T02:24:43.830795+0000) 2026-02-13T02:24:56.838 INFO:journalctl@ceph.osd.9.trial011.stdout:Feb 13 02:24:56 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-9[43169]: 2026-02-13T02:24:56.540+0000 7fb6ba0a26c0 -1 osd.9 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:28.531392+0000 front 2026-02-13T02:24:28.531406+0000 (oldest deadline 2026-02-13T02:24:51.431407+0000) 2026-02-13T02:24:56.838 INFO:journalctl@ceph.osd.9.trial011.stdout:Feb 13 02:24:56 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-9[43169]: 2026-02-13T02:24:56.540+0000 7fb6ba0a26c0 -1 osd.9 73 heartbeat_check: no reply from 10.20.193.78:6804 osd.2 since back 2026-02-13T02:24:31.931791+0000 front 2026-02-13T02:24:31.931884+0000 (oldest deadline 2026-02-13T02:24:56.031836+0000) 2026-02-13T02:24:56.838 INFO:journalctl@ceph.osd.6.trial011.stdout:Feb 13 02:24:56 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-6[36692]: 2026-02-13T02:24:56.543+0000 7f2a641056c0 -1 osd.6 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:21.166218+0000 front 2026-02-13T02:24:21.166209+0000 (oldest deadline 2026-02-13T02:24:44.066265+0000) 2026-02-13T02:24:56.839 INFO:journalctl@ceph.osd.6.trial011.stdout:Feb 13 02:24:56 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-6[36692]: 2026-02-13T02:24:56.543+0000 7f2a641056c0 -1 osd.6 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:25.766737+0000 front 2026-02-13T02:24:25.766752+0000 (oldest deadline 2026-02-13T02:24:51.666813+0000) 2026-02-13T02:24:56.839 INFO:journalctl@ceph.osd.6.trial011.stdout:Feb 13 02:24:56 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-6[36692]: 2026-02-13T02:24:56.543+0000 7f2a641056c0 -1 osd.6 73 heartbeat_check: no reply from 10.20.193.78:6804 osd.2 since back 2026-02-13T02:24:33.367330+0000 front 2026-02-13T02:24:33.367250+0000 (oldest deadline 2026-02-13T02:24:55.667271+0000) 2026-02-13T02:24:56.839 INFO:journalctl@ceph.osd.6.trial011.stdout:Feb 13 02:24:56 trial011 podman[66980]: 2026-02-13 02:24:56.693235171 +0000 UTC m=+5.101559343 container died 792d32e803e7276507df925c30d18f4ecfde0bf8906c8a4391058733e0588f65 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-6, license=BSD-3-Clause, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, version=10, CEPH_REF=wip-pdonnell-testing-20260210.171210, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, io.buildah.version=1.33.7, summary=Rocky Linux Base image, name=rockylinux, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.title=rockylinux, ceph=True, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default) 2026-02-13T02:24:56.839 INFO:journalctl@ceph.osd.6.trial011.stdout:Feb 13 02:24:56 trial011 podman[66980]: 2026-02-13 02:24:56.701292657 +0000 UTC m=+5.109616819 container remove 792d32e803e7276507df925c30d18f4ecfde0bf8906c8a4391058733e0588f65 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-6, license=BSD-3-Clause, summary=Rocky Linux Base image, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.33.7, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.title=rockylinux, CEPH_REF=wip-pdonnell-testing-20260210.171210, ceph=True, version=10, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, name=rockylinux, org.opencontainers.image.version=10, OSD_FLAVOR=default, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10) 2026-02-13T02:24:56.839 INFO:journalctl@ceph.osd.6.trial011.stdout:Feb 13 02:24:56 trial011 bash[66980]: ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-6 2026-02-13T02:24:57.032 DEBUG:teuthology.orchestra.run.trial011:> sudo pkill -f 'journalctl -f -n 0 -u ceph-fc631695-0881-11f1-899c-d404e6e7d460@osd.6.service' 2026-02-13T02:24:57.078 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T02:24:57.078 INFO:tasks.cephadm.osd.6:Stopped osd.6 2026-02-13T02:24:57.078 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2026-02-13T02:24:57.078 DEBUG:teuthology.orchestra.run.trial060:> sudo systemctl stop ceph-fc631695-0881-11f1-899c-d404e6e7d460@osd.7 2026-02-13T02:24:57.250 INFO:journalctl@ceph.osd.7.trial060.stdout:Feb 13 02:24:56 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-7[32498]: 2026-02-13T02:24:56.937+0000 7feab95646c0 -1 osd.7 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:26.986717+0000 front 2026-02-13T02:24:26.986746+0000 (oldest deadline 2026-02-13T02:24:51.686828+0000) 2026-02-13T02:24:57.250 INFO:journalctl@ceph.osd.7.trial060.stdout:Feb 13 02:24:56 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-7[32498]: 2026-02-13T02:24:56.937+0000 7feab95646c0 -1 osd.7 73 heartbeat_check: no reply from 10.20.193.78:6804 osd.2 since back 2026-02-13T02:24:33.387322+0000 front 2026-02-13T02:24:33.387304+0000 (oldest deadline 2026-02-13T02:24:56.887348+0000) 2026-02-13T02:24:57.250 INFO:journalctl@ceph.osd.7.trial060.stdout:Feb 13 02:24:57 trial060 systemd[1]: Stopping ceph-fc631695-0881-11f1-899c-d404e6e7d460@osd.7.service - Ceph osd.7 for fc631695-0881-11f1-899c-d404e6e7d460... 2026-02-13T02:24:57.251 INFO:journalctl@ceph.osd.7.trial060.stdout:Feb 13 02:24:57 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-7[32498]: 2026-02-13T02:24:57.176+0000 7feac16976c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T02:24:57.251 INFO:journalctl@ceph.osd.7.trial060.stdout:Feb 13 02:24:57 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-7[32498]: 2026-02-13T02:24:57.176+0000 7feac16976c0 -1 osd.7 73 *** Got signal Terminated *** 2026-02-13T02:24:57.251 INFO:journalctl@ceph.osd.7.trial060.stdout:Feb 13 02:24:57 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-7[32498]: 2026-02-13T02:24:57.176+0000 7feac16976c0 -1 osd.7 73 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T02:24:57.541 INFO:journalctl@ceph.osd.8.trial078.stdout:Feb 13 02:24:57 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-8[32377]: 2026-02-13T02:24:57.341+0000 7f39ad2336c0 -1 osd.8 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:20.388100+0000 front 2026-02-13T02:24:20.388058+0000 (oldest deadline 2026-02-13T02:24:44.488088+0000) 2026-02-13T02:24:57.541 INFO:journalctl@ceph.osd.8.trial078.stdout:Feb 13 02:24:57 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-8[32377]: 2026-02-13T02:24:57.341+0000 7f39ad2336c0 -1 osd.8 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:27.988606+0000 front 2026-02-13T02:24:27.988677+0000 (oldest deadline 2026-02-13T02:24:50.888692+0000) 2026-02-13T02:24:57.542 INFO:journalctl@ceph.osd.8.trial078.stdout:Feb 13 02:24:57 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-8[32377]: 2026-02-13T02:24:57.341+0000 7f39ad2336c0 -1 osd.8 73 heartbeat_check: no reply from 10.20.193.78:6804 osd.2 since back 2026-02-13T02:24:33.789049+0000 front 2026-02-13T02:24:33.789067+0000 (oldest deadline 2026-02-13T02:24:56.689164+0000) 2026-02-13T02:24:57.542 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:24:57 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:24:57.136+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:23.112468+0000 front 2026-02-13T02:24:23.112473+0000 (oldest deadline 2026-02-13T02:24:47.212522+0000) 2026-02-13T02:24:57.542 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:24:57 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:24:57.136+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:27.212755+0000 front 2026-02-13T02:24:27.212693+0000 (oldest deadline 2026-02-13T02:24:53.112753+0000) 2026-02-13T02:24:57.542 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:24:57 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:24:57.136+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.78:6804 osd.2 since back 2026-02-13T02:24:34.213127+0000 front 2026-02-13T02:24:34.213138+0000 (oldest deadline 2026-02-13T02:24:54.713206+0000) 2026-02-13T02:24:57.750 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:24:57 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:24:57.346+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:21.576733+0000 front 2026-02-13T02:24:21.576946+0000 (oldest deadline 2026-02-13T02:24:43.876770+0000) 2026-02-13T02:24:57.750 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:24:57 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:24:57.346+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:23.876890+0000 front 2026-02-13T02:24:23.876928+0000 (oldest deadline 2026-02-13T02:24:49.777050+0000) 2026-02-13T02:24:57.750 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:24:57 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:24:57.346+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.78:6804 osd.2 since back 2026-02-13T02:24:31.977616+0000 front 2026-02-13T02:24:31.977623+0000 (oldest deadline 2026-02-13T02:24:57.277647+0000) 2026-02-13T02:24:57.952 INFO:journalctl@ceph.osd.9.trial011.stdout:Feb 13 02:24:57 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-9[43169]: 2026-02-13T02:24:57.521+0000 7fb6ba0a26c0 -1 osd.9 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:19.130671+0000 front 2026-02-13T02:24:19.130656+0000 (oldest deadline 2026-02-13T02:24:43.830795+0000) 2026-02-13T02:24:57.952 INFO:journalctl@ceph.osd.9.trial011.stdout:Feb 13 02:24:57 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-9[43169]: 2026-02-13T02:24:57.521+0000 7fb6ba0a26c0 -1 osd.9 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:28.531392+0000 front 2026-02-13T02:24:28.531406+0000 (oldest deadline 2026-02-13T02:24:51.431407+0000) 2026-02-13T02:24:57.952 INFO:journalctl@ceph.osd.9.trial011.stdout:Feb 13 02:24:57 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-9[43169]: 2026-02-13T02:24:57.521+0000 7fb6ba0a26c0 -1 osd.9 73 heartbeat_check: no reply from 10.20.193.78:6804 osd.2 since back 2026-02-13T02:24:31.931791+0000 front 2026-02-13T02:24:31.931884+0000 (oldest deadline 2026-02-13T02:24:56.031836+0000) 2026-02-13T02:24:58.250 INFO:journalctl@ceph.osd.7.trial060.stdout:Feb 13 02:24:57 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-7[32498]: 2026-02-13T02:24:57.931+0000 7feab95646c0 -1 osd.7 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:26.986717+0000 front 2026-02-13T02:24:26.986746+0000 (oldest deadline 2026-02-13T02:24:51.686828+0000) 2026-02-13T02:24:58.250 INFO:journalctl@ceph.osd.7.trial060.stdout:Feb 13 02:24:57 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-7[32498]: 2026-02-13T02:24:57.931+0000 7feab95646c0 -1 osd.7 73 heartbeat_check: no reply from 10.20.193.78:6804 osd.2 since back 2026-02-13T02:24:33.387322+0000 front 2026-02-13T02:24:33.387304+0000 (oldest deadline 2026-02-13T02:24:56.887348+0000) 2026-02-13T02:24:58.541 INFO:journalctl@ceph.osd.8.trial078.stdout:Feb 13 02:24:58 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-8[32377]: 2026-02-13T02:24:58.353+0000 7f39ad2336c0 -1 osd.8 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:20.388100+0000 front 2026-02-13T02:24:20.388058+0000 (oldest deadline 2026-02-13T02:24:44.488088+0000) 2026-02-13T02:24:58.542 INFO:journalctl@ceph.osd.8.trial078.stdout:Feb 13 02:24:58 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-8[32377]: 2026-02-13T02:24:58.353+0000 7f39ad2336c0 -1 osd.8 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:27.988606+0000 front 2026-02-13T02:24:27.988677+0000 (oldest deadline 2026-02-13T02:24:50.888692+0000) 2026-02-13T02:24:58.542 INFO:journalctl@ceph.osd.8.trial078.stdout:Feb 13 02:24:58 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-8[32377]: 2026-02-13T02:24:58.353+0000 7f39ad2336c0 -1 osd.8 73 heartbeat_check: no reply from 10.20.193.78:6804 osd.2 since back 2026-02-13T02:24:33.789049+0000 front 2026-02-13T02:24:33.789067+0000 (oldest deadline 2026-02-13T02:24:56.689164+0000) 2026-02-13T02:24:58.542 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:24:58 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:24:58.122+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:23.112468+0000 front 2026-02-13T02:24:23.112473+0000 (oldest deadline 2026-02-13T02:24:47.212522+0000) 2026-02-13T02:24:58.542 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:24:58 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:24:58.122+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:27.212755+0000 front 2026-02-13T02:24:27.212693+0000 (oldest deadline 2026-02-13T02:24:53.112753+0000) 2026-02-13T02:24:58.542 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:24:58 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:24:58.122+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.78:6804 osd.2 since back 2026-02-13T02:24:34.213127+0000 front 2026-02-13T02:24:34.213138+0000 (oldest deadline 2026-02-13T02:24:54.713206+0000) 2026-02-13T02:24:58.750 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:24:58 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:24:58.360+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:21.576733+0000 front 2026-02-13T02:24:21.576946+0000 (oldest deadline 2026-02-13T02:24:43.876770+0000) 2026-02-13T02:24:58.750 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:24:58 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:24:58.360+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:23.876890+0000 front 2026-02-13T02:24:23.876928+0000 (oldest deadline 2026-02-13T02:24:49.777050+0000) 2026-02-13T02:24:58.750 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:24:58 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:24:58.360+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.78:6804 osd.2 since back 2026-02-13T02:24:31.977616+0000 front 2026-02-13T02:24:31.977623+0000 (oldest deadline 2026-02-13T02:24:57.277647+0000) 2026-02-13T02:24:58.952 INFO:journalctl@ceph.osd.9.trial011.stdout:Feb 13 02:24:58 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-9[43169]: 2026-02-13T02:24:58.536+0000 7fb6ba0a26c0 -1 osd.9 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:19.130671+0000 front 2026-02-13T02:24:19.130656+0000 (oldest deadline 2026-02-13T02:24:43.830795+0000) 2026-02-13T02:24:58.952 INFO:journalctl@ceph.osd.9.trial011.stdout:Feb 13 02:24:58 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-9[43169]: 2026-02-13T02:24:58.536+0000 7fb6ba0a26c0 -1 osd.9 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:28.531392+0000 front 2026-02-13T02:24:28.531406+0000 (oldest deadline 2026-02-13T02:24:51.431407+0000) 2026-02-13T02:24:58.952 INFO:journalctl@ceph.osd.9.trial011.stdout:Feb 13 02:24:58 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-9[43169]: 2026-02-13T02:24:58.536+0000 7fb6ba0a26c0 -1 osd.9 73 heartbeat_check: no reply from 10.20.193.78:6804 osd.2 since back 2026-02-13T02:24:31.931791+0000 front 2026-02-13T02:24:31.931884+0000 (oldest deadline 2026-02-13T02:24:56.031836+0000) 2026-02-13T02:24:59.250 INFO:journalctl@ceph.osd.7.trial060.stdout:Feb 13 02:24:58 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-7[32498]: 2026-02-13T02:24:58.928+0000 7feab95646c0 -1 osd.7 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:26.986717+0000 front 2026-02-13T02:24:26.986746+0000 (oldest deadline 2026-02-13T02:24:51.686828+0000) 2026-02-13T02:24:59.250 INFO:journalctl@ceph.osd.7.trial060.stdout:Feb 13 02:24:58 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-7[32498]: 2026-02-13T02:24:58.928+0000 7feab95646c0 -1 osd.7 73 heartbeat_check: no reply from 10.20.193.78:6804 osd.2 since back 2026-02-13T02:24:33.387322+0000 front 2026-02-13T02:24:33.387304+0000 (oldest deadline 2026-02-13T02:24:56.887348+0000) 2026-02-13T02:24:59.346 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:24:59 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:24:59.088+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:23.112468+0000 front 2026-02-13T02:24:23.112473+0000 (oldest deadline 2026-02-13T02:24:47.212522+0000) 2026-02-13T02:24:59.346 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:24:59 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:24:59.088+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:27.212755+0000 front 2026-02-13T02:24:27.212693+0000 (oldest deadline 2026-02-13T02:24:53.112753+0000) 2026-02-13T02:24:59.347 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:24:59 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:24:59.088+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.78:6804 osd.2 since back 2026-02-13T02:24:34.213127+0000 front 2026-02-13T02:24:34.213138+0000 (oldest deadline 2026-02-13T02:24:54.713206+0000) 2026-02-13T02:24:59.750 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:24:59 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:24:59.390+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:21.576733+0000 front 2026-02-13T02:24:21.576946+0000 (oldest deadline 2026-02-13T02:24:43.876770+0000) 2026-02-13T02:24:59.750 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:24:59 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:24:59.390+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:23.876890+0000 front 2026-02-13T02:24:23.876928+0000 (oldest deadline 2026-02-13T02:24:49.777050+0000) 2026-02-13T02:24:59.750 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:24:59 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:24:59.390+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.78:6804 osd.2 since back 2026-02-13T02:24:31.977616+0000 front 2026-02-13T02:24:31.977623+0000 (oldest deadline 2026-02-13T02:24:57.277647+0000) 2026-02-13T02:24:59.791 INFO:journalctl@ceph.osd.8.trial078.stdout:Feb 13 02:24:59 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-8[32377]: 2026-02-13T02:24:59.344+0000 7f39ad2336c0 -1 osd.8 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:20.388100+0000 front 2026-02-13T02:24:20.388058+0000 (oldest deadline 2026-02-13T02:24:44.488088+0000) 2026-02-13T02:24:59.791 INFO:journalctl@ceph.osd.8.trial078.stdout:Feb 13 02:24:59 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-8[32377]: 2026-02-13T02:24:59.344+0000 7f39ad2336c0 -1 osd.8 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:27.988606+0000 front 2026-02-13T02:24:27.988677+0000 (oldest deadline 2026-02-13T02:24:50.888692+0000) 2026-02-13T02:24:59.791 INFO:journalctl@ceph.osd.8.trial078.stdout:Feb 13 02:24:59 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-8[32377]: 2026-02-13T02:24:59.344+0000 7f39ad2336c0 -1 osd.8 73 heartbeat_check: no reply from 10.20.193.78:6804 osd.2 since back 2026-02-13T02:24:33.789049+0000 front 2026-02-13T02:24:33.789067+0000 (oldest deadline 2026-02-13T02:24:56.689164+0000) 2026-02-13T02:24:59.952 INFO:journalctl@ceph.osd.9.trial011.stdout:Feb 13 02:24:59 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-9[43169]: 2026-02-13T02:24:59.538+0000 7fb6ba0a26c0 -1 osd.9 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:19.130671+0000 front 2026-02-13T02:24:19.130656+0000 (oldest deadline 2026-02-13T02:24:43.830795+0000) 2026-02-13T02:24:59.952 INFO:journalctl@ceph.osd.9.trial011.stdout:Feb 13 02:24:59 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-9[43169]: 2026-02-13T02:24:59.538+0000 7fb6ba0a26c0 -1 osd.9 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:28.531392+0000 front 2026-02-13T02:24:28.531406+0000 (oldest deadline 2026-02-13T02:24:51.431407+0000) 2026-02-13T02:24:59.952 INFO:journalctl@ceph.osd.9.trial011.stdout:Feb 13 02:24:59 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-9[43169]: 2026-02-13T02:24:59.538+0000 7fb6ba0a26c0 -1 osd.9 73 heartbeat_check: no reply from 10.20.193.78:6804 osd.2 since back 2026-02-13T02:24:31.931791+0000 front 2026-02-13T02:24:31.931884+0000 (oldest deadline 2026-02-13T02:24:56.031836+0000) 2026-02-13T02:25:00.250 INFO:journalctl@ceph.osd.7.trial060.stdout:Feb 13 02:24:59 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-7[32498]: 2026-02-13T02:24:59.929+0000 7feab95646c0 -1 osd.7 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:26.986717+0000 front 2026-02-13T02:24:26.986746+0000 (oldest deadline 2026-02-13T02:24:51.686828+0000) 2026-02-13T02:25:00.250 INFO:journalctl@ceph.osd.7.trial060.stdout:Feb 13 02:24:59 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-7[32498]: 2026-02-13T02:24:59.929+0000 7feab95646c0 -1 osd.7 73 heartbeat_check: no reply from 10.20.193.78:6804 osd.2 since back 2026-02-13T02:24:33.387322+0000 front 2026-02-13T02:24:33.387304+0000 (oldest deadline 2026-02-13T02:24:56.887348+0000) 2026-02-13T02:25:00.541 INFO:journalctl@ceph.osd.8.trial078.stdout:Feb 13 02:25:00 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-8[32377]: 2026-02-13T02:25:00.371+0000 7f39ad2336c0 -1 osd.8 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:20.388100+0000 front 2026-02-13T02:24:20.388058+0000 (oldest deadline 2026-02-13T02:24:44.488088+0000) 2026-02-13T02:25:00.542 INFO:journalctl@ceph.osd.8.trial078.stdout:Feb 13 02:25:00 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-8[32377]: 2026-02-13T02:25:00.371+0000 7f39ad2336c0 -1 osd.8 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:27.988606+0000 front 2026-02-13T02:24:27.988677+0000 (oldest deadline 2026-02-13T02:24:50.888692+0000) 2026-02-13T02:25:00.542 INFO:journalctl@ceph.osd.8.trial078.stdout:Feb 13 02:25:00 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-8[32377]: 2026-02-13T02:25:00.371+0000 7f39ad2336c0 -1 osd.8 73 heartbeat_check: no reply from 10.20.193.78:6804 osd.2 since back 2026-02-13T02:24:33.789049+0000 front 2026-02-13T02:24:33.789067+0000 (oldest deadline 2026-02-13T02:24:56.689164+0000) 2026-02-13T02:25:00.542 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:00 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:00.135+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:23.112468+0000 front 2026-02-13T02:24:23.112473+0000 (oldest deadline 2026-02-13T02:24:47.212522+0000) 2026-02-13T02:25:00.542 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:00 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:00.135+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:27.212755+0000 front 2026-02-13T02:24:27.212693+0000 (oldest deadline 2026-02-13T02:24:53.112753+0000) 2026-02-13T02:25:00.542 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:00 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:00.135+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.78:6804 osd.2 since back 2026-02-13T02:24:34.213127+0000 front 2026-02-13T02:24:34.213138+0000 (oldest deadline 2026-02-13T02:24:54.713206+0000) 2026-02-13T02:25:00.750 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:00 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:25:00.393+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:21.576733+0000 front 2026-02-13T02:24:21.576946+0000 (oldest deadline 2026-02-13T02:24:43.876770+0000) 2026-02-13T02:25:00.750 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:00 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:25:00.393+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:23.876890+0000 front 2026-02-13T02:24:23.876928+0000 (oldest deadline 2026-02-13T02:24:49.777050+0000) 2026-02-13T02:25:00.750 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:00 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:25:00.393+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.78:6804 osd.2 since back 2026-02-13T02:24:31.977616+0000 front 2026-02-13T02:24:31.977623+0000 (oldest deadline 2026-02-13T02:24:57.277647+0000) 2026-02-13T02:25:00.952 INFO:journalctl@ceph.osd.9.trial011.stdout:Feb 13 02:25:00 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-9[43169]: 2026-02-13T02:25:00.520+0000 7fb6ba0a26c0 -1 osd.9 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:19.130671+0000 front 2026-02-13T02:24:19.130656+0000 (oldest deadline 2026-02-13T02:24:43.830795+0000) 2026-02-13T02:25:00.952 INFO:journalctl@ceph.osd.9.trial011.stdout:Feb 13 02:25:00 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-9[43169]: 2026-02-13T02:25:00.520+0000 7fb6ba0a26c0 -1 osd.9 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:28.531392+0000 front 2026-02-13T02:24:28.531406+0000 (oldest deadline 2026-02-13T02:24:51.431407+0000) 2026-02-13T02:25:00.952 INFO:journalctl@ceph.osd.9.trial011.stdout:Feb 13 02:25:00 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-9[43169]: 2026-02-13T02:25:00.520+0000 7fb6ba0a26c0 -1 osd.9 73 heartbeat_check: no reply from 10.20.193.78:6804 osd.2 since back 2026-02-13T02:24:31.931791+0000 front 2026-02-13T02:24:31.931884+0000 (oldest deadline 2026-02-13T02:24:56.031836+0000) 2026-02-13T02:25:01.250 INFO:journalctl@ceph.osd.7.trial060.stdout:Feb 13 02:25:00 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-7[32498]: 2026-02-13T02:25:00.918+0000 7feab95646c0 -1 osd.7 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:26.986717+0000 front 2026-02-13T02:24:26.986746+0000 (oldest deadline 2026-02-13T02:24:51.686828+0000) 2026-02-13T02:25:01.250 INFO:journalctl@ceph.osd.7.trial060.stdout:Feb 13 02:25:00 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-7[32498]: 2026-02-13T02:25:00.918+0000 7feab95646c0 -1 osd.7 73 heartbeat_check: no reply from 10.20.193.78:6804 osd.2 since back 2026-02-13T02:24:33.387322+0000 front 2026-02-13T02:24:33.387304+0000 (oldest deadline 2026-02-13T02:24:56.887348+0000) 2026-02-13T02:25:01.409 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:01 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:01.085+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:23.112468+0000 front 2026-02-13T02:24:23.112473+0000 (oldest deadline 2026-02-13T02:24:47.212522+0000) 2026-02-13T02:25:01.409 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:01 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:01.085+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:27.212755+0000 front 2026-02-13T02:24:27.212693+0000 (oldest deadline 2026-02-13T02:24:53.112753+0000) 2026-02-13T02:25:01.409 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:01 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:01.085+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.78:6804 osd.2 since back 2026-02-13T02:24:34.213127+0000 front 2026-02-13T02:24:34.213138+0000 (oldest deadline 2026-02-13T02:24:54.713206+0000) 2026-02-13T02:25:01.750 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:01 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:25:01.396+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:21.576733+0000 front 2026-02-13T02:24:21.576946+0000 (oldest deadline 2026-02-13T02:24:43.876770+0000) 2026-02-13T02:25:01.750 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:01 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:25:01.396+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:23.876890+0000 front 2026-02-13T02:24:23.876928+0000 (oldest deadline 2026-02-13T02:24:49.777050+0000) 2026-02-13T02:25:01.750 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:01 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:25:01.396+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.78:6804 osd.2 since back 2026-02-13T02:24:31.977616+0000 front 2026-02-13T02:24:31.977623+0000 (oldest deadline 2026-02-13T02:24:57.277647+0000) 2026-02-13T02:25:01.791 INFO:journalctl@ceph.osd.8.trial078.stdout:Feb 13 02:25:01 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-8[32377]: 2026-02-13T02:25:01.407+0000 7f39ad2336c0 -1 osd.8 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:20.388100+0000 front 2026-02-13T02:24:20.388058+0000 (oldest deadline 2026-02-13T02:24:44.488088+0000) 2026-02-13T02:25:01.791 INFO:journalctl@ceph.osd.8.trial078.stdout:Feb 13 02:25:01 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-8[32377]: 2026-02-13T02:25:01.407+0000 7f39ad2336c0 -1 osd.8 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:27.988606+0000 front 2026-02-13T02:24:27.988677+0000 (oldest deadline 2026-02-13T02:24:50.888692+0000) 2026-02-13T02:25:01.791 INFO:journalctl@ceph.osd.8.trial078.stdout:Feb 13 02:25:01 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-8[32377]: 2026-02-13T02:25:01.407+0000 7f39ad2336c0 -1 osd.8 73 heartbeat_check: no reply from 10.20.193.78:6804 osd.2 since back 2026-02-13T02:24:33.789049+0000 front 2026-02-13T02:24:33.789067+0000 (oldest deadline 2026-02-13T02:24:56.689164+0000) 2026-02-13T02:25:01.952 INFO:journalctl@ceph.osd.9.trial011.stdout:Feb 13 02:25:01 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-9[43169]: 2026-02-13T02:25:01.495+0000 7fb6ba0a26c0 -1 osd.9 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:19.130671+0000 front 2026-02-13T02:24:19.130656+0000 (oldest deadline 2026-02-13T02:24:43.830795+0000) 2026-02-13T02:25:01.952 INFO:journalctl@ceph.osd.9.trial011.stdout:Feb 13 02:25:01 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-9[43169]: 2026-02-13T02:25:01.495+0000 7fb6ba0a26c0 -1 osd.9 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:28.531392+0000 front 2026-02-13T02:24:28.531406+0000 (oldest deadline 2026-02-13T02:24:51.431407+0000) 2026-02-13T02:25:01.952 INFO:journalctl@ceph.osd.9.trial011.stdout:Feb 13 02:25:01 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-9[43169]: 2026-02-13T02:25:01.495+0000 7fb6ba0a26c0 -1 osd.9 73 heartbeat_check: no reply from 10.20.193.78:6804 osd.2 since back 2026-02-13T02:24:31.931791+0000 front 2026-02-13T02:24:31.931884+0000 (oldest deadline 2026-02-13T02:24:56.031836+0000) 2026-02-13T02:25:02.247 INFO:journalctl@ceph.osd.7.trial060.stdout:Feb 13 02:25:01 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-7[32498]: 2026-02-13T02:25:01.901+0000 7feab95646c0 -1 osd.7 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:26.986717+0000 front 2026-02-13T02:24:26.986746+0000 (oldest deadline 2026-02-13T02:24:51.686828+0000) 2026-02-13T02:25:02.247 INFO:journalctl@ceph.osd.7.trial060.stdout:Feb 13 02:25:01 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-7[32498]: 2026-02-13T02:25:01.901+0000 7feab95646c0 -1 osd.7 73 heartbeat_check: no reply from 10.20.193.78:6804 osd.2 since back 2026-02-13T02:24:33.387322+0000 front 2026-02-13T02:24:33.387304+0000 (oldest deadline 2026-02-13T02:24:56.887348+0000) 2026-02-13T02:25:02.247 INFO:journalctl@ceph.osd.7.trial060.stdout:Feb 13 02:25:01 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-7[32498]: 2026-02-13T02:25:01.901+0000 7feab95646c0 -1 osd.7 73 heartbeat_check: no reply from 10.20.193.11:6814 osd.3 since back 2026-02-13T02:24:39.187806+0000 front 2026-02-13T02:24:39.187833+0000 (oldest deadline 2026-02-13T02:25:01.487887+0000) 2026-02-13T02:25:02.414 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:02 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:02.134+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:23.112468+0000 front 2026-02-13T02:24:23.112473+0000 (oldest deadline 2026-02-13T02:24:47.212522+0000) 2026-02-13T02:25:02.414 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:02 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:02.134+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:27.212755+0000 front 2026-02-13T02:24:27.212693+0000 (oldest deadline 2026-02-13T02:24:53.112753+0000) 2026-02-13T02:25:02.414 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:02 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:02.134+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.78:6804 osd.2 since back 2026-02-13T02:24:34.213127+0000 front 2026-02-13T02:24:34.213138+0000 (oldest deadline 2026-02-13T02:24:54.713206+0000) 2026-02-13T02:25:02.501 INFO:journalctl@ceph.osd.7.trial060.stdout:Feb 13 02:25:02 trial060 podman[46823]: 2026-02-13 02:25:02.247588349 +0000 UTC m=+5.081076345 container died 5dd6af78abd54a446031dea5f24f84d797c379a0828132be84c3be5a5174da89 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-7, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, summary=Rocky Linux Base image, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_REF=wip-pdonnell-testing-20260210.171210, license=BSD-3-Clause, version=10, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, name=rockylinux, io.buildah.version=1.33.7, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.title=rockylinux, vendor=Rocky Enterprise Software Foundation, ceph=True, org.opencontainers.image.version=10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f) 2026-02-13T02:25:02.501 INFO:journalctl@ceph.osd.7.trial060.stdout:Feb 13 02:25:02 trial060 podman[46823]: 2026-02-13 02:25:02.255537113 +0000 UTC m=+5.089025119 container remove 5dd6af78abd54a446031dea5f24f84d797c379a0828132be84c3be5a5174da89 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-7, ceph=True, org.opencontainers.image.title=rockylinux, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, io.buildah.version=1.33.7, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-pdonnell-testing-20260210.171210, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.authors=Ceph Release Team , vendor=Rocky Enterprise Software Foundation, version=10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, name=rockylinux, license=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.version=10, org.opencontainers.image.licenses=BSD-3-Clause, summary=Rocky Linux Base image, OSD_FLAVOR=default) 2026-02-13T02:25:02.501 INFO:journalctl@ceph.osd.7.trial060.stdout:Feb 13 02:25:02 trial060 bash[46823]: ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-7 2026-02-13T02:25:02.501 INFO:journalctl@ceph.osd.7.trial060.stdout:Feb 13 02:25:02 trial060 podman[46949]: 2026-02-13 02:25:02.386890398 +0000 UTC m=+0.014881370 container create 014ca888372589ecf94d0b73d467fab52cda8a1388b9ff8976ccfe60901ba1e6 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-7-deactivate, name=rockylinux, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.version=10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, ceph=True, io.buildah.version=1.33.7, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.title=rockylinux, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, version=10, org.opencontainers.image.documentation=https://docs.ceph.com/, summary=Rocky Linux Base image, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_REF=wip-pdonnell-testing-20260210.171210, OSD_FLAVOR=default, license=BSD-3-Clause, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-13T02:25:02.502 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:02 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:25:02.394+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:21.576733+0000 front 2026-02-13T02:24:21.576946+0000 (oldest deadline 2026-02-13T02:24:43.876770+0000) 2026-02-13T02:25:02.502 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:02 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:25:02.394+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:23.876890+0000 front 2026-02-13T02:24:23.876928+0000 (oldest deadline 2026-02-13T02:24:49.777050+0000) 2026-02-13T02:25:02.502 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:02 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:25:02.394+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.78:6804 osd.2 since back 2026-02-13T02:24:31.977616+0000 front 2026-02-13T02:24:31.977623+0000 (oldest deadline 2026-02-13T02:24:57.277647+0000) 2026-02-13T02:25:02.502 INFO:journalctl@ceph.osd.7.trial060.stdout:Feb 13 02:25:02 trial060 podman[46949]: 2026-02-13 02:25:02.415033434 +0000 UTC m=+0.043024416 container init 014ca888372589ecf94d0b73d467fab52cda8a1388b9ff8976ccfe60901ba1e6 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-7-deactivate, CEPH_REF=wip-pdonnell-testing-20260210.171210, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, license=BSD-3-Clause, org.opencontainers.image.title=rockylinux, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.licenses=BSD-3-Clause, ceph=True, vendor=Rocky Enterprise Software Foundation, io.buildah.version=1.33.7, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.documentation=https://docs.ceph.com/, summary=Rocky Linux Base image, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, OSD_FLAVOR=default, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , name=rockylinux, version=10, org.opencontainers.image.version=10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10) 2026-02-13T02:25:02.502 INFO:journalctl@ceph.osd.7.trial060.stdout:Feb 13 02:25:02 trial060 podman[46949]: 2026-02-13 02:25:02.417025108 +0000 UTC m=+0.045016090 container start 014ca888372589ecf94d0b73d467fab52cda8a1388b9ff8976ccfe60901ba1e6 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-7-deactivate, OSD_FLAVOR=default, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.authors=Ceph Release Team , license=BSD-3-Clause, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, ceph=True, version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.version=10, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.title=rockylinux, name=rockylinux, io.buildah.version=1.33.7, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, summary=Rocky Linux Base image, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_REF=wip-pdonnell-testing-20260210.171210) 2026-02-13T02:25:02.502 INFO:journalctl@ceph.osd.7.trial060.stdout:Feb 13 02:25:02 trial060 podman[46949]: 2026-02-13 02:25:02.417500793 +0000 UTC m=+0.045491775 container attach 014ca888372589ecf94d0b73d467fab52cda8a1388b9ff8976ccfe60901ba1e6 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-7-deactivate, version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.authors=Ceph Release Team , license=BSD-3-Clause, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.licenses=BSD-3-Clause, OSD_FLAVOR=default, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.title=rockylinux, CEPH_REF=wip-pdonnell-testing-20260210.171210, ceph=True, io.buildah.version=1.33.7, org.opencontainers.image.version=10, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, summary=Rocky Linux Base image, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, name=rockylinux) 2026-02-13T02:25:02.503 INFO:journalctl@ceph.osd.7.trial060.stdout:Feb 13 02:25:02 trial060 podman[46949]: 2026-02-13 02:25:02.380761018 +0000 UTC m=+0.008752000 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T02:25:02.584 DEBUG:teuthology.orchestra.run.trial060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-fc631695-0881-11f1-899c-d404e6e7d460@osd.7.service' 2026-02-13T02:25:02.629 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T02:25:02.630 INFO:tasks.cephadm.osd.7:Stopped osd.7 2026-02-13T02:25:02.630 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2026-02-13T02:25:02.630 DEBUG:teuthology.orchestra.run.trial078:> sudo systemctl stop ceph-fc631695-0881-11f1-899c-d404e6e7d460@osd.8 2026-02-13T02:25:02.689 INFO:journalctl@ceph.osd.8.trial078.stdout:Feb 13 02:25:02 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-8[32377]: 2026-02-13T02:25:02.411+0000 7f39ad2336c0 -1 osd.8 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:20.388100+0000 front 2026-02-13T02:24:20.388058+0000 (oldest deadline 2026-02-13T02:24:44.488088+0000) 2026-02-13T02:25:02.690 INFO:journalctl@ceph.osd.8.trial078.stdout:Feb 13 02:25:02 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-8[32377]: 2026-02-13T02:25:02.411+0000 7f39ad2336c0 -1 osd.8 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:27.988606+0000 front 2026-02-13T02:24:27.988677+0000 (oldest deadline 2026-02-13T02:24:50.888692+0000) 2026-02-13T02:25:02.690 INFO:journalctl@ceph.osd.8.trial078.stdout:Feb 13 02:25:02 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-8[32377]: 2026-02-13T02:25:02.411+0000 7f39ad2336c0 -1 osd.8 73 heartbeat_check: no reply from 10.20.193.78:6804 osd.2 since back 2026-02-13T02:24:33.789049+0000 front 2026-02-13T02:24:33.789067+0000 (oldest deadline 2026-02-13T02:24:56.689164+0000) 2026-02-13T02:25:02.690 INFO:journalctl@ceph.osd.8.trial078.stdout:Feb 13 02:25:02 trial078 systemd[1]: Stopping ceph-fc631695-0881-11f1-899c-d404e6e7d460@osd.8.service - Ceph osd.8 for fc631695-0881-11f1-899c-d404e6e7d460... 2026-02-13T02:25:02.952 INFO:journalctl@ceph.osd.9.trial011.stdout:Feb 13 02:25:02 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-9[43169]: 2026-02-13T02:25:02.502+0000 7fb6ba0a26c0 -1 osd.9 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:19.130671+0000 front 2026-02-13T02:24:19.130656+0000 (oldest deadline 2026-02-13T02:24:43.830795+0000) 2026-02-13T02:25:02.952 INFO:journalctl@ceph.osd.9.trial011.stdout:Feb 13 02:25:02 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-9[43169]: 2026-02-13T02:25:02.502+0000 7fb6ba0a26c0 -1 osd.9 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:28.531392+0000 front 2026-02-13T02:24:28.531406+0000 (oldest deadline 2026-02-13T02:24:51.431407+0000) 2026-02-13T02:25:02.952 INFO:journalctl@ceph.osd.9.trial011.stdout:Feb 13 02:25:02 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-9[43169]: 2026-02-13T02:25:02.502+0000 7fb6ba0a26c0 -1 osd.9 73 heartbeat_check: no reply from 10.20.193.78:6804 osd.2 since back 2026-02-13T02:24:31.931791+0000 front 2026-02-13T02:24:31.931884+0000 (oldest deadline 2026-02-13T02:24:56.031836+0000) 2026-02-13T02:25:02.952 INFO:journalctl@ceph.osd.9.trial011.stdout:Feb 13 02:25:02 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-9[43169]: 2026-02-13T02:25:02.502+0000 7fb6ba0a26c0 -1 osd.9 73 heartbeat_check: no reply from 10.20.193.11:6814 osd.3 since back 2026-02-13T02:24:37.132166+0000 front 2026-02-13T02:24:37.132150+0000 (oldest deadline 2026-02-13T02:25:02.432203+0000) 2026-02-13T02:25:03.041 INFO:journalctl@ceph.osd.8.trial078.stdout:Feb 13 02:25:02 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-8[32377]: 2026-02-13T02:25:02.744+0000 7f39b135e6c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T02:25:03.041 INFO:journalctl@ceph.osd.8.trial078.stdout:Feb 13 02:25:02 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-8[32377]: 2026-02-13T02:25:02.744+0000 7f39b135e6c0 -1 osd.8 73 *** Got signal Terminated *** 2026-02-13T02:25:03.042 INFO:journalctl@ceph.osd.8.trial078.stdout:Feb 13 02:25:02 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-8[32377]: 2026-02-13T02:25:02.744+0000 7f39b135e6c0 -1 osd.8 73 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T02:25:03.541 INFO:journalctl@ceph.osd.8.trial078.stdout:Feb 13 02:25:03 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-8[32377]: 2026-02-13T02:25:03.412+0000 7f39ad2336c0 -1 osd.8 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:20.388100+0000 front 2026-02-13T02:24:20.388058+0000 (oldest deadline 2026-02-13T02:24:44.488088+0000) 2026-02-13T02:25:03.542 INFO:journalctl@ceph.osd.8.trial078.stdout:Feb 13 02:25:03 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-8[32377]: 2026-02-13T02:25:03.412+0000 7f39ad2336c0 -1 osd.8 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:27.988606+0000 front 2026-02-13T02:24:27.988677+0000 (oldest deadline 2026-02-13T02:24:50.888692+0000) 2026-02-13T02:25:03.542 INFO:journalctl@ceph.osd.8.trial078.stdout:Feb 13 02:25:03 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-8[32377]: 2026-02-13T02:25:03.412+0000 7f39ad2336c0 -1 osd.8 73 heartbeat_check: no reply from 10.20.193.78:6804 osd.2 since back 2026-02-13T02:24:33.789049+0000 front 2026-02-13T02:24:33.789067+0000 (oldest deadline 2026-02-13T02:24:56.689164+0000) 2026-02-13T02:25:03.542 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:03 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:03.182+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:23.112468+0000 front 2026-02-13T02:24:23.112473+0000 (oldest deadline 2026-02-13T02:24:47.212522+0000) 2026-02-13T02:25:03.542 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:03 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:03.182+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:27.212755+0000 front 2026-02-13T02:24:27.212693+0000 (oldest deadline 2026-02-13T02:24:53.112753+0000) 2026-02-13T02:25:03.542 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:03 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:03.182+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.78:6804 osd.2 since back 2026-02-13T02:24:34.213127+0000 front 2026-02-13T02:24:34.213138+0000 (oldest deadline 2026-02-13T02:24:54.713206+0000) 2026-02-13T02:25:03.750 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:03 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:25:03.415+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:21.576733+0000 front 2026-02-13T02:24:21.576946+0000 (oldest deadline 2026-02-13T02:24:43.876770+0000) 2026-02-13T02:25:03.750 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:03 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:25:03.415+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:23.876890+0000 front 2026-02-13T02:24:23.876928+0000 (oldest deadline 2026-02-13T02:24:49.777050+0000) 2026-02-13T02:25:03.751 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:03 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:25:03.415+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.78:6804 osd.2 since back 2026-02-13T02:24:31.977616+0000 front 2026-02-13T02:24:31.977623+0000 (oldest deadline 2026-02-13T02:24:57.277647+0000) 2026-02-13T02:25:03.751 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:03 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:25:03.415+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.11:6814 osd.3 since back 2026-02-13T02:24:38.978047+0000 front 2026-02-13T02:24:38.977983+0000 (oldest deadline 2026-02-13T02:25:03.077981+0000) 2026-02-13T02:25:03.952 INFO:journalctl@ceph.osd.9.trial011.stdout:Feb 13 02:25:03 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-9[43169]: 2026-02-13T02:25:03.491+0000 7fb6ba0a26c0 -1 osd.9 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:19.130671+0000 front 2026-02-13T02:24:19.130656+0000 (oldest deadline 2026-02-13T02:24:43.830795+0000) 2026-02-13T02:25:03.952 INFO:journalctl@ceph.osd.9.trial011.stdout:Feb 13 02:25:03 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-9[43169]: 2026-02-13T02:25:03.491+0000 7fb6ba0a26c0 -1 osd.9 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:28.531392+0000 front 2026-02-13T02:24:28.531406+0000 (oldest deadline 2026-02-13T02:24:51.431407+0000) 2026-02-13T02:25:03.952 INFO:journalctl@ceph.osd.9.trial011.stdout:Feb 13 02:25:03 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-9[43169]: 2026-02-13T02:25:03.491+0000 7fb6ba0a26c0 -1 osd.9 73 heartbeat_check: no reply from 10.20.193.78:6804 osd.2 since back 2026-02-13T02:24:31.931791+0000 front 2026-02-13T02:24:31.931884+0000 (oldest deadline 2026-02-13T02:24:56.031836+0000) 2026-02-13T02:25:03.952 INFO:journalctl@ceph.osd.9.trial011.stdout:Feb 13 02:25:03 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-9[43169]: 2026-02-13T02:25:03.491+0000 7fb6ba0a26c0 -1 osd.9 73 heartbeat_check: no reply from 10.20.193.11:6814 osd.3 since back 2026-02-13T02:24:37.132166+0000 front 2026-02-13T02:24:37.132150+0000 (oldest deadline 2026-02-13T02:25:02.432203+0000) 2026-02-13T02:25:04.541 INFO:journalctl@ceph.osd.8.trial078.stdout:Feb 13 02:25:04 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-8[32377]: 2026-02-13T02:25:04.401+0000 7f39ad2336c0 -1 osd.8 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:20.388100+0000 front 2026-02-13T02:24:20.388058+0000 (oldest deadline 2026-02-13T02:24:44.488088+0000) 2026-02-13T02:25:04.542 INFO:journalctl@ceph.osd.8.trial078.stdout:Feb 13 02:25:04 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-8[32377]: 2026-02-13T02:25:04.401+0000 7f39ad2336c0 -1 osd.8 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:27.988606+0000 front 2026-02-13T02:24:27.988677+0000 (oldest deadline 2026-02-13T02:24:50.888692+0000) 2026-02-13T02:25:04.542 INFO:journalctl@ceph.osd.8.trial078.stdout:Feb 13 02:25:04 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-8[32377]: 2026-02-13T02:25:04.401+0000 7f39ad2336c0 -1 osd.8 73 heartbeat_check: no reply from 10.20.193.78:6804 osd.2 since back 2026-02-13T02:24:33.789049+0000 front 2026-02-13T02:24:33.789067+0000 (oldest deadline 2026-02-13T02:24:56.689164+0000) 2026-02-13T02:25:04.542 INFO:journalctl@ceph.osd.8.trial078.stdout:Feb 13 02:25:04 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-8[32377]: 2026-02-13T02:25:04.401+0000 7f39ad2336c0 -1 osd.8 73 heartbeat_check: no reply from 10.20.193.11:6814 osd.3 since back 2026-02-13T02:24:37.789627+0000 front 2026-02-13T02:24:37.789602+0000 (oldest deadline 2026-02-13T02:25:03.689649+0000) 2026-02-13T02:25:04.542 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:04 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:04.172+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:23.112468+0000 front 2026-02-13T02:24:23.112473+0000 (oldest deadline 2026-02-13T02:24:47.212522+0000) 2026-02-13T02:25:04.542 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:04 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:04.172+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:27.212755+0000 front 2026-02-13T02:24:27.212693+0000 (oldest deadline 2026-02-13T02:24:53.112753+0000) 2026-02-13T02:25:04.542 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:04 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:04.172+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.78:6804 osd.2 since back 2026-02-13T02:24:34.213127+0000 front 2026-02-13T02:24:34.213138+0000 (oldest deadline 2026-02-13T02:24:54.713206+0000) 2026-02-13T02:25:04.750 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:04 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:25:04.450+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:21.576733+0000 front 2026-02-13T02:24:21.576946+0000 (oldest deadline 2026-02-13T02:24:43.876770+0000) 2026-02-13T02:25:04.751 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:04 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:25:04.450+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:23.876890+0000 front 2026-02-13T02:24:23.876928+0000 (oldest deadline 2026-02-13T02:24:49.777050+0000) 2026-02-13T02:25:04.751 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:04 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:25:04.450+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.78:6804 osd.2 since back 2026-02-13T02:24:31.977616+0000 front 2026-02-13T02:24:31.977623+0000 (oldest deadline 2026-02-13T02:24:57.277647+0000) 2026-02-13T02:25:04.751 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:04 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:25:04.450+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.11:6814 osd.3 since back 2026-02-13T02:24:38.978047+0000 front 2026-02-13T02:24:38.977983+0000 (oldest deadline 2026-02-13T02:25:03.077981+0000) 2026-02-13T02:25:04.952 INFO:journalctl@ceph.osd.9.trial011.stdout:Feb 13 02:25:04 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-9[43169]: 2026-02-13T02:25:04.471+0000 7fb6ba0a26c0 -1 osd.9 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:19.130671+0000 front 2026-02-13T02:24:19.130656+0000 (oldest deadline 2026-02-13T02:24:43.830795+0000) 2026-02-13T02:25:04.952 INFO:journalctl@ceph.osd.9.trial011.stdout:Feb 13 02:25:04 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-9[43169]: 2026-02-13T02:25:04.471+0000 7fb6ba0a26c0 -1 osd.9 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:28.531392+0000 front 2026-02-13T02:24:28.531406+0000 (oldest deadline 2026-02-13T02:24:51.431407+0000) 2026-02-13T02:25:04.952 INFO:journalctl@ceph.osd.9.trial011.stdout:Feb 13 02:25:04 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-9[43169]: 2026-02-13T02:25:04.471+0000 7fb6ba0a26c0 -1 osd.9 73 heartbeat_check: no reply from 10.20.193.78:6804 osd.2 since back 2026-02-13T02:24:31.931791+0000 front 2026-02-13T02:24:31.931884+0000 (oldest deadline 2026-02-13T02:24:56.031836+0000) 2026-02-13T02:25:04.952 INFO:journalctl@ceph.osd.9.trial011.stdout:Feb 13 02:25:04 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-9[43169]: 2026-02-13T02:25:04.471+0000 7fb6ba0a26c0 -1 osd.9 73 heartbeat_check: no reply from 10.20.193.11:6814 osd.3 since back 2026-02-13T02:24:37.132166+0000 front 2026-02-13T02:24:37.132150+0000 (oldest deadline 2026-02-13T02:25:02.432203+0000) 2026-02-13T02:25:05.436 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:05 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:05.169+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:23.112468+0000 front 2026-02-13T02:24:23.112473+0000 (oldest deadline 2026-02-13T02:24:47.212522+0000) 2026-02-13T02:25:05.436 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:05 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:05.169+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:27.212755+0000 front 2026-02-13T02:24:27.212693+0000 (oldest deadline 2026-02-13T02:24:53.112753+0000) 2026-02-13T02:25:05.436 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:05 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:05.169+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.78:6804 osd.2 since back 2026-02-13T02:24:34.213127+0000 front 2026-02-13T02:24:34.213138+0000 (oldest deadline 2026-02-13T02:24:54.713206+0000) 2026-02-13T02:25:05.750 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:05 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:25:05.458+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:21.576733+0000 front 2026-02-13T02:24:21.576946+0000 (oldest deadline 2026-02-13T02:24:43.876770+0000) 2026-02-13T02:25:05.750 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:05 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:25:05.458+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:23.876890+0000 front 2026-02-13T02:24:23.876928+0000 (oldest deadline 2026-02-13T02:24:49.777050+0000) 2026-02-13T02:25:05.751 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:05 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:25:05.458+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.78:6804 osd.2 since back 2026-02-13T02:24:31.977616+0000 front 2026-02-13T02:24:31.977623+0000 (oldest deadline 2026-02-13T02:24:57.277647+0000) 2026-02-13T02:25:05.751 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:05 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:25:05.458+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.11:6814 osd.3 since back 2026-02-13T02:24:38.978047+0000 front 2026-02-13T02:24:38.977983+0000 (oldest deadline 2026-02-13T02:25:03.077981+0000) 2026-02-13T02:25:05.791 INFO:journalctl@ceph.osd.8.trial078.stdout:Feb 13 02:25:05 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-8[32377]: 2026-02-13T02:25:05.433+0000 7f39ad2336c0 -1 osd.8 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:20.388100+0000 front 2026-02-13T02:24:20.388058+0000 (oldest deadline 2026-02-13T02:24:44.488088+0000) 2026-02-13T02:25:05.792 INFO:journalctl@ceph.osd.8.trial078.stdout:Feb 13 02:25:05 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-8[32377]: 2026-02-13T02:25:05.433+0000 7f39ad2336c0 -1 osd.8 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:27.988606+0000 front 2026-02-13T02:24:27.988677+0000 (oldest deadline 2026-02-13T02:24:50.888692+0000) 2026-02-13T02:25:05.792 INFO:journalctl@ceph.osd.8.trial078.stdout:Feb 13 02:25:05 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-8[32377]: 2026-02-13T02:25:05.433+0000 7f39ad2336c0 -1 osd.8 73 heartbeat_check: no reply from 10.20.193.78:6804 osd.2 since back 2026-02-13T02:24:33.789049+0000 front 2026-02-13T02:24:33.789067+0000 (oldest deadline 2026-02-13T02:24:56.689164+0000) 2026-02-13T02:25:05.792 INFO:journalctl@ceph.osd.8.trial078.stdout:Feb 13 02:25:05 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-8[32377]: 2026-02-13T02:25:05.433+0000 7f39ad2336c0 -1 osd.8 73 heartbeat_check: no reply from 10.20.193.11:6814 osd.3 since back 2026-02-13T02:24:37.789627+0000 front 2026-02-13T02:24:37.789602+0000 (oldest deadline 2026-02-13T02:25:03.689649+0000) 2026-02-13T02:25:05.853 INFO:journalctl@ceph.osd.9.trial011.stdout:Feb 13 02:25:05 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-9[43169]: 2026-02-13T02:25:05.478+0000 7fb6ba0a26c0 -1 osd.9 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:19.130671+0000 front 2026-02-13T02:24:19.130656+0000 (oldest deadline 2026-02-13T02:24:43.830795+0000) 2026-02-13T02:25:05.853 INFO:journalctl@ceph.osd.9.trial011.stdout:Feb 13 02:25:05 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-9[43169]: 2026-02-13T02:25:05.478+0000 7fb6ba0a26c0 -1 osd.9 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:28.531392+0000 front 2026-02-13T02:24:28.531406+0000 (oldest deadline 2026-02-13T02:24:51.431407+0000) 2026-02-13T02:25:05.853 INFO:journalctl@ceph.osd.9.trial011.stdout:Feb 13 02:25:05 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-9[43169]: 2026-02-13T02:25:05.478+0000 7fb6ba0a26c0 -1 osd.9 73 heartbeat_check: no reply from 10.20.193.78:6804 osd.2 since back 2026-02-13T02:24:31.931791+0000 front 2026-02-13T02:24:31.931884+0000 (oldest deadline 2026-02-13T02:24:56.031836+0000) 2026-02-13T02:25:05.853 INFO:journalctl@ceph.osd.9.trial011.stdout:Feb 13 02:25:05 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-9[43169]: 2026-02-13T02:25:05.478+0000 7fb6ba0a26c0 -1 osd.9 73 heartbeat_check: no reply from 10.20.193.11:6814 osd.3 since back 2026-02-13T02:24:37.132166+0000 front 2026-02-13T02:24:37.132150+0000 (oldest deadline 2026-02-13T02:25:02.432203+0000) 2026-02-13T02:25:06.541 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:06 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:06.173+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:23.112468+0000 front 2026-02-13T02:24:23.112473+0000 (oldest deadline 2026-02-13T02:24:47.212522+0000) 2026-02-13T02:25:06.542 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:06 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:06.173+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:27.212755+0000 front 2026-02-13T02:24:27.212693+0000 (oldest deadline 2026-02-13T02:24:53.112753+0000) 2026-02-13T02:25:06.542 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:06 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:06.173+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.78:6804 osd.2 since back 2026-02-13T02:24:34.213127+0000 front 2026-02-13T02:24:34.213138+0000 (oldest deadline 2026-02-13T02:24:54.713206+0000) 2026-02-13T02:25:06.542 INFO:journalctl@ceph.osd.8.trial078.stdout:Feb 13 02:25:06 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-8[32377]: 2026-02-13T02:25:06.416+0000 7f39ad2336c0 -1 osd.8 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:20.388100+0000 front 2026-02-13T02:24:20.388058+0000 (oldest deadline 2026-02-13T02:24:44.488088+0000) 2026-02-13T02:25:06.542 INFO:journalctl@ceph.osd.8.trial078.stdout:Feb 13 02:25:06 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-8[32377]: 2026-02-13T02:25:06.416+0000 7f39ad2336c0 -1 osd.8 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:27.988606+0000 front 2026-02-13T02:24:27.988677+0000 (oldest deadline 2026-02-13T02:24:50.888692+0000) 2026-02-13T02:25:06.542 INFO:journalctl@ceph.osd.8.trial078.stdout:Feb 13 02:25:06 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-8[32377]: 2026-02-13T02:25:06.416+0000 7f39ad2336c0 -1 osd.8 73 heartbeat_check: no reply from 10.20.193.78:6804 osd.2 since back 2026-02-13T02:24:33.789049+0000 front 2026-02-13T02:24:33.789067+0000 (oldest deadline 2026-02-13T02:24:56.689164+0000) 2026-02-13T02:25:06.542 INFO:journalctl@ceph.osd.8.trial078.stdout:Feb 13 02:25:06 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-8[32377]: 2026-02-13T02:25:06.416+0000 7f39ad2336c0 -1 osd.8 73 heartbeat_check: no reply from 10.20.193.11:6814 osd.3 since back 2026-02-13T02:24:37.789627+0000 front 2026-02-13T02:24:37.789602+0000 (oldest deadline 2026-02-13T02:25:03.689649+0000) 2026-02-13T02:25:06.750 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:06 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:25:06.427+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:21.576733+0000 front 2026-02-13T02:24:21.576946+0000 (oldest deadline 2026-02-13T02:24:43.876770+0000) 2026-02-13T02:25:06.750 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:06 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:25:06.427+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:23.876890+0000 front 2026-02-13T02:24:23.876928+0000 (oldest deadline 2026-02-13T02:24:49.777050+0000) 2026-02-13T02:25:06.750 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:06 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:25:06.427+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.78:6804 osd.2 since back 2026-02-13T02:24:31.977616+0000 front 2026-02-13T02:24:31.977623+0000 (oldest deadline 2026-02-13T02:24:57.277647+0000) 2026-02-13T02:25:06.751 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:06 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:25:06.427+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.11:6814 osd.3 since back 2026-02-13T02:24:38.978047+0000 front 2026-02-13T02:24:38.977983+0000 (oldest deadline 2026-02-13T02:25:03.077981+0000) 2026-02-13T02:25:06.952 INFO:journalctl@ceph.osd.9.trial011.stdout:Feb 13 02:25:06 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-9[43169]: 2026-02-13T02:25:06.484+0000 7fb6ba0a26c0 -1 osd.9 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:19.130671+0000 front 2026-02-13T02:24:19.130656+0000 (oldest deadline 2026-02-13T02:24:43.830795+0000) 2026-02-13T02:25:06.952 INFO:journalctl@ceph.osd.9.trial011.stdout:Feb 13 02:25:06 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-9[43169]: 2026-02-13T02:25:06.484+0000 7fb6ba0a26c0 -1 osd.9 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:28.531392+0000 front 2026-02-13T02:24:28.531406+0000 (oldest deadline 2026-02-13T02:24:51.431407+0000) 2026-02-13T02:25:06.952 INFO:journalctl@ceph.osd.9.trial011.stdout:Feb 13 02:25:06 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-9[43169]: 2026-02-13T02:25:06.484+0000 7fb6ba0a26c0 -1 osd.9 73 heartbeat_check: no reply from 10.20.193.78:6804 osd.2 since back 2026-02-13T02:24:31.931791+0000 front 2026-02-13T02:24:31.931884+0000 (oldest deadline 2026-02-13T02:24:56.031836+0000) 2026-02-13T02:25:06.952 INFO:journalctl@ceph.osd.9.trial011.stdout:Feb 13 02:25:06 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-9[43169]: 2026-02-13T02:25:06.484+0000 7fb6ba0a26c0 -1 osd.9 73 heartbeat_check: no reply from 10.20.193.11:6814 osd.3 since back 2026-02-13T02:24:37.132166+0000 front 2026-02-13T02:24:37.132150+0000 (oldest deadline 2026-02-13T02:25:02.432203+0000) 2026-02-13T02:25:07.541 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:07 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:07.191+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:23.112468+0000 front 2026-02-13T02:24:23.112473+0000 (oldest deadline 2026-02-13T02:24:47.212522+0000) 2026-02-13T02:25:07.542 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:07 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:07.191+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:27.212755+0000 front 2026-02-13T02:24:27.212693+0000 (oldest deadline 2026-02-13T02:24:53.112753+0000) 2026-02-13T02:25:07.542 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:07 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:07.191+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.78:6804 osd.2 since back 2026-02-13T02:24:34.213127+0000 front 2026-02-13T02:24:34.213138+0000 (oldest deadline 2026-02-13T02:24:54.713206+0000) 2026-02-13T02:25:07.542 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:07 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:07.191+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.60:6812 osd.4 since back 2026-02-13T02:24:41.113972+0000 front 2026-02-13T02:24:41.114178+0000 (oldest deadline 2026-02-13T02:25:06.413983+0000) 2026-02-13T02:25:07.542 INFO:journalctl@ceph.osd.8.trial078.stdout:Feb 13 02:25:07 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-8[32377]: 2026-02-13T02:25:07.377+0000 7f39ad2336c0 -1 osd.8 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:20.388100+0000 front 2026-02-13T02:24:20.388058+0000 (oldest deadline 2026-02-13T02:24:44.488088+0000) 2026-02-13T02:25:07.542 INFO:journalctl@ceph.osd.8.trial078.stdout:Feb 13 02:25:07 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-8[32377]: 2026-02-13T02:25:07.377+0000 7f39ad2336c0 -1 osd.8 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:27.988606+0000 front 2026-02-13T02:24:27.988677+0000 (oldest deadline 2026-02-13T02:24:50.888692+0000) 2026-02-13T02:25:07.543 INFO:journalctl@ceph.osd.8.trial078.stdout:Feb 13 02:25:07 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-8[32377]: 2026-02-13T02:25:07.377+0000 7f39ad2336c0 -1 osd.8 73 heartbeat_check: no reply from 10.20.193.78:6804 osd.2 since back 2026-02-13T02:24:33.789049+0000 front 2026-02-13T02:24:33.789067+0000 (oldest deadline 2026-02-13T02:24:56.689164+0000) 2026-02-13T02:25:07.543 INFO:journalctl@ceph.osd.8.trial078.stdout:Feb 13 02:25:07 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-8[32377]: 2026-02-13T02:25:07.377+0000 7f39ad2336c0 -1 osd.8 73 heartbeat_check: no reply from 10.20.193.11:6814 osd.3 since back 2026-02-13T02:24:37.789627+0000 front 2026-02-13T02:24:37.789602+0000 (oldest deadline 2026-02-13T02:25:03.689649+0000) 2026-02-13T02:25:07.543 INFO:journalctl@ceph.osd.8.trial078.stdout:Feb 13 02:25:07 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-8[32377]: 2026-02-13T02:25:07.377+0000 7f39ad2336c0 -1 osd.8 73 heartbeat_check: no reply from 10.20.193.60:6812 osd.4 since back 2026-02-13T02:24:45.390140+0000 front 2026-02-13T02:24:45.390073+0000 (oldest deadline 2026-02-13T02:25:06.490095+0000) 2026-02-13T02:25:07.750 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:07 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:25:07.455+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:21.576733+0000 front 2026-02-13T02:24:21.576946+0000 (oldest deadline 2026-02-13T02:24:43.876770+0000) 2026-02-13T02:25:07.750 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:07 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:25:07.455+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:23.876890+0000 front 2026-02-13T02:24:23.876928+0000 (oldest deadline 2026-02-13T02:24:49.777050+0000) 2026-02-13T02:25:07.750 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:07 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:25:07.455+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.78:6804 osd.2 since back 2026-02-13T02:24:31.977616+0000 front 2026-02-13T02:24:31.977623+0000 (oldest deadline 2026-02-13T02:24:57.277647+0000) 2026-02-13T02:25:07.751 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:07 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:25:07.455+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.11:6814 osd.3 since back 2026-02-13T02:24:38.978047+0000 front 2026-02-13T02:24:38.977983+0000 (oldest deadline 2026-02-13T02:25:03.077981+0000) 2026-02-13T02:25:07.952 INFO:journalctl@ceph.osd.9.trial011.stdout:Feb 13 02:25:07 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-9[43169]: 2026-02-13T02:25:07.463+0000 7fb6ba0a26c0 -1 osd.9 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:19.130671+0000 front 2026-02-13T02:24:19.130656+0000 (oldest deadline 2026-02-13T02:24:43.830795+0000) 2026-02-13T02:25:07.952 INFO:journalctl@ceph.osd.9.trial011.stdout:Feb 13 02:25:07 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-9[43169]: 2026-02-13T02:25:07.463+0000 7fb6ba0a26c0 -1 osd.9 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:28.531392+0000 front 2026-02-13T02:24:28.531406+0000 (oldest deadline 2026-02-13T02:24:51.431407+0000) 2026-02-13T02:25:07.952 INFO:journalctl@ceph.osd.9.trial011.stdout:Feb 13 02:25:07 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-9[43169]: 2026-02-13T02:25:07.463+0000 7fb6ba0a26c0 -1 osd.9 73 heartbeat_check: no reply from 10.20.193.78:6804 osd.2 since back 2026-02-13T02:24:31.931791+0000 front 2026-02-13T02:24:31.931884+0000 (oldest deadline 2026-02-13T02:24:56.031836+0000) 2026-02-13T02:25:07.952 INFO:journalctl@ceph.osd.9.trial011.stdout:Feb 13 02:25:07 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-9[43169]: 2026-02-13T02:25:07.463+0000 7fb6ba0a26c0 -1 osd.9 73 heartbeat_check: no reply from 10.20.193.11:6814 osd.3 since back 2026-02-13T02:24:37.132166+0000 front 2026-02-13T02:24:37.132150+0000 (oldest deadline 2026-02-13T02:25:02.432203+0000) 2026-02-13T02:25:08.123 INFO:journalctl@ceph.osd.8.trial078.stdout:Feb 13 02:25:07 trial078 podman[48086]: 2026-02-13 02:25:07.814557641 +0000 UTC m=+5.080822616 container died cf0d419341eaf9657946b862ea93d0a1f69de3465db2cca32c40a26859c4df12 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-8, license=BSD-3-Clause, version=10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_REF=wip-pdonnell-testing-20260210.171210, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.title=rockylinux, org.opencontainers.image.documentation=https://docs.ceph.com/, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, io.buildah.version=1.33.7, org.opencontainers.image.authors=Ceph Release Team , ceph=True, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.licenses=BSD-3-Clause, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, summary=Rocky Linux Base image, name=rockylinux) 2026-02-13T02:25:08.123 INFO:journalctl@ceph.osd.8.trial078.stdout:Feb 13 02:25:07 trial078 podman[48086]: 2026-02-13 02:25:07.823098975 +0000 UTC m=+5.089363950 container remove cf0d419341eaf9657946b862ea93d0a1f69de3465db2cca32c40a26859c4df12 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-8, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_REF=wip-pdonnell-testing-20260210.171210, name=rockylinux, license=BSD-3-Clause, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, OSD_FLAVOR=default, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.version=10, summary=Rocky Linux Base image, ceph=True, io.buildah.version=1.33.7, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.documentation=https://docs.ceph.com/, version=10, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.title=rockylinux) 2026-02-13T02:25:08.123 INFO:journalctl@ceph.osd.8.trial078.stdout:Feb 13 02:25:07 trial078 bash[48086]: ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-8 2026-02-13T02:25:08.124 INFO:journalctl@ceph.osd.8.trial078.stdout:Feb 13 02:25:07 trial078 podman[48209]: 2026-02-13 02:25:07.956371933 +0000 UTC m=+0.014034606 container create f3ce3aae699282c8a7920c749f03c51f2c2dd0eadd13a7392fd3dea787efc861 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-8-deactivate, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, vendor=Rocky Enterprise Software Foundation, name=rockylinux, version=10, org.opencontainers.image.licenses=BSD-3-Clause, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.version=10, summary=Rocky Linux Base image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, license=BSD-3-Clause, org.opencontainers.image.title=rockylinux, CEPH_REF=wip-pdonnell-testing-20260210.171210, ceph=True, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, io.buildah.version=1.33.7, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-13T02:25:08.124 INFO:journalctl@ceph.osd.8.trial078.stdout:Feb 13 02:25:07 trial078 podman[48209]: 2026-02-13 02:25:07.982049736 +0000 UTC m=+0.039712419 container init f3ce3aae699282c8a7920c749f03c51f2c2dd0eadd13a7392fd3dea787efc861 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-8-deactivate, org.opencontainers.image.title=rockylinux, version=10, OSD_FLAVOR=default, org.opencontainers.image.version=10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, ceph=True, summary=Rocky Linux Base image, license=BSD-3-Clause, io.buildah.version=1.33.7, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-pdonnell-testing-20260210.171210, vendor=Rocky Enterprise Software Foundation, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, name=rockylinux, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-13T02:25:08.124 INFO:journalctl@ceph.osd.8.trial078.stdout:Feb 13 02:25:07 trial078 podman[48209]: 2026-02-13 02:25:07.983819438 +0000 UTC m=+0.041482111 container start f3ce3aae699282c8a7920c749f03c51f2c2dd0eadd13a7392fd3dea787efc861 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-8-deactivate, summary=Rocky Linux Base image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, license=BSD-3-Clause, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.version=10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, version=10, OSD_FLAVOR=default, ceph=True, org.opencontainers.image.title=rockylinux, io.buildah.version=1.33.7, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.authors=Ceph Release Team , vendor=Rocky Enterprise Software Foundation, name=rockylinux, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-pdonnell-testing-20260210.171210) 2026-02-13T02:25:08.124 INFO:journalctl@ceph.osd.8.trial078.stdout:Feb 13 02:25:07 trial078 podman[48209]: 2026-02-13 02:25:07.984275552 +0000 UTC m=+0.041938235 container attach f3ce3aae699282c8a7920c749f03c51f2c2dd0eadd13a7392fd3dea787efc861 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-8-deactivate, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-pdonnell-testing-20260210.171210, vendor=Rocky Enterprise Software Foundation, summary=Rocky Linux Base image, license=BSD-3-Clause, org.opencontainers.image.title=rockylinux, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, version=10, OSD_FLAVOR=default, org.opencontainers.image.version=10, name=rockylinux, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, ceph=True, io.buildah.version=1.33.7) 2026-02-13T02:25:08.124 INFO:journalctl@ceph.osd.8.trial078.stdout:Feb 13 02:25:08 trial078 podman[48209]: 2026-02-13 02:25:07.950592367 +0000 UTC m=+0.008255060 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T02:25:08.124 INFO:journalctl@ceph.osd.8.trial078.stdout:Feb 13 02:25:08 trial078 podman[48209]: 2026-02-13 02:25:08.121245037 +0000 UTC m=+0.178907721 container died f3ce3aae699282c8a7920c749f03c51f2c2dd0eadd13a7392fd3dea787efc861 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-8-deactivate, summary=Rocky Linux Base image, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, version=10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, vendor=Rocky Enterprise Software Foundation, name=rockylinux, ceph=True, io.buildah.version=1.33.7, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default, license=BSD-3-Clause, org.opencontainers.image.title=rockylinux, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.version=10) 2026-02-13T02:25:08.168 DEBUG:teuthology.orchestra.run.trial078:> sudo pkill -f 'journalctl -f -n 0 -u ceph-fc631695-0881-11f1-899c-d404e6e7d460@osd.8.service' 2026-02-13T02:25:08.215 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T02:25:08.216 INFO:tasks.cephadm.osd.8:Stopped osd.8 2026-02-13T02:25:08.216 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2026-02-13T02:25:08.216 DEBUG:teuthology.orchestra.run.trial011:> sudo systemctl stop ceph-fc631695-0881-11f1-899c-d404e6e7d460@osd.9 2026-02-13T02:25:08.541 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:08 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:08.183+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:23.112468+0000 front 2026-02-13T02:24:23.112473+0000 (oldest deadline 2026-02-13T02:24:47.212522+0000) 2026-02-13T02:25:08.542 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:08 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:08.183+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:27.212755+0000 front 2026-02-13T02:24:27.212693+0000 (oldest deadline 2026-02-13T02:24:53.112753+0000) 2026-02-13T02:25:08.542 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:08 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:08.183+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.78:6804 osd.2 since back 2026-02-13T02:24:34.213127+0000 front 2026-02-13T02:24:34.213138+0000 (oldest deadline 2026-02-13T02:24:54.713206+0000) 2026-02-13T02:25:08.542 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:08 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:08.183+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.60:6812 osd.4 since back 2026-02-13T02:24:41.113972+0000 front 2026-02-13T02:24:41.114178+0000 (oldest deadline 2026-02-13T02:25:06.413983+0000) 2026-02-13T02:25:08.702 INFO:journalctl@ceph.osd.9.trial011.stdout:Feb 13 02:25:08 trial011 systemd[1]: Stopping ceph-fc631695-0881-11f1-899c-d404e6e7d460@osd.9.service - Ceph osd.9 for fc631695-0881-11f1-899c-d404e6e7d460... 2026-02-13T02:25:08.702 INFO:journalctl@ceph.osd.9.trial011.stdout:Feb 13 02:25:08 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-9[43169]: 2026-02-13T02:25:08.330+0000 7fb6be1cd6c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T02:25:08.702 INFO:journalctl@ceph.osd.9.trial011.stdout:Feb 13 02:25:08 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-9[43169]: 2026-02-13T02:25:08.330+0000 7fb6be1cd6c0 -1 osd.9 73 *** Got signal Terminated *** 2026-02-13T02:25:08.702 INFO:journalctl@ceph.osd.9.trial011.stdout:Feb 13 02:25:08 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-9[43169]: 2026-02-13T02:25:08.330+0000 7fb6be1cd6c0 -1 osd.9 73 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T02:25:08.702 INFO:journalctl@ceph.osd.9.trial011.stdout:Feb 13 02:25:08 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-9[43169]: 2026-02-13T02:25:08.449+0000 7fb6ba0a26c0 -1 osd.9 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:19.130671+0000 front 2026-02-13T02:24:19.130656+0000 (oldest deadline 2026-02-13T02:24:43.830795+0000) 2026-02-13T02:25:08.703 INFO:journalctl@ceph.osd.9.trial011.stdout:Feb 13 02:25:08 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-9[43169]: 2026-02-13T02:25:08.449+0000 7fb6ba0a26c0 -1 osd.9 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:28.531392+0000 front 2026-02-13T02:24:28.531406+0000 (oldest deadline 2026-02-13T02:24:51.431407+0000) 2026-02-13T02:25:08.703 INFO:journalctl@ceph.osd.9.trial011.stdout:Feb 13 02:25:08 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-9[43169]: 2026-02-13T02:25:08.449+0000 7fb6ba0a26c0 -1 osd.9 73 heartbeat_check: no reply from 10.20.193.78:6804 osd.2 since back 2026-02-13T02:24:31.931791+0000 front 2026-02-13T02:24:31.931884+0000 (oldest deadline 2026-02-13T02:24:56.031836+0000) 2026-02-13T02:25:08.703 INFO:journalctl@ceph.osd.9.trial011.stdout:Feb 13 02:25:08 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-9[43169]: 2026-02-13T02:25:08.449+0000 7fb6ba0a26c0 -1 osd.9 73 heartbeat_check: no reply from 10.20.193.11:6814 osd.3 since back 2026-02-13T02:24:37.132166+0000 front 2026-02-13T02:24:37.132150+0000 (oldest deadline 2026-02-13T02:25:02.432203+0000) 2026-02-13T02:25:09.000 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:08 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:25:08.502+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:21.576733+0000 front 2026-02-13T02:24:21.576946+0000 (oldest deadline 2026-02-13T02:24:43.876770+0000) 2026-02-13T02:25:09.000 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:08 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:25:08.502+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:23.876890+0000 front 2026-02-13T02:24:23.876928+0000 (oldest deadline 2026-02-13T02:24:49.777050+0000) 2026-02-13T02:25:09.001 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:08 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:25:08.502+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.78:6804 osd.2 since back 2026-02-13T02:24:31.977616+0000 front 2026-02-13T02:24:31.977623+0000 (oldest deadline 2026-02-13T02:24:57.277647+0000) 2026-02-13T02:25:09.001 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:08 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:25:08.502+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.11:6814 osd.3 since back 2026-02-13T02:24:38.978047+0000 front 2026-02-13T02:24:38.977983+0000 (oldest deadline 2026-02-13T02:25:03.077981+0000) 2026-02-13T02:25:09.001 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:08 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:25:08.502+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.60:6812 osd.4 since back 2026-02-13T02:24:44.778320+0000 front 2026-02-13T02:24:44.778314+0000 (oldest deadline 2026-02-13T02:25:07.678459+0000) 2026-02-13T02:25:09.541 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:09 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:09.158+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:23.112468+0000 front 2026-02-13T02:24:23.112473+0000 (oldest deadline 2026-02-13T02:24:47.212522+0000) 2026-02-13T02:25:09.542 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:09 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:09.158+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:27.212755+0000 front 2026-02-13T02:24:27.212693+0000 (oldest deadline 2026-02-13T02:24:53.112753+0000) 2026-02-13T02:25:09.542 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:09 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:09.158+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.78:6804 osd.2 since back 2026-02-13T02:24:34.213127+0000 front 2026-02-13T02:24:34.213138+0000 (oldest deadline 2026-02-13T02:24:54.713206+0000) 2026-02-13T02:25:09.542 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:09 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:09.158+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.60:6812 osd.4 since back 2026-02-13T02:24:41.113972+0000 front 2026-02-13T02:24:41.114178+0000 (oldest deadline 2026-02-13T02:25:06.413983+0000) 2026-02-13T02:25:09.953 INFO:journalctl@ceph.osd.9.trial011.stdout:Feb 13 02:25:09 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-9[43169]: 2026-02-13T02:25:09.458+0000 7fb6ba0a26c0 -1 osd.9 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:19.130671+0000 front 2026-02-13T02:24:19.130656+0000 (oldest deadline 2026-02-13T02:24:43.830795+0000) 2026-02-13T02:25:09.953 INFO:journalctl@ceph.osd.9.trial011.stdout:Feb 13 02:25:09 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-9[43169]: 2026-02-13T02:25:09.458+0000 7fb6ba0a26c0 -1 osd.9 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:28.531392+0000 front 2026-02-13T02:24:28.531406+0000 (oldest deadline 2026-02-13T02:24:51.431407+0000) 2026-02-13T02:25:09.953 INFO:journalctl@ceph.osd.9.trial011.stdout:Feb 13 02:25:09 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-9[43169]: 2026-02-13T02:25:09.458+0000 7fb6ba0a26c0 -1 osd.9 73 heartbeat_check: no reply from 10.20.193.78:6804 osd.2 since back 2026-02-13T02:24:31.931791+0000 front 2026-02-13T02:24:31.931884+0000 (oldest deadline 2026-02-13T02:24:56.031836+0000) 2026-02-13T02:25:09.954 INFO:journalctl@ceph.osd.9.trial011.stdout:Feb 13 02:25:09 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-9[43169]: 2026-02-13T02:25:09.458+0000 7fb6ba0a26c0 -1 osd.9 73 heartbeat_check: no reply from 10.20.193.11:6814 osd.3 since back 2026-02-13T02:24:37.132166+0000 front 2026-02-13T02:24:37.132150+0000 (oldest deadline 2026-02-13T02:25:02.432203+0000) 2026-02-13T02:25:10.000 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:09 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:25:09.509+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:21.576733+0000 front 2026-02-13T02:24:21.576946+0000 (oldest deadline 2026-02-13T02:24:43.876770+0000) 2026-02-13T02:25:10.000 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:09 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:25:09.509+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:23.876890+0000 front 2026-02-13T02:24:23.876928+0000 (oldest deadline 2026-02-13T02:24:49.777050+0000) 2026-02-13T02:25:10.001 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:09 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:25:09.509+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.78:6804 osd.2 since back 2026-02-13T02:24:31.977616+0000 front 2026-02-13T02:24:31.977623+0000 (oldest deadline 2026-02-13T02:24:57.277647+0000) 2026-02-13T02:25:10.001 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:09 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:25:09.509+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.11:6814 osd.3 since back 2026-02-13T02:24:38.978047+0000 front 2026-02-13T02:24:38.977983+0000 (oldest deadline 2026-02-13T02:25:03.077981+0000) 2026-02-13T02:25:10.001 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:09 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:25:09.509+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.60:6812 osd.4 since back 2026-02-13T02:24:44.778320+0000 front 2026-02-13T02:24:44.778314+0000 (oldest deadline 2026-02-13T02:25:07.678459+0000) 2026-02-13T02:25:10.541 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:10 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:10.145+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:23.112468+0000 front 2026-02-13T02:24:23.112473+0000 (oldest deadline 2026-02-13T02:24:47.212522+0000) 2026-02-13T02:25:10.542 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:10 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:10.145+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:27.212755+0000 front 2026-02-13T02:24:27.212693+0000 (oldest deadline 2026-02-13T02:24:53.112753+0000) 2026-02-13T02:25:10.542 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:10 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:10.145+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.78:6804 osd.2 since back 2026-02-13T02:24:34.213127+0000 front 2026-02-13T02:24:34.213138+0000 (oldest deadline 2026-02-13T02:24:54.713206+0000) 2026-02-13T02:25:10.542 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:10 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:10.145+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.60:6812 osd.4 since back 2026-02-13T02:24:41.113972+0000 front 2026-02-13T02:24:41.114178+0000 (oldest deadline 2026-02-13T02:25:06.413983+0000) 2026-02-13T02:25:10.702 INFO:journalctl@ceph.osd.9.trial011.stdout:Feb 13 02:25:10 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-9[43169]: 2026-02-13T02:25:10.445+0000 7fb6ba0a26c0 -1 osd.9 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:19.130671+0000 front 2026-02-13T02:24:19.130656+0000 (oldest deadline 2026-02-13T02:24:43.830795+0000) 2026-02-13T02:25:10.702 INFO:journalctl@ceph.osd.9.trial011.stdout:Feb 13 02:25:10 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-9[43169]: 2026-02-13T02:25:10.445+0000 7fb6ba0a26c0 -1 osd.9 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:28.531392+0000 front 2026-02-13T02:24:28.531406+0000 (oldest deadline 2026-02-13T02:24:51.431407+0000) 2026-02-13T02:25:10.702 INFO:journalctl@ceph.osd.9.trial011.stdout:Feb 13 02:25:10 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-9[43169]: 2026-02-13T02:25:10.445+0000 7fb6ba0a26c0 -1 osd.9 73 heartbeat_check: no reply from 10.20.193.78:6804 osd.2 since back 2026-02-13T02:24:31.931791+0000 front 2026-02-13T02:24:31.931884+0000 (oldest deadline 2026-02-13T02:24:56.031836+0000) 2026-02-13T02:25:10.702 INFO:journalctl@ceph.osd.9.trial011.stdout:Feb 13 02:25:10 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-9[43169]: 2026-02-13T02:25:10.445+0000 7fb6ba0a26c0 -1 osd.9 73 heartbeat_check: no reply from 10.20.193.11:6814 osd.3 since back 2026-02-13T02:24:37.132166+0000 front 2026-02-13T02:24:37.132150+0000 (oldest deadline 2026-02-13T02:25:02.432203+0000) 2026-02-13T02:25:11.000 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:10 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:25:10.540+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:21.576733+0000 front 2026-02-13T02:24:21.576946+0000 (oldest deadline 2026-02-13T02:24:43.876770+0000) 2026-02-13T02:25:11.000 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:10 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:25:10.540+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:23.876890+0000 front 2026-02-13T02:24:23.876928+0000 (oldest deadline 2026-02-13T02:24:49.777050+0000) 2026-02-13T02:25:11.001 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:10 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:25:10.540+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.78:6804 osd.2 since back 2026-02-13T02:24:31.977616+0000 front 2026-02-13T02:24:31.977623+0000 (oldest deadline 2026-02-13T02:24:57.277647+0000) 2026-02-13T02:25:11.001 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:10 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:25:10.540+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.11:6814 osd.3 since back 2026-02-13T02:24:38.978047+0000 front 2026-02-13T02:24:38.977983+0000 (oldest deadline 2026-02-13T02:25:03.077981+0000) 2026-02-13T02:25:11.001 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:10 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:25:10.540+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.60:6812 osd.4 since back 2026-02-13T02:24:44.778320+0000 front 2026-02-13T02:24:44.778314+0000 (oldest deadline 2026-02-13T02:25:07.678459+0000) 2026-02-13T02:25:11.541 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:11 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:11.103+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:23.112468+0000 front 2026-02-13T02:24:23.112473+0000 (oldest deadline 2026-02-13T02:24:47.212522+0000) 2026-02-13T02:25:11.542 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:11 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:11.103+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:27.212755+0000 front 2026-02-13T02:24:27.212693+0000 (oldest deadline 2026-02-13T02:24:53.112753+0000) 2026-02-13T02:25:11.542 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:11 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:11.103+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.78:6804 osd.2 since back 2026-02-13T02:24:34.213127+0000 front 2026-02-13T02:24:34.213138+0000 (oldest deadline 2026-02-13T02:24:54.713206+0000) 2026-02-13T02:25:11.542 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:11 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:11.103+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.60:6812 osd.4 since back 2026-02-13T02:24:41.113972+0000 front 2026-02-13T02:24:41.114178+0000 (oldest deadline 2026-02-13T02:25:06.413983+0000) 2026-02-13T02:25:11.702 INFO:journalctl@ceph.osd.9.trial011.stdout:Feb 13 02:25:11 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-9[43169]: 2026-02-13T02:25:11.424+0000 7fb6ba0a26c0 -1 osd.9 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:19.130671+0000 front 2026-02-13T02:24:19.130656+0000 (oldest deadline 2026-02-13T02:24:43.830795+0000) 2026-02-13T02:25:11.702 INFO:journalctl@ceph.osd.9.trial011.stdout:Feb 13 02:25:11 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-9[43169]: 2026-02-13T02:25:11.424+0000 7fb6ba0a26c0 -1 osd.9 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:28.531392+0000 front 2026-02-13T02:24:28.531406+0000 (oldest deadline 2026-02-13T02:24:51.431407+0000) 2026-02-13T02:25:11.702 INFO:journalctl@ceph.osd.9.trial011.stdout:Feb 13 02:25:11 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-9[43169]: 2026-02-13T02:25:11.424+0000 7fb6ba0a26c0 -1 osd.9 73 heartbeat_check: no reply from 10.20.193.78:6804 osd.2 since back 2026-02-13T02:24:31.931791+0000 front 2026-02-13T02:24:31.931884+0000 (oldest deadline 2026-02-13T02:24:56.031836+0000) 2026-02-13T02:25:11.702 INFO:journalctl@ceph.osd.9.trial011.stdout:Feb 13 02:25:11 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-9[43169]: 2026-02-13T02:25:11.424+0000 7fb6ba0a26c0 -1 osd.9 73 heartbeat_check: no reply from 10.20.193.11:6814 osd.3 since back 2026-02-13T02:24:37.132166+0000 front 2026-02-13T02:24:37.132150+0000 (oldest deadline 2026-02-13T02:25:02.432203+0000) 2026-02-13T02:25:12.000 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:11 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:25:11.501+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:21.576733+0000 front 2026-02-13T02:24:21.576946+0000 (oldest deadline 2026-02-13T02:24:43.876770+0000) 2026-02-13T02:25:12.000 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:11 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:25:11.501+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:23.876890+0000 front 2026-02-13T02:24:23.876928+0000 (oldest deadline 2026-02-13T02:24:49.777050+0000) 2026-02-13T02:25:12.001 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:11 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:25:11.501+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.78:6804 osd.2 since back 2026-02-13T02:24:31.977616+0000 front 2026-02-13T02:24:31.977623+0000 (oldest deadline 2026-02-13T02:24:57.277647+0000) 2026-02-13T02:25:12.001 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:11 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:25:11.501+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.11:6814 osd.3 since back 2026-02-13T02:24:38.978047+0000 front 2026-02-13T02:24:38.977983+0000 (oldest deadline 2026-02-13T02:25:03.077981+0000) 2026-02-13T02:25:12.001 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:11 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:25:11.501+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.60:6812 osd.4 since back 2026-02-13T02:24:44.778320+0000 front 2026-02-13T02:24:44.778314+0000 (oldest deadline 2026-02-13T02:25:07.678459+0000) 2026-02-13T02:25:12.541 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:12 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:12.147+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:23.112468+0000 front 2026-02-13T02:24:23.112473+0000 (oldest deadline 2026-02-13T02:24:47.212522+0000) 2026-02-13T02:25:12.542 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:12 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:12.147+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:27.212755+0000 front 2026-02-13T02:24:27.212693+0000 (oldest deadline 2026-02-13T02:24:53.112753+0000) 2026-02-13T02:25:12.542 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:12 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:12.147+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.78:6804 osd.2 since back 2026-02-13T02:24:34.213127+0000 front 2026-02-13T02:24:34.213138+0000 (oldest deadline 2026-02-13T02:24:54.713206+0000) 2026-02-13T02:25:12.542 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:12 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:12.147+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.60:6812 osd.4 since back 2026-02-13T02:24:41.113972+0000 front 2026-02-13T02:24:41.114178+0000 (oldest deadline 2026-02-13T02:25:06.413983+0000) 2026-02-13T02:25:12.702 INFO:journalctl@ceph.osd.9.trial011.stdout:Feb 13 02:25:12 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-9[43169]: 2026-02-13T02:25:12.381+0000 7fb6ba0a26c0 -1 osd.9 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:19.130671+0000 front 2026-02-13T02:24:19.130656+0000 (oldest deadline 2026-02-13T02:24:43.830795+0000) 2026-02-13T02:25:12.702 INFO:journalctl@ceph.osd.9.trial011.stdout:Feb 13 02:25:12 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-9[43169]: 2026-02-13T02:25:12.381+0000 7fb6ba0a26c0 -1 osd.9 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:28.531392+0000 front 2026-02-13T02:24:28.531406+0000 (oldest deadline 2026-02-13T02:24:51.431407+0000) 2026-02-13T02:25:12.702 INFO:journalctl@ceph.osd.9.trial011.stdout:Feb 13 02:25:12 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-9[43169]: 2026-02-13T02:25:12.381+0000 7fb6ba0a26c0 -1 osd.9 73 heartbeat_check: no reply from 10.20.193.78:6804 osd.2 since back 2026-02-13T02:24:31.931791+0000 front 2026-02-13T02:24:31.931884+0000 (oldest deadline 2026-02-13T02:24:56.031836+0000) 2026-02-13T02:25:12.702 INFO:journalctl@ceph.osd.9.trial011.stdout:Feb 13 02:25:12 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-9[43169]: 2026-02-13T02:25:12.381+0000 7fb6ba0a26c0 -1 osd.9 73 heartbeat_check: no reply from 10.20.193.11:6814 osd.3 since back 2026-02-13T02:24:37.132166+0000 front 2026-02-13T02:24:37.132150+0000 (oldest deadline 2026-02-13T02:25:02.432203+0000) 2026-02-13T02:25:12.702 INFO:journalctl@ceph.osd.9.trial011.stdout:Feb 13 02:25:12 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-9[43169]: 2026-02-13T02:25:12.381+0000 7fb6ba0a26c0 -1 osd.9 73 heartbeat_check: no reply from 10.20.193.78:6812 osd.5 since back 2026-02-13T02:24:45.932852+0000 front 2026-02-13T02:24:45.932779+0000 (oldest deadline 2026-02-13T02:25:11.832683+0000) 2026-02-13T02:25:12.750 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:12 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:25:12.465+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:21.576733+0000 front 2026-02-13T02:24:21.576946+0000 (oldest deadline 2026-02-13T02:24:43.876770+0000) 2026-02-13T02:25:12.750 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:12 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:25:12.465+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:23.876890+0000 front 2026-02-13T02:24:23.876928+0000 (oldest deadline 2026-02-13T02:24:49.777050+0000) 2026-02-13T02:25:12.750 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:12 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:25:12.465+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.78:6804 osd.2 since back 2026-02-13T02:24:31.977616+0000 front 2026-02-13T02:24:31.977623+0000 (oldest deadline 2026-02-13T02:24:57.277647+0000) 2026-02-13T02:25:12.750 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:12 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:25:12.465+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.11:6814 osd.3 since back 2026-02-13T02:24:38.978047+0000 front 2026-02-13T02:24:38.977983+0000 (oldest deadline 2026-02-13T02:25:03.077981+0000) 2026-02-13T02:25:12.751 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:12 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:25:12.465+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.60:6812 osd.4 since back 2026-02-13T02:24:44.778320+0000 front 2026-02-13T02:24:44.778314+0000 (oldest deadline 2026-02-13T02:25:07.678459+0000) 2026-02-13T02:25:13.541 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:13 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:13.109+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:23.112468+0000 front 2026-02-13T02:24:23.112473+0000 (oldest deadline 2026-02-13T02:24:47.212522+0000) 2026-02-13T02:25:13.542 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:13 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:13.109+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:27.212755+0000 front 2026-02-13T02:24:27.212693+0000 (oldest deadline 2026-02-13T02:24:53.112753+0000) 2026-02-13T02:25:13.542 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:13 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:13.109+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.78:6804 osd.2 since back 2026-02-13T02:24:34.213127+0000 front 2026-02-13T02:24:34.213138+0000 (oldest deadline 2026-02-13T02:24:54.713206+0000) 2026-02-13T02:25:13.542 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:13 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:13.109+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.60:6812 osd.4 since back 2026-02-13T02:24:41.113972+0000 front 2026-02-13T02:24:41.114178+0000 (oldest deadline 2026-02-13T02:25:06.413983+0000) 2026-02-13T02:25:13.702 INFO:journalctl@ceph.osd.9.trial011.stdout:Feb 13 02:25:13 trial011 podman[67243]: 2026-02-13 02:25:13.421026552 +0000 UTC m=+5.100970714 container died 7aeb3c6b3c1b7927d9347c5be6cfa69d6fdd7f55b52ba687155ddfdf2dc34eb9 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-9, ceph=True, io.buildah.version=1.33.7, name=rockylinux, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.authors=Ceph Release Team , version=10, OSD_FLAVOR=default, summary=Rocky Linux Base image, org.opencontainers.image.title=rockylinux, vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, CEPH_REF=wip-pdonnell-testing-20260210.171210, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.version=10, license=BSD-3-Clause, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-13T02:25:13.703 INFO:journalctl@ceph.osd.9.trial011.stdout:Feb 13 02:25:13 trial011 podman[67243]: 2026-02-13 02:25:13.428583949 +0000 UTC m=+5.108528111 container remove 7aeb3c6b3c1b7927d9347c5be6cfa69d6fdd7f55b52ba687155ddfdf2dc34eb9 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-9, summary=Rocky Linux Base image, OSD_FLAVOR=default, ceph=True, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-pdonnell-testing-20260210.171210, license=BSD-3-Clause, name=rockylinux, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.version=10, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.title=rockylinux, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, vendor=Rocky Enterprise Software Foundation, version=10, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, io.buildah.version=1.33.7) 2026-02-13T02:25:13.703 INFO:journalctl@ceph.osd.9.trial011.stdout:Feb 13 02:25:13 trial011 bash[67243]: ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-9 2026-02-13T02:25:13.703 INFO:journalctl@ceph.osd.9.trial011.stdout:Feb 13 02:25:13 trial011 podman[67369]: 2026-02-13 02:25:13.566998808 +0000 UTC m=+0.013929284 container create 37a8670d0c6b337a80a5ca95a358781cd720efaabaabb595dd483d91f7535ab4 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-9-deactivate, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.documentation=https://docs.ceph.com/, vendor=Rocky Enterprise Software Foundation, name=rockylinux, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, io.buildah.version=1.33.7, org.opencontainers.image.title=rockylinux, summary=Rocky Linux Base image, org.opencontainers.image.licenses=BSD-3-Clause, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_REF=wip-pdonnell-testing-20260210.171210, ceph=True, org.opencontainers.image.authors=Ceph Release Team , license=BSD-3-Clause, version=10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.version=10) 2026-02-13T02:25:13.703 INFO:journalctl@ceph.osd.9.trial011.stdout:Feb 13 02:25:13 trial011 podman[67369]: 2026-02-13 02:25:13.596986649 +0000 UTC m=+0.043917125 container init 37a8670d0c6b337a80a5ca95a358781cd720efaabaabb595dd483d91f7535ab4 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-9-deactivate, org.opencontainers.image.authors=Ceph Release Team , license=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.title=rockylinux, vendor=Rocky Enterprise Software Foundation, name=rockylinux, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, CEPH_REF=wip-pdonnell-testing-20260210.171210, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.version=10, OSD_FLAVOR=default, summary=Rocky Linux Base image, version=10, io.buildah.version=1.33.7) 2026-02-13T02:25:13.703 INFO:journalctl@ceph.osd.9.trial011.stdout:Feb 13 02:25:13 trial011 podman[67369]: 2026-02-13 02:25:13.598814154 +0000 UTC m=+0.045744640 container start 37a8670d0c6b337a80a5ca95a358781cd720efaabaabb595dd483d91f7535ab4 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-9-deactivate, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.title=rockylinux, summary=Rocky Linux Base image, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.version=10, OSD_FLAVOR=default, io.buildah.version=1.33.7, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, license=BSD-3-Clause, org.opencontainers.image.documentation=https://docs.ceph.com/, name=rockylinux, ceph=True, version=10, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f) 2026-02-13T02:25:13.703 INFO:journalctl@ceph.osd.9.trial011.stdout:Feb 13 02:25:13 trial011 podman[67369]: 2026-02-13 02:25:13.59932936 +0000 UTC m=+0.046259846 container attach 37a8670d0c6b337a80a5ca95a358781cd720efaabaabb595dd483d91f7535ab4 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-9-deactivate, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, org.opencontainers.image.authors=Ceph Release Team , summary=Rocky Linux Base image, license=BSD-3-Clause, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, io.buildah.version=1.33.7, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.title=rockylinux, vendor=Rocky Enterprise Software Foundation, version=10, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.version=10, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, name=rockylinux) 2026-02-13T02:25:13.703 INFO:journalctl@ceph.osd.9.trial011.stdout:Feb 13 02:25:13 trial011 podman[67369]: 2026-02-13 02:25:13.561187023 +0000 UTC m=+0.008117509 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T02:25:13.750 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:13 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:25:13.476+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:21.576733+0000 front 2026-02-13T02:24:21.576946+0000 (oldest deadline 2026-02-13T02:24:43.876770+0000) 2026-02-13T02:25:13.750 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:13 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:25:13.476+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:23.876890+0000 front 2026-02-13T02:24:23.876928+0000 (oldest deadline 2026-02-13T02:24:49.777050+0000) 2026-02-13T02:25:13.750 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:13 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:25:13.476+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.78:6804 osd.2 since back 2026-02-13T02:24:31.977616+0000 front 2026-02-13T02:24:31.977623+0000 (oldest deadline 2026-02-13T02:24:57.277647+0000) 2026-02-13T02:25:13.750 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:13 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:25:13.476+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.11:6814 osd.3 since back 2026-02-13T02:24:38.978047+0000 front 2026-02-13T02:24:38.977983+0000 (oldest deadline 2026-02-13T02:25:03.077981+0000) 2026-02-13T02:25:13.751 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:13 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:25:13.476+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.60:6812 osd.4 since back 2026-02-13T02:24:44.778320+0000 front 2026-02-13T02:24:44.778314+0000 (oldest deadline 2026-02-13T02:25:07.678459+0000) 2026-02-13T02:25:13.768 DEBUG:teuthology.orchestra.run.trial011:> sudo pkill -f 'journalctl -f -n 0 -u ceph-fc631695-0881-11f1-899c-d404e6e7d460@osd.9.service' 2026-02-13T02:25:13.814 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T02:25:13.815 INFO:tasks.cephadm.osd.9:Stopped osd.9 2026-02-13T02:25:13.815 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2026-02-13T02:25:13.815 DEBUG:teuthology.orchestra.run.trial060:> sudo systemctl stop ceph-fc631695-0881-11f1-899c-d404e6e7d460@osd.10 2026-02-13T02:25:14.250 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:13 trial060 systemd[1]: Stopping ceph-fc631695-0881-11f1-899c-d404e6e7d460@osd.10.service - Ceph osd.10 for fc631695-0881-11f1-899c-d404e6e7d460... 2026-02-13T02:25:14.251 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:13 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:25:13.925+0000 7fe0601906c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T02:25:14.251 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:13 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:25:13.925+0000 7fe0601906c0 -1 osd.10 73 *** Got signal Terminated *** 2026-02-13T02:25:14.251 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:13 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:25:13.925+0000 7fe0601906c0 -1 osd.10 73 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T02:25:14.541 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:14 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:14.090+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:23.112468+0000 front 2026-02-13T02:24:23.112473+0000 (oldest deadline 2026-02-13T02:24:47.212522+0000) 2026-02-13T02:25:14.542 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:14 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:14.090+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:27.212755+0000 front 2026-02-13T02:24:27.212693+0000 (oldest deadline 2026-02-13T02:24:53.112753+0000) 2026-02-13T02:25:14.542 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:14 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:14.090+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.78:6804 osd.2 since back 2026-02-13T02:24:34.213127+0000 front 2026-02-13T02:24:34.213138+0000 (oldest deadline 2026-02-13T02:24:54.713206+0000) 2026-02-13T02:25:14.542 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:14 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:14.090+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.60:6812 osd.4 since back 2026-02-13T02:24:41.113972+0000 front 2026-02-13T02:24:41.114178+0000 (oldest deadline 2026-02-13T02:25:06.413983+0000) 2026-02-13T02:25:14.542 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:14 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:14.090+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.78:6812 osd.5 since back 2026-02-13T02:24:48.714330+0000 front 2026-02-13T02:24:48.714349+0000 (oldest deadline 2026-02-13T02:25:13.414416+0000) 2026-02-13T02:25:14.750 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:14 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:25:14.436+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:21.576733+0000 front 2026-02-13T02:24:21.576946+0000 (oldest deadline 2026-02-13T02:24:43.876770+0000) 2026-02-13T02:25:14.750 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:14 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:25:14.436+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:23.876890+0000 front 2026-02-13T02:24:23.876928+0000 (oldest deadline 2026-02-13T02:24:49.777050+0000) 2026-02-13T02:25:14.751 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:14 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:25:14.436+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.78:6804 osd.2 since back 2026-02-13T02:24:31.977616+0000 front 2026-02-13T02:24:31.977623+0000 (oldest deadline 2026-02-13T02:24:57.277647+0000) 2026-02-13T02:25:14.751 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:14 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:25:14.436+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.11:6814 osd.3 since back 2026-02-13T02:24:38.978047+0000 front 2026-02-13T02:24:38.977983+0000 (oldest deadline 2026-02-13T02:25:03.077981+0000) 2026-02-13T02:25:14.751 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:14 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:25:14.436+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.60:6812 osd.4 since back 2026-02-13T02:24:44.778320+0000 front 2026-02-13T02:24:44.778314+0000 (oldest deadline 2026-02-13T02:25:07.678459+0000) 2026-02-13T02:25:14.751 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:14 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:25:14.436+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.78:6812 osd.5 since back 2026-02-13T02:24:48.178924+0000 front 2026-02-13T02:24:48.179015+0000 (oldest deadline 2026-02-13T02:25:13.478939+0000) 2026-02-13T02:25:15.442 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:15 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:15.106+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:23.112468+0000 front 2026-02-13T02:24:23.112473+0000 (oldest deadline 2026-02-13T02:24:47.212522+0000) 2026-02-13T02:25:15.443 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:15 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:15.106+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:27.212755+0000 front 2026-02-13T02:24:27.212693+0000 (oldest deadline 2026-02-13T02:24:53.112753+0000) 2026-02-13T02:25:15.443 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:15 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:15.106+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.78:6804 osd.2 since back 2026-02-13T02:24:34.213127+0000 front 2026-02-13T02:24:34.213138+0000 (oldest deadline 2026-02-13T02:24:54.713206+0000) 2026-02-13T02:25:15.443 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:15 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:15.106+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.60:6812 osd.4 since back 2026-02-13T02:24:41.113972+0000 front 2026-02-13T02:24:41.114178+0000 (oldest deadline 2026-02-13T02:25:06.413983+0000) 2026-02-13T02:25:15.443 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:15 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:15.106+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.78:6812 osd.5 since back 2026-02-13T02:24:48.714330+0000 front 2026-02-13T02:24:48.714349+0000 (oldest deadline 2026-02-13T02:25:13.414416+0000) 2026-02-13T02:25:15.750 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:15 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:25:15.401+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:21.576733+0000 front 2026-02-13T02:24:21.576946+0000 (oldest deadline 2026-02-13T02:24:43.876770+0000) 2026-02-13T02:25:15.750 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:15 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:25:15.401+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:23.876890+0000 front 2026-02-13T02:24:23.876928+0000 (oldest deadline 2026-02-13T02:24:49.777050+0000) 2026-02-13T02:25:15.751 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:15 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:25:15.401+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.78:6804 osd.2 since back 2026-02-13T02:24:31.977616+0000 front 2026-02-13T02:24:31.977623+0000 (oldest deadline 2026-02-13T02:24:57.277647+0000) 2026-02-13T02:25:15.751 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:15 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:25:15.401+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.11:6814 osd.3 since back 2026-02-13T02:24:38.978047+0000 front 2026-02-13T02:24:38.977983+0000 (oldest deadline 2026-02-13T02:25:03.077981+0000) 2026-02-13T02:25:15.751 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:15 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:25:15.401+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.60:6812 osd.4 since back 2026-02-13T02:24:44.778320+0000 front 2026-02-13T02:24:44.778314+0000 (oldest deadline 2026-02-13T02:25:07.678459+0000) 2026-02-13T02:25:15.751 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:15 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:25:15.401+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.78:6812 osd.5 since back 2026-02-13T02:24:48.178924+0000 front 2026-02-13T02:24:48.179015+0000 (oldest deadline 2026-02-13T02:25:13.478939+0000) 2026-02-13T02:25:16.541 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:16 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:16.087+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:23.112468+0000 front 2026-02-13T02:24:23.112473+0000 (oldest deadline 2026-02-13T02:24:47.212522+0000) 2026-02-13T02:25:16.542 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:16 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:16.087+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:27.212755+0000 front 2026-02-13T02:24:27.212693+0000 (oldest deadline 2026-02-13T02:24:53.112753+0000) 2026-02-13T02:25:16.542 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:16 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:16.087+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.78:6804 osd.2 since back 2026-02-13T02:24:34.213127+0000 front 2026-02-13T02:24:34.213138+0000 (oldest deadline 2026-02-13T02:24:54.713206+0000) 2026-02-13T02:25:16.542 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:16 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:16.087+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.60:6812 osd.4 since back 2026-02-13T02:24:41.113972+0000 front 2026-02-13T02:24:41.114178+0000 (oldest deadline 2026-02-13T02:25:06.413983+0000) 2026-02-13T02:25:16.542 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:16 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:16.087+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.78:6812 osd.5 since back 2026-02-13T02:24:48.714330+0000 front 2026-02-13T02:24:48.714349+0000 (oldest deadline 2026-02-13T02:25:13.414416+0000) 2026-02-13T02:25:16.750 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:16 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:25:16.450+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:21.576733+0000 front 2026-02-13T02:24:21.576946+0000 (oldest deadline 2026-02-13T02:24:43.876770+0000) 2026-02-13T02:25:16.750 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:16 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:25:16.450+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:23.876890+0000 front 2026-02-13T02:24:23.876928+0000 (oldest deadline 2026-02-13T02:24:49.777050+0000) 2026-02-13T02:25:16.750 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:16 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:25:16.450+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.78:6804 osd.2 since back 2026-02-13T02:24:31.977616+0000 front 2026-02-13T02:24:31.977623+0000 (oldest deadline 2026-02-13T02:24:57.277647+0000) 2026-02-13T02:25:16.751 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:16 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:25:16.450+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.11:6814 osd.3 since back 2026-02-13T02:24:38.978047+0000 front 2026-02-13T02:24:38.977983+0000 (oldest deadline 2026-02-13T02:25:03.077981+0000) 2026-02-13T02:25:16.751 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:16 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:25:16.450+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.60:6812 osd.4 since back 2026-02-13T02:24:44.778320+0000 front 2026-02-13T02:24:44.778314+0000 (oldest deadline 2026-02-13T02:25:07.678459+0000) 2026-02-13T02:25:16.751 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:16 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:25:16.450+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.78:6812 osd.5 since back 2026-02-13T02:24:48.178924+0000 front 2026-02-13T02:24:48.179015+0000 (oldest deadline 2026-02-13T02:25:13.478939+0000) 2026-02-13T02:25:17.541 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:17 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:17.100+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:23.112468+0000 front 2026-02-13T02:24:23.112473+0000 (oldest deadline 2026-02-13T02:24:47.212522+0000) 2026-02-13T02:25:17.542 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:17 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:17.100+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:27.212755+0000 front 2026-02-13T02:24:27.212693+0000 (oldest deadline 2026-02-13T02:24:53.112753+0000) 2026-02-13T02:25:17.542 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:17 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:17.100+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.78:6804 osd.2 since back 2026-02-13T02:24:34.213127+0000 front 2026-02-13T02:24:34.213138+0000 (oldest deadline 2026-02-13T02:24:54.713206+0000) 2026-02-13T02:25:17.542 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:17 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:17.100+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.60:6812 osd.4 since back 2026-02-13T02:24:41.113972+0000 front 2026-02-13T02:24:41.114178+0000 (oldest deadline 2026-02-13T02:25:06.413983+0000) 2026-02-13T02:25:17.542 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:17 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:17.100+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.78:6812 osd.5 since back 2026-02-13T02:24:48.714330+0000 front 2026-02-13T02:24:48.714349+0000 (oldest deadline 2026-02-13T02:25:13.414416+0000) 2026-02-13T02:25:17.750 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:17 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:25:17.419+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:21.576733+0000 front 2026-02-13T02:24:21.576946+0000 (oldest deadline 2026-02-13T02:24:43.876770+0000) 2026-02-13T02:25:17.750 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:17 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:25:17.419+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:23.876890+0000 front 2026-02-13T02:24:23.876928+0000 (oldest deadline 2026-02-13T02:24:49.777050+0000) 2026-02-13T02:25:17.750 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:17 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:25:17.419+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.78:6804 osd.2 since back 2026-02-13T02:24:31.977616+0000 front 2026-02-13T02:24:31.977623+0000 (oldest deadline 2026-02-13T02:24:57.277647+0000) 2026-02-13T02:25:17.751 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:17 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:25:17.419+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.11:6814 osd.3 since back 2026-02-13T02:24:38.978047+0000 front 2026-02-13T02:24:38.977983+0000 (oldest deadline 2026-02-13T02:25:03.077981+0000) 2026-02-13T02:25:17.751 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:17 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:25:17.419+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.60:6812 osd.4 since back 2026-02-13T02:24:44.778320+0000 front 2026-02-13T02:24:44.778314+0000 (oldest deadline 2026-02-13T02:25:07.678459+0000) 2026-02-13T02:25:17.751 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:17 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:25:17.419+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.78:6812 osd.5 since back 2026-02-13T02:24:48.178924+0000 front 2026-02-13T02:24:48.179015+0000 (oldest deadline 2026-02-13T02:25:13.478939+0000) 2026-02-13T02:25:18.541 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:18 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:18.069+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:23.112468+0000 front 2026-02-13T02:24:23.112473+0000 (oldest deadline 2026-02-13T02:24:47.212522+0000) 2026-02-13T02:25:18.542 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:18 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:18.069+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:27.212755+0000 front 2026-02-13T02:24:27.212693+0000 (oldest deadline 2026-02-13T02:24:53.112753+0000) 2026-02-13T02:25:18.542 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:18 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:18.069+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.78:6804 osd.2 since back 2026-02-13T02:24:34.213127+0000 front 2026-02-13T02:24:34.213138+0000 (oldest deadline 2026-02-13T02:24:54.713206+0000) 2026-02-13T02:25:18.542 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:18 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:18.069+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.60:6812 osd.4 since back 2026-02-13T02:24:41.113972+0000 front 2026-02-13T02:24:41.114178+0000 (oldest deadline 2026-02-13T02:25:06.413983+0000) 2026-02-13T02:25:18.542 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:18 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:18.069+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.78:6812 osd.5 since back 2026-02-13T02:24:48.714330+0000 front 2026-02-13T02:24:48.714349+0000 (oldest deadline 2026-02-13T02:25:13.414416+0000) 2026-02-13T02:25:18.750 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:18 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:25:18.401+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:21.576733+0000 front 2026-02-13T02:24:21.576946+0000 (oldest deadline 2026-02-13T02:24:43.876770+0000) 2026-02-13T02:25:18.750 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:18 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:25:18.401+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:23.876890+0000 front 2026-02-13T02:24:23.876928+0000 (oldest deadline 2026-02-13T02:24:49.777050+0000) 2026-02-13T02:25:18.751 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:18 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:25:18.401+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.78:6804 osd.2 since back 2026-02-13T02:24:31.977616+0000 front 2026-02-13T02:24:31.977623+0000 (oldest deadline 2026-02-13T02:24:57.277647+0000) 2026-02-13T02:25:18.751 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:18 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:25:18.401+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.11:6814 osd.3 since back 2026-02-13T02:24:38.978047+0000 front 2026-02-13T02:24:38.977983+0000 (oldest deadline 2026-02-13T02:25:03.077981+0000) 2026-02-13T02:25:18.751 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:18 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:25:18.401+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.60:6812 osd.4 since back 2026-02-13T02:24:44.778320+0000 front 2026-02-13T02:24:44.778314+0000 (oldest deadline 2026-02-13T02:25:07.678459+0000) 2026-02-13T02:25:18.751 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:18 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10[38961]: 2026-02-13T02:25:18.401+0000 7fe05c0656c0 -1 osd.10 73 heartbeat_check: no reply from 10.20.193.78:6812 osd.5 since back 2026-02-13T02:24:48.178924+0000 front 2026-02-13T02:24:48.179015+0000 (oldest deadline 2026-02-13T02:25:13.478939+0000) 2026-02-13T02:25:19.310 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:19 trial060 podman[47089]: 2026-02-13 02:25:19.005665807 +0000 UTC m=+5.090916511 container died 92d7f77ca18abc76ba8cdbef58635da30e9bb56ecabf1bc21eee3b76b0661398 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10, org.opencontainers.image.version=10, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.title=rockylinux, version=10, ceph=True, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, io.buildah.version=1.33.7, vendor=Rocky Enterprise Software Foundation, name=rockylinux, CEPH_REF=wip-pdonnell-testing-20260210.171210, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, license=BSD-3-Clause, summary=Rocky Linux Base image, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-13T02:25:19.310 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:19 trial060 podman[47089]: 2026-02-13 02:25:19.013508444 +0000 UTC m=+5.098759148 container remove 92d7f77ca18abc76ba8cdbef58635da30e9bb56ecabf1bc21eee3b76b0661398 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10, io.buildah.version=1.33.7, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, name=rockylinux, ceph=True, license=BSD-3-Clause, org.opencontainers.image.licenses=BSD-3-Clause, vendor=Rocky Enterprise Software Foundation, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, org.opencontainers.image.version=10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.title=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.documentation=https://docs.ceph.com/, version=10, org.opencontainers.image.authors=Ceph Release Team , summary=Rocky Linux Base image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-pdonnell-testing-20260210.171210) 2026-02-13T02:25:19.310 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:19 trial060 bash[47089]: ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10 2026-02-13T02:25:19.310 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:19 trial060 podman[47216]: 2026-02-13 02:25:19.145030182 +0000 UTC m=+0.015241199 container create 2ecb973768483b43d75f6cd8e339c27c103c836ee6553ba53f63df27d78e55ad (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10-deactivate, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, name=rockylinux, org.opencontainers.image.licenses=BSD-3-Clause, version=10, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, OSD_FLAVOR=default, org.opencontainers.image.title=rockylinux, org.opencontainers.image.version=10, license=BSD-3-Clause, ceph=True, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.documentation=https://docs.ceph.com/, summary=Rocky Linux Base image, io.buildah.version=1.33.7, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-pdonnell-testing-20260210.171210, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, FROM_IMAGE=docker.io/rockylinux/rockylinux:10) 2026-02-13T02:25:19.310 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:19 trial060 podman[47216]: 2026-02-13 02:25:19.169169291 +0000 UTC m=+0.039380298 container init 2ecb973768483b43d75f6cd8e339c27c103c836ee6553ba53f63df27d78e55ad (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10-deactivate, version=10, OSD_FLAVOR=default, org.opencontainers.image.title=rockylinux, org.opencontainers.image.version=10, license=BSD-3-Clause, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.documentation=https://docs.ceph.com/, name=rockylinux, io.buildah.version=1.33.7, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-pdonnell-testing-20260210.171210, summary=Rocky Linux Base image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.licenses=BSD-3-Clause, ceph=True, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10) 2026-02-13T02:25:19.310 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:19 trial060 podman[47216]: 2026-02-13 02:25:19.171151417 +0000 UTC m=+0.041362444 container start 2ecb973768483b43d75f6cd8e339c27c103c836ee6553ba53f63df27d78e55ad (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10-deactivate, org.opencontainers.image.title=rockylinux, io.buildah.version=1.33.7, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.authors=Ceph Release Team , license=BSD-3-Clause, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, ceph=True, version=10, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, summary=Rocky Linux Base image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.version=10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, name=rockylinux, org.opencontainers.image.licenses=BSD-3-Clause, OSD_FLAVOR=default) 2026-02-13T02:25:19.310 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:19 trial060 podman[47216]: 2026-02-13 02:25:19.171670813 +0000 UTC m=+0.041881840 container attach 2ecb973768483b43d75f6cd8e339c27c103c836ee6553ba53f63df27d78e55ad (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10-deactivate, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.documentation=https://docs.ceph.com/, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.licenses=BSD-3-Clause, license=BSD-3-Clause, version=10, org.opencontainers.image.title=rockylinux, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.authors=Ceph Release Team , name=rockylinux, OSD_FLAVOR=default, io.buildah.version=1.33.7, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, summary=Rocky Linux Base image, org.opencontainers.image.version=10) 2026-02-13T02:25:19.310 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:19 trial060 podman[47216]: 2026-02-13 02:25:19.139112065 +0000 UTC m=+0.009323082 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T02:25:19.311 INFO:journalctl@ceph.osd.10.trial060.stdout:Feb 13 02:25:19 trial060 podman[47216]: 2026-02-13 02:25:19.309802486 +0000 UTC m=+0.180013513 container died 2ecb973768483b43d75f6cd8e339c27c103c836ee6553ba53f63df27d78e55ad (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-10-deactivate, org.opencontainers.image.version=10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, io.buildah.version=1.33.7, ceph=True, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, vendor=Rocky Enterprise Software Foundation, OSD_FLAVOR=default, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.title=rockylinux, license=BSD-3-Clause, version=10, summary=Rocky Linux Base image, name=rockylinux, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_REF=wip-pdonnell-testing-20260210.171210) 2026-02-13T02:25:19.346 DEBUG:teuthology.orchestra.run.trial060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-fc631695-0881-11f1-899c-d404e6e7d460@osd.10.service' 2026-02-13T02:25:19.391 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T02:25:19.391 INFO:tasks.cephadm.osd.10:Stopped osd.10 2026-02-13T02:25:19.391 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2026-02-13T02:25:19.392 DEBUG:teuthology.orchestra.run.trial078:> sudo systemctl stop ceph-fc631695-0881-11f1-899c-d404e6e7d460@osd.11 2026-02-13T02:25:19.418 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:19 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:19.077+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:23.112468+0000 front 2026-02-13T02:24:23.112473+0000 (oldest deadline 2026-02-13T02:24:47.212522+0000) 2026-02-13T02:25:19.418 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:19 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:19.077+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:27.212755+0000 front 2026-02-13T02:24:27.212693+0000 (oldest deadline 2026-02-13T02:24:53.112753+0000) 2026-02-13T02:25:19.418 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:19 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:19.077+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.78:6804 osd.2 since back 2026-02-13T02:24:34.213127+0000 front 2026-02-13T02:24:34.213138+0000 (oldest deadline 2026-02-13T02:24:54.713206+0000) 2026-02-13T02:25:19.418 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:19 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:19.077+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.60:6812 osd.4 since back 2026-02-13T02:24:41.113972+0000 front 2026-02-13T02:24:41.114178+0000 (oldest deadline 2026-02-13T02:25:06.413983+0000) 2026-02-13T02:25:19.418 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:19 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:19.077+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.78:6812 osd.5 since back 2026-02-13T02:24:48.714330+0000 front 2026-02-13T02:24:48.714349+0000 (oldest deadline 2026-02-13T02:25:13.414416+0000) 2026-02-13T02:25:19.418 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:19 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:19.077+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.11:6822 osd.6 since back 2026-02-13T02:24:53.414674+0000 front 2026-02-13T02:24:53.414733+0000 (oldest deadline 2026-02-13T02:25:18.714685+0000) 2026-02-13T02:25:19.792 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:19 trial078 systemd[1]: Stopping ceph-fc631695-0881-11f1-899c-d404e6e7d460@osd.11.service - Ceph osd.11 for fc631695-0881-11f1-899c-d404e6e7d460... 2026-02-13T02:25:19.792 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:19 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:19.491+0000 7fa6a551d6c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T02:25:19.792 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:19 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:19.491+0000 7fa6a551d6c0 -1 osd.11 73 *** Got signal Terminated *** 2026-02-13T02:25:19.792 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:19 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:19.491+0000 7fa6a551d6c0 -1 osd.11 73 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T02:25:20.541 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:20 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:20.069+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:23.112468+0000 front 2026-02-13T02:24:23.112473+0000 (oldest deadline 2026-02-13T02:24:47.212522+0000) 2026-02-13T02:25:20.542 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:20 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:20.069+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:27.212755+0000 front 2026-02-13T02:24:27.212693+0000 (oldest deadline 2026-02-13T02:24:53.112753+0000) 2026-02-13T02:25:20.542 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:20 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:20.069+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.78:6804 osd.2 since back 2026-02-13T02:24:34.213127+0000 front 2026-02-13T02:24:34.213138+0000 (oldest deadline 2026-02-13T02:24:54.713206+0000) 2026-02-13T02:25:20.542 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:20 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:20.069+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.60:6812 osd.4 since back 2026-02-13T02:24:41.113972+0000 front 2026-02-13T02:24:41.114178+0000 (oldest deadline 2026-02-13T02:25:06.413983+0000) 2026-02-13T02:25:20.542 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:20 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:20.069+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.78:6812 osd.5 since back 2026-02-13T02:24:48.714330+0000 front 2026-02-13T02:24:48.714349+0000 (oldest deadline 2026-02-13T02:25:13.414416+0000) 2026-02-13T02:25:20.542 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:20 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:20.069+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.11:6822 osd.6 since back 2026-02-13T02:24:53.414674+0000 front 2026-02-13T02:24:53.414733+0000 (oldest deadline 2026-02-13T02:25:18.714685+0000) 2026-02-13T02:25:21.541 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:21 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:21.076+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:23.112468+0000 front 2026-02-13T02:24:23.112473+0000 (oldest deadline 2026-02-13T02:24:47.212522+0000) 2026-02-13T02:25:21.542 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:21 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:21.076+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:27.212755+0000 front 2026-02-13T02:24:27.212693+0000 (oldest deadline 2026-02-13T02:24:53.112753+0000) 2026-02-13T02:25:21.542 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:21 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:21.076+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.78:6804 osd.2 since back 2026-02-13T02:24:34.213127+0000 front 2026-02-13T02:24:34.213138+0000 (oldest deadline 2026-02-13T02:24:54.713206+0000) 2026-02-13T02:25:21.542 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:21 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:21.076+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.60:6812 osd.4 since back 2026-02-13T02:24:41.113972+0000 front 2026-02-13T02:24:41.114178+0000 (oldest deadline 2026-02-13T02:25:06.413983+0000) 2026-02-13T02:25:21.542 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:21 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:21.076+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.78:6812 osd.5 since back 2026-02-13T02:24:48.714330+0000 front 2026-02-13T02:24:48.714349+0000 (oldest deadline 2026-02-13T02:25:13.414416+0000) 2026-02-13T02:25:21.542 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:21 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:21.076+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.11:6822 osd.6 since back 2026-02-13T02:24:53.414674+0000 front 2026-02-13T02:24:53.414733+0000 (oldest deadline 2026-02-13T02:25:18.714685+0000) 2026-02-13T02:25:22.541 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:22 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:22.114+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:23.112468+0000 front 2026-02-13T02:24:23.112473+0000 (oldest deadline 2026-02-13T02:24:47.212522+0000) 2026-02-13T02:25:22.542 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:22 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:22.114+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:27.212755+0000 front 2026-02-13T02:24:27.212693+0000 (oldest deadline 2026-02-13T02:24:53.112753+0000) 2026-02-13T02:25:22.542 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:22 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:22.114+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.78:6804 osd.2 since back 2026-02-13T02:24:34.213127+0000 front 2026-02-13T02:24:34.213138+0000 (oldest deadline 2026-02-13T02:24:54.713206+0000) 2026-02-13T02:25:22.542 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:22 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:22.114+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.60:6812 osd.4 since back 2026-02-13T02:24:41.113972+0000 front 2026-02-13T02:24:41.114178+0000 (oldest deadline 2026-02-13T02:25:06.413983+0000) 2026-02-13T02:25:22.542 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:22 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:22.114+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.78:6812 osd.5 since back 2026-02-13T02:24:48.714330+0000 front 2026-02-13T02:24:48.714349+0000 (oldest deadline 2026-02-13T02:25:13.414416+0000) 2026-02-13T02:25:22.542 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:22 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:22.114+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.11:6822 osd.6 since back 2026-02-13T02:24:53.414674+0000 front 2026-02-13T02:24:53.414733+0000 (oldest deadline 2026-02-13T02:25:18.714685+0000) 2026-02-13T02:25:23.541 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:23 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:23.142+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:23.112468+0000 front 2026-02-13T02:24:23.112473+0000 (oldest deadline 2026-02-13T02:24:47.212522+0000) 2026-02-13T02:25:23.542 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:23 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:23.142+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:27.212755+0000 front 2026-02-13T02:24:27.212693+0000 (oldest deadline 2026-02-13T02:24:53.112753+0000) 2026-02-13T02:25:23.542 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:23 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:23.142+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.78:6804 osd.2 since back 2026-02-13T02:24:34.213127+0000 front 2026-02-13T02:24:34.213138+0000 (oldest deadline 2026-02-13T02:24:54.713206+0000) 2026-02-13T02:25:23.542 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:23 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:23.142+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.60:6812 osd.4 since back 2026-02-13T02:24:41.113972+0000 front 2026-02-13T02:24:41.114178+0000 (oldest deadline 2026-02-13T02:25:06.413983+0000) 2026-02-13T02:25:23.542 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:23 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:23.142+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.78:6812 osd.5 since back 2026-02-13T02:24:48.714330+0000 front 2026-02-13T02:24:48.714349+0000 (oldest deadline 2026-02-13T02:25:13.414416+0000) 2026-02-13T02:25:23.542 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:23 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:23.142+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.11:6822 osd.6 since back 2026-02-13T02:24:53.414674+0000 front 2026-02-13T02:24:53.414733+0000 (oldest deadline 2026-02-13T02:25:18.714685+0000) 2026-02-13T02:25:24.542 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:24 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:24.098+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.11:6806 osd.0 since back 2026-02-13T02:24:23.112468+0000 front 2026-02-13T02:24:23.112473+0000 (oldest deadline 2026-02-13T02:24:47.212522+0000) 2026-02-13T02:25:24.542 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:24 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:24.098+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.60:6804 osd.1 since back 2026-02-13T02:24:27.212755+0000 front 2026-02-13T02:24:27.212693+0000 (oldest deadline 2026-02-13T02:24:53.112753+0000) 2026-02-13T02:25:24.542 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:24 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:24.098+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.78:6804 osd.2 since back 2026-02-13T02:24:34.213127+0000 front 2026-02-13T02:24:34.213138+0000 (oldest deadline 2026-02-13T02:24:54.713206+0000) 2026-02-13T02:25:24.542 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:24 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:24.098+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.60:6812 osd.4 since back 2026-02-13T02:24:41.113972+0000 front 2026-02-13T02:24:41.114178+0000 (oldest deadline 2026-02-13T02:25:06.413983+0000) 2026-02-13T02:25:24.542 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:24 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:24.098+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.78:6812 osd.5 since back 2026-02-13T02:24:48.714330+0000 front 2026-02-13T02:24:48.714349+0000 (oldest deadline 2026-02-13T02:25:13.414416+0000) 2026-02-13T02:25:24.542 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:24 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:24.098+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.11:6822 osd.6 since back 2026-02-13T02:24:53.414674+0000 front 2026-02-13T02:24:53.414733+0000 (oldest deadline 2026-02-13T02:25:18.714685+0000) 2026-02-13T02:25:24.542 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:24 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11[38684]: 2026-02-13T02:25:24.098+0000 7fa6a13f26c0 -1 osd.11 73 heartbeat_check: no reply from 10.20.193.60:6820 osd.7 since back 2026-02-13T02:24:58.714885+0000 front 2026-02-13T02:24:58.714891+0000 (oldest deadline 2026-02-13T02:25:23.414856+0000) 2026-02-13T02:25:24.882 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:24 trial078 podman[48349]: 2026-02-13 02:25:24.560787987 +0000 UTC m=+5.080092652 container died ded7253a5a91a44f353e7cb2bfd901a33119831152b36d46212baa5b3df9fd3c (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11, org.opencontainers.image.title=rockylinux, summary=Rocky Linux Base image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, name=rockylinux, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.version=10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, version=10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, OSD_FLAVOR=default, io.buildah.version=1.33.7, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-pdonnell-testing-20260210.171210, license=BSD-3-Clause) 2026-02-13T02:25:24.882 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:24 trial078 podman[48349]: 2026-02-13 02:25:24.568531358 +0000 UTC m=+5.087836023 container remove ded7253a5a91a44f353e7cb2bfd901a33119831152b36d46212baa5b3df9fd3c (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11, ceph=True, license=BSD-3-Clause, org.opencontainers.image.version=10, summary=Rocky Linux Base image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, name=rockylinux, vendor=Rocky Enterprise Software Foundation, io.buildah.version=1.33.7, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.title=rockylinux, version=10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, OSD_FLAVOR=default, CEPH_REF=wip-pdonnell-testing-20260210.171210, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-13T02:25:24.882 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:24 trial078 bash[48349]: ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11 2026-02-13T02:25:24.882 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:24 trial078 podman[48474]: 2026-02-13 02:25:24.700733912 +0000 UTC m=+0.015632375 container create cc641e9beaac5bfffd1766445d2d5a629e595b60455bad7d71110688965b744e (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11-deactivate, org.opencontainers.image.authors=Ceph Release Team , version=10, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.licenses=BSD-3-Clause, license=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, io.buildah.version=1.33.7, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, name=rockylinux, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, OSD_FLAVOR=default, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.version=10, org.opencontainers.image.title=rockylinux, summary=Rocky Linux Base image, vendor=Rocky Enterprise Software Foundation) 2026-02-13T02:25:24.882 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:24 trial078 podman[48474]: 2026-02-13 02:25:24.735802019 +0000 UTC m=+0.050700482 container init cc641e9beaac5bfffd1766445d2d5a629e595b60455bad7d71110688965b744e (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11-deactivate, ceph=True, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.version=10, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.title=rockylinux, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, io.buildah.version=1.33.7, vendor=Rocky Enterprise Software Foundation, version=10, summary=Rocky Linux Base image, org.opencontainers.image.licenses=BSD-3-Clause, license=BSD-3-Clause, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, name=rockylinux, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f) 2026-02-13T02:25:24.882 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:24 trial078 podman[48474]: 2026-02-13 02:25:24.737668291 +0000 UTC m=+0.052566765 container start cc641e9beaac5bfffd1766445d2d5a629e595b60455bad7d71110688965b744e (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11-deactivate, org.opencontainers.image.version=10, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.title=rockylinux, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, version=10, summary=Rocky Linux Base image, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.documentation=https://docs.ceph.com/, name=rockylinux, license=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, io.buildah.version=1.33.7, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.licenses=BSD-3-Clause, vendor=Rocky Enterprise Software Foundation, OSD_FLAVOR=default) 2026-02-13T02:25:24.882 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:24 trial078 podman[48474]: 2026-02-13 02:25:24.738201139 +0000 UTC m=+0.053099612 container attach cc641e9beaac5bfffd1766445d2d5a629e595b60455bad7d71110688965b744e (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11-deactivate, name=rockylinux, ceph=True, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.version=10, version=10, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=docker.io/rockylinux/rockylinux:10, io.buildah.version=1.33.7, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, license=BSD-3-Clause, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.title=rockylinux, summary=Rocky Linux Base image, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f) 2026-02-13T02:25:24.882 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:24 trial078 podman[48474]: 2026-02-13 02:25:24.694198492 +0000 UTC m=+0.009096975 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T02:25:24.883 INFO:journalctl@ceph.osd.11.trial078.stdout:Feb 13 02:25:24 trial078 podman[48474]: 2026-02-13 02:25:24.879513301 +0000 UTC m=+0.194411774 container died cc641e9beaac5bfffd1766445d2d5a629e595b60455bad7d71110688965b744e (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-fc631695-0881-11f1-899c-d404e6e7d460-osd-11-deactivate, vendor=Rocky Enterprise Software Foundation, summary=Rocky Linux Base image, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.version=10, version=10, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.title=rockylinux, ceph=True, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, name=rockylinux, license=BSD-3-Clause, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.licenses=BSD-3-Clause, io.buildah.version=1.33.7) 2026-02-13T02:25:24.917 DEBUG:teuthology.orchestra.run.trial078:> sudo pkill -f 'journalctl -f -n 0 -u ceph-fc631695-0881-11f1-899c-d404e6e7d460@osd.11.service' 2026-02-13T02:25:25.003 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T02:25:25.003 INFO:tasks.cephadm.osd.11:Stopped osd.11 2026-02-13T02:25:25.003 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2026-02-13T02:25:25.003 DEBUG:teuthology.orchestra.run.trial011:> sudo systemctl stop ceph-fc631695-0881-11f1-899c-d404e6e7d460@mds.a 2026-02-13T02:25:25.452 INFO:journalctl@ceph.mds.a.trial011.stdout:Feb 13 02:25:25 trial011 systemd[1]: Stopping ceph-fc631695-0881-11f1-899c-d404e6e7d460@mds.a.service - Ceph mds.a for fc631695-0881-11f1-899c-d404e6e7d460... 2026-02-13T02:25:25.452 INFO:journalctl@ceph.mds.a.trial011.stdout:Feb 13 02:25:25 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mds-a[49100]: 2026-02-13T02:25:25.108+0000 7fc01a7336c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T02:25:25.452 INFO:journalctl@ceph.mds.a.trial011.stdout:Feb 13 02:25:25 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mds-a[49100]: 2026-02-13T02:25:25.108+0000 7fc01a7336c0 -1 mds.a *** got signal Terminated *** 2026-02-13T02:25:26.222 DEBUG:teuthology.orchestra.run.trial011:> sudo pkill -f 'journalctl -f -n 0 -u ceph-fc631695-0881-11f1-899c-d404e6e7d460@mds.a.service' 2026-02-13T02:25:26.264 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T02:25:26.265 INFO:tasks.cephadm.mds.a:Stopped mds.a 2026-02-13T02:25:26.265 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2026-02-13T02:25:26.265 DEBUG:teuthology.orchestra.run.trial011:> sudo systemctl stop ceph-fc631695-0881-11f1-899c-d404e6e7d460@mds.d 2026-02-13T02:25:26.409 INFO:journalctl@ceph.mds.d.trial011.stdout:Feb 13 02:25:26 trial011 systemd[1]: Stopping ceph-fc631695-0881-11f1-899c-d404e6e7d460@mds.d.service - Ceph mds.d for fc631695-0881-11f1-899c-d404e6e7d460... 2026-02-13T02:25:26.702 INFO:journalctl@ceph.mds.d.trial011.stdout:Feb 13 02:25:26 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mds-d[48165]: 2026-02-13T02:25:26.406+0000 7f0b00e6f6c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T02:25:26.702 INFO:journalctl@ceph.mds.d.trial011.stdout:Feb 13 02:25:26 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mds-d[48165]: 2026-02-13T02:25:26.406+0000 7f0b00e6f6c0 -1 mds.d *** got signal Terminated *** 2026-02-13T02:25:27.460 DEBUG:teuthology.orchestra.run.trial011:> sudo pkill -f 'journalctl -f -n 0 -u ceph-fc631695-0881-11f1-899c-d404e6e7d460@mds.d.service' 2026-02-13T02:25:27.503 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T02:25:27.504 INFO:tasks.cephadm.mds.d:Stopped mds.d 2026-02-13T02:25:27.504 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2026-02-13T02:25:27.504 DEBUG:teuthology.orchestra.run.trial011:> sudo systemctl stop ceph-fc631695-0881-11f1-899c-d404e6e7d460@mds.g 2026-02-13T02:25:27.640 INFO:journalctl@ceph.mds.g.trial011.stdout:Feb 13 02:25:27 trial011 systemd[1]: Stopping ceph-fc631695-0881-11f1-899c-d404e6e7d460@mds.g.service - Ceph mds.g for fc631695-0881-11f1-899c-d404e6e7d460... 2026-02-13T02:25:27.952 INFO:journalctl@ceph.mds.g.trial011.stdout:Feb 13 02:25:27 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mds-g[48673]: 2026-02-13T02:25:27.638+0000 7fe861f716c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T02:25:27.952 INFO:journalctl@ceph.mds.g.trial011.stdout:Feb 13 02:25:27 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mds-g[48673]: 2026-02-13T02:25:27.638+0000 7fe861f716c0 -1 mds.g *** got signal Terminated *** 2026-02-13T02:25:28.778 DEBUG:teuthology.orchestra.run.trial011:> sudo pkill -f 'journalctl -f -n 0 -u ceph-fc631695-0881-11f1-899c-d404e6e7d460@mds.g.service' 2026-02-13T02:25:28.820 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T02:25:28.821 INFO:tasks.cephadm.mds.g:Stopped mds.g 2026-02-13T02:25:28.821 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2026-02-13T02:25:28.821 DEBUG:teuthology.orchestra.run.trial011:> sudo systemctl stop ceph-fc631695-0881-11f1-899c-d404e6e7d460@mds.j 2026-02-13T02:25:28.952 INFO:journalctl@ceph.mds.j.trial011.stdout:Feb 13 02:25:28 trial011 systemd[1]: Stopping ceph-fc631695-0881-11f1-899c-d404e6e7d460@mds.j.service - Ceph mds.j for fc631695-0881-11f1-899c-d404e6e7d460... 2026-02-13T02:25:29.452 INFO:journalctl@ceph.mds.j.trial011.stdout:Feb 13 02:25:28 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mds-j[47704]: 2026-02-13T02:25:28.964+0000 7fa545c146c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T02:25:29.452 INFO:journalctl@ceph.mds.j.trial011.stdout:Feb 13 02:25:28 trial011 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mds-j[47704]: 2026-02-13T02:25:28.964+0000 7fa545c146c0 -1 mds.j *** got signal Terminated *** 2026-02-13T02:25:30.008 DEBUG:teuthology.orchestra.run.trial011:> sudo pkill -f 'journalctl -f -n 0 -u ceph-fc631695-0881-11f1-899c-d404e6e7d460@mds.j.service' 2026-02-13T02:25:30.051 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T02:25:30.051 INFO:tasks.cephadm.mds.j:Stopped mds.j 2026-02-13T02:25:30.051 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2026-02-13T02:25:30.051 DEBUG:teuthology.orchestra.run.trial060:> sudo systemctl stop ceph-fc631695-0881-11f1-899c-d404e6e7d460@mds.b 2026-02-13T02:25:30.500 INFO:journalctl@ceph.mds.b.trial060.stdout:Feb 13 02:25:30 trial060 systemd[1]: Stopping ceph-fc631695-0881-11f1-899c-d404e6e7d460@mds.b.service - Ceph mds.b for fc631695-0881-11f1-899c-d404e6e7d460... 2026-02-13T02:25:30.501 INFO:journalctl@ceph.mds.b.trial060.stdout:Feb 13 02:25:30 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mds-b[43709]: 2026-02-13T02:25:30.159+0000 7f01300f16c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T02:25:30.501 INFO:journalctl@ceph.mds.b.trial060.stdout:Feb 13 02:25:30 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mds-b[43709]: 2026-02-13T02:25:30.159+0000 7f01300f16c0 -1 mds.b *** got signal Terminated *** 2026-02-13T02:25:35.311 DEBUG:teuthology.orchestra.run.trial060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-fc631695-0881-11f1-899c-d404e6e7d460@mds.b.service' 2026-02-13T02:25:35.355 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T02:25:35.355 INFO:tasks.cephadm.mds.b:Stopped mds.b 2026-02-13T02:25:35.355 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2026-02-13T02:25:35.355 DEBUG:teuthology.orchestra.run.trial060:> sudo systemctl stop ceph-fc631695-0881-11f1-899c-d404e6e7d460@mds.e 2026-02-13T02:25:35.496 INFO:journalctl@ceph.mds.e.trial060.stdout:Feb 13 02:25:35 trial060 systemd[1]: Stopping ceph-fc631695-0881-11f1-899c-d404e6e7d460@mds.e.service - Ceph mds.e for fc631695-0881-11f1-899c-d404e6e7d460... 2026-02-13T02:25:35.750 INFO:journalctl@ceph.mds.e.trial060.stdout:Feb 13 02:25:35 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mds-e[42979]: 2026-02-13T02:25:35.496+0000 7fc0334826c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T02:25:35.750 INFO:journalctl@ceph.mds.e.trial060.stdout:Feb 13 02:25:35 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mds-e[42979]: 2026-02-13T02:25:35.496+0000 7fc0334826c0 -1 mds.e *** got signal Terminated *** 2026-02-13T02:25:38.389 DEBUG:teuthology.orchestra.run.trial060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-fc631695-0881-11f1-899c-d404e6e7d460@mds.e.service' 2026-02-13T02:25:38.434 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T02:25:38.434 INFO:tasks.cephadm.mds.e:Stopped mds.e 2026-02-13T02:25:38.435 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2026-02-13T02:25:38.435 DEBUG:teuthology.orchestra.run.trial060:> sudo systemctl stop ceph-fc631695-0881-11f1-899c-d404e6e7d460@mds.h 2026-02-13T02:25:38.750 INFO:journalctl@ceph.mds.h.trial060.stdout:Feb 13 02:25:38 trial060 systemd[1]: Stopping ceph-fc631695-0881-11f1-899c-d404e6e7d460@mds.h.service - Ceph mds.h for fc631695-0881-11f1-899c-d404e6e7d460... 2026-02-13T02:25:38.750 INFO:journalctl@ceph.mds.h.trial060.stdout:Feb 13 02:25:38 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mds-h[43348]: 2026-02-13T02:25:38.539+0000 7f6f99dcd6c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T02:25:38.751 INFO:journalctl@ceph.mds.h.trial060.stdout:Feb 13 02:25:38 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mds-h[43348]: 2026-02-13T02:25:38.539+0000 7f6f99dcd6c0 -1 mds.h *** got signal Terminated *** 2026-02-13T02:25:41.389 DEBUG:teuthology.orchestra.run.trial060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-fc631695-0881-11f1-899c-d404e6e7d460@mds.h.service' 2026-02-13T02:25:41.432 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T02:25:41.433 INFO:tasks.cephadm.mds.h:Stopped mds.h 2026-02-13T02:25:41.433 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2026-02-13T02:25:41.433 DEBUG:teuthology.orchestra.run.trial060:> sudo systemctl stop ceph-fc631695-0881-11f1-899c-d404e6e7d460@mds.k 2026-02-13T02:25:41.576 INFO:journalctl@ceph.mds.k.trial060.stdout:Feb 13 02:25:41 trial060 systemd[1]: Stopping ceph-fc631695-0881-11f1-899c-d404e6e7d460@mds.k.service - Ceph mds.k for fc631695-0881-11f1-899c-d404e6e7d460... 2026-02-13T02:25:42.000 INFO:journalctl@ceph.mds.k.trial060.stdout:Feb 13 02:25:41 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mds-k[42611]: 2026-02-13T02:25:41.576+0000 7fd5f5bcc6c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T02:25:42.000 INFO:journalctl@ceph.mds.k.trial060.stdout:Feb 13 02:25:41 trial060 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mds-k[42611]: 2026-02-13T02:25:41.576+0000 7fd5f5bcc6c0 -1 mds.k *** got signal Terminated *** 2026-02-13T02:25:42.841 DEBUG:teuthology.orchestra.run.trial060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-fc631695-0881-11f1-899c-d404e6e7d460@mds.k.service' 2026-02-13T02:25:42.883 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T02:25:42.883 INFO:tasks.cephadm.mds.k:Stopped mds.k 2026-02-13T02:25:42.883 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2026-02-13T02:25:42.883 DEBUG:teuthology.orchestra.run.trial078:> sudo systemctl stop ceph-fc631695-0881-11f1-899c-d404e6e7d460@mds.c 2026-02-13T02:25:43.292 INFO:journalctl@ceph.mds.c.trial078.stdout:Feb 13 02:25:42 trial078 systemd[1]: Stopping ceph-fc631695-0881-11f1-899c-d404e6e7d460@mds.c.service - Ceph mds.c for fc631695-0881-11f1-899c-d404e6e7d460... 2026-02-13T02:25:43.292 INFO:journalctl@ceph.mds.c.trial078.stdout:Feb 13 02:25:42 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mds-c[43602]: 2026-02-13T02:25:42.989+0000 7fdd30e5e6c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T02:25:43.292 INFO:journalctl@ceph.mds.c.trial078.stdout:Feb 13 02:25:42 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mds-c[43602]: 2026-02-13T02:25:42.989+0000 7fdd30e5e6c0 -1 mds.c *** got signal Terminated *** 2026-02-13T02:25:44.422 DEBUG:teuthology.orchestra.run.trial078:> sudo pkill -f 'journalctl -f -n 0 -u ceph-fc631695-0881-11f1-899c-d404e6e7d460@mds.c.service' 2026-02-13T02:25:44.469 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T02:25:44.470 INFO:tasks.cephadm.mds.c:Stopped mds.c 2026-02-13T02:25:44.470 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2026-02-13T02:25:44.470 DEBUG:teuthology.orchestra.run.trial078:> sudo systemctl stop ceph-fc631695-0881-11f1-899c-d404e6e7d460@mds.f 2026-02-13T02:25:44.791 INFO:journalctl@ceph.mds.f.trial078.stdout:Feb 13 02:25:44 trial078 systemd[1]: Stopping ceph-fc631695-0881-11f1-899c-d404e6e7d460@mds.f.service - Ceph mds.f for fc631695-0881-11f1-899c-d404e6e7d460... 2026-02-13T02:25:44.792 INFO:journalctl@ceph.mds.f.trial078.stdout:Feb 13 02:25:44 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mds-f[43241]: 2026-02-13T02:25:44.573+0000 7f6fc357a6c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T02:25:44.792 INFO:journalctl@ceph.mds.f.trial078.stdout:Feb 13 02:25:44 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mds-f[43241]: 2026-02-13T02:25:44.573+0000 7f6fc357a6c0 -1 mds.f *** got signal Terminated *** 2026-02-13T02:25:45.668 DEBUG:teuthology.orchestra.run.trial078:> sudo pkill -f 'journalctl -f -n 0 -u ceph-fc631695-0881-11f1-899c-d404e6e7d460@mds.f.service' 2026-02-13T02:25:45.712 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T02:25:45.712 INFO:tasks.cephadm.mds.f:Stopped mds.f 2026-02-13T02:25:45.712 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2026-02-13T02:25:45.713 DEBUG:teuthology.orchestra.run.trial078:> sudo systemctl stop ceph-fc631695-0881-11f1-899c-d404e6e7d460@mds.i 2026-02-13T02:25:45.850 INFO:journalctl@ceph.mds.i.trial078.stdout:Feb 13 02:25:45 trial078 systemd[1]: Stopping ceph-fc631695-0881-11f1-899c-d404e6e7d460@mds.i.service - Ceph mds.i for fc631695-0881-11f1-899c-d404e6e7d460... 2026-02-13T02:25:46.291 INFO:journalctl@ceph.mds.i.trial078.stdout:Feb 13 02:25:45 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mds-i[43965]: 2026-02-13T02:25:45.846+0000 7f8640e3b6c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T02:25:46.292 INFO:journalctl@ceph.mds.i.trial078.stdout:Feb 13 02:25:45 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mds-i[43965]: 2026-02-13T02:25:45.846+0000 7f8640e3b6c0 -1 mds.i *** got signal Terminated *** 2026-02-13T02:25:47.236 DEBUG:teuthology.orchestra.run.trial078:> sudo pkill -f 'journalctl -f -n 0 -u ceph-fc631695-0881-11f1-899c-d404e6e7d460@mds.i.service' 2026-02-13T02:25:47.279 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T02:25:47.279 INFO:tasks.cephadm.mds.i:Stopped mds.i 2026-02-13T02:25:47.280 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2026-02-13T02:25:47.280 DEBUG:teuthology.orchestra.run.trial078:> sudo systemctl stop ceph-fc631695-0881-11f1-899c-d404e6e7d460@mds.l 2026-02-13T02:25:47.430 INFO:journalctl@ceph.mds.l.trial078.stdout:Feb 13 02:25:47 trial078 systemd[1]: Stopping ceph-fc631695-0881-11f1-899c-d404e6e7d460@mds.l.service - Ceph mds.l for fc631695-0881-11f1-899c-d404e6e7d460... 2026-02-13T02:25:47.791 INFO:journalctl@ceph.mds.l.trial078.stdout:Feb 13 02:25:47 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mds-l[42874]: 2026-02-13T02:25:47.427+0000 7f1e9e1a86c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T02:25:47.792 INFO:journalctl@ceph.mds.l.trial078.stdout:Feb 13 02:25:47 trial078 ceph-fc631695-0881-11f1-899c-d404e6e7d460-mds-l[42874]: 2026-02-13T02:25:47.427+0000 7f1e9e1a86c0 -1 mds.l *** got signal Terminated *** 2026-02-13T02:25:48.492 DEBUG:teuthology.orchestra.run.trial078:> sudo pkill -f 'journalctl -f -n 0 -u ceph-fc631695-0881-11f1-899c-d404e6e7d460@mds.l.service' 2026-02-13T02:25:48.534 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T02:25:48.534 INFO:tasks.cephadm.mds.l:Stopped mds.l 2026-02-13T02:25:48.535 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid fc631695-0881-11f1-899c-d404e6e7d460 --force --keep-logs 2026-02-13T02:25:48.660 INFO:teuthology.orchestra.run.trial011.stdout:Deleting cluster with fsid: fc631695-0881-11f1-899c-d404e6e7d460 2026-02-13T02:25:50.882 DEBUG:teuthology.orchestra.run.trial060:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid fc631695-0881-11f1-899c-d404e6e7d460 --force --keep-logs 2026-02-13T02:25:51.006 INFO:teuthology.orchestra.run.trial060.stdout:Deleting cluster with fsid: fc631695-0881-11f1-899c-d404e6e7d460 2026-02-13T02:25:53.185 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid fc631695-0881-11f1-899c-d404e6e7d460 --force --keep-logs 2026-02-13T02:25:53.311 INFO:teuthology.orchestra.run.trial078.stdout:Deleting cluster with fsid: fc631695-0881-11f1-899c-d404e6e7d460 2026-02-13T02:25:55.476 DEBUG:teuthology.orchestra.run.trial011:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-13T02:25:55.508 DEBUG:teuthology.orchestra.run.trial060:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-13T02:25:55.539 DEBUG:teuthology.orchestra.run.trial078:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-13T02:25:55.571 INFO:tasks.cephadm:Archiving crash dumps... 2026-02-13T02:25:55.574 DEBUG:teuthology.misc:Transferring archived files from trial011:/var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/crash to /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47968/remote/trial011/crash 2026-02-13T02:25:55.575 DEBUG:teuthology.orchestra.run.trial011:> sudo tar c -f - -C /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/crash -- . 2026-02-13T02:25:55.603 INFO:teuthology.orchestra.run.trial011.stderr:tar: /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/crash: Cannot open: No such file or directory 2026-02-13T02:25:55.603 INFO:teuthology.orchestra.run.trial011.stderr:tar: Error is not recoverable: exiting now 2026-02-13T02:25:55.606 DEBUG:teuthology.misc:Transferring archived files from trial060:/var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/crash to /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47968/remote/trial060/crash 2026-02-13T02:25:55.607 DEBUG:teuthology.orchestra.run.trial060:> sudo tar c -f - -C /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/crash -- . 2026-02-13T02:25:55.637 INFO:teuthology.orchestra.run.trial060.stderr:tar: /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/crash: Cannot open: No such file or directory 2026-02-13T02:25:55.637 INFO:teuthology.orchestra.run.trial060.stderr:tar: Error is not recoverable: exiting now 2026-02-13T02:25:55.640 DEBUG:teuthology.misc:Transferring archived files from trial078:/var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/crash to /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47968/remote/trial078/crash 2026-02-13T02:25:55.641 DEBUG:teuthology.orchestra.run.trial078:> sudo tar c -f - -C /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/crash -- . 2026-02-13T02:25:55.668 INFO:teuthology.orchestra.run.trial078.stderr:tar: /var/lib/ceph/fc631695-0881-11f1-899c-d404e6e7d460/crash: Cannot open: No such file or directory 2026-02-13T02:25:55.668 INFO:teuthology.orchestra.run.trial078.stderr:tar: Error is not recoverable: exiting now 2026-02-13T02:25:55.669 INFO:tasks.cephadm:Checking cluster log for badness... 2026-02-13T02:25:55.670 DEBUG:teuthology.orchestra.run.trial011:> sudo grep -E '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph.log | grep -E -v '\(MDS_ALL_DOWN\)' | grep -E -v '\(MDS_UP_LESS_THAN_MAX\)' | grep -E -v FS_DEGRADED | grep -E -v 'fs.*is degraded' | grep -E -v 'filesystem is degraded' | grep -E -v FS_INLINE_DATA_DEPRECATED | grep -E -v FS_WITH_FAILED_MDS | grep -E -v MDS_ALL_DOWN | grep -E -v 'filesystem is offline' | grep -E -v 'is offline because no MDS' | grep -E -v MDS_DAMAGE | grep -E -v MDS_DEGRADED | grep -E -v MDS_FAILED | grep -E -v MDS_INSUFFICIENT_STANDBY | grep -E -v 'insufficient standby MDS daemons available' | grep -E -v MDS_UP_LESS_THAN_MAX | grep -E -v 'online, but wants' | grep -E -v 'filesystem is online with fewer MDS than max_mds' | grep -E -v POOL_APP_NOT_ENABLED | grep -E -v 'do not have an application enabled' | grep -E -v 'overall HEALTH_' | grep -E -v 'Replacing daemon' | grep -E -v 'deprecated feature inline_data' | grep -E -v BLUESTORE_SLOW_OP_ALERT | grep -E -v 'slow operation indications in BlueStore' | grep -E -v 'experiencing slow operations in BlueStore' | grep -E -v MGR_MODULE_ERROR | grep -E -v OSD_DOWN | grep -E -v 'osd.* is down' | grep -E -v 'overall HEALTH_' | grep -E -v '\(OSD_DOWN\)' | grep -E -v '\(OSD_' | grep -E -v 'but it is still running' | grep -E -v 'is not responding' | grep -E -v 'osds down' | grep -E -v 'osd.* is down' | grep -E -v PG_AVAILABILITY | grep -E -v PG_DEGRADED | grep -E -v 'Reduced data availability' | grep -E -v 'Degraded data redundancy' | grep -E -v 'pg .* is stuck inactive' | grep -E -v 'pg .* is .*degraded' | grep -E -v 'slow metadata IO' | grep -E -v SLOW_OPS | grep -E -v 'slow request' | head -n 1 2026-02-13T02:25:55.701 INFO:teuthology.orchestra.run.trial011.stdout:2026-02-13T02:17:18.505391+0000 mon.a (mon.0) 309 : cluster [WRN] Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:25:55.701 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2026-02-13T02:25:55.702 DEBUG:teuthology.orchestra.run.trial011:> sudo grep -E '\[SEC\]' /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph.log | grep -E -v '\(MDS_ALL_DOWN\)' | grep -E -v '\(MDS_UP_LESS_THAN_MAX\)' | grep -E -v FS_DEGRADED | grep -E -v 'fs.*is degraded' | grep -E -v 'filesystem is degraded' | grep -E -v FS_INLINE_DATA_DEPRECATED | grep -E -v FS_WITH_FAILED_MDS | grep -E -v MDS_ALL_DOWN | grep -E -v 'filesystem is offline' | grep -E -v 'is offline because no MDS' | grep -E -v MDS_DAMAGE | grep -E -v MDS_DEGRADED | grep -E -v MDS_FAILED | grep -E -v MDS_INSUFFICIENT_STANDBY | grep -E -v 'insufficient standby MDS daemons available' | grep -E -v MDS_UP_LESS_THAN_MAX | grep -E -v 'online, but wants' | grep -E -v 'filesystem is online with fewer MDS than max_mds' | grep -E -v POOL_APP_NOT_ENABLED | grep -E -v 'do not have an application enabled' | grep -E -v 'overall HEALTH_' | grep -E -v 'Replacing daemon' | grep -E -v 'deprecated feature inline_data' | grep -E -v BLUESTORE_SLOW_OP_ALERT | grep -E -v 'slow operation indications in BlueStore' | grep -E -v 'experiencing slow operations in BlueStore' | grep -E -v MGR_MODULE_ERROR | grep -E -v OSD_DOWN | grep -E -v 'osd.* is down' | grep -E -v 'overall HEALTH_' | grep -E -v '\(OSD_DOWN\)' | grep -E -v '\(OSD_' | grep -E -v 'but it is still running' | grep -E -v 'is not responding' | grep -E -v 'osds down' | grep -E -v 'osd.* is down' | grep -E -v PG_AVAILABILITY | grep -E -v PG_DEGRADED | grep -E -v 'Reduced data availability' | grep -E -v 'Degraded data redundancy' | grep -E -v 'pg .* is stuck inactive' | grep -E -v 'pg .* is .*degraded' | grep -E -v 'slow metadata IO' | grep -E -v SLOW_OPS | grep -E -v 'slow request' | head -n 1 2026-02-13T02:25:55.769 DEBUG:teuthology.orchestra.run.trial011:> sudo grep -E '\[ERR\]' /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph.log | grep -E -v '\(MDS_ALL_DOWN\)' | grep -E -v '\(MDS_UP_LESS_THAN_MAX\)' | grep -E -v FS_DEGRADED | grep -E -v 'fs.*is degraded' | grep -E -v 'filesystem is degraded' | grep -E -v FS_INLINE_DATA_DEPRECATED | grep -E -v FS_WITH_FAILED_MDS | grep -E -v MDS_ALL_DOWN | grep -E -v 'filesystem is offline' | grep -E -v 'is offline because no MDS' | grep -E -v MDS_DAMAGE | grep -E -v MDS_DEGRADED | grep -E -v MDS_FAILED | grep -E -v MDS_INSUFFICIENT_STANDBY | grep -E -v 'insufficient standby MDS daemons available' | grep -E -v MDS_UP_LESS_THAN_MAX | grep -E -v 'online, but wants' | grep -E -v 'filesystem is online with fewer MDS than max_mds' | grep -E -v POOL_APP_NOT_ENABLED | grep -E -v 'do not have an application enabled' | grep -E -v 'overall HEALTH_' | grep -E -v 'Replacing daemon' | grep -E -v 'deprecated feature inline_data' | grep -E -v BLUESTORE_SLOW_OP_ALERT | grep -E -v 'slow operation indications in BlueStore' | grep -E -v 'experiencing slow operations in BlueStore' | grep -E -v MGR_MODULE_ERROR | grep -E -v OSD_DOWN | grep -E -v 'osd.* is down' | grep -E -v 'overall HEALTH_' | grep -E -v '\(OSD_DOWN\)' | grep -E -v '\(OSD_' | grep -E -v 'but it is still running' | grep -E -v 'is not responding' | grep -E -v 'osds down' | grep -E -v 'osd.* is down' | grep -E -v PG_AVAILABILITY | grep -E -v PG_DEGRADED | grep -E -v 'Reduced data availability' | grep -E -v 'Degraded data redundancy' | grep -E -v 'pg .* is stuck inactive' | grep -E -v 'pg .* is .*degraded' | grep -E -v 'slow metadata IO' | grep -E -v SLOW_OPS | grep -E -v 'slow request' | head -n 1 2026-02-13T02:25:55.838 DEBUG:teuthology.orchestra.run.trial011:> sudo grep -E '\[WRN\]' /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph.log | grep -E -v '\(MDS_ALL_DOWN\)' | grep -E -v '\(MDS_UP_LESS_THAN_MAX\)' | grep -E -v FS_DEGRADED | grep -E -v 'fs.*is degraded' | grep -E -v 'filesystem is degraded' | grep -E -v FS_INLINE_DATA_DEPRECATED | grep -E -v FS_WITH_FAILED_MDS | grep -E -v MDS_ALL_DOWN | grep -E -v 'filesystem is offline' | grep -E -v 'is offline because no MDS' | grep -E -v MDS_DAMAGE | grep -E -v MDS_DEGRADED | grep -E -v MDS_FAILED | grep -E -v MDS_INSUFFICIENT_STANDBY | grep -E -v 'insufficient standby MDS daemons available' | grep -E -v MDS_UP_LESS_THAN_MAX | grep -E -v 'online, but wants' | grep -E -v 'filesystem is online with fewer MDS than max_mds' | grep -E -v POOL_APP_NOT_ENABLED | grep -E -v 'do not have an application enabled' | grep -E -v 'overall HEALTH_' | grep -E -v 'Replacing daemon' | grep -E -v 'deprecated feature inline_data' | grep -E -v BLUESTORE_SLOW_OP_ALERT | grep -E -v 'slow operation indications in BlueStore' | grep -E -v 'experiencing slow operations in BlueStore' | grep -E -v MGR_MODULE_ERROR | grep -E -v OSD_DOWN | grep -E -v 'osd.* is down' | grep -E -v 'overall HEALTH_' | grep -E -v '\(OSD_DOWN\)' | grep -E -v '\(OSD_' | grep -E -v 'but it is still running' | grep -E -v 'is not responding' | grep -E -v 'osds down' | grep -E -v 'osd.* is down' | grep -E -v PG_AVAILABILITY | grep -E -v PG_DEGRADED | grep -E -v 'Reduced data availability' | grep -E -v 'Degraded data redundancy' | grep -E -v 'pg .* is stuck inactive' | grep -E -v 'pg .* is .*degraded' | grep -E -v 'slow metadata IO' | grep -E -v SLOW_OPS | grep -E -v 'slow request' | head -n 1 2026-02-13T02:25:55.908 INFO:teuthology.orchestra.run.trial011.stdout:2026-02-13T02:17:18.505391+0000 mon.a (mon.0) 309 : cluster [WRN] Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T02:25:55.908 INFO:tasks.cephadm:Compressing logs... 2026-02-13T02:25:55.908 DEBUG:teuthology.orchestra.run.trial011:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-13T02:25:55.950 DEBUG:teuthology.orchestra.run.trial060:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-13T02:25:55.953 DEBUG:teuthology.orchestra.run.trial078:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-13T02:25:55.973 INFO:teuthology.orchestra.run.trial011.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2026-02-13T02:25:55.973 INFO:teuthology.orchestra.run.trial011.stderr:: No such file or directory 2026-02-13T02:25:55.974 INFO:teuthology.orchestra.run.trial011.stderr:gzip -5 --verbose -- /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph.cephadm.log 2026-02-13T02:25:55.977 INFO:teuthology.orchestra.run.trial011.stderr:gzip -5 --verbose -- /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-mon.a.log 2026-02-13T02:25:55.977 INFO:teuthology.orchestra.run.trial011.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-mds.a.log 2026-02-13T02:25:55.978 INFO:teuthology.orchestra.run.trial011.stderr:/var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph.cephadm.log: 43.6% -- replaced with /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph.cephadm.log.gz 2026-02-13T02:25:55.978 INFO:teuthology.orchestra.run.trial011.stderr:/var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-mds.g.log 2026-02-13T02:25:55.978 INFO:teuthology.orchestra.run.trial011.stderr:gzip -5 --verbose -- /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-osd.6.log 2026-02-13T02:25:55.978 INFO:teuthology.orchestra.run.trial011.stderr:/var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-mds.a.log: gzip/var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-mds.g.log: -5 --verbose -- /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-osd.3.log 2026-02-13T02:25:55.978 INFO:teuthology.orchestra.run.trial011.stderr:/var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-mgr.x.log 2026-02-13T02:25:55.978 INFO:teuthology.orchestra.run.trial011.stderr:/var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-osd.9.log 2026-02-13T02:25:55.978 INFO:teuthology.orchestra.run.trial011.stderr:/var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-mds.d.log 2026-02-13T02:25:55.978 INFO:teuthology.orchestra.run.trial011.stderr: 94.6% -- replaced with /var/log/ceph/cephadm.log.gz 2026-02-13T02:25:55.978 INFO:teuthology.orchestra.run.trial011.stderr:/var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-osd.0.log 2026-02-13T02:25:55.978 INFO:teuthology.orchestra.run.trial011.stderr:/var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-volume.log 2026-02-13T02:25:55.978 INFO:teuthology.orchestra.run.trial011.stderr:/var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-mds.j.log 2026-02-13T02:25:55.979 INFO:teuthology.orchestra.run.trial011.stderr:/var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph.audit.log 2026-02-13T02:25:55.979 INFO:teuthology.orchestra.run.trial011.stderr:gzip/var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-mds.j.log: -5 --verbose -- /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph.log 2026-02-13T02:25:55.979 INFO:teuthology.orchestra.run.trial011.stderr:/var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph.audit.log: /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph.log: 94.9% -- replaced with /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-mds.d.log.gz 2026-02-13T02:25:55.980 INFO:teuthology.orchestra.run.trial011.stderr: 86.5% -- replaced with /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph.log.gz 2026-02-13T02:25:55.980 INFO:teuthology.orchestra.run.trial011.stderr: 95.0% -- replaced with /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-mds.j.log.gz 2026-02-13T02:25:55.980 INFO:teuthology.orchestra.run.trial011.stderr: 91.0% -- replaced with /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph.audit.log.gz 2026-02-13T02:25:55.984 INFO:teuthology.orchestra.run.trial060.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2026-02-13T02:25:55.984 INFO:teuthology.orchestra.run.trial060.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2026-02-13T02:25:55.984 INFO:teuthology.orchestra.run.trial060.stderr:gzip -5 --verbose -- /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-mds.k.log 2026-02-13T02:25:55.984 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-osd.7.log 2026-02-13T02:25:55.984 INFO:teuthology.orchestra.run.trial060.stderr:gzip -5 --verbose -- /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-mon.b.log 2026-02-13T02:25:55.984 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-mds.k.log: /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-osd.4.log 2026-02-13T02:25:55.984 INFO:teuthology.orchestra.run.trial060.stderr: 93.0% -- replaced with /var/log/ceph/cephadm.log.gz 2026-02-13T02:25:55.985 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-osd.1.log 2026-02-13T02:25:55.985 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-mds.e.log 2026-02-13T02:25:55.985 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-mds.b.log 2026-02-13T02:25:55.985 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-mds.h.log 2026-02-13T02:25:55.985 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-volume.log 2026-02-13T02:25:55.985 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-osd.10.log 2026-02-13T02:25:55.985 INFO:teuthology.orchestra.run.trial060.stderr:gzip -5 --verbose -- /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph.audit.log 2026-02-13T02:25:55.985 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-volume.log: /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph.log 2026-02-13T02:25:55.985 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-mgr.y.log 2026-02-13T02:25:55.985 INFO:teuthology.orchestra.run.trial060.stderr:/var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph.log: /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-mgr.y.log: 91.1% -- replaced with /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph.audit.log.gz 2026-02-13T02:25:55.985 INFO:teuthology.orchestra.run.trial060.stderr: 86.5% -- replaced with /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph.log.gz 2026-02-13T02:25:55.985 INFO:teuthology.orchestra.run.trial060.stderr: 92.2% -- replaced with /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-mgr.y.log.gz 2026-02-13T02:25:55.986 INFO:teuthology.orchestra.run.trial060.stderr: 93.4% -- replaced with /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-volume.log.gz 2026-02-13T02:25:55.987 INFO:teuthology.orchestra.run.trial011.stderr: 93.2% -- replaced with /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-volume.log.gz 2026-02-13T02:25:55.987 INFO:teuthology.orchestra.run.trial011.stderr: 95.0% -- replaced with /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-mds.a.log.gz 2026-02-13T02:25:55.988 INFO:teuthology.orchestra.run.trial011.stderr: 95.1% -- replaced with /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-mds.g.log.gz 2026-02-13T02:25:55.991 INFO:teuthology.orchestra.run.trial078.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2026-02-13T02:25:55.991 INFO:teuthology.orchestra.run.trial078.stderr:: No such file or directory 2026-02-13T02:25:55.991 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-osd.8.log 2026-02-13T02:25:55.991 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-mds.f.log 2026-02-13T02:25:55.992 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-osd.11.log 2026-02-13T02:25:55.992 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-osd.8.log: /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-mds.c.log 2026-02-13T02:25:55.992 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-osd.5.log 2026-02-13T02:25:55.992 INFO:teuthology.orchestra.run.trial078.stderr: 93.6% -- replaced with /var/log/ceph/cephadm.log.gz 2026-02-13T02:25:55.992 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-mds.i.log 2026-02-13T02:25:55.992 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-mds.l.log 2026-02-13T02:25:55.992 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-osd.5.log: /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-mon.c.log 2026-02-13T02:25:55.992 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-mds.l.log: gzip -5 --verbose -- /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-volume.log 2026-02-13T02:25:55.992 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph.audit.log 2026-02-13T02:25:55.992 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph.log 2026-02-13T02:25:55.992 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-mgr.z.log 2026-02-13T02:25:55.993 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph.log: gzip -5 --verbose -- /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-osd.2.log 2026-02-13T02:25:55.993 INFO:teuthology.orchestra.run.trial078.stderr:/var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-mgr.z.log: /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-osd.2.log: 86.5% -- replaced with /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph.log.gz 2026-02-13T02:25:55.993 INFO:teuthology.orchestra.run.trial078.stderr: 91.2% -- replaced with /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph.audit.log.gz 2026-02-13T02:25:55.993 INFO:teuthology.orchestra.run.trial078.stderr: 92.2% -- replaced with /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-mgr.z.log.gz 2026-02-13T02:25:55.993 INFO:teuthology.orchestra.run.trial078.stderr: 93.8% -- replaced with /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-volume.log.gz 2026-02-13T02:25:55.993 INFO:teuthology.orchestra.run.trial078.stderr: 94.3% -- replaced with /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-mds.c.log.gz 2026-02-13T02:25:55.993 INFO:teuthology.orchestra.run.trial078.stderr: 95.1% -- replaced with /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-mds.f.log.gz 2026-02-13T02:25:55.994 INFO:teuthology.orchestra.run.trial078.stderr: 94.3% -- replaced with /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-mds.i.log.gz 2026-02-13T02:25:55.994 INFO:teuthology.orchestra.run.trial060.stderr: 94.0% -- replaced with /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-mds.e.log.gz 2026-02-13T02:25:55.994 INFO:teuthology.orchestra.run.trial060.stderr: 94.2% -- replaced with /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-mds.h.log.gz 2026-02-13T02:25:55.994 INFO:teuthology.orchestra.run.trial060.stderr: 94.5% -- replaced with /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-mds.k.log.gz 2026-02-13T02:25:55.995 INFO:teuthology.orchestra.run.trial078.stderr: 94.8% -- replaced with /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-mds.l.log.gz 2026-02-13T02:25:56.010 INFO:teuthology.orchestra.run.trial060.stderr: 93.3% -- replaced with /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-mds.b.log.gz 2026-02-13T02:25:56.052 INFO:teuthology.orchestra.run.trial060.stderr: 92.2% -- replaced with /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-mon.b.log.gz 2026-02-13T02:25:56.054 INFO:teuthology.orchestra.run.trial011.stderr: 90.1% -- replaced with /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-mgr.x.log.gz 2026-02-13T02:25:56.058 INFO:teuthology.orchestra.run.trial078.stderr: 92.2% -- replaced with /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-mon.c.log.gz 2026-02-13T02:25:56.068 INFO:teuthology.orchestra.run.trial078.stderr: 92.8% -- replaced with /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-osd.11.log.gz 2026-02-13T02:25:56.072 INFO:teuthology.orchestra.run.trial011.stderr: 92.8% -- replaced with /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-osd.0.log.gz 2026-02-13T02:25:56.078 INFO:teuthology.orchestra.run.trial011.stderr: 92.3% -- replaced with /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-osd.9.log.gz 2026-02-13T02:25:56.082 INFO:teuthology.orchestra.run.trial078.stderr: 92.6% -- replaced with /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-osd.8.log.gz 2026-02-13T02:25:56.083 INFO:teuthology.orchestra.run.trial011.stderr: 92.6% -- replaced with /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-osd.6.log.gz 2026-02-13T02:25:56.084 INFO:teuthology.orchestra.run.trial060.stderr: 92.5% -- replaced with /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-osd.4.log.gz 2026-02-13T02:25:56.087 INFO:teuthology.orchestra.run.trial011.stderr: 92.6% -- replaced with /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-osd.3.log.gz 2026-02-13T02:25:56.099 INFO:teuthology.orchestra.run.trial060.stderr: 92.7% -- replaced with /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-osd.7.log.gz 2026-02-13T02:25:56.100 INFO:teuthology.orchestra.run.trial060.stderr: 93.1% -- replaced with /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-osd.1.log.gz 2026-02-13T02:25:56.106 INFO:teuthology.orchestra.run.trial078.stderr: 92.6% -- replaced with /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-osd.2.log.gz 2026-02-13T02:25:56.119 INFO:teuthology.orchestra.run.trial078.stderr: 92.7% -- replaced with /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-osd.5.log.gz 2026-02-13T02:25:56.120 INFO:teuthology.orchestra.run.trial078.stderr: 2026-02-13T02:25:56.120 INFO:teuthology.orchestra.run.trial078.stderr:real 0m0.149s 2026-02-13T02:25:56.120 INFO:teuthology.orchestra.run.trial078.stderr:user 0m0.540s 2026-02-13T02:25:56.120 INFO:teuthology.orchestra.run.trial078.stderr:sys 0m0.046s 2026-02-13T02:25:56.138 INFO:teuthology.orchestra.run.trial060.stderr: 92.9% -- replaced with /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-osd.10.log.gz 2026-02-13T02:25:56.139 INFO:teuthology.orchestra.run.trial060.stderr: 2026-02-13T02:25:56.139 INFO:teuthology.orchestra.run.trial060.stderr:real 0m0.171s 2026-02-13T02:25:56.139 INFO:teuthology.orchestra.run.trial060.stderr:user 0m0.605s 2026-02-13T02:25:56.139 INFO:teuthology.orchestra.run.trial060.stderr:sys 0m0.063s 2026-02-13T02:25:56.230 INFO:teuthology.orchestra.run.trial011.stderr: 90.2% -- replaced with /var/log/ceph/fc631695-0881-11f1-899c-d404e6e7d460/ceph-mon.a.log.gz 2026-02-13T02:25:56.232 INFO:teuthology.orchestra.run.trial011.stderr: 2026-02-13T02:25:56.233 INFO:teuthology.orchestra.run.trial011.stderr:real 0m0.268s 2026-02-13T02:25:56.233 INFO:teuthology.orchestra.run.trial011.stderr:user 0m0.730s 2026-02-13T02:25:56.233 INFO:teuthology.orchestra.run.trial011.stderr:sys 0m0.076s 2026-02-13T02:25:56.233 INFO:tasks.cephadm:Archiving logs... 2026-02-13T02:25:56.233 DEBUG:teuthology.misc:Transferring archived files from trial011:/var/log/ceph to /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47968/remote/trial011/log 2026-02-13T02:25:56.235 DEBUG:teuthology.orchestra.run.trial011:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-13T02:25:56.470 DEBUG:teuthology.misc:Transferring archived files from trial060:/var/log/ceph to /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47968/remote/trial060/log 2026-02-13T02:25:56.471 DEBUG:teuthology.orchestra.run.trial060:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-13T02:25:56.584 DEBUG:teuthology.misc:Transferring archived files from trial078:/var/log/ceph to /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47968/remote/trial078/log 2026-02-13T02:25:56.586 DEBUG:teuthology.orchestra.run.trial078:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-13T02:25:56.686 INFO:tasks.cephadm:Removing cluster... 2026-02-13T02:25:56.686 DEBUG:teuthology.orchestra.run.trial011:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid fc631695-0881-11f1-899c-d404e6e7d460 --force 2026-02-13T02:25:56.813 INFO:teuthology.orchestra.run.trial011.stdout:Deleting cluster with fsid: fc631695-0881-11f1-899c-d404e6e7d460 2026-02-13T02:25:56.996 DEBUG:teuthology.orchestra.run.trial060:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid fc631695-0881-11f1-899c-d404e6e7d460 --force 2026-02-13T02:25:57.120 INFO:teuthology.orchestra.run.trial060.stdout:Deleting cluster with fsid: fc631695-0881-11f1-899c-d404e6e7d460 2026-02-13T02:25:57.307 DEBUG:teuthology.orchestra.run.trial078:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid fc631695-0881-11f1-899c-d404e6e7d460 --force 2026-02-13T02:25:57.433 INFO:teuthology.orchestra.run.trial078.stdout:Deleting cluster with fsid: fc631695-0881-11f1-899c-d404e6e7d460 2026-02-13T02:25:57.617 INFO:tasks.cephadm:Removing cephadm ... 2026-02-13T02:25:57.618 DEBUG:teuthology.orchestra.run.trial011:> rm -rf /home/ubuntu/cephtest/cephadm 2026-02-13T02:25:57.638 DEBUG:teuthology.orchestra.run.trial060:> rm -rf /home/ubuntu/cephtest/cephadm 2026-02-13T02:25:57.659 DEBUG:teuthology.orchestra.run.trial078:> rm -rf /home/ubuntu/cephtest/cephadm 2026-02-13T02:25:57.677 INFO:tasks.cephadm:Teardown complete 2026-02-13T02:25:57.678 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.12/contextlib.py", line 137, in __enter__ return next(self.gen) ^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_batrick_ceph_cfcf307502511ba51c39a8b9085c2fcde505d421/qa/tasks/cephadm.py", line 2025, in task healthy(ctx=ctx, config=config) File "/home/teuthworker/src/github.com_batrick_ceph_cfcf307502511ba51c39a8b9085c2fcde505d421/qa/tasks/ceph.py", line 1557, in healthy manager.wait_until_healthy(timeout=300) File "/home/teuthworker/src/github.com_batrick_ceph_cfcf307502511ba51c39a8b9085c2fcde505d421/qa/tasks/ceph_manager.py", line 3393, in wait_until_healthy assert time.time() - start < timeout, \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: timeout expired in wait_until_healthy 2026-02-13T02:25:57.680 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2026-02-13T02:25:57.694 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-13T02:25:57.709 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-13T02:25:57.709 DEBUG:teuthology.orchestra.run.trial011:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-13T02:25:57.712 DEBUG:teuthology.orchestra.run.trial060:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-13T02:25:57.715 DEBUG:teuthology.orchestra.run.trial078:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-13T02:25:57.960 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-13T02:25:57.971 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-13T02:25:57.971 DEBUG:teuthology.orchestra.run.trial011:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-13T02:25:57.973 DEBUG:teuthology.orchestra.run.trial060:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-13T02:25:57.975 DEBUG:teuthology.orchestra.run.trial078:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-13T02:25:57.989 INFO:teuthology.orchestra.run.trial011.stderr:bash: line 1: ntpq: command not found 2026-02-13T02:25:57.991 INFO:teuthology.orchestra.run.trial060.stderr:bash: line 1: ntpq: command not found 2026-02-13T02:25:57.993 INFO:teuthology.orchestra.run.trial078.stderr:bash: line 1: ntpq: command not found 2026-02-13T02:25:58.011 INFO:teuthology.orchestra.run.trial078.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-13T02:25:58.011 INFO:teuthology.orchestra.run.trial078.stdout:=============================================================================== 2026-02-13T02:25:58.011 INFO:teuthology.orchestra.run.trial078.stdout:^+ time.nullroutenetworks.c> 2 6 377 24 -61us[ -61us] +/- 43ms 2026-02-13T02:25:58.011 INFO:teuthology.orchestra.run.trial078.stdout:^+ LAX.CALTICK.NET 2 6 377 26 -3595us[-3748us] +/- 35ms 2026-02-13T02:25:58.012 INFO:teuthology.orchestra.run.trial078.stdout:^* s2-b.time.mci1.us.rozint> 2 6 377 27 -332us[ -485us] +/- 23ms 2026-02-13T02:25:58.012 INFO:teuthology.orchestra.run.trial078.stdout:^+ 44.190.5.123 2 6 377 28 +1701us[+1548us] +/- 35ms 2026-02-13T02:25:58.017 INFO:teuthology.orchestra.run.trial011.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-13T02:25:58.017 INFO:teuthology.orchestra.run.trial011.stdout:=============================================================================== 2026-02-13T02:25:58.017 INFO:teuthology.orchestra.run.trial011.stdout:^* nyc2.us.ntp.li 2 6 377 27 -47us[ -56us] +/- 2648us 2026-02-13T02:25:58.017 INFO:teuthology.orchestra.run.trial011.stdout:^- us-east-2.clearnet.pw 2 6 377 28 +317us[ +308us] +/- 54ms 2026-02-13T02:25:58.017 INFO:teuthology.orchestra.run.trial011.stdout:^- 44.190.5.123 2 6 377 28 +2582us[+2573us] +/- 35ms 2026-02-13T02:25:58.017 INFO:teuthology.orchestra.run.trial011.stdout:^- ip216-250-115-174.pbiaas> 2 6 377 27 +202us[ +202us] +/- 123ms 2026-02-13T02:25:58.021 INFO:teuthology.orchestra.run.trial060.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-13T02:25:58.021 INFO:teuthology.orchestra.run.trial060.stdout:=============================================================================== 2026-02-13T02:25:58.022 INFO:teuthology.orchestra.run.trial060.stdout:^- ntp.maxhost.io 2 6 257 27 -5403us[-5360us] +/- 64ms 2026-02-13T02:25:58.022 INFO:teuthology.orchestra.run.trial060.stdout:^- ntp.shastacoe.net 2 6 377 26 -1829us[-1829us] +/- 95ms 2026-02-13T02:25:58.022 INFO:teuthology.orchestra.run.trial060.stdout:^* 99-28-14-242.lightspeed.> 1 6 377 28 -67us[ -24us] +/- 13ms 2026-02-13T02:25:58.022 INFO:teuthology.orchestra.run.trial060.stdout:^+ time2.trtnw.net 2 6 377 29 +118us[ +161us] +/- 40ms 2026-02-13T02:25:58.022 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-13T02:25:58.034 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-13T02:25:58.034 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-13T02:25:58.048 DEBUG:teuthology.orchestra.run.trial011:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-13T02:25:58.110 DEBUG:teuthology.orchestra.run.trial060:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-13T02:25:58.158 DEBUG:teuthology.orchestra.run.trial078:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-13T02:25:58.207 DEBUG:teuthology.orchestra.run.trial011:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e 'comm="systemd".*denied.*\{ prog_run \}.*tclass=bpf.*permissive=1' 2026-02-13T02:25:58.226 INFO:teuthology.orchestra.run.trial011.stderr:grep: Invalid content of \{\} 2026-02-13T02:25:58.236 DEBUG:teuthology.orchestra.run:got remote process result: 2 2026-02-13T02:25:58.237 DEBUG:teuthology.orchestra.run.trial060:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e 'comm="systemd".*denied.*\{ prog_run \}.*tclass=bpf.*permissive=1' 2026-02-13T02:25:58.256 INFO:teuthology.orchestra.run.trial060.stderr:grep: Invalid content of \{\} 2026-02-13T02:25:58.265 DEBUG:teuthology.orchestra.run:got remote process result: 2 2026-02-13T02:25:58.266 DEBUG:teuthology.orchestra.run.trial078:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e 'comm="systemd".*denied.*\{ prog_run \}.*tclass=bpf.*permissive=1' 2026-02-13T02:25:58.285 INFO:teuthology.orchestra.run.trial078.stderr:grep: Invalid content of \{\} 2026-02-13T02:25:58.294 DEBUG:teuthology.orchestra.run:got remote process result: 2 2026-02-13T02:25:58.295 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-13T02:25:58.311 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-13T02:25:58.328 INFO:teuthology.task.internal:Duration was 685.082924 seconds 2026-02-13T02:25:58.328 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-13T02:25:58.343 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-13T02:25:58.343 DEBUG:teuthology.orchestra.run.trial011:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-13T02:25:58.346 DEBUG:teuthology.orchestra.run.trial060:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-13T02:25:58.349 DEBUG:teuthology.orchestra.run.trial078:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-13T02:25:58.382 INFO:teuthology.orchestra.run.trial011.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-13T02:25:58.387 INFO:teuthology.orchestra.run.trial060.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-13T02:25:58.388 INFO:teuthology.orchestra.run.trial078.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-13T02:25:58.734 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-13T02:25:58.734 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial011.front.sepia.ceph.com 2026-02-13T02:25:58.734 DEBUG:teuthology.orchestra.run.trial011:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-13T02:25:58.795 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial060.front.sepia.ceph.com 2026-02-13T02:25:58.795 DEBUG:teuthology.orchestra.run.trial060:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-13T02:25:58.817 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial078.front.sepia.ceph.com 2026-02-13T02:25:58.818 DEBUG:teuthology.orchestra.run.trial078:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-13T02:25:58.840 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-13T02:25:58.840 DEBUG:teuthology.orchestra.run.trial011:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-13T02:25:58.842 DEBUG:teuthology.orchestra.run.trial060:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-13T02:25:58.860 DEBUG:teuthology.orchestra.run.trial078:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-13T02:25:59.027 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-13T02:25:59.028 DEBUG:teuthology.orchestra.run.trial011:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-13T02:25:59.030 DEBUG:teuthology.orchestra.run.trial060:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-13T02:25:59.033 DEBUG:teuthology.orchestra.run.trial078:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-13T02:25:59.054 INFO:teuthology.orchestra.run.trial011.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T02:25:59.055 INFO:teuthology.orchestra.run.trial011.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-13T02:25:59.055 INFO:teuthology.orchestra.run.trial011.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0%gzip -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-13T02:25:59.056 INFO:teuthology.orchestra.run.trial011.stderr: -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T02:25:59.056 INFO:teuthology.orchestra.run.trial011.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: /home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-13T02:25:59.057 INFO:teuthology.orchestra.run.trial060.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T02:25:59.059 INFO:teuthology.orchestra.run.trial060.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-13T02:25:59.059 INFO:teuthology.orchestra.run.trial060.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T02:25:59.059 INFO:teuthology.orchestra.run.trial060.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-13T02:25:59.059 INFO:teuthology.orchestra.run.trial060.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: /home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-13T02:25:59.060 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T02:25:59.061 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-13T02:25:59.061 INFO:teuthology.orchestra.run.trial078.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-13T02:25:59.061 INFO:teuthology.orchestra.run.trial078.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T02:25:59.061 INFO:teuthology.orchestra.run.trial078.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: /home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-13T02:25:59.069 INFO:teuthology.orchestra.run.trial060.stderr: 90.4% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-13T02:25:59.073 INFO:teuthology.orchestra.run.trial078.stderr: 90.4% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-13T02:25:59.094 INFO:teuthology.orchestra.run.trial011.stderr: 92.1% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-13T02:25:59.097 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-13T02:25:59.113 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-13T02:25:59.113 DEBUG:teuthology.orchestra.run.trial011:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-13T02:25:59.163 DEBUG:teuthology.orchestra.run.trial060:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-13T02:25:59.191 DEBUG:teuthology.orchestra.run.trial078:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-13T02:25:59.219 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-13T02:25:59.235 DEBUG:teuthology.orchestra.run.trial011:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-13T02:25:59.238 DEBUG:teuthology.orchestra.run.trial060:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-13T02:25:59.241 DEBUG:teuthology.orchestra.run.trial078:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-13T02:25:59.282 INFO:teuthology.orchestra.run.trial011.stdout:kernel.core_pattern = core 2026-02-13T02:25:59.283 INFO:teuthology.orchestra.run.trial060.stdout:kernel.core_pattern = core 2026-02-13T02:25:59.305 INFO:teuthology.orchestra.run.trial078.stdout:kernel.core_pattern = core 2026-02-13T02:25:59.319 DEBUG:teuthology.orchestra.run.trial011:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-13T02:25:59.336 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T02:25:59.337 DEBUG:teuthology.orchestra.run.trial060:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-13T02:25:59.353 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T02:25:59.354 DEBUG:teuthology.orchestra.run.trial078:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-13T02:25:59.371 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T02:25:59.371 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-13T02:25:59.387 INFO:teuthology.task.internal:Transferring archived files... 2026-02-13T02:25:59.388 DEBUG:teuthology.misc:Transferring archived files from trial011:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47968/remote/trial011 2026-02-13T02:25:59.389 DEBUG:teuthology.orchestra.run.trial011:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-13T02:25:59.434 DEBUG:teuthology.misc:Transferring archived files from trial060:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47968/remote/trial060 2026-02-13T02:25:59.434 DEBUG:teuthology.orchestra.run.trial060:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-13T02:25:59.471 DEBUG:teuthology.misc:Transferring archived files from trial078:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/47968/remote/trial078 2026-02-13T02:25:59.472 DEBUG:teuthology.orchestra.run.trial078:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-13T02:25:59.510 INFO:teuthology.task.internal:Removing archive directory... 2026-02-13T02:25:59.511 DEBUG:teuthology.orchestra.run.trial011:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-13T02:25:59.513 DEBUG:teuthology.orchestra.run.trial060:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-13T02:25:59.516 DEBUG:teuthology.orchestra.run.trial078:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-13T02:25:59.561 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-13T02:25:59.579 INFO:teuthology.task.internal:Not uploading archives. 2026-02-13T02:25:59.580 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-13T02:25:59.597 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-13T02:25:59.597 DEBUG:teuthology.orchestra.run.trial011:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-13T02:25:59.599 DEBUG:teuthology.orchestra.run.trial060:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-13T02:25:59.602 DEBUG:teuthology.orchestra.run.trial078:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-13T02:25:59.615 INFO:teuthology.orchestra.run.trial011.stdout: 786580 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 13 02:25 /home/ubuntu/cephtest 2026-02-13T02:25:59.619 INFO:teuthology.orchestra.run.trial060.stdout: 786461 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 13 02:25 /home/ubuntu/cephtest 2026-02-13T02:25:59.621 INFO:teuthology.orchestra.run.trial078.stdout: 786461 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 13 02:25 /home/ubuntu/cephtest 2026-02-13T02:25:59.623 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-13T02:25:59.643 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-13T02:25:59.683 INFO:teuthology.run:Summary data: description: fs/workload/{0-distro begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rpm_latest} ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/always} standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-namespace-isolated} 0-use-snaprealm/{global} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-quiesce/no 6-workunit/postgres}} duration: 685.0829238891602 failure_reason: '"2026-02-13T02:17:18.505391+0000 mon.a (mon.0) 309 : cluster [WRN] Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL)" in cluster log' flavor: default owner: scheduled_pdonnell@soko04.front.sepia.ceph.com sentry_event: null status: fail success: false 2026-02-13T02:25:59.683 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-13T02:25:59.808 INFO:teuthology.run:FAIL